Sydney Apache Spark User Group relaunch!

Spark meetup re-launch!

What is happening:
We are excited to announce the relaunch of the Sydney Spark meetup! Spark is more popular than ever, but this group has seen very little activity in the last couple of years. With the lockdown over, we would like to re-energise our local Spark community and give us a place to meet, share ideas, and chat.

What are we doing:
We will have space for two hours at the Databricks office in Sydney. In these two hours we will:

• (1) Discuss Spark’s ecosystem in 2022, and where it’s going.
• (2) Have 1-2 talks from the Spark community (if you are interested in presenting, please reach out to [yan@databricks.com](mailto:yan@databricks.com)).
• (3) Have plenty of time to meet, chat, eat pizza, and drink a beverage of our choice.

Talks agenda:

**Talk 1**
Paul Ashley@Atlassian: How Atlassian is building external-facing Data Lake with Spark and DBT.

In this session, we will talk about how we are building a new product called Atlassian Data Lake–access to data from the Atlassian portfolio of apps in one queryable place. It contains cross-product and cross-instance data for easy analysis with pre-modeled and enriched fields to speed up insight generation while ensuring privacy and security.

More specifically, we will talk about how we built Atlassian’s Structured Streaming capability to dynamically transform data with Apache Spark and DBT, lessons learned and architectural decisions that we made along the way.

About Paul:
Paul is a Senior Software Engineer working on Atlassian Data Lake. In his role, he is involved in building next-generation data apps, scaling them from 0 to 100’s of terabytes of processed data.

**Talk 2**
Marina Sigaeva@Commbank: How to teach Spark and Scala to anyone.

You can learn how to work with Spark on Scala and more - you can jump on the Cloud to do so in just 3 hours with no tech background at all. In this session, I will show you how we built and ran Scala zero-to-hero workshop in CommBank with GEEK.

If you are a Scala or Spark beginner, this can help you get started. If you are already familiar with the tools, you can learn how to run the workshop for your team or organisation!

About Marina:
Marina is a Staff Data Engineer at the Commonwealth Bank of Australia. She is a big believer in simplifying complex things and making the software engineering world open for anyone who wants to join us in this wonderful journey.