What we’re about
Anyone who is interested in the movement of data and getting data from one place to another. We will be talking about cloud based and open sourced solutions - sharing our knowledge on how we've managed to achieve real-time streaming and the challenges we've faced along the way
We have our own slack group and website which you can find out more details about here: https://sydneydataengineers.github.io/
Sponsors
See allUpcoming events (2)
See all- Sydney Data Eng meetup, May 2024 (Special Edition)level 6/341 George St, Sydney, NS
Sydney Data Engineers, join us for a special edition of the Sydney Data Eng Meetup on May 20th. We have a special guest speaker coming all the way from the USA to give a talk. Not only that, but we'll also be hosting two other amazing talks on the night. Are you all excited or what? We can't wait!
Don't miss out—RSVP to secure your spot. A big shout-out to Atlassian for providing us with the venue and catering! 🎉
🏠 Location: Atlassian Office, Level 6, 341 George Street, Sydney
🍕 Catering: Atlassian 😊
💬 Join our Slack Group here: Data Engineers Slack ChannelSchedule:
- 5.00pm: Doors Open
- 5.30pm: Announcements and Welcome
- 5.40pm: 1st Talk (25min + 5min Q/A)
- 6.10pm: 2nd Talk (25min + 5min Q/A)
- 6.40pm: 3rd Talk (25min + 5min Q/A)
- 7.10pm: Networking
- 7.40pm: Doors CloseSpeakers:
🎤 Sean Falconer, Skyflow
Talk Title: Data's Cheese and Diamond Problem
Talk Summary: Customer data is everywhere. It's in our databases, warehouses, CRMs, log files, and the backups of these systems. The proliferation of sensitive data makes it nearly impossible to protect. Companies attempt to get a handle on this problem by applying various bespoke point solutions wherever they think the data resides, but this is a flawed approach. The underlying system is broken and putting a bandaid on it won't fix the fundamental problem.
Treating users' PII data like any other application data is a fundamentally flawed design choice. User data is special and must be treated that way. Just as I don't store my diamonds in the refrigerator with my cheese, user data doesn't belong intermixed with your other data. It must be isolated and protected.
In this talk, we explore the nature of data, how it's stored, why we have created different technologies for handling different types of data, and make a case that the only way to stop the epidemic of data breaches and meet consumer and regulatory demands for privacy is to fundamentally change our mindsets about how to store and manage customer PII.Speaker Bio: Sean Falconer, PhD in Computer Science, with a Postdoc in Bioinformatics from Stanford University, brings over 15 years of experience in research, engineering, product, developer relations, and marketing. Prior to Skyflow, he contributed to projects with the World Health Organization, founded Proven.com, and led developer relations engineering for Google's Business Communication products. At Skyflow, Sean leads marketing and developer relations, actively engaging with communities through building, writing, speaking, and fostering discussions on engineering and data privacy.
🎤 Tim McNamara, Founder at Accelerant
Talk Title: The promise of data engineering powered by Rust
Talk Summary: If your business involves data processing, then you’ll enjoy this informative talk about the Rust programming language.
Rust is one of the most high-performance languages available to teams today -- conservatively 50x faster than Python while using significantly less memory -- and guards against many of the problems that plague other languages that provide similar performance. It’s also a delight to work with, with an industry-leading package manager and tools which make it easy to deploy apps to whatever environment, from bare metal, cloud native, and even embedded within the browser.
Rust is an exciting programming language, but it’s one that’s typically seen as hard to learn and hard to use. Come and learn why this isn’t quite true and how data engineering problems are a wonderful fit for the language.Speaker Bio: Tim McNamara is one of the world's leading Rust educators and runs a consultancy in the language called [accelerant.dev](https://accelerant.dev). Previously the global head of Rust language education at AWS, he is the lead content creator for the official Rust training program offered by the Rust Foundation, author of the world-renowned textbook Rust in Action, and host of a popular YouTube channel offering tutorials in the language.
🎤 Gerald Nakhle, Software Engineer at Atlassian
🎤 Chen Zhou, Senior Data Platform Engineer at Atlassian
Talk Title: Walkthrough of Atlassian's Next Generation Data Platform
Talk Summary: Atlassian has reimagined and rearchitected its central data lakehouse from the ground up - a greenfield re-design based on everything we have learned from the last 5 years of working with Databricks. In this talk, we'll give an architectural overview of how we're setting up this new lake.If you'd like to present at future meetups, please submit your talk here!
Remember to bring along some great questions! See you all there...
- DataEngBytes Sydney 2024Sofitel Sydney Wentworth, Sydney, NS
Welcome to DataEngBytes 2024!
We're a conference for data engineers, by data engineers.CFP Now Open: Submit Talk Now!
DataEngBytes is the largest independent conference for data engineers and practitioners in Oceania. We are a vendor-neutral forum to bring together data experts, leaders, practitioners and community members in one place to learn about the latest in the field, share challenges, and discover new solutions. Our mission is to drive excellence and innovation in data engineering practices through the power of community.
This year, we'll be featuring prominent international thought leaders and awesome speakers from the data engineering community to share their insights and knowledge in a multi-track conference format.
What are you waiting for? Purchase your ticket now! Click on our website for more information and to view the agenda when it is ready. https://dataengconf.com.au/
Please note that this event requires tickets for attendance. To secure your spot, please purchase tickets here: [Buy Ticket]
Accessibility: Sofitel Wentworth is a fully accessible venue.
Refunds: If cancellation is made less than 14 days from the event start date, no refunds will be issued. This policy is in place because we need to finalise all vendor, catering and venue arrangements well in advance to ensure a seamless experience for all attendees. DataEngBytes Conference accepts no responsibility for changes to work or personal circumstances within this 14-day period. Your understanding and cooperation are greatly appreciated.
Thank you!