July Edition, Sydney Data Engineering meetup

MongoDB have kindly invited us to their Haymarket offices.

Speaker 1:
Jessica Flanagan - Chief Data Architect, Deckard Technologies
Data pipelines need to be flexible, modular and easily monitored. They are not just set-and-forget. The team that monitors a pipeline might not have developed it and may not be experts on the dataset. End users must have confidence in the output. This talk is a practical walkthrough of a suggested pipeline architecture on AWS using Step functions, Spot instance, AWS Batch, Glue, Lambda and Data Dog. I'll be covering techniques using AWS and DataDog, but many of the approaches are applicable in an Apache Airflow/Kibana environment.
I have 15 years software development experience with the last ten years spent working with medium to large data. I have a passion for exploration, optimisation and best practices. I enjoy developing and mentoring teams and experimenting with new technology. I prefer to be technology agnostic and am focused on finding the right solution for a problem.

Speaker 2:
Sam Harley - Senior Solutions Architect, MongoDB
What’s New in MongoDB v4.2
Take a closer look at the key capabilities introduced at MongoDB World 2019, and included as part of the MongoDB version 4.2 release; including a deeper discussion around distributed transactions, the Atlas Data Lake, Atlas Full Text Search capability, field level encryption, native K8s integration, materialised views, wild card indexes and much, much more.

Speaker 3:
Masadur Rahaman Sayem - Solutions Architect, AWS
Use case of a ledger database. An introduction to Amazon QLDB.
In this session, we talk about the kinds of problems that Amazon Quantum Ledger Database (QLDB) can solve and answer your questions about when and why you would use a ledger database. Join expert guest Masudur Rahaman Sayem, Solutions Architect at AWS, to learn about benefits and use cases for Amazon QLDB.

Stay tuned for further details on the speaker lineup!