November Edition, Sydney Data Engineering meetup

Thoughtworks have kindly invited us to their Carrington St offices which is right next door to Wynyard station.

🏠Host: Thoughtworks
🍕Food and Drink: Thoughtworks

Speakers:
🎤 Karen Davis, Senior Data Engineer, Thoughtworks
Fitness functions for Data Pipelines
Fitness functions are a tool used in evolutionary architecture to measure a system’s alignment to the architectural goals.
During this talk Karen will explain what a fitness function is and talk about some useful fitness functions to apply to data pipelines.
Bio : Karen Davis is a Senior Data Engineer at ThoughtWorks. She is passionate about all things data and is especially interested in ways to apply software engineering best practices to data and machine learning

🎤 Ryan Collingwood, Senior Consultant, Thoughtworks
Decision Making in a Data World
Ryan Collingwood has worn a couple of hats in the software development space. Most of which can be distilled as being a professional five year asking "why" to better understand the world.

🎤 Simon Aubury, Principal Data Engineer, Thoughtworks
Machine learning with Apache Kafka and KSQL stream processing
Realtime stream processing using Apache Kafka to continuously monitor household power consumption. A demo (fingers crossed) showing how to build a trained model to alert on unexpected power usage for time of day. How building a ML UDF for KSQL and using Apache Kafka alerts me when I’ve left the iron running .
Bio : Simon Aubury is a Principal Data Engineer at ThoughtWorks. He loves building enterprise streaming applications and has worked on Kafka platforms for banks, insurance & real-time vehicle tracking.
~~~~~~~~

Remember to bring along some great questions!