Data Engineering Melbourne Meetup - July(ish) 2019

Hi folks, due to last minute virus acquisition, I've had to postpone the meetup. The good news is that gives us more time to find awesome talks. Let me know if you have sometime that you'd like to present!

Let's do some more data engineering talks, networking and knowledge sharing! We still have room for more talks, so let me know if you've got something to talk about. Talks can run anywhere from 5-30 mins. Let me know if you think you've got something to talk about - all skill levels welcome to present something - just about everything is new to someone!

We will also have time after the talks for a community noticeboard where folks will have around 60 seconds to pitch their wares - if you've got an awesome data job going or you are available to fill an awesome job or even that you've found a great open source tool that we should all be contributing to, this will be the time to let us know!

Speakers:

Andrew Jones - Observability for everyone

Have you ever tried to debug a production outage, when your system comprises apps your team has written, third-party apps your team runs, with logs going into some system, application performance metrics going into another system, and cloud platform metrics going somewhere else? Did you find yourself switching tabs, trying to correlate metrics with logs and alerts and finding yourself in a huge tangle? It is a nightmare.

In the data world, we talk about aggregating all our data so we can derive new insights quickly, but what about our operational data? Observability is your ability to be able to ask questions of your system without having to write new code, or grab new data. When you’ve got an observable system, it feels like you have debugging superpowers, but can be challenging to even know where to start.

In this talk, Andrew will talk about what monitoring and logging are not sufficient anymore (if they ever were), observability basics, and demo an observability architecture that you can use to start your observability journey today.