Data Engineering Melbourne Meetup November 2020

Let's do some more data engineering talks, networking and knowledge sharing!

Topic: How to tame the data beast using DataHub

Speaker: Mars Lan, co-founder & CTO @ Metaphor Data, co-creator of DataHub & ex-LinkedIn

Data democratization has empowered many organizations to become more agile and data-driven. However, as the data ecosystem grows more rapidly and organically, the resulting complexity quickly leads to confusions, duplicated efforts, and loss of productivity. Companies are struggling to keep track of their data assets and have tried—and often failed—to implement proper data governance. In this talk, I’ll give a brief history of the evolution of DataHub and an overview of its unique architecture. I’ll also explain how LinkedIn and other companies leveraged it to solve an array of metadata-related use cases, including search & discovery, data privacy, access control, documentation, end-to-end lineage, and lifecycle management. This will be followed by a live demo of the open source version of DatHub.

Message to the Audience:
We will also have time after the talk(s) for a community noticeboard where folks will have around 60 seconds to pitch their wares - if you've got an awesome data job going or you are available to fill an awesome job or even that you've found a great open source tool that we should all be contributing to, this will be the time to let us know!

Future Talks:

Let us know if you've got something to talk about for the future meetups. Talks can run anywhere from 5-30 min. All skill levels welcome to present something - just about everything is new to someone!