Skip to content

Transforming data flows: Engineering solutions for technical & climate challenge

Photo of sarthak anand
Hosted By
sarthak a.
Transforming data flows: Engineering solutions for technical & climate challenge

Details

We are pleased to invite you to our upcoming meetup co-organized with Company.info on May 15 at the Company.info Office. Get ready for a deep dive into data engineering featuring two compelling talks that explore innovative approaches to data pipeline modernization and climate data integration. Food and drinks will be provided! πŸš€πŸ’‘

SCHEDULE
17:30-18:25: Welcome with drinks! πŸ™Œ
18:25-18:30: Company.info introduction
18:30-19:15: Talk 1 - "Modernizing Data Pipelines on Databricks: How We Unified Batch and Streaming with Hera", by Theodoros Katsikeros & Ehsan Sabaghian
19:15-19:45: Break + Food (πŸ•)
19:45-20:30: Talk 2 - "Climate change: from data ingestion to knowledge ingestion", by Matteo De Felice at RaboResearch
20:30-21:00: Networking / drinks!

TALKS
[Talk 1]: "Modernizing Data Pipelines on Databricks: How We Unified Batch and Streaming with Hera" by Theodoros Katsikeros & Ehsan Sabaghian

In this talk Theodoros & Ehsan will walk through how they tamed their growing web of streaming pipelines by merging all streaming pipelines into a unified batch system, thanks to Hera, the custom-built solution, transforming its data platform into something simpler, faster, and easier to maintain.

[Talk 2]: "Climate change: from data ingestion to knowledge ingestion" by Matteo De Felice at RaboResearch

There are some very good and robust ways to "ingest" data in your decisions, but thousands of ways to include knowledge. Climate is a very good example and Matteo would like to share an example of a python-driven process to understand and use climate information. "We need more knowledge plumbers."

DIRECTIONS

Address:
Abram Dudok van Heelstraat 2,
1096 BE Amsterdam

Photo of PyData Amsterdam group
PyData Amsterdam
See more events
FREE
60 spots left