Data Engineering lessons from Catch

• Topic: Data Engineering lessons from Catch
• Date: Friday 20th September at 6.00 pm - 8.00 pm
• Networking: 6 pm - 6.30 pm and 7.20 - 8 pm
• Presentation Time: 6.30 pm - 7.20 pm
• (includes welcome, presentation 30 mins & community marketplace)
• Location: Mantel, Level 2/452 Flinders St
• Ticket: Free of cost, however, registrations and RSVP are required!
• Sponsor: ThoughtWorks, Mantel

Catch had a legacy data platform, built on AWS Redshift, Airflow, SQL, and Python, which faced challenges in scalability, maintainability, and time-to-market. The solution was to implement a modernised data platform leveraging a Medallion architecture using Iceberg, Glue, MWAA, and Snowflake. This approach shifted from complex code-driven processes to a configuration and schema-driven paradigm, enabling flexible data lake management with Iceberg and scalable, high-performance data warehousing with Snowflake.In this talk, I will walk you through our modernisation journey and share the key learnings we gained along the way.
About the speaker
Harsha is a data engineering leader focused on modernizing data platforms using a modern tech stack. He specializes in enhancing scalability, maintainability, and efficiency through flexible data management and optimized warehousing solutions. He has enabled organizations to quickly adapt to evolving business needs.