IN PERSON: Apache Kafka® Meetup Edinburgh - June 2024

Join us for an Apache Kafka® meetup on Wednesday, June 12th from 6:00pm in Edinburgh hosted by Trustpilot!

📍Venue:
Trustpilot
10 George Street, Edinburgh, EH2 2PF, UK

***
🗓 Agenda:

• 6:00pm: Doors open/Welcome
• 6:00pm - 6:30pm: Drinks & Networking
• 6:30pm - 7:15pm: Chris Finlayson, CTO & Founder at BigSpark
• 7:15pm - 7:45pm: Angus Neilson, Senior Data Engineer, Trustpilot
• 7:45pm - 8:00pm: Q&A
• 8:00pm - 9:00pm: Pizza, Drinks & additional Q&A/Networking

***
💡 Speaker One:
Chris Finlayson, CTO & Founder at BigSpark

Title of Talk:
Navigating Data Complexity: Reverting and Resolving Issues in Kafka and Iceberg Environments

Abstract:
In the evolving world of data engineering, managing and ensuring the integrity of data lakes is crucial. This talk will explore advanced strategies for using Apache Kafka, Apache Iceberg, and ‘git for data’ frameworks to handle event feeds effectively, implement branching metadata schemes, and maintaining robust data storage systems.

Bio:
Chris is a founder at bigspark, a pioneering Data & AI consultancy. Having held senior engineering roles within Financial Services - focussed predominantly on Data Platform Engineering – he has a express interest in data storage and management technologies and experience delivering solutions within large scale enterprise environments.

***
💡 Speaker Two:
Angus Neilson, Senior Data Engineer, Trustpilot

Title of Talk:
DynamoDB streaming to Kafka

Abstract:
Trustpilot uses AWS DynamoDB extensively in operational stores and the Data Operations team need to source that data to the Datalake currently using Kafka Connect however there were some challenges so this talk will explore use of AWS Lambda and DynamodDB event streams to provide CDC to kafka

Bio:
Angus Neilson, Senior Engineer in the Data Operations team at Trustpilot spends a lot of his time focused on Data Platform Engineering enabling the smooth flow of data. For the last few years much of his time has been spent in streaming data, especially Kafka. Before that he worked in a variety of Software Engineering roles primarily concerned with Data.

***
DISCLAIMER
BY ATTENDING THIS EVENT IN PERSON, you acknowledge that risk includes possible exposure to and illness from infectious diseases including COVID-19, and accept responsibility for this, if it occurs.
NOTE: We are unable to cater for any attendees under the age of 18.
***
If you would like to speak or host our next event please let us know! community@confluent.io