Manila Big Data Tech Meetup #6 - Apache Kafka and Airflow

Meet other data engineers that shares the same passion in Big Data Architecture and ETL!

This session is in collaboration with Manila Apache Kakfa Group(by Confluent) - https://www.meetup.com/Manila-Kafka/
*If you're interested in Streaming ETL feel free to join this group.

For this session learn about:

1. Streaming ETL with Apache Kafka and KSQL

• "Companies new and old are all recognising the importance of a low-latency, scalable, fault-tolerant data backbone - in the form of the Apache Kafka streaming platform. With Kafka developers can integrate multiple systems and data sources, enabling low latency analytics, event-driven architectures and the population of multiple downstream systems. What’s more, these data pipelines can be built using configuration alone.

In this talk, we’ll see how easy it is to capture a stream of data changes in real-time from a database such as MySQL into Kafka using the Kafka Connect framework and then use KSQL to filter, aggregate and join it to other data, and finally stream the results from Kafka out into multiple targets such as Elasticsearch and MySQL. All of this can be accomplished without a single line of Java code!"

About the Speaker: Nick Dearden
Nick is a technology and product leader at Confluent, where he enjoys leveraging many years of experience in the world of data and analytic systems to help design and explain the power of a streaming platform for every business. Prior to Confluent, he led the data platform group for a leading online real-estate seller and was chief architect for a cloud-based financial analytics platform. His early career stretches all the way back through multiple data warehouse and business intelligence adventures to the green-screen days of mainframe banking systems.

Connect with Nick via https://www.linkedin.com/in/ndearden/

2. Apache Airflow - Learn what Airflow is and how it can help you create, schedule and monitor workflows. The speaker will share use-cases and implementations of Airflow followed by a quick demo.

About the Speaker: Jake Mongaya is one of the Lead Data Engineer under the Enterprise Data Office in Globe Telecom.

Connect with Jake - https://www.linkedin.com/in/jakerobertmongaya/

See you!!!!!