Streaming ETL with Apache Kafka and KSQL / Apache Metron

Join us for our next Melbourne Apache Kafka meetup on May 16th from 5:45pm hosted by Servian. The agenda, venue and speaker information can be found below. See you there!

-----

Agenda:
5:45pm: Doors open: Pizza & Drinks
6:15pm: Ideen Faraji, Servian
7:00pm: - Nick Dearden, Confluent
7:45 - 8:30 - Drinks, Networking and additional Q&A

------

Speaker:
Ideen Faraji, Servian

Bio:
I am a software engineer with strong focus on open source, currently, working as a senior consultant at Servian. Within the past couple of years, I have been involved in 2 Big Data projects - "data at rest" and "data in motion" - in architecture, build and support capacities. Prior to joining Servian, I worked as a software developer in the Java and Cloud spaces.

Title:
Apache Metron - Real-time Cybersecurity Analytics

Abstract:
Apache Metron is a streaming analytics application in cyber security context. It provides the capability to ingest, process and store security telemetry in order to detect cyber anomalies in real-time. Metron is built on top of open source technologies such as Kafka and Storm.
In this talk, we will see:
An overview of the Apache Metron product
Basics of Metron architecture
Using a secondary Kafka to prevent from data loss during data ingestion

-----

Speaker:
Nick Dearden, Confluent

Bio:
Nick is a technology and product leader at Confluent, where he enjoys leveraging many years of experience in the world of data and analytic systems to help design and explain the power of a streaming platform for every business. Prior to Confluent, he led the data platform group for a leading online real-estate seller and was chief architect for a cloud-based financial analytics platform. His early career stretches all the way back through multiple data warehouse and business intelligence adventures to the green-screen days of mainframe banking systems.

Title:
Streaming ETL with Apache Kafka and KSQL

Abstract:
Companies new and old are all recognising the importance of a low-latency, scalable, fault-tolerant data backbone - in the form of the Apache Kafka streaming platform. With Kafka developers can integrate multiple systems and data sources, enabling low latency analytics, event-driven architectures and the population of multiple downstream systems. What's more, these data pipelines can be built using configuration alone.

In this talk, we'll see how easy it is to capture a stream of data changes in real-time from a database such as MySQL into Kafka using the Kafka Connect framework and then use KSQL to filter, aggregate and join it to other data, and finally stream the results from Kafka out into multiple targets such as Elasticsearch and MySQL. All of this can be accomplished without a single line of Java code!

--------

Special thanks to Servian who are our local organisers for this event.

Don't forget to join our Community Slack Team (https://launchpass.com/confluentcommunity) !

If you would like to speak or host our next event please let us know! community@confluent.io

NOTE: We are unable to cater for any attendees under the age of 18. Please do not sign up for this event if you are under 18.