Apache Kafka and stream processing meetup @ Near
Details
Join us on 22nd-Feb for Apache Kafka and stream processing meetup with talks from Confluent, Near, MakeMyTrip and Gojek.
========
Agenda
10:15 am - 10:30 am -> Registration and introduction
10:30 am - 11:20 am -> Nautilus - Near's Big Data platform
Speakers: Mahesh V Chalil (https://www.linkedin.com/in/maheshvc/), Sooraj Balakrishnan (https://www.linkedin.com/in/soorajb/)
11:30 am - 12:20 pm -> Kafka Stream Processing fundamentals and Introduction to ksqlDB (Confluent)
Speaker: Vish Srinivasan (https://www.linkedin.com/in/vishwanathsrinivasan/)
12:20 pm - 01:00 pm -> Lunch and open discussions
1:00pm - 1:50pm -> Building the big data platform from scratch at MakemyTrip/GoIbibo
Speaker: Sunny Shah (https://www.linkedin.com/in/sunny-shah-8924577/)
2:00 pm - 2:50 pm -> Monitoring and alerting for Kafka at Gojek
Speaker: Dinesh Kumar (https://www.linkedin.com/in/dinesh-kumar/)
======
Venue
Near.co Kormangala Office (Google map: http://bit.ly/NearOffice)
No. 1, Kathalipalya, opposite to Indian Bank, 6th Block, Koramangala, Bengaluru, Karnataka 560095
Lunch, snacks and beverages will be provided at the venue. Thanks to Near team for sponsoring
This meetup is only for working professionals. Please mention your company name during RSVP and carry your company ID card for registration.
=========
Abstracts
Talk: Nautilus - Near’s Big Data Platform
As part of this session, we will discuss in detail how Near is handling 8B+ requests per day and processing 12TB+ of data passing via Kafka cluster to go through pre-processing pipelines to reach different destinations for further processing.
----
Talk: Stream Processing fundamentals and Introduction to ksqlDB
The rapidly evolving world of streaming data can be daunting, This is a primer to stream processing and will cover the basics of Kafka, Events, Streams, Tables. We will also introduce ksqlDB, walk through what's new with KSQL - pull queries and connector management and how this allows ksqlDB to become the core of your event streaming applications.
----
Talk: Building a big data platform from scratch
In this talk, we will discuss the tech stack at Goibibo(now part of MakeMyTrip) and lessons learned while building the data platform from the ground up and what's next.
----
Talk: Monitoring and alerting for Kafka
We will discuss KAFQA (a tool for Kafka quality analyzer, measuring data loss, ops and latency) and how our monitoring and alerting changed over time in Gojek. We will also discuss specifics of few configs and it's need, eg: under replicated partitions became normal than being alert if cluster is set up properly
-----
