Bangalore Streams In-Person meetup - August 2023

Hello Bengaluru

Join us for exciting discussions in the streaming world with opportunities to network with peers & leaders in the industry.

📅 When: August 26 2023 9:00am - 02:30pm

📌Where: CRED Aero Office, Bengaluru

🗺 Directions: https://goo.gl/maps/jEsQKjx2Z7e4EV77A (769 & 770, 100 Feet Road, 12th Main, HAL 2nd Stage, Indiranagar, Bengaluru 560038)

🕒 Schedule :

10:00 am - 10:30 am: Welcome & registrations

10:30 am - 10:45 am: Keynote by CRED

10:45 am - 11:15 am: Apace Pulsar - The anatomy of Pub & Sub by Shivji Kumar Jha, Staff Engineer @ Nutanix

11:25 am - 12:00 pm: Empowering Interactive Queries on Lakehouse: Integrating Apache Hudi with Presto & Trino by Sagar Sumit, Apache Committer, Software Engineer @ Onehouse

12:00 pm - 12:20 pm: Networking break

12:20 pm - 1:00 pm: Stream joins using Aerospike and RTP (Realtime Processing Platform) by Vikas Sharma, Principal Engineer @ CRED

1:00 pm - 1:40 pm: A primer on streaming databases: next gen tooling for streaming and stream processing by Pavan Keshavamurthy, CTO @ Platformatory.io

1:45 pm - 2:30 pm: Lunch & Networking

Please try be present at the venue by 9:45am for a punctual start and smooth registrations! There is a traffic disruption expected in the city till 9:30am due to PM's visit to ISRO. Please plan accordingly!

🗣Talks:

Apace Pulsar - The anatomy of Pub & Sub

About the talk: This is a deep tech presentation on what Apache Pulsar ( a great choice for streaming & messaging) does internally to store a message and give it back in single digit milliseconds at high throughput. We will look at the internal data structures, APIs, read and write paths that make a streaming engine efficient given the expectations and constraints. This talk will give you a great perspective on what and how of designing your apps right to make the best use of Apache Pulsar (or any other streaming framework).

Empowering Interactive Queries on Lakehouse: Integrating Apache Hudi with Presto & Trino

About the talk: Apache Hudi is revolutionizing big data analytics by optimizing lakehouse architecture for efficient upserts, deletes, and incremental processes. As query engines like Presto, Trino become increasingly prominent in data ecosystems, the need for swift querying and on-the-fly data exploration becomes paramount. This talk dives deep into the harmonization between Hudi and these engines, showcasing how their integration yields unparalleled query performance on petabyte-scale datasets, all while ensuring data freshness. Attendees will gather insights into the architectural intricacies, the challenges of integration, and the manifold benefits stemming from this collaboration.

Stream joins using Aerospike and RTP (Realtime Processing Platform)

About the talk: Stream joins are integral to real-time data processing, enabling the fusion of information from different data streams for more insightful analytics and product decisioning. Leveraging Aerospike, a high-performance NoSQL database, in conjunction with a Realtime Processing Platform (RTP), we will explore how Aerospike’s in-memory and disk hybrid storage architecture and RTP’s real-time computation abilities can work together to perform efficient stream joins. It will delve into various techniques, such as parallel stream processing, stream state management, sharding, async I/O and optimisation of stream join algorithms for eventual consistency.

A primer on streaming databases: next gen tooling for streaming and stream processing

About the talk: In this talk, we will explore why streaming databases are the rage and what makes them the hottest thing in the world of streaming. In particular, we will cover how they converge into and diverge from the world views of both traditional OLAP & stream processing. As a final part of this talk, we will also deep dive into important characteristics of a few streaming DBs with a comparative lens.

Please note that there will be limited parking at the venue and we can only accommodate parking on a first-come first-serve basis.