Using Kafka and Pinot for User-Facing Real-Time Analytics

Target Audience: Software Engineers, Data Engineers, Distributed System Engineers, Product Managers

This event is in partnership with:
Big Data and Data Science Israel https://www.meetup.com/Big-Data-Israel/
Apache Pinot https://www.meetup.com/apache-pinot/
Confluent https://www.confluent.io/
Dataconomy https://dataconomy.com/

----------------
Abstract:

Apache Kafka is the de facto standard for real-time event streaming, but what do you do if you want to perform user-facing, ad-hoc, real-time analytics too? That's a hard problem. Apache Pinot solves it, and the two together are like chocolate and peanut butter, peaches and cream, and Steve Rogers and Peggy Carter. Come to this talk for an introduction to both systems and a view of how they work together.

About Apache Pinot:
Pinot is a real-time distributed OLAP datastore, built to deliver scalable real-time analytics with low latency. It can ingest from batch data sources (such as Hadoop HDFS, Amazon S3, Azure ADLS, Google Cloud Storage) as well as stream data sources (such as Apache Kafka).
Pinot was built by engineers at LinkedIn and Uber and is designed to scale up and out with no upper bound. Performance always remains constant based on the size of your cluster and an expected query per second (QPS) threshold.

----------------
What will you learn:

• What is user-facing real-time analytics, with some familiar examples
• Challenges unique to a user-facing real-time analytics system
• Apache Kafka overview, plus concepts like partitioning, Kafka Producer, Kafka Consumer
• ksqlDB, and other solutions in the analytics landscape
• Apache Pinot overview, architecture, and integration with Kafka
• Demo showing how to quickly and easily go from analytics to events with Kafka+Pinot
• Features that make Kafka and Pinot a great combination for user-facing realtime analytics

----------------
Presenters:

Tim Berglund is a teacher, author, and technology leader with Confluent, where he serves as the Senior Director of Developer Advocacy. He can frequently be found speaking at conferences in the United States and all over the world. He is the co-presenter of various training videos on topics ranging from Git to Distributed Systems to Apache Kafka. He tweets as @tlberglund, blogs very occasionally at http://timberglund.com, and lives in Littleton, CO, USA.
https://www.linkedin.com/in/tlberglund/

Neha Pawar is a Founding Engineer at a Stealth Mode Startup. Prior to this, she worked at LinkedIn as a Senior Software Engineer in the Data Analytics Infrastructure org. Neha is an Apache Pinot PMC and Committer & has made numerous impactful contributions to the Apache Pinot project. She actively fosters the growing Apache Pinot community & loves to evangelize Apache Pinot in the form of blogs, video tutorials, speaking in meetups and conferences. You can find her on Twitter at @nehapawar18.
https://www.linkedin.com/in/neha-pawar-86a66031/

----------------
Video Link:

https://us02web.zoom.us/j/87876256308?pwd=dFQya3pMcnZuNGlvYUZRQzhKbmxSZz09
Meeting ID: 878 7625 6308
Passcode: Vineyard