Title of Talk:
Intro to Stream Processing
Tim Berglund, Sr. Director, Developer Advocacy, Confluent
Modern businesses have data at their core, and this data is changing continuously. How can we harness this torrent of information in real-time? The answer is stream processing, and the technology that has since become the core platform for streaming data is Apache Kafka. Among the thousands of companies that use Kafka to transform and reshape their industries are the likes of Netflix, Uber, PayPal, and AirBnB, but also established players such as Goldman Sachs, Cisco, and Oracle. Unfortunately, today’s common architectures for real-time data processing at scale suffer from complexity: there are many technologies that need to be stitched and operated together, and each individual technology is often complex by itself. This has led to a strong discrepancy between how we, as engineers, would like to work vs. how we actually end up working in practice. In this session we talk about how Apache Kafka helps teams deliver on the systems they are building today: complex suites of microservices with demands to compute analytics about their activity in real time. We’ll introduce the Kafka ecosystem and show how it lends itself to systems that finally deliver on the promises of evolvability and real-time insight.
Tim is a teacher, author, and technology leader with Confluent, where he serves as the Senior Director, Developer Advocacy. He is the co-presenter of various O’Reilly training videos on topics ranging from Git to Distributed Systems, and is the author of Gradle Beyond the Basics. He tweets as @tlberglund, blogs very occasionally at http://timberglund.com, writes at https://cnfl.io/blog-tim-berglund, is the co-host of the http://devrelrad.io podcast, and lives in Littleton, CO, USA with the wife of his youth and their youngest child, the other two having mostly grown up.