Kafka, the power of events and unbounded data

This event is hosted and sponsored by Datadog (https://www.datadoghq.com/)

Agenda:

19:00 : Accueil

19:15 - The Changing Face of ETL: Event-Driven Architectures for Data Engineers

Speaker: Robin Moffatt, Confluent

Bio:

Robin is a Developer Advocate at Confluent, the company founded by the original creators of Apache Kafka, as well as an Oracle Groundbreaker Ambassador and ACE Director (alumnus). His career has always involved data, from the old worlds of COBOL and DB2, through the worlds of Oracle and Hadoop, and into the current world with Kafka. His particular interests are analytics, systems architecture, performance testing and optimization. He blogs at http://cnfl.io/rmoff and http://rmoff.net/(and previously http://ritt.md/rmoff) and can be found tweeting grumpy geek thoughts as @rmoff. Outside of work he enjoys drinking good beer and eating fried breakfasts, although generally not at the same time.

Abstract:

Data integration in architectures built on static, update-in-place datastores inevitably end up with pathologically high degrees of coupling and poor scalability. This has been the standard practice for decades, as we attempt to build data pipelines on top of databases that do a poor job modeling the fundamental objects that drive our businesses and systems: events.

Events carry both notification and state, and form a powerful primitive on which to build systems for developers and data engineers alike. Developers benefit from the asynchronous communication that events enable between services, and data engineers benefit from the integration capabilities. Everyone gains from using the standards-based, scalable and resilient streaming platform.

In this talk, we'll discuss the concepts of events, their relevance to both software engineers and data engineers and their ability to unify architectures in a powerful way. We'll see how stream processing makes sense in both a microservices and ETL environment, and why analytics, data integration and ETL fit naturally into a streaming world. The talk will conclude with a hands-on demonstration of these concepts in practice using Apache Kafka and commentary on the design choices made.

20:00 - Processor API : the dark side of Kafka-Streams

Speaker: Loic Divad, Xebia

Bio:

Loïc is a french software engineer at Xebia France. He works on Data Engineering topics as Scala developer. Training and blogging are part of his job as well. Kafka, Spark and Akka are his favorite tools among all the Big / Fast Data technologies. Passionate about distributed system, he’s also the organiser of a conference in Paris: DataXDay.

Abstract:

Complexe et fastidieuse, la Processor API est souvent mise de côté. C’est dommage, surtout quand on apprend que les plus grandes fonctionnalités de Kafka-Streams s’y cachent. Notamment les stateful operations et interactives queries. Malgré cela c’est Stream DSL, l’API haut niveau, qui a su séduire les développeurs. Intuitive et puissante, elle propulse Kafka-Streams parmi les meilleurs frameworks de traitement de données en temps réel. Et pourtant, son implémentation nous ramène encore à la processor API.
Ce talk propose donc d’explorer les bases de la Processor API. De lui redonner sa place au sein de Kafka-Streams. De voir comment étendre les fonctionnalités d’une applications de stream processing. Enfin, au-delà des “count words”, il présente un cas d’usages particulier dans lequel le DSL principal ne suffit plus.

--------------------------------
Join this talk to learn:

The power of events and unbounded data
Streaming is not just for real-time applications—it's for everyone

Where a streaming platform fits in an analytic architecture

How event-driven architectures can enable greater scalability and flexibility of systems both now and in the future

21h - 22h - Networking & Apéro

Keep Calm and Stream your Data !