Skip to content

Apache Kafka & KSQL in Action & Distributed Tracing for Event-Driven Applcations

Photo of Ale Murray
Hosted By
Ale M.
Apache Kafka & KSQL in Action & Distributed Tracing for Event-Driven Applcations

Details

Join us for our next Oslo Apache Kafka® meetup on September 10th from 6:00pm, hosted by Sysco. The agenda, venue and speaker information can be found below. See you there!

-----

Agenda:
6:00 pm: Doors open
6:00 pm - 6:30 pm: Pizza, Drinks and Networking
6:30 pm - 7:15 pm: Robin Moffatt, Confluent
7:15 pm - 8:00 pm - Jorge Quilcate Otoya, Sysco
8:00 pm - 8:15 pm - Additional Q&A & Networking

------

Speaker:
Robin Moffatt, Confluent

Bio:
Robin is a Developer Advocate at Confluent, the company founded by the creators of Apache Kafka, as well as an Oracle ACE Director and Developer Champion. His career has always involved data, from the old worlds of COBOL and DB2, through the worlds of Oracle and Hadoop, and into the current world with Kafka. His particular interests are analytics, systems architecture, performance testing and optimization. He blogs at http://cnfl.io/rmoff and http://rmoff.net/ (and previously http://ritt.md/rmoff) and can be found tweeting grumpy geek thoughts as @rmoff. Outside of work he enjoys drinking good beer and eating fried breakfasts, although generally not at the same time.

Title:
Apache Kafka and KSQL in Action : Let’s Build a Streaming Data Pipeline!

Abstract:
Have you ever thought that you needed to be a programmer to do stream processing and build streaming data pipelines? Think again! Apache Kafka is a distributed, scalable, and fault-tolerant streaming platform, providing low-latency pub-sub messaging coupled with native storage and stream processing capabilities. Integrating Kafka with RDBMS, NoSQL, and object stores is simple with Kafka Connect, which is part of Apache Kafka. KSQL is the open-source SQL streaming engine for Apache Kafka, and makes it possible to build stream processing applications at scale, written using a familiar SQL interface.
In this talk we’ll explain the architectural reasoning for Apache Kafka and the benefits of real-time integration, and we’ll build a streaming data pipeline using nothing but our bare hands, Kafka Connect, and KSQL.
Gasp as we filter events in real time! Be amazed at how we can enrich streams of data with data from RDBMS! Be astonished at the power of streaming aggregates for anomaly detection!

------

Speaker:
Jorge Quilcate Otoya, Chief Consultant at Sysco AS

Bio:
Jorge is a software developer, enjoying his journey of learning and building distributed systems. Working as Developer and Chief Consultant at Sysco Middleware, in Norway, and contributing to open-source projects like Apache Kafka, Jorge is currently focused on researching and applying technologies related to Stream Processing, Messaging, Java ecosystem, DevOps and Observability.

Title:
Distributed Tracing for Event-Driven Applications

Abstract:
The adoption of new patterns as Microservices and Event-Driven architectures are (hopefully) enabling organizations to scale and grow with their systems faster in a scalable and decentralized manner. But this adoption comes at the cost adding inherent complexity by splitting things apart; so now is not that easy anymore to “know” what happen once your data is around all those splitted components: Did this message that user produced was correctly consumed? How long did it took to reach downstream systems? What impact had the latest change to the message schema we deployed to production? Are consumers still working as they usually do? What does “usually” mean?
This talk is aimed to introduce the usage of distributed tracing as a tool to understand how our systems behave in “real-life” and how to integrate it in environments where Kafka is used a as back-bone component for Event-Driven architectures. Finally, we will review how valuable “tracing” data is and what we can produce.

--------

Don't forget to join our Community Slack Team !
https://launchpass.com/confluentcommunity

If you would like to speak or host our next event please let us know! community@confluent.io

Photo of Oslo Apache Kafka® Meetup by Confluent group
Oslo Apache Kafka® Meetup by Confluent
See more events
Thon Hotel Slottsparken
Wergelandsveien 5 0167 · Oslo, al