Creating data pipelines using open-source with Strimzi on Kubernetes

In a world where data continues to become increasingly important, that same data can be used as a building block for event-driven architectures by leveraging change data capture. Open source projects such as Debezium, Apicurio Registry, and Strimzi, which include components required for Kafka on Kubernetes, are key enablers for designing such architectures.

In this session, we’ll walk through a real-world example of capturing changes made in a relational database with a connector configured to use Apicurio Registry, publishing those changes to Kafka serialized in Avro’s compact binary form, and utilizing Kafka Streams, Quarkus, and Camel-K to build a pipeline to manage an Elasticsearch index with extremely low latency efficiently.

Speaker Bio:
Hugo Guerrero works as a developer advocate at Red Hat. He has spent more than two decades working in software development. During that time, he has held various roles, including developer, consultant, architect, and software development factory manager. He is a passionate advocate for a new way of building applications called AsyncAPI, and he volunteers his time to help spread the word about this technology. He also contributes to open source projects. He is responsible for maintaining the Microcks Docker Desktop Extension.

Sponsors:

• Food : John Galt
• Venue : Microsoft