Developing real-time data pipelines with Spring and Kafka

Kafka has emerged as a clear choice for a high-throughput, low latency messaging system that addresses the needs of high-performance streaming applications. The Spring Framework has been, in the last decade, the de-facto standard for developing enterprise Java applications, providing a simple and powerful programming model that allows developers to focus on the business needs, leaving the boilerplate and middleware integration to the framework itself. In fact, it has evolved into a rich and powerful ecosystem, with projects focusing on specific aspects of enterprise software development - like Spring Boot, Spring Data, Spring Integration, Spring XD, Spring Cloud Stream/Data Flow to name just a few. This presentation will take the perspective of the Kafka user, and show, with live demos, how the various projects in the Spring ecosystem address their needs:

• how to build simple data integration applications using Spring Integration Kafka;
• how to build sophisticated data pipelines with Spring XD and Kafka;
• how to build cloud native message-driven microservices using Spring Cloud Stream and Kafka, and how to orchestrate them using Spring Cloud Data Flow;

In this presentation, Marius Bogoevici (http://twitter.com/mariusbogoevici) from the Spring team will take the perspective of the Kafka user, and show, with live demos, how the various projects in the Spring ecosystem address their needs: