PA: Stream Processing at Scale with Spring XD, Kafka, Spark streaming & RxJava

PA: Stream Processing at Scale with Spring XD, Kafka, Spark streaming & RxJava

NOTE: THIS MEETUP IS IN PALO ALTO at 5:45pm PDT

Schedule:
6:00-6:30 pm Food and networking
6:30-8:00pm Talk and Q&A
8:00-8:30 pm Wind down

In recent years, drastic increases in data volume, as well as a greater demand for low latency, have led to a radical shift in business requirements and application development methods.

Near real-time data processing has become more prevalent and high throughput messaging systems such as Apache Kafka have emerged as key building blocks. Focusing on developer experience and productivity, Spring XD makes it easy to develop big data applications, without the need for dealing with the details of integrating and scaling a big data stack. In the particular context of Kafka, this means allowing developers to benefit from its specific features and power, while at the same time remaining focused on writing and testing business logic.

This talk will provide a brief introduction of how Kafka is supported in the Spring ecosystem in general, in Spring Integration, and how Spring XD integrates with Kafka as an external data source and transport.

We will also walk through a demo showing you how to unleash the power of Kafka with Spring XD, by building a highly scalable data pipeline with Spark streaming, RxJava and Kafka, using Spring XD as a platform."

About the speaker: Ilayaperumal Gopinathan is a member of the Spring XD team. Previously, he was a contributor to vFabric, CloudFoundry and Hyperic products. He holds a bachelors degree in Electronics and Communications Engineering from Thiagarajar College of Engineering, Madurai, India.

Want to give a talk? Have a talk idea? Submit your idea here! (http://bit.ly/SubmitIdeaHere)