DataMass Meetup #4: Introduction to Streaming Application Development

The fourth edition of DataMass Meetup is coming!

This time, our expert is Paweł Topka who works in the growing Kainos Big Data team. Paweł is an enthusiast of Apache Spark and Functional Programming. He is a person who loves to share knowledge.

Topic: Introduction to Streaming Application Development

AGENDA
Part 1:

1. What is a batch job?
2. What is a Stream?
   “Hello world” application in:

• Spark Streaming
• Spark Structured Streaming
• Kafka Streams

3. Useful operations:

• Basic operations
• Window Operation
• Stateful Operation
• Join operation

4. Event Time vs Processing Time
5. Delivery semantics
6. Lambda architecture in Big Data

Part 2:
Spark Structured Streaming and Kafka Streams in practice