The fourth edition of DataMass Meetup is coming!
This time, our expert is Paweł Topka who works in the growing Kainos Big Data team. Paweł is an enthusiast of Apache Spark and Functional Programming. He is a person who loves to share knowledge.
Topic: Introduction to Streaming Application Development
1) What is a batch job?
2) What is a Stream?
“Hello world” application in:
- Spark Streaming
- Spark Structured Streaming
- Kafka Streams
3) Useful operations:
- Basic operations
- Window Operation
- Stateful Operation
- Join operation
4) Event Time vs Processing Time
5) Delivery semantics
6) Lambda architecture in Big Data
Spark Structured Streaming and Kafka Streams in practice