Workshop on Spark 2.x
Details
Hi All,
In continuation to the Spark Streaming Workshop that we did on 20th May, we are doing a follow-up workshop on the same but ONLY focused on hands-on exercises in 2.x (including Structured Streaming).
As mentioned earlier, it was really great to interact with all the attendees of the workshop that we did on 20th May. I request all the attendees of 20th workshop to make it to this follow-up workshop on 03rd Jun too to be able to get the most out of the same.
We have made this a full day event (8 hours) to ensure that the goals of the workshop are met and everyone gets to spend sometime time to get around the Spark applications. Please note that we will be arranging for lunch to all the attendees.
Agenda:
• Workshop
• Getting started with basic Spark Applications
• Word Count in Spark 2.x
• Write Streaming Application in Spark 2.x
• Quick Introduction to Spark Structure Streaming
• Write Structured Streaming Application in Spark 2.x
• Problem Definition -- Stream Data Processing (Same as what we had for 20th May)
• BrainStorm on how to solve it with Spark (Using Kafka as the source)
• Implement the solution
• Conclusion
Pre-requisites:
• A laptop with the below configuration and tools installed
• 4+ GB RAM
• Idea-IntelliJ 14.x or higher
• JDK 1.8, Maven 3.x and Git installed
https://secure.meetupstatic.com/photos/event/9/d/f/9/600_461080441.jpeg
https://secure.meetupstatic.com/photos/event/9/e/1/4/600_461080468.jpeg
Workshop on Spark 2.x