In this presentation, we will learn how to design and assemble a complete Spark application and submit / run / modify the job on the fly.
We will see a demo of how various node can just be dragged and dropped through the web interface, with an explanation along the way about the overall design and Apache Livy as one of the key tools that makes this possible.
Hu Dawei (David) is a System Engineer at Qubida, responsible for the back-end services that supports the Qubida web platform, such as Big Data ingestion, Spark job execution / scheduling, ML workflow visualization, etc.
Thanks to RedMart for providing us withthe venue and refreshments.
7:00 pm -- Food & drinks
7:20 pm -- Meetup group announcements
7:30 pm -- Venue / event host and sponsor announcements
7:40 pm -- Presentation
8:40 pm -- Q&A