The Spark Kernel
Details
This meetup at Galvanize in San Francisco will feature a talk by IBM about their use of Spark. Find a detailed talk abstract below.
Agenda for the evening:
6:30 - 7:00 :: Mingling
7:00 - 7:05 :: Welcome and Intro to Galvanize
7:05 - 8:15 :: Technical talk
8:15 - 9:00 :: Mingling
The talk will be published on the Apache Spark (https://www.youtube.com/user/TheApacheSpark) channel on YouTube.
------
Talk Title: The Spark Kernel
Talk Abstract:
In this presentation, we will describe the "Spark Kernel" which enables applications, such as end-user facing and interactive applications, to interface with Spark clusters. It provides a gateway to define and run Spark tasks and to collect results from a cluster without the friction associated with shipping jars and reading results from peripheral systems. Using the Spark Kernel as a proxy, applications can be hosted remotely from Spark. Furthermore, a Kernel client library is available to enable application development. In addition to describing the Kernel itself, we will describe application use cases, potential limitations, and future plans for the codebase.