Skip to content

Spark-a-thon -- Developing Spark Extensions (using Scala)

Spark-a-thon -- Developing Spark Extensions (using Scala)

Details

2nd edition of Spark/Scala spark-a-thon on Google Campus in Warsaw.

You're going to develop one or two extensions to Apache Spark (http://spark.apache.org/) using the best programming language Scala (http://www.scala-lang.org/).

Bring your laptop, JDK, sbt, and IntelliJ IDEA. Clone the Spark repo (https://github.com/apache/spark) or stay with Spark 1.6.2 (https://spark.apache.org/news/spark-1-6-2-released.html) if you like, but you should rather use Spark 2.0.0 RC4 (http://apache-spark-developers-list.1001551.n3.nabble.com/VOTE-Release-Apache-Spark-2-0-0-RC4-td18317.html) instead. The real fun is on master, though.

It is about extending the platform itself (not about writing Scala apps for Spark) so writing custom DataSource formats, schedulers or streaming sinks is expected.

Food and drinks sponsored by the one and only Javeo (http://javeo.eu/).

http://photos2.meetupstatic.com/photos/event/3/f/8/6/600_337756262.jpeg

Use comments below to build the agenda first. What would you like to have covered?

Official language: Polish and Scala.

Photo of Warsaw Scala Enthusiasts group
Warsaw Scala Enthusiasts
See more events
Campus Warsaw
Pl. Konesera 10 · Warsaw