Skip to content

Committer night: spark 1.5 and beyond

Photo of Matthew Hunt
Hosted By
Matthew H.
Committer night: spark 1.5 and beyond

Details

Food. Drink. Spark!

Spark 1.5 was recently released. In this meetup, join TD, Patrick, Reynold from Databricks and Dean from Typesafe to talk about the latest release and what is coming next.
Many of the major changes in Spark 1.5 are under-the-hood changes to improve Spark’s performance, usability, and operational stability. Spark 1.5 ships major pieces of Project Tungsten, an initiative focused on increasing Spark’s performance through several low-level architectural optimizations. The release also adds operational features for the streaming component, such as backpressure support. Another major theme of this release is data science: Spark 1.5 ships several new machine learning algorithms and utilities, and extends Spark’s new R API with distributed GLM.
We will give a high level intro of the release, dive into Project Tungsten and Spark Streaming, and discuss future plans.

Speakers:
Tathagata Das, Patrick Wendell, Reynold Xin, Databricks
Dean Wampler, Ph.D. (@deanwampler) leads the Big Data efforts at Typesafe, focusing on Spark, Mesos, Hadoop, Akka, and other tools. He is the author of "Programming Scala, Second Edition" and "Functional Programming for Java Developers", and the co-author of "Programming Hive", all from O'Reilly. Dean is a contributor to several open source projects and he co-organizes and speaks at many technology conferences and Chicago-based user groups.

Mingling from 6:30-7 and again from 8-9.

Photo of New York Spark Meetup group
New York Spark Meetup
See more events
Civic Hall
156 5th Avenue,2nd floor · New York, NY