Skip to content

Rapid Prototyping in PySparkStreaming

Photo of Donna Fernandez
Hosted By
Donna F.
Rapid Prototyping in PySparkStreaming

Details

Please join us at Endgame for pizza and beer and to hear how they using pySparkStreaming and Docker Containers.

Rapid Prototyping in PySparkStreaming (The Thermodynamics of Docker Containers)

This talk will cover the new pySparkStreaming functionality in Spark 1.2. For people who aren't as familiar with Java or Scala, using Python can be an easier way to try out ideas and algorithms on DStreams. At Endgame, we are beginning to ship Docker containers, so I'll show a pySparkStreaming demo to calculate certain properties of individual containers running on one machine. I'll also tie in thermodynamics concepts to keep things interesting beyond the buzzwords of Spark and Docker.

Speaker Bio:

Rich Seymour is a Senior Data Scientist at Endgame working with a full stack of assorted tools, from Apache Spark to React.js and everything in between. Prior to Endgame, Rich spent a large chunk of time studying Materials Science via molecular dynamics simulations.

http://photos3.meetupstatic.com/photos/event/c/5/2/6/600_434030470.jpeg

Parking and Metro:

There is a public garage located below our building, and several more within a few blocks. We are located directly across from the Clarendon metro stop on the orange line.

Photo of Washington DC Area Apache Spark Interactive group
Washington DC Area Apache Spark Interactive
See more events
Endgame
3101 Wilson Blvd Suite 500 · Arlington, VA