Skip to content

Lifting the hood on Spark Streaming

Photo of Eugene Dvorkin
Hosted By
Eugene D.
Lifting the hood on Spark Streaming

Details

Dear friends,

There is no doubt that Spark has become the most popular tool for data processing. Spark Streaming may replace Storm for some use cases. In this session we will learn about Spark Streaming and how it works. Our guest will be Andrew Psaltis, an international speaker and author of Streaming Data (http://manning.com/psaltis/) by Manning publication. Andrew will be in New York on July 23 and agreed to give us a talk. I am sure it will be a very interesting and informative session for all of us.

http://photos3.meetupstatic.com/photos/event/1/1/f/5/600_439504597.jpeg

Abstract:

Today if a byte of data were a gallon of water, in only 10 seconds there would be enough data to fill an average home, in 2020 it will only take 2 seconds. The Internet of Things is driving a tremendous amount of this growth, providing more data at a higher rate then we’ve ever seen. With this explosive growth comes the demand from consumers and businesses to leverage and act on what is happening right now. Without stream processing these demands will never be met, and there will be no big data and no Internet of Things.

Apache Spark, and Spark Streaming in particular can be used to fulfill this stream processing need now and in the future. In this talk I will peel back the covers and we will take a deep dive into the inner workings of Spark Streaming; discussing topics such as DStreams, input and output operations, transformations, thinking about time, and fault tolerance. After this talk you will be ready to take on the world of stream processing using Apache Spark.

About Speaker:

http://photos1.meetupstatic.com/photos/event/1/0/a/6/600_439504262.jpeg

Andrew Psaltis has a wealth of experience in software design, and in the construction of large-scale data-intensive systems. He is deeply entrenched in streaming systems and obsessed with delivering insight at the speed of thought. As the author of Streaming Data ( http://manning.com/psaltis/ ) by Manning and an international speaker he spends most of his waking hours thinking about, writing about, and building streaming systems. He was the primary architect of Webtrends Streams -- the first scalable streaming architecture pushing real-time visitor and event-level digital intelligence into the marketing ecosystem. When he's not busy being busy, he's spending time with his lovely wife, two kids, coaching and watching as much Lacrosse as possible.

http://photos2.meetupstatic.com/photos/event/1/1/6/2/600_439504450.jpeg

Agenda:

6 :30 pm: Guest arrival & networking.

7: 00 pm: Lifting the hood on Spark Streaming

8.30pm: Event ends.

We still have some spots left for "Spotify's Music Recommendations Lambda Architecture (https://www.meetup.com/New-York-City-Storm-User-Group/events/223407344/)" talk scheduled for Monday, July 13.

Best price for Strata+Hadoop World ends on July 10. Register before it's gone using our group discount code below.

http://www.tqlkg.com/image-7592525-12229853-1433519484000

Save 20% on any pass with discount code UGNYCSUG20. Check out the impressive agenda and speaker lineup. (http://www.anrdoezrs.net/click-7592525-12229853-1432672200000)

Strata conference is the most interesting Big Data event in New York. We negotiated 20% discount for our group.

Strata + Hadoop World, happening September 29 - October 1 is where
cutting-edge science and new business fundamentals intersect. It’s a
deep-immersion event where data scientists, analysts, and executives
explore the latest in emerging techniques and technologies.

Photo of New York City Real-Time Stream Processing User Group group
New York City Real-Time Stream Processing User Group
See more events
ADP Innovation Lab
135 West 18th, St 4 floor · New York, NY