Experiences Running Spark in Production at Quantifind

  • August 14, 2012 · 6:30 PM

 

Experiences Running Spark in Production at Quantifind

 

Erich Nachbar, CTO of Quantifind, will talk about their experiences running Spark in production. Spark is currently used for batch processing of unstructured text (entity extraction, language detection, indexing, Tweet & topic classification) and realtime, in-memory data retrieval (statistical & metrics computations) exposed through REST. Using Spark in production can enable unique product features like driving complex, on-demand computations in realtime. After a short demo, we will explore architectural and operational aspects of such a system as currently running at Quantifind.

 

About: Erich Nachbar is CTO of Quantifind. Quantifind is analyzing unstructured user content like comments and product reviews to predict product revenue and intentful audience demographics for major companies in the entertainment industry. He specializes in distributed data storage and processing using modern technologies like Spark, Storm, Scala, Kafka and Cassandra.

 

Pizza and beer will be served at 6:30pm. Talk will start at 7PM. Thanks to Groupon for hosting this meetup.

Join or login to comment.

  • Andy K.

    Great to hear about production experiences with Spark. Also, I'm impressed with the infrastructure that a team of less than 20 folks is supporting! Great talk Erich.

    August 15, 2012

  • Warren R.

    Meeting was too technical for me. I wanted to get into the BIG picture on what business problem is solved with Spark technology.

    August 15, 2012

  • Andrew W.

    Speaker evidently put effort into the slides, discussion was pretty on topic and went in interesting directions. Pretty smooth overall.

    August 15, 2012

  • A former member
    A former member

    It was a very interesting presentation.

    August 15, 2012

  • Cristian O.

    very good and informational meetup!

    August 15, 2012

  • Stoney V.

    Erich Nachbar's presentation was excellent. The group sponsor might reign in multiple questions that are not clarifying something in the presentation.

    August 14, 2012

People in this
Meetup are also in:

Imagine having a community behind you

Get started Learn more
Rafaël

We just grab a coffee and speak French. Some people have been coming every week for months... it creates a kind of warmth to the group.

Rafaël, started French Conversation Group

Start your Meetup today

Act now and get 50% off.
Until February 1.

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy