xPatterns on Spark, Shark, Mesos, & Tachyon

Due to the popularity, we have moved the xPatterns on Spark, Shark, Mesos, and Tachyon session from Atigeo offices to the larger Expedia offices - thanks Expedia!

We will be in Expedia Building,[masked]th Ave NE, Bellevue, WA - in Conf Room Bellevue 1N-110.  Parking is a bit limited in the area but there is street parking nearby.

Claudiu Barbura will be presenting on his and his team's experience for building the Atigeo data platform - called xPatterns - making use of Spark, Shark, Mesos, and Tachyon.   

xPatterns is a big data analytics platform that enables rapid development of enterprise-grade analytical applications through built in apis and tools, driven from a management console with data, application and system monitoring. We will showcase the tools and APIs used for building multiple big data apps for largest production customer (20 billion healthcare records, 200 TB of compressed hdfs data) while evolving our infrastructure from Hadoop/Hive to Spark, Shark, Tachyon and Mesos. We will provide detailed ELT pipeline stats with performance comparison between Hive, Shark and Shark w/ Tachyon,  live demos of: Jaws,  our http Shark Server and GUI for exploring the data warehouse through Shark queries, Mesos providing resource management for multiple workloads, (Hadoop/Hive, Spark Job Server, Jaws, Aurora)  the Export to NoSql API console (generates geo-replicated, instrumented and resilient apis for real-time access to Cassandra data exported from the warehouse through instrumented Spark jobs), monitoring and instrumentation (Graphite, Nagios) Lessons learned through our Spark journey, from 0.8.0 to 0.9.1, challenges (OOM!), advanced performance tuning and our own patches for the BDAS.


Agenda:

6:30pm: Come in and have some pizza

7:00pm: xPatterns Presentation

8:30pm: we should be done!



Join or login to comment.

  • Claudiu B.

    Thank you for showing up, I enjoyed the questions asked throughout the presentation. I thank the meet up organizers for the the opportunity, Expedia (Shehaaz) for hosting and Atigeo for the pizza :).Here are the slides : http://www.slideshare.net/ClaudiuBarbura/seattle-spark-meetup-may-2014

    2 · May 23, 2014

  • Tom

    This was a really great talk with an in depth very practical demo. Thank you. Could you Claudiu upload your slides? Thanks

    1 · May 23, 2014

  • Prashanth K.

    Very helpful. Thank you.

    1 · May 15, 2014

  • Bernie W.

    Really nice demo!

    1 · May 14, 2014

  • Ryan H.

    Excellent, in-depth presentation.

    3 · May 14, 2014

  • e

    will this be recorded and link posted?

    May 14, 2014

    • Denny L.

      The slides will be posted but I'm afraid we're not recording this. Sorry!

      May 14, 2014

  • Claudiu B.

    Since this event needs a location, Atigeo in downtown Bellevue can both host and present all our work with Spark, Shark, Mesos, Tachyon and Ganglia.

    February 20, 2014

    • Denny L.

      Thanks Claudiu - that would be intriguing. We will be working on following up on future presentations shortly!

      February 20, 2014

People in this
Meetup are also in:

Imagine having a community behind you

Get started Learn more
Henry

I decided to start Reno Motorcycle Riders Group because I wanted to be part of a group of people who enjoyed my passion... I was excited and nervous. Our group has grown by leaps and bounds. I never thought it would be this big.

Henry, started Reno Motorcycle Riders

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy