addressalign-toparrow-leftarrow-rightbackbellblockcalendarcameraccwcheckchevron-downchevron-leftchevron-rightchevron-small-downchevron-small-leftchevron-small-rightchevron-small-upchevron-upcircle-with-checkcircle-with-crosscircle-with-pluscontroller-playcrossdots-three-verticaleditemptyheartexporteye-with-lineeyefacebookfolderfullheartglobegmailgooglegroupshelp-with-circleimageimagesinstagramFill 1light-bulblinklocation-pinm-swarmSearchmailmessagesminusmoremuplabelShape 3 + Rectangle 1ShapeoutlookpersonJoin Group on CardStartprice-ribbonprintShapeShapeShapeShapeImported LayersImported LayersImported Layersshieldstartickettrashtriangle-downtriangle-uptwitteruserwarningyahoo

Seattle Scalability Meetup - Facebook and xPatterns

This meetup focuses on Scalability and technologies to enable handling large amounts of data: Hadoop, HBase, distributed NoSQL databases, and more!

There's not only a focus on technology, but also everything surrounding it including operations, management, business use cases, and more.

We've had great success in the past, and are growing quickly! Previous guests were from Twitter, LinkedIn, Amazon, Cloudant, Microsoft, 10gen/MongoDB, and more.

 

This month's guests:

Shu Wu, Facebook - 700 Million Videos in 4 Days

For Facebook’s 10 year anniversary, we produced 700 million personalized “lookback” videos. Without any marketing or promotions within Facebook, these videos were shared by over 100M people in the first two days. To make this happen, we scanned through 4 billion years of timelines and pre-rendered about 11 petabytes of videos. I’ll talk about the algorithms used to select the stories, how the videos were rendered and the systems used to scale it. The development time for this project was 3 weeks, including a few days for the infrastructure to compute and store the output. If there’s time, I’ll talk about how we built the system to “edit” the videos in real-time.


Claudiu Barbura, Atigeo - xPatterns on Spark, Shark, Tachyon and Mesos

xPatterns is a big data analytics platform that enables rapid development of enterprise-grade analytical applications through built in apis and tools, driven from a management console with data, application and system monitoring. We will showcase the entire lifecycle of one of the xPatterns applications built for our largest production customer (20 billion healthcare records, 200 TB of compressed hdfs data) while evolving our infrastructure from Hadoop and Hive to Spark, Shark, Tachyon and Mesos. We will provide detailed ELT pipeline stats with lessons learned (Hive vs Shark vs Shark w/ Tachyon),  live demos of Jaws,  our Rest SharkServer and web console for exploring the warehouse through Shark queries, Mesos providing resource management for multiple workloads (Hadoop/Hive, Spark, Jaws),  the Export to NoSql API console (generates geo-replicated apis for real-time access to Cassandra data exported from the warehouse through Spark jobs), the Referral Provider Network, a user-facing dashboard application (D3.js) and finally monitoring and instrumentations consoles (Nagios, Ganglia and Graphite)

 

Our format is flexible: We usually have 2 speakers who talk for ~30 minutes each and then do Q+A plus discussion (about 45 minutes each talk) finish by 8:45.

There'll be beer afterwards, of course!

Meetup Location:

WhitePages,[masked]th Avenue #1600, Seattle, WA

After-beer Location:

Rock Bottom Brewery.  

Doors open 30 minutes ahead of show-time. Please show up at least 15 minutes early out of respect for our first speaker.

 

Join or login to comment.

  • Claudiu B.

    Interested in learning about our experience with Cassandra in xPatterns? http://www.meetup.com/Cassandra-Seattle-Users/events/175164202/

    April 4, 2014

  • Bradford S.

    Facebook was pretty darn inspiring.

    1 · April 3, 2014

  • Claudiu B.

    Thank you for the opportunity, I wish we had more time for Q&A... I hope to see you all in May in Bellevue, for another talk on xPatterns (Spark Meetup), hopefully with new xPatterns APIs and tools to showcase ... I promise to start with demos and then deep dive into tech :)
    Here are the enhanced slides that offer more context around the blitzkrieg session at the end of my talk:
    http://www.slideshare.net/ClaudiuBarbura/xpatterns-beyond-hadoop

    4 · March 28, 2014

  • Luke S.

    Is is possible to access the slides from xPatterns talk?

    March 28, 2014

  • Silvia V.

    As always, really great and interesting talks. Thanks also for the catering. Unfortunately, such popular and nice gesture made for a considerable delay which was hard on us tired early-risers.

    March 27, 2014

  • Lindsey T.

    As always, so great to see everyone! So many new faces... Thanks to White Pages for hosting as always! Thanks as well to Facebook and Atigeo for the great talks.

    3 · March 27, 2014

  • Yenchi L.

    FB talk should be it's own event

    March 26, 2014

  • A former member
    A former member

    Awesome talks tonight!

    3 · March 26, 2014

  • Eric F.

    I am going to be a little late. I hope someone will open the door for me.

    March 26, 2014

  • Lindsey T.

    Jennifer - do you know when you have to have your car out by?

    March 25, 2014

    • Nick K.

      I recall 11pm as well for the valet parking; two people thinking that means it must be true.

      1 · March 25, 2014

    • Jennifer

      Our garage is open until midnight (but no guarantees there will be space. It's pretty small.)

      March 26, 2014

  • A former member
    A former member

    Scalability is something that any big thing needs to address. I am here learn this.

    March 26, 2014

  • Jennifer

    Parking is available in our building and is valet only. $9.00 after 6pm. (Enter on Union between 4th & 5th) Additional parking can be found in the Hilton Parking Garage. Cost is $6.00 after 5pm. Enter on 6th Ave between University and Union. There is also parking on the street (but yes, most are paid until 8pm)

    March 25, 2014

  • Michael R.

    What are the best places to park? Recently Seattle closed some of the close parking spots for public parking or open them up only after 8pm.

    March 25, 2014

  • A former member
    A former member

    I've noticed that the norm for meetups is to list the event start time as being when the doors open. Why not set the official start time as 6:30pm and note in the details that the lecture starts at 7pm?

    2 · March 25, 2014

    • Jennifer

      Eytan - feel free to come early and relax/network in our Great Room!

      1 · March 25, 2014

  • Jennifer

    WhitePages is happy to be hosting this event! Please remember to use the 4th Ave entrance after 6pm. The 5th Ave entrance locks at this time.

    2 · March 25, 2014

  • Ron

    Red eye to Chicago that morning

    March 25, 2014

  • Ron

    Red eye to Chicago that morning

    March 25, 2014

  • Ron

    Red eye to Chicago that morning

    March 25, 2014

  • Lindsey T.

    Greythorn is looking forward to buying drinks again - cant wait to see you all there!

    4 · March 18, 2014

Our Sponsors

People in this
Meetup are also in:

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy