addressalign-toparrow-leftarrow-rightbackbellblockcalendarcameraccwcheckchevron-downchevron-leftchevron-rightchevron-small-downchevron-small-leftchevron-small-rightchevron-small-upchevron-upcircle-with-checkcircle-with-crosscircle-with-pluscrossdots-three-verticaleditemptyheartexporteye-with-lineeyefacebookfolderfullheartglobegmailgooglegroupshelp-with-circleimageimagesinstagramlinklocation-pinm-swarmSearchmailmessagesminusmoremuplabelShape 3 + Rectangle 1ShapeoutlookpersonJoin Group on CardStartprice-ribbonShapeShapeShapeShapeImported LayersImported LayersImported Layersshieldstartickettrashtriangle-downtriangle-uptwitteruserwarningyahoo

Big Data: Collecting, Analyzing & Presenting with Ruby and Rails with Rob Bucci

  • Mar 29, 2012 · 7:00 PM
  • Orbs.com

STAT Search Analytics is a Vancouver-based SEO Analytics company that powers real-time search data and analytics for SEO experts at some of the world's largest companies.  Using Ruby, we crawl over 3 million keywords every day.  We analyze that data in real time, and present it to our users via our application powered by Rails and extJS.  For this talk, we'll cover the following:

  • The Crawl
  • How do we scale ruby to crawl 3mm keywords per day?
  • What are some of the Ruby-related pitfalls we encountered? What lessons did we learn?
  • The Storage
  • We're analyzing over 100 GB of data per day. How do we store it all? Where do we store it?
  • How do we prepare that data for display in Rails? 
  • How do we analyze all that data using Ruby?
  • The Frontend
  •  90% of our Rails application is Javascript. How do we structure our Javascript within Rails?
  • How we built our own caching system to reduce Rails' load on our databases.
  • Lessons learned in making Rails effectively communicate with our Javascript frontend

Born and raised in Vancouver, Rob Bucci is the Founder and CEO of STAT Search Analytics (getSTAT.com). Since 2008, STAT has equipped SEO experts with massive-scale, real-time, localised search data. Largely through word of mouth, the company has been happily building up a client base that includes some of the world's largest online companies and SEO agencies.

Rob’s been working with Ruby on Rails since 2006, and he’s been lucky enough to use it in a number of big-data projects related to SEO, data mining, and natural language processing.

Join or login to comment.

  • Maia

    Rob let us learn from his mistakes! It was very comprehensive and I gained a lot of insight into issues and solutions around Ruby and Big Data.

    March 30, 2012

  • Colin S.

    Rob did a great job sharing practical experience on Ruby, MySQL, Redis, Rails and Mongo. I thoroughly enjoyed it.

    March 30, 2012

  • Robert M.

    Rob provided some excellent insights into how to scale a large Ruby applications.

    Thanks.

    March 30, 2012

  • A former member
    A former member

    I thought it was a great talk. There was lots of good insight and not too much geeking out.

    March 30, 2012

  • A former member
    A former member

    Extremely informative, with plenty of lessons learned. Enjoyed the pragmatic approach. Thanks, Rob! Best wishes for the next stage of your venture.

    March 30, 2012

  • Rob B.

    A big thank you to everyone for attending last night! You guys asked some great questions! I was going to refrain from rating my own talk, but it turns out I HAVE to give a star rating, so I'll give myself 5 stars, naturally. :)

    Thanks again everyone. I enjoyed the experience, and I hope you all got something out of it.

    If anyone has any questions, I welcome you to email me at [masked]

    March 30, 2012

  • Geoffrey S.

    Great meet up, learned lots, clearly new his topic inside and out. Would have preferred a handout of key points, there was a lot of into on scaling ruby apps.

    March 30, 2012

Our Sponsors

People in this
Meetup are also in:

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy