Crunching Big Data with Google BigQuery + Introducing Apache Drill

6:00 - 6:50 Networking and Light Dinner (Thanks Google)

6:50 - 7:00 Welcome and Announcements

7:00 - 7:45 Ryan Boyd - Crunching Big Data with Google BigQuery

7:45 - 8:30 Tomer Shiran - Introducing Apache Drill

8:30 - 8:45 Q&A

Crunching Big Data with Google BigQuery

Applications which grow to web-scale generate massive amounts of data.  Many developers end up throwing this data away because they can’t extract value from it without the necessary expertise or infrastructure.

Google knows Big Data -- our infrastructure processes 60 hours of YouTube video uploads every minute and many of our products have hundreds of millions of users.   Google has developed custom technologies to analyze this data and make intelligent product decisions.  We’ve started to open up some of these technologies as APIs which allow developers to concentrate on their business problems, while Google handles the underlying infrastructure.

Google BigQuery is a Big Data analysis tool born from an internal technology known as Dremel. BigQuery enables developers to analyze terabyte data sets in seconds using a RESTful API and a SQL-like query language. We'll demonstrate how you can incorporate Google BigQuery into your own applications, and how queries are processed underneath the covers.  We’ll also show examples using public data sets and demos built by other developers like you.

Ryan Boyd is a Developer Advocate at Google, focused on cloud data services such as Google BigQuery. He’s been in the Developer Relations group for 5 years and previously helped build out the Google Apps ISV ecosystem. Ryan recently published his first book on “Getting Started with OAuth 2.0” with O’Reilly.

Introducing Apache Drill

Apache Drill is a new open source Apache Incubator project for interactive analysis of large-scale datasets, inspired by Google's Dremel. It enables users to query terabytes of data in seconds. Apache Drill supports a broad range of data formats, including Protocol Buffers, Avro and JSON, and leverages Hadoop and HBase as data sources. Drill's primary query language, DrQL, is compatible with Google BigQuery. In this talk we provide an overview of the Drill project, including its design goals and architecture.

Tomer Shiran heads the product management team at MapR and is responsible for product strategy, roadmap and requirements. Prior to MapR, Tomer held numerous product management and engineering roles at Microsoft, most recently as the product manager for Microsoft Internet Security & Acceleration Server (now Microsoft Forefront). He is the founder of two websites that have served tens of millions of users, and received coverage in prestigious publications such as The New York Times, USA Today and The Times of London. Tomer is also the author of a 900-page programming book. He holds an MS in Computer Engineering from Carnegie Mellon University and a BS in Computer Science from Technion - Israel Institute of Technology.

 

Join or login to comment.

  • Jason T.

    Hi All, we'll be live streaming here:
    http://www.youtube.com/user/gtu...­
    The event will go live at 7:00pm PST.

    Please let us know that you can see it clearly. --thanks!

    1 · September 5, 2012

    • Van R.

      try reloading the live streaming URL page, I am seeing both the video and the audio

      September 5, 2012

    • Brent M

      Thanks much! I just watched the recorded version. Great to have it available anytime. Excellence.

      September 6, 2012

  • Kate Z

    Even i am not a developer, It was a great opportunity to learn how the system works! Nice presentation:) thank you for all.

    September 6, 2012

  • A former member
    A former member

    BigQuery = Google's Dremel-as-a-Service; Drill = OSS Implementation of Dremel

    September 6, 2012

  • Prasad D.

    Excellent. Ryan and Tomer explained both topics very well.

    September 6, 2012

  • A former member
    A former member

    Great presentations about Google BigQuery (Dremel) and Apache Drill.

    September 6, 2012

  • petya

    excellent

    September 6, 2012

  • Ram N.

    Learned a good bit from both talks. Looking forward to checking out BQ as well as Drill.

    September 6, 2012

  • Jennifer

    Interesting. Thanks!

    September 5, 2012

  • Nausher

    Nice presentation. But not enough room, quite a few folks had to stand.

    September 5, 2012

  • Suyash J.

    Great talks, both the speakers were really good and so was their content.

    September 5, 2012

  • Olga K.

    really liked streamline video.

    September 5, 2012

  • Suyash J.

    YouTube streaming is not working, can someone look into it please...people are waiting online

    September 5, 2012

    • Suyash J.

      now working thanks!

      September 5, 2012

    • Jason T.

      hi, you may need to refresh the youtube page

      September 5, 2012

  • Syecom

    Data mining camp and big data professional development seminar Oct 13 and 14.
    http://www.sfbayacm.org/home­

    September 5, 2012

  • Van R.

    I am cautiously optimistic that we will succeed in live streaming this one. Possibly even as a Hangout On Air. Stay tuned! Streaming details will be provided the evening of the event assuming we can pull that together.

    2 · August 29, 2012

    • Ronald I.

      will the session be streamed today? what the URL?

      September 5, 2012

    • Suyash J.

      it says being in few minutes..not working :(

      September 5, 2012

  • lawrence

    To Developers,
    For a limited time, get a free developer demo ticket to GMIC SV
    at following link -
    http://www.gmic-sv.com/register­
    Change quantity to 1 for Developer (Expo) line item
    click "Enter promotional code" and enter "gdgdev" in box,
    click Apply button, then click Register button.

    If you have a new app, we encourage you to submit it to appAttack, a global contest for latest apps.
    http://www.gmic-sv.com/appattac...­

    For details, checkout this presentation
    https://docs.google.com/presenta...­

    or email me at [masked] if you have any questions. Thank you.

    September 5, 2012

  • Steven Max P.

    W. DDc if

    September 1, 2012

  • Brent M

    Excellent! Thanks for working on it. Cheers!

    August 30, 2012

  • Brent M

    Very interesting topic, but I no longer live in the south bay. Is this being web-cast... g+ hangout?

    August 29, 2012

Our Sponsors

  • Google

    Google provides the venue and the refreshments for our meetings.

  • Silicon Valley Code Camp

    SVCC, a weekend event, over 200 Sessions and it is free!

People in this
Meetup are also in:

Imagine having a community behind you

Get started Learn more
Rafaël

We just grab a coffee and speak French. Some people have been coming every week for months... it creates a kind of warmth to the group.

Rafaël, started French Conversation Group

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy