add-memberalign-toparrow-leftarrow-rightbellblockcalendarcamerachatchevron-leftchevron-rightchevron-small-downchevron-upcircle-with-crosscomposecrossfacebookflagfolderglobegoogleimagesinstagramkeylocation-pinmedalmoremuplabelShape 3 + Rectangle 1pagepersonpluspollsImported LayersImported LayersImported LayersshieldstartwitterwinbackClosewinbackCompletewinbackDiscountyahoo

Bigvis: visualising 100,000,000 observations in R with Hadley Wickham

For our second meetup this month we are very excited to have Hadley Wickham presenting his new bigviz initiative.

About his talk:

R has a notorious reputation for not being able to deal with "big" data (and ggplot2 is a frequent culprit). Fortunately, this isn't an underlying problem with R, and it's something that we can fix with good programming practices and intelligent use of compiled code. In
this talk, I'll introduce a new package, bigvis, that aims to make it easier (and faster) to work with very large datasets.

Bigvis makes it possible to visualise[masked] million observations in just a few seconds. It is built around a pipeline of bin, summarise, smooth and visualise, and makes minimal sacrifices of flexibility to achieve fast performance. As well as discussing the visualisation
challenges when you have 10s of millions of observations, I'll also discuss the performance challenges, and how C++ and Rcpp make it pleasurable to integrate compiled code into R.


For those of you who don't know about Hadley:

Hadley Wickham is Chief Scientist at RStudio and an adjunct Assistant Professor at Rice University. He's interested in building tools (both computational and cognitive) that make data preparation, visualization and analysis easier. His contributions to R include over 30 R
packages, for data analysis (ggplot2, plyr, reshape), making frustrating parts of R easier to use (lubridate for dates, stringr for strings, httr for accessing web APIs), and for streamlining the R package development process (roxygen2, testthat, devtools, profr,


Pizza starts at 6:15, Hadley will begin at 7 and we will head to the bar after.

Thank you again to Knewton for hosting.

Join or login to comment.

  • Rainier

    Is there a transcript or slide that I can print (instead of the video) of the presentation?

    May 28, 2013

  • Christina G.

    Nice preso with enough meat; I learned something new about working w compresses data sets and am remotivated to bring Rcpp into my coding. Thanks, Hadley & Jared. + Knewton is the perfect host.

    April 26, 2013

  • John W.

    Very good. Pizza was ok but popsicle was excellent. Enjoyed presentation and thanks to knewton for hosting.

    April 26, 2013

  • floris p.

    Will it be possible to see this presentation on Knewton in the near future? I can't find it. As I live in the netherlands it will be hard to join the meetings ;)

    April 26, 2013

  • John Peter S.

    Good presentation, I always learn something from Hadley and this time it cost me only a fin.

    April 26, 2013

  • Xu F.

    Excellent presentation.

    April 26, 2013

  • Zaiming Y.

    awesome presentation, Thank you Jared!

    April 25, 2013

  • Pedro A.

    Do we have Hadley's presentation to share? The code was hard to see but I'd like to explore some of the functionality...

    3 · April 25, 2013

    • Jared L.

      Working on getting the slides.

      1 · April 25, 2013

  • Geert D.

    Congrats, tonight's meetup is one of NYC most popular today!

    April 25, 2013

    • Adam L.

      This account spams pretty much every meetup list that I'm on. Can we ban it please?

      3 · April 25, 2013

    • Rick S.

      Agreed with @Adam. I don't see what our good friend Geert is aiming at anyway

      April 25, 2013

  • Rick S.

    Great talk, bigviz looks amazing and psyched to play around with it.

    April 25, 2013

  • Frank D.

    Letting someone else go.......

    April 25, 2013

  • James B.

    Not able to attend in person, will watch the live stream!

    April 25, 2013

  • Andy L.

    Will watch live stream instead of going to NYC.

    April 25, 2013

  • jake

    sadly i have a conflict!

    any chance someone will take a video?

    April 24, 2013

  • Tim C.


    April 24, 2013

  • Susan H.

    Ok. Jared. I'm signed up. Statistics here I come.

    April 13, 2013

  • Susan H.

    Yippee! My first R meetup!

    2 · April 13, 2013

  • Bryan L.


    April 10, 2013

  • A former member
    A former member

    Into stats, R and all things Data science.

    April 10, 2013

Your organizer's refund policy for Bigvis: visualising 100,000,000 observations in R with Hadley Wickham

Refunds are not offered for this Meetup.

Our Sponsors

People in this
Meetup are also in:

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy