addressalign-toparrow-leftarrow-rightbackbellblockcalendarcameraccwcheckchevron-downchevron-leftchevron-rightchevron-small-downchevron-small-leftchevron-small-rightchevron-small-upchevron-upcircle-with-checkcircle-with-crosscircle-with-pluscontroller-playcrossdots-three-verticaleditemptyheartexporteye-with-lineeyefacebookfolderfullheartglobegmailgooglegroupshelp-with-circleimageimagesinstagramFill 1light-bulblinklocation-pinm-swarmSearchmailmessagesminusmoremuplabelShape 3 + Rectangle 1ShapeoutlookpersonJoin Group on CardStartprice-ribbonprintShapeShapeShapeShapeImported LayersImported LayersImported Layersshieldstartickettrashtriangle-downtriangle-uptwitteruserwarningyahoo

What I learned from 100,000 open data across 100 open data portals


Thomas Levine has downloaded 100,000 datasets from 100 open data portals, and this is what he learned.

He will talking about all aspects of how he did this, and downloading is, of course, a big part of that. Here are two repositories that you could link to if you like. They lack comprehensible documentation, though.

Speaker Bio:

Playing with computers since he was young, Thomas Levine eventually developed back and wrist pain, so he started studying ergonomics and conducting quantitative ergonomics research. Then he realized that he’d accidentally become a data scientist. And his back and wrists now hurt less. He also has a band called CSV Soundsystem that makes music from spreadsheets.


Browsing through his site and find interesting questions to ask Tom.


For the first half of the session, he'll talk about what he did and what he learned.

After that, he'll talk in more detail about how to conduct an analysis like this. The specifics will depend on what interests participants,but topics could include

* Planning complicated data workflows/pipelines
* Storing data
* Tricks for making things run faster

Event Material(update on 11/29/2013 Friday)

Event Slides:!/data-about-open-data-talk-december-2-2013

The speaker is planning on doing at least one of the documented exercises
during the session, but people can feel free to try one beforehand.!/data-about-open-data-talk-december-2-2013/#exercises

He will also talk a bit about brainstorming and six thinking hats.Then we'll do a couple of exercises.
1. Choose an open data catalog. Diagram how a person could manually download all of the datasets. Then change the labels in the diagram so that it describes a computer program that downloads the datasets.
2. Select a guideline from one of these lists, and brainstorm ways of testing it.

Join or login to comment.

  • Thomas L.

    Hi everyone. Thanks for coming. The video unfortunately didn't record, but here are the notes.!/data-about-open-data-talk-december-2-2013/

    December 3, 2013

  • David E.

    Couldn't make it but would love to see the video!

    December 2, 2013

  • Marvin B.

    cannot make it; hoping there will be a recording

    December 2, 2013

  • Gustavo

    I might not be able to attend, but love to see the video. Will there be one after the talk ?

    December 2, 2013

  • Jeff T.

    Unfortunately, I need to travel on business this evening, so I will no longer be able to attend. I look forward to the next one.

    November 25, 2013

57 went

Your organizer's refund policy for What I learned from 100,000 open data across 100 open data portals

Refunds offered if:

  • the Meetup is cancelled
  • the Meetup is rescheduled
  • you can cancel at least 3 day(s) before the Meetup

Payments you make go to the organizer, not to Meetup. You must make refund requests to the organizer.

Regardless of the refund policy set by the organizer, Meetup may issue refunds on an organizer's behalf if we determine that Meetup's Payment Policies have been violated.

Our Sponsors

  • NYC Data Science Academy

    NYC Data Science Academy runs "NYC Open Data" meetup group.

  • Supstat

    Supstat shares its expertise in data mining and visualization.

People in this
Meetup are also in:

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy