TDWI Boston: "Infrastructure­ Enablers for Effective Large-Scale Data Pipelines”

Free registration at

Topics: "Infrastructure Enablers for Effective Large-Scale Data Pipelines” by Jeromy Carriere, Tech Lead, Google
Processing large amounts of data in a corporate setting requires infrastructural enablers to build and support effective large-scale data pipelines. Specifically, Jeromy will be pointing out some of the practicalities we uncovered as the space grew: reliable large dataset movement, metadata (e.g. for dup/replication management, provenance), reliable workflow systems, abstractions for programming, infrastructure version management. Writing a MapReduce function to run over a petabyte of data is the "easy" part.

BYOB (Bring Your Own Business-Case)
This is a new feature for the TDWI Boston chapter meeting. Bring your own business case or problem and we’ll discuss the issue together. Take advantage of the assembled brain-power spanning the technical and business side as well as multiple verticals. There’s always something to be learned from the issues that others are facing. TDWI chapter officers will have a couple of problem sets ready to seed the discussion.

Join or login to comment.

  • Jens Meyer changed the date and time from Thursday, September 19, 2013 at 12:00 PM to Thursday, October 03, 2013 at 12:00 PM

    September 9, 2013

3 went

Our Sponsors

People in this
Meetup are also in:

Create a Meetup Group and meet new people

Get started Learn more

I started the group because there wasn't any other type of group like this. I've met some great folks in the group who have become close friends and have also met some amazing business owners.

Bill, started New York City Gay Craft Beer Lovers

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy