Come learn about PigPen - Data Engineering with Clojure and Hadoop

PigPen is Clojure for big data, or distributed Clojure. You write idiomatic Clojure code, we translate it to Cascading (or Apache Pig) and run it on thousands of machines. PigPen provides a seamless mesh between the code used to build your pipeline and the code running remotely. It does this by capturing lexical closures and packaging them for evaluation later, so your map-reduce applications now look and feel like they're running on a single machine. Gone are the days of verbose UDFs being defined elsewhere and manual context sharing. PigPen allows you develop your jobs iteratively (and locally) using the Clojure REPL and also to write unit and generative tests using the existing Clojure frameworks.

PigPen brings the simplicity and elegance of Clojure to big data.

About the Speakers:

Matt Bossenbroek works at Netflix on the Personalization & Search team. He helps to manage the data pipelines that deliver the Netflix you know & love. He is a Clojure enthusiast, writing PigPen and other internal Netflix libraries in Clojure, working to spread the language throughout the company. Previously he worked at Microsoft, doing basically the same thing in c# (sans OSS).

Ryan Desmond currently serves as Solution Architect for Concurrent Inc, the minds behind Cascading. Ryan brings a decade of software and data engineering experience to the table and has brought his entrepreneurial experience to several companies in San Francisco, Silicon Valley and New York to help them meet rising demand, radical growth and ever evolving challenges.

Agenda:

• 6:30pm-Registration

• 7pm- Talks Start

(Food and Drinks provided)