Past Meetup

Etsy's journey: JRuby to Scalding. What happens when a technology chooses you

This Meetup is past

65 people went

Details

Come hear Dan McKinley, Principal Engineer at Etsy, talk about his journey from JRuby to Scalding.

After 3 years building features and analytics infrastructure in cascading.jruby, the framework (similar in most ways to Pig) was entrenched. Etsy had just finished migrating their EMR pipeline onto new internal hardware, and standardizing the development environment for their 150+ person product development team. It was at this moment that the Scalding grenade hit. Introduced using guerrilla tactics, within a few months Scalding had been widely adopted. Within a year, cascading.jruby was deprecated. The talk will cover Etsy’s story, the technical problems that precipitated it, and the general unease implied when your technology chooses you.