Docker Containers in Yarn: Make Your Complex Jobs Play Nice.

As Hadoop and YARN increase in popularity, more complex jobs get run, and configuration management and maintenance issues soar. How can you make your jobs play nice? This talk introduces Docker, explains Docker/YARN integration, and discusses examples of how DockerContainerExecutor can launch jobs in Docker containers inside YARN. Upcoming features in Docker-YARN integration are also covered.

Abin Shahab is a Senior Software Engineer at Altiscale, and a contributor to Docker, and LXC. Abin's work at Altiscale is focused on multi-tenant Hadoop clusters using Docker containers. Abin holds a Masters degree in Software Engineering from Carnegie Mellon University and a Bachelors in Computer Science from the University of Arizona.

Pizza and Refreshments will be served.