Distributed Deep Learning Jobs on Hadoop

This is a past event

30 people went

Needs a location


This event is online, one of our weekly online AI tech talks series. You can listen, watch, Q&A with speakers from anywhere around the world. Miss the live session due to time zone or conflict? you can still sign up to watch session replay at any time:


At LinkedIn, machine learning is everywhere, from People You May Know, Job Recommendation System to News Feed. Most of existing models were built on top of traditional machine learning algorithms, which are not capable of capturing deep and complex relationship - like language processing, images, and videos understanding. Deep learning has been catching up velocity and gaining its popularity to discover and learn these deep relationships, however, the infrastructure support for deep learning is still in its early age. LinkedIn's offline infrastructure is based on Hadoop and there has been no mature solution to run distributed TensorFlow jobs on Hadoop. TonY was born to solve this problem. TonY makes it easy and effective to run distributed deep learning jobs with GPUs on Hadoop clusters, it supports both Hadoop 2.x and 3.x to be compatible with most Hadoop clusters.

Speaker: Keqiu Hu, staff software engineer at LinkedIn

Online AI tech talks, courses, bootcamps : https://learn.xnextcon.com