Deep Learning ("DL") is far more than a subset of Artificial Intelligence: it's a fundamental breakthrough in software engineering. Because prediction is the essential aspect of decision making DL is pervasive and applied DL is thriving in every industry from finance to oil & gas, media & entertainment, and of course e-commerce.
Join Innovators, Inventors, Enthusiasts, Experts in Applied AI, AI, Artificial Intelligence, Deep Learning, Machine Learning, Data Science, Cognitive Analytics, Blockchain technology, Smart Contracts, you name it. This is New York. We have the A-team of every team and the best of the best are deeply into DL.
Join William Falcon from NYU as he explores everyone's favorite deep learning framework: PyTorch.
In recent years, techniques such as 16-bit precision, accumulated gradients and distributed training have allowed models to train in record times.
In this talk we’ll go through the implementation details of the 10 most useful of these techniques, including DataLoaders, 16-bit precision, accumulated gradients and 4 different ways of distributing model training across hundreds of GPUs. We’ll also show how to use these already built-in in PyTorch Lightning, a Keras-like framework for ML researchers.
William is the creator of PyTorch-Lightning and an AI PhD student at Facebook AI Research and NYU CILVR lab advised by Kyunghyun Cho. Before his PhD, he Co-founded AI startup NextGenVest (acquired by Commonbond). He also spent time at Goldman Sachs and Bonobos. He received his BA in Stats/CS/Math from Columbia University.
Every month the deep learning community of New York gathers at the AWS loft to share discoveries and achievements and describe new techniques.