Deep Learning Hardware: Past, Present, and Future
Details
By Bill Dally, Chief Scientist and Senior Vice President of Research, NVIDIA, and Stanford Professor
Organized by IEEE-SVCS
Regstration
https://forms.gle/NdPbxDC2q9iuDwnw8
ABSTRACT: The current resurgence of artificial intelligence is due to advances in deep learning. Systems based on deep learning now exceed human capability in speech recognition, object classification, and playing games like Go. Deep learning has been enabled by powerful, efficient computing hardware. The algorithms used have been around since the 1980s, but it has only been in the last decade - when powerful GPUs became available to train networks - that the technology has become practical. Advances in DL are now gated by hardware performance. This talk will review the current state of deep learning hardware and explore a number of directions to continue performance scaling in the absence of Moore’s Law. Topics discussed will include number representation, sparsity, memory organization, optimized circuits, and analog computation.
Speaker Bio:
Prof. Bill Dally, Chief Scientist and Senior Vice President of Research
NVIDIA in the past 12 years, providing technology direction and oversight. Build and lead a world-class industrial research laboratory. He is also a Stanford University Graphic Professor (Research) Direct a research group developing new processor and network architectures and new digital design techniques; Teach classes on architecture, digital design, VLSI, and "green" electronics.
SOCIAL MEDIA: https://www.linkedin.com/in/billdally/
PAST TALKS: https://youtube.com/playlist?list=PLb8j28CYROlwx1sgQmFUw7uMD1GCXbpfS
