Introduction to Continual Learning - Davide Abati

This talk will introduce Continual Learning in general and a deep dive into the CVPR2020 paper "Conditional Channel Gated Networks for Task-Aware Continual Learning".

Wiki: https://wiki.continualai.org
Arxiv: https://arxiv.org/abs/2004.00070

Lecture abstract:

Neural networks struggle to learn continuously and experience catastrophic forgetting when optimized on a sequence of learning problems. As such, whenever the training distribution shifts, they overwrite the old knowledge to fit the current examples. Continual Learning (CL) is the research area addressing the forgetting problem in learning models, and it has inspired a plethora of approaches and evaluation settings. This talk will discuss several successful strategies as well as some of their drawbacks. Moreover, we will introduce a CL model based on conditional computation: by equipping each layer with task-specific gating modules, the network can autonomously select which units to apply at the given input. By monitoring the activation patterns of such gates, we can identify important units for the current task and freeze them before proceeding to the next one, ensuring no loss in performance. An extension will also be discussed, capable of dealing with the more general case in which, at test time, examples do not come with associated task labels

Presenter BIO:

Davide Abati is a machine learning researcher at Qualcomm AI Research, based in Amsterdam. He holds a master's degree in computer engineering from the University of Modena and Reggio Emilia, where he also pursued his Ph.D. in computer vision advised by Prof. Rita Cucchiara. His research focuses on different areas of computer vision, spanning from human attention prediction to novelty detection and continual learning. Some of his works were published in top-tier conferences and journals, such as CVPR, Neurips, and TPAMI. He also regularly serves as a reviewer for several IEEE transactions journals.

His website: https://davideabati.info

This is a technical talk, prior knowledge of deep learning is advised.

** ** Please register through the zoom link right after your RSVP. We will send the links to the zoom event via email only to those who have registered through zoom. ** **

-------------------------
Find us at:

All lectures are uploaded to our Youtube channel ➜ https://www.youtube.com/channel/UCHObHaxTXKFyI_EI8HiQ5xw

Newsletter for updates about more events ➜ http://eepurl.com/gJ1t-D

Sub-reddit for discussions ➜ https://www.reddit.com/r/2D3DAI/

Discord server for, well, discord ➜ https://discord.gg/MZuWSjF

Blog ➜ https://2d3d.ai