Name: Study Group Meeting: Paper Discussion
Start: 2020-01-08T18:30:00-05:00
End: 2020-01-08T20:00:00-05:00
Location: Town 'N Country Regional Public Library

Paper Discussion: 1803.09820 Disciplined Approach to Hyper parameters
Learning Rate, Batch Size, Momentum and Weight Decay

We'll discuss this follow up paper to Leslie Smith's Super-Convergence paper. Leslie Smith's papers focus on minimizing the time and epochs to train a model.

http://arxiv.org/abs/1803.09820

Here is a link to a good web post on Cyclical Learning Rates. https://iconof.com/1cycle-learning-rate-policy. Consider studying the papers before hand.

The idea for this topic and the links came from Vicor Lu, thanks.

Tampa Bay Artificial Intelligence Meetup

Technology

Artificial Intelligence

Machine Learning

Artificial Intelligence Applications

Python

Software Development

Study Group Meeting: Paper Discussion

Town 'N Country Regional Public Library

Share

Tampa Bay Artificial Intelligence Meetup

Study Group Meeting: Paper Discussion

Tampa Bay Artificial Intelligence Meetup

Details

Members are also interested in