Study Group Meeting: Paper Discussion

Tampa Artificial Intelligence Meetup
Tampa Artificial Intelligence Meetup
Public group

Town 'N Country Regional Public Library

7606 Paula Drive · Tampa

How to find us

Computer Room upstairs to right of entry doors

Location image of event venue

Details

Paper Discussion:[masked] Disciplined Approach to Hyper parameters
Learning Rate, Batch Size, Momentum and Weight Decay

We'll discuss this follow up paper to Leslie Smith's Super-Convergence paper. Leslie Smith's papers focus on minimizing the time and epochs to train a model.

http://arxiv.org/abs/1803.09820

Here is a link to a good web post on Cyclical Learning Rates. https://iconof.com/1cycle-learning-rate-policy. Consider studying the papers before hand.

The idea for this topic and the links came from Vicor Lu, thanks.