About us
Come join the vibes based learning theory reading group! We meet once every other week to gain a better understanding of the mathematics behind learning systems - covering deep learning, AI, and cognitive science.
We’re here to learn from each other and satisfy our curiosity. As such, we aim to gain a general understanding of the materials we read (i.e., the vibe), and not to cover every detail of proofs or technical arguments. Individuals from all backgrounds and levels of subject matter expertise are welcome, though a general familiarity with mathematics (at the undergraduate level) is encouraged.
Upcoming events
1
Optimization Methods in Deep Learning, Part 2
·OnlineOnlineDuring this meeting, we will be going over the following review paper on optimization methods in deep learning:
A Survey of Optimization Methods from a Machine Learning Perspective, Sun et. al.
https://arxiv.org/pdf/1906.06821To get some hands on familiarity with the reviewed methods, we encourage folks to try out the exercises here: https://drive.google.com/file/d/1Vx_1heSHEwrGmN7C2lhO_35tkX-iWRf4/view?usp=sharing
We will review solutions at the end of the meeting.
This is the second of a three meeting series. Previously, we read Chapter 9 of Boyd's Convex Optimization: https://web.stanford.edu/~boyd/cvxbook/bv_cvxbook.pdf
Next time, we will go over the muon optimizer.NOTE: This meeting is virtual! Normally, we meet in person.
2 attendees
