About us
Hands-on project-oriented data science, with a heavy focus on machine learning and artificial intelligence. We're here to get neck-deep into projects and actually do awesome things!
Join our new discord https://discord.gg/xtFVsSZuPG where you can:
- discuss more AI/ML papers
- suggest/plan events
- share and discuss github projects
- find and post jobs on our jobs channel
- buy/sell used local gpu/server equipment
- scroll our social media aggregators for the latest AI research news across Bsky, X, Reddit, Youtube, Podcasts, and more
The meetup consists of:
- recurring study groups (if you want to start one, just notify Ben to be made a meetup co-organizer).
- intermediate/advanced working groups (starting in 2019)
- occasional talks and gathering (aiming for at least quarterly starting in 2019)
Upcoming events
23

MARL: Population Training with Exact PSRO
·OnlineOnlineLast meeting we revisited the population training algorithm introduced in Chapter 9 of Multi-Agent Reinforcement Learning: Foundations and Modern Approaches and considered only tabular problems with exact solution techniques. That version of the algorithm has some limitations regarding the ability to learn stochastic equilibrium solutions which is often required in stochastic games with simultaneous actions.
In this meeting we will explain the origin of the deficiency and how the stochastic game scenario differs from the problem used in the original paper describing the double oracle algorithm. Then we will derive the method needed to apply Kuhn's theorem and build a tabular MDP from a population distribution of opponent behavior. Finally, we can then create an exact tabular version of the PSRO algorithm and demonstrate the equivalence of its equilibrium policies with that of a value iteration solution. For additional reading, see the paper introducing PSRO
Meetup Links:
Recordings of Previous RL Meetings
Recordings of Previous MARL Meetings
Short RL Tutorials
My exercise solutions and chapter notes for Sutton-Barto
My MARL repository
Kickoff Slides which contain other links
MARL Kickoff SlidesMARL Links:
Multi-Agent Reinforcement Learning: Foundations and Modern Approaches
MARL Summer Course Videos
MARL SlidesSutton and Barto Links:
Reinforcement Learning: An Introduction by Richard S. Sutton and Andrew G. Barto
Video lectures from a similar course6 attendees
Reinforcement Learning: Topic TBA
·OnlineOnlineThis meeting typically covers topics in reinforcement learning and multi-agent extensions. You can find below links to notes and recordings of previous meetings.
Meetup Links:
Recordings of Previous RL Meetings
Recordings of Previous MARL Meetings
Short RL Tutorials
My exercise solutions and chapter notes for Sutton-Barto
My MARL repository
Kickoff Slides which contain other links
MARL Kickoff SlidesMARL Links:
Multi-Agent Reinforcement Learning: Foundations and Modern Approaches
MARL Summer Course Videos
MARL SlidesSutton and Barto Links:
Reinforcement Learning: An Introduction by Richard S. Sutton and Andrew G. Barto
Video lectures from a similar course2 attendees
Reinforcement Learning: Topic TBA
·OnlineOnlineThis meeting typically covers topics in reinforcement learning and multi-agent extensions. You can find below links to notes and recordings of previous meetings.
Meetup Links:
Recordings of Previous RL Meetings
Recordings of Previous MARL Meetings
Short RL Tutorials
My exercise solutions and chapter notes for Sutton-Barto
My MARL repository
Kickoff Slides which contain other links
MARL Kickoff SlidesMARL Links:
Multi-Agent Reinforcement Learning: Foundations and Modern Approaches
MARL Summer Course Videos
MARL SlidesSutton and Barto Links:
Reinforcement Learning: An Introduction by Richard S. Sutton and Andrew G. Barto
Video lectures from a similar course4 attendees
Reinforcement Learning: Topic TBA
·OnlineOnlineThis meeting typically covers topics in reinforcement learning and multi-agent extensions. You can find below links to notes and recordings of previous meetings.
Meetup Links:
Recordings of Previous RL Meetings
Recordings of Previous MARL Meetings
Short RL Tutorials
My exercise solutions and chapter notes for Sutton-Barto
My MARL repository
Kickoff Slides which contain other links
MARL Kickoff SlidesMARL Links:
Multi-Agent Reinforcement Learning: Foundations and Modern Approaches
MARL Summer Course Videos
MARL SlidesSutton and Barto Links:
Reinforcement Learning: An Introduction by Richard S. Sutton and Andrew G. Barto
Video lectures from a similar course2 attendees
Past events
697

