Noam Brown | AI for Imperfect-Information Games: Poker and Beyond

Virtual London Machine Learning Meetup - 10.05.2021 @ 18:30

We would like to invite you to our next Virtual Machine Learning Meetup. Please read the papers below and help us create a vibrant discussion.

The discussion will be facilitated by Michal Šustr. Michal is a PhD student at Czech Technical University, interested in large-scale imperfect information games. He is one of the main contributors to OpenSpiel, a framework for reinforcement learning in games and co-organizer of the new Hidden Information Games Competition, a benchmark of game-playing AIs.

Agenda:

• 18:25: Virtual doors open
• 18:30: Talk
• 19:10: Q&A session
• 19:30: Close

Sponsors
https://evolution.ai/ : Machines that Read - Intelligent data extraction from corporate and financial documents.

• Title: AI for Imperfect-Information Games: Poker and Beyond
  (Noam Brown is a Research Scientist at Facebook AI Research working on multi-agent artificial intelligence, with a particular focus on imperfect-information games)

• Papers:
  http://www.cs.cmu.edu/~noamb/papers/19-Science-Superhuman.pdf
  https://proceedings.neurips.cc//paper/2020/file/c61f571dbd2fb949d3fe5ae1608dd48b-Paper.pdf

Abstract: The field of artificial intelligence has had a number of high-profile successes in the domain of perfect-information games like chess or Go where all participants know the exact state of the world. But real-world strategic interactions typically involve hidden information, such as in negotiations, cybersecurity, and financial markets. Past AI techniques fall apart in these settings, with poker serving as the classic benchmark and challenge problem.

In this talk, I will cover the key breakthroughs behind Libratus and Pluribus, the first AI agents to defeat elite human professionals in two-player no-limit poker and multiplayer no-limit poker, respectively. In particular, I will discuss new forms of the counterfactual regret minimization equilibrium-finding algorithm and breakthroughs that enabled depth-limited search for imperfect-information games to be conducted orders of magnitude faster than previous algorithms. Finally, I will conclude with a discussion on recent work combining the previously separate threads of research on perfect-information and imperfect-information games.

Bio: Noam Brown is a Research Scientist at Facebook AI Research working on multi-agent artificial intelligence, with a particular focus on imperfect-information games. He co-created Libratus and Pluribus, the first AIs to defeat top humans in two-player no-limit poker and multiplayer no-limit poker, respectively. He has received the Marvin Minsky Medal for Outstanding Achievements in AI, was named one of MIT Tech Review's 35 Innovators Under 35, and his work on Pluribus was named by Science Magazine to be one of the top 10 scientific breakthroughs of the year. Noam received his PhD from Carnegie Mellon University, where he received the School of Computer Science Distinguished Dissertation Award.