The Measure of AI: From Benchmarks to Wisdom in Leadership

Overview
We've seen incredible progress toward superhuman performance on PhD-level tasks, but are we truly on the path to usefully intelligent AI? This talk explores Moravec's Paradox, the still relevant observation that models struggle where humans excel, on common sense reasoning and basic pattern recognition. Does this come from competition among the major labs to best each other’s performance on increasingly difficult tests? We'll discuss alternative benchmarks, like Simple Bench and ARC-AGI, that challenge AIs to do what we find easy. By understanding these benchmarks, AI leaders can better assess their options and anticipate where AI is headed. This talk aims to provide immediately useful resources and reflection to shape long-term strategy—it’s a slice from the new MA in AI Leadership at the University of St. Thomas.

Agenda:
3:00pm - 3:30pm: Networking - food & drinks
3:30pm - 5:00pm: Presentation & discussion
5:00pm: Networking at Lake Monster Brewing

Meet Our Featured Speaker
Dr. Thomas Feeney is helping to shape the next generation of AI leaders as the inaugural Program Director for the Master of Arts in Artificial Intelligence Leadership at the University of St. Thomas, where he also serves as an Associate Professor of Philosophy. He holds a PhD in Philosophy from Yale University, where his research focused on Early Modern philosophy (notably Leibniz) and metaphysics. Dr. Feeney's inquiry now extends to artificial intelligence, particularly its ethical dimensions and the nature of machine reasoning. This focus is informed by his participation in activities like the AI Safety Camp and his contributions to the University's Institute for AI for the Common Good. In his work and talks, he explores how humanistic traditions and logical rigor can help guide AI's development toward genuinely beneficial ends, a theme central to his June 6 presentation.

Sponsors
This event is sponsored by the University of St. Thomas and offers a unique opportunity to get a sneak peek at their new MA in AI Leadership at the University of St. Thomas.