CHIFOO

Much like the useless "42" answer from The Hitchhiker’s Guide to the Galaxy, early LLM experiences were often grammatically correct but fundamentally unhelpful. LLMs can navigate old bureaucratic mazes. They also architect new, shifting ones. The rapid evolution of AI has propelled humanity through an exhausting emotional cycle from awe to utility. Mirroring the Oracle-Genie-Sovereign model (Drexler), we are enduring an expensive and unclear recalibration of our economic future.

We are now in a phase of seamless experiences, where these systems have quietly begun redistributing agency. The average member of the public is rapidly institutionally pressured to start using AI models for their day-to-day activities. This has been everything from "why did they break up with me" to "I need a raise instead of a silent promotion". Unable to see the flaws of the underlying technology or draw on life experience prior to algorithms, models steer and shift access to housing, healthcare, and employment. This unregulated approach creates another opportunity to siphon agency and wealth from the average person. Much like the era of the wealthy-yet-needy "Nigerian prince", we must again fend for ourselves. Algorithmically pre-filtered, individuals are not being served but contained. The maneuvering room required for social mobility collapses.

The talk proposes designers define a baseline of high-agency architecture, framed through Context, Criteria, Control, and Collaboration, and asks whether human sovereignty can remain a first-class design constraint in an era of agentic systems, or whether we have already resigned to designing ourselves into cargo.