Rapid Development of GPT Realtime 2 Browser Agents with actions.json

Overview
Yaniv Ben-Ami will present a 40-50 minute session on rapid development of GPT Realtime 2 browser agents, followed by Q&A.

GPT Realtime 2 makes it possible to build live agents that can speak, listen, handle interruptions, and respond naturally. But if the agent needs to operate a real website, the builder still has a hard problem: how does the agent know what actions are available, what each action means, and how to call those actions reliably?

This talk introduces actions.json, an open-source rapid-development tool for GPT Realtime 2 browser agents. actions.json lets builders describe useful website actions in a readable action map, test those actions against the live site, and hand that map to a Realtime agent instead of wiring every browser action by hand.

The demo will use Trello as the target website and show the path from website exploration to declared actions to a working Realtime browser agent.

Open source project: https://github.com/yaniv256/actions.json

Agenda
6:00pm - 6:30pm: Networking - food & drinks
6:30pm - 8:00pm: Presentation & discussion
8:00pm: Networking at Lake Monster Brewing

Meet Our Featured Speaker
Yaniv Ben-Ami is a voice-agent builder working across Babel3.com, realtimevoice.dev, and actions.json. Babel3 is his open-source voice-first coding environment for talking to Claude Code or Codex from a phone and building away from the desk. realtimevoice.dev is his consulting practice for teams that want GPT Realtime 2 agents inside real websites and software products. actions.json is his open-source rapid-development tool for GPT Realtime 2 browser agents. Before this work, Yaniv was a hedge-fund quant consultant, taught Economics at Carleton College, and earned a PhD in Economics from Yale.

Sponsors
This event is sponsored by Lab651 & Recursive Awesome