Skip to content

Details

Part of Zürich AI Meetup | Secure Orchestration: this workshop takes place before the main meetup, which starts at 17:30 at the same venue. Main meetup: https://www.meetup.com/zurich-ai-meetup/events/316103725/
The demo looked perfect. Then we opened the traces.
The agent repeated the same search 14 times, bounced work between subagents, and confidently booked the wrong flight. Its dashboard still reported success.
We’ll instrument an agent with OpenTelemetry, build repeatable checks with DeepEval, and place a proxy between the agent and the model so we can inspect and change its behaviour without retraining it.
You’ll learn how to:
• Follow requests across tools, models, and subagents
• Catch loops, broken handoffs, unsafe outputs, and hidden costs
• Understand impact your agent is creating
• Add proxy rules that block or rewrite problematic calls
• Replay the same tasks after every change
• Decide whether an agent should be promoted, coached, or fired
Bring your laptop. We’ll investigate the agent together and improve it live.
Workshop lead: Mike Koźmiński, founder of Zürich AI Meetup.
Registration requires approval on Luma: https://luma.com/lh30mcew

Related topics

You may also like