Build and Continuously Improve Agents That Work in Production (with Agents)
Details
# Frontier models are more capable than ever. So why do so many agents still fall over in production?
There's still a big gap between what a model can do in a demo and what an agent can reliably deliver at scale. Join Triangle Tech Talks for a practical session on why that gap exists and how teams are closing it.
About the talk
Marc Klingen, Co-Founder of Langfuse, will cover the real challenges of turning capable models into useful agents: tool use, reliability, evaluation, monitoring, and handling how real users actually behave.
Marc will also explain why the Langfuse team started building open-source observability and evaluation infrastructure, what has changed since then, and what state of the art looks like today. Using Langfuse as a working example, he'll show how to:
- ๐ Trace agents in production so you can see what's happening inside them
- ๐งฉ Learn from failures and find out why an agent went wrong
- ๐ Turn real interactions into evaluation datasets that reflect how users behave
- ๐ Keep improving prompts, models, tools, and agent architectures
The main idea: production agents aren't built once. They get useful through an ongoing loop of observing, experimenting, and iterating, and you'll use a lot of AI along the way to keep that loop running.
Who should attend
- AI and ML engineers building or running LLM apps and agents
- Platform, MLOps, and observability engineers
- Engineering leaders and architects taking agents from pilot to production
- Anyone curious about what it takes to make AI agents dependable
About the speaker
Marc Klingen is Co-Founder of Langfuse (YC W23), the open-source platform for tracing, evaluating, and improving LLM applications and AI agents. More than 50,000 companies use Langfuse, including 21 of the Fortune 50, and its SDKs are installed 50 million times a month. ClickHouse acquired Langfuse in 2026, and Marc still leads the product team there, working closely with developers and customers on production-grade AI systems.
๐ marcklingen.com ยท X: @marcklingen
Agenda
- [5:00 PM]: Doors Open.
- [5:30 PM]: Networking, food and drinks.
- [6:00 PM]: Community Updates and How I use Langfuse by TBD.
- [6:30 PM]: Talk by Marc Klingen.
- [7:30 PM]: More networking.
๐ Location: [Deutsche Bank Cary - 2nd Floor]
๐๏ธ Date and time: [15-Oct-2026, 5:30 PM ]
Bring your questions, war stories, and toughest agent failures. RSVP now, because seats are limited!
