Measuring AI Agents

Building Production AI That Actually Works: From Development to Observability Organizations building AI systems hit two walls: getting models into production workflows reliably, and keeping them there. This session pairs KolmioLabs (custom AI system development) with Arize AI (production observability) to show how the build-and-monitor lifecycle works end-to-end.
KolmioLabs deploys AI engineers directly into organizations to build systems trained on your data and processes. Arize provides real-time monitoring, drift detection, root cause analysis, and model optimization in production. Together: KolmioLabs builds it, Arize watches it, and you catch problems before they hit the business.
Attendees will see real-world examples of how production data improves development, how observability catches data drift and model degradation early, and how to scale AI from experiment to enterprise asset.

Who Should Attend: AI/ML practitioners, MLOps engineers, enterprise architects, data science leaders, and executives evaluating AI investments.

Speakers:

• Arun Jain, Founder & CEO, KolmioLabs (ex-Amazon, Kubera Capital)
• Maggie Parkhurst, Head of Growth Marketing, Arize AI
• Gokhul Srinivasan, Sr Partner Solutions Architect, AWS

Agenda:
5:00-5:40 Networking + food & drinks
5:40-6:00 Introduction & Demo
6:00-6:30 Panel: Measuring AI Agents
6:30-7:00 Q&A & Networking