Triangle AWS User Group

Abstract: Most teams can get an AI agent working in a demo. The hard part is knowing whether it's still working correctly once it's in production.

The gap between "it runs" and "it runs reliably" is observability and evaluation — and most agentic AI stacks have neither. This session introduces
the Agentic AI Development Lifecycle — a structured path from prototype to production covering deployment, observability, and continuous evaluation.
We'll show how to deploy agents to Amazon Bedrock AgentCore, instrument them with OpenTelemetry for end-to-end tracing in CloudWatch, and configure
both offline and online evaluation to catch quality drift before your users do. We'll walk through a live demo of the full lifecycle using a product
catalog agent built with Strands Agents SDK, and show what production-grade agent monitoring actually looks like — traces, dashboards, evaluator
scores, and drift detection in a single view.

Who Should Attend: Engineers building AI agents who want a clear path from prototype to production. DevOps and platform teams who need to monitor and
evaluate GenAI workloads. Solutions architects designing production agent architectures on AWS. Tech leads evaluating Amazon Bedrock AgentCore for
agent hosting and observability. Anyone who's deployed an agent and then had no visibility into whether it was actually doing the right thing.

About the Speakers:

Senthil Kamala Rathinam - Sr. Solutions Architect, AWS | AGS NAMER Tech. Senthil is based in Raleigh, NC.

Hasan Mehdi Rizvi - Sr.Solutions Architect, AWS | AGS NAMER Tech. Hasan is based in Raleigh, NC.

Agenda:

Date: Aug 14th

• 12:00 pm to 12:10 pm ET - Arrival & Networking
• 12:10 pm to 12:35 pm ET - The Problem: Why Agents Break in Production & The Agentic AI Lifecycle
• 12:35 pm to 1:05 pm ET - Deploy & Observe: AgentCore Runtime, OpenTelemetry Traces, CloudWatch Dashboards
• 1:05 pm to 1:15 pm ET - Break
• 1:15 pm to 1:45 pm ET - Evaluate & Detect Drift: Offline Baselines, Online Evaluation, LLM-as-Judge
• 1:45 pm to 2:00 pm ET - Q&A / Open Discussion

Venue & Parking: WeWork One Glenwood, 1 Glenwood Ave, Raleigh, NC 27603. Parking is available at the Glenwood South parking deck (directly behind the
building) or metered street parking along Glenwood Ave. WeWork is on the 5th floor — check in at the front desk and mention the AWS User Group event.