Governing and Evaluating Generative & Agentic AI in Regulated Industries

Please register using the zoom link to get a reminder:

https://us02web.zoom.us/webinar/register/3317557643700/WN_mC_RYJvhRqW9PJNuK8uZQg

As generative and agentic AI systems move from prototypes to production, builders must balance innovation with trust, safety, and compliance. This talk explores the unique evaluation and monitoring challenges of next-generation AI, with healthcare as a case study of one of the most regulated domains:
Evaluation gaps: why conventional benchmarks miss multi-step reasoning, tool use, and domain-specific workflows—and how contamination and fragile metrics distort results.
Bias and safety: demographic bias, hallucinations, and unsafe autonomy that trigger regulatory, legal, and contractual obligations for fairness and safety assessments.
Continuous monitoring: practical MLOps strategies for drift detection, risk scoring, and compliance auditing in deployed systems.
Tools and standards: open-source libraries like LangTest and HELM, new stress-test and red teaming datasets, and emerging guidance from NIST, CHAI, and ISO.
While the examples draw heavily from healthcare, the lessons are broadly applicable to anyone building and deploying generative or agentic AI systems in highly regulated industries where safety, fairness, and compliance are paramount.

Agenda:
(PDT) 11:50 am - 11:55 am Arrival and socializing and Opening
(PDT) 11:55 am - 1:00 pm "Governing and Evaluating Generative & Agentic AI in Regulated Industries"
(PDT) 1:00 pm - 1:10 pm Q&A

About David Talby

David Talby is the CEO at John Snow Labs and Pacific AI, helping companies apply artificial intelligence to solve real-world problems in healthcare and life science. David has extensive experience building and running web-scale software platforms and teams – in startups, open-source projects, for Microsoft’s Bing in the US and Europe, and to scale Amazon’s financial systems in Seattle and the UK. David holds a Ph.D. in Computer Science and Master’s degrees in both Computer Science and Business Administration. He was named USA CTO of the Year by the Global 100 Awards in 2022, Game Changers Awards in 2023, and ACQ5 Global Awards in 2025.

Please register using the zoom link to get a reminder:

https://us02web.zoom.us/webinar/register/3317557643700/WN_mC_RYJvhRqW9PJNuK8uZQg