Meet-Up #25: How to Clinically Validate LLMs
Details
Overview
Large Language Models (LLMs) are rapidly entering healthcare products, clinical workflows, and Software as a Medical Device (SaMD) solutions. While their potential is significant, demonstrating clinical performance, safety, and regulatory compliance remains a major challenge for manufacturers and regulators alike.
Questions continue to emerge around clinical validation methodologies, evidence generation, intended use, performance monitoring, transparency, and the application of existing regulatory frameworks to LLM-based medical devices.
This European SaMD Meetup session will focus on how organisations approach the clinical validation of LLMs, from regulatory strategy and market access considerations through to notified body expectations and practical implementation experiences.
The discussion is intended for professionals working across regulatory affairs, quality, software development, clinical affairs, AI governance, and digital health.
Agenda
Introduction (5–10 minutes) – Host (Ivo Flipse)
- Welcome and overview of LLM adoption within regulated healthcare
- Key challenges around clinical validation and regulatory compliance
Session 1 (10–15 minutes + Q&A) – Cecile van der Heijden (Sr. Legal Counsel, Axon Lawyers)
- Legal outline
- When is an LLM considered a medical device, and changes to the landscape
Session 2 (10–15 minutes + Q&A) – Despoina Ioannidou (CTO, Coforix)
- Manufacturer perspective
- How to define the LLM architecture and validate an LLM as a medical device
Session 3 (10–15 minutes + Q&A) – Yun Hsuan Chang (Internal Clinician, Scarlet)
- Notified Body perspective
- Expectations towards the clinical validation of medical devices as LLMs
Panel Discussion (20–30 minutes)
- Validation approaches for LLM-based healthcare applications.
- Regulatory expectations, future developments, and open industry challenges
Conclusion (5 minutes)
Wrap-up, discussion, and key takeaways.
Event Date & Time
July 21st – 7:30 PM – 9:30 PM CET