Evaluating LLM Safety & Quality with NVIDIA NeMo & Deepchecks


Details
The upcoming meetup is about "Evaluating LLM Safety & Quality with Deepchecks & NVIDIA NeMo".
In this session, we’ll showcase how to evaluate LLM applications across both safety and quality, using a compatible stack that brings together NVIDIA’s NeMo and the Deepchecks evaluation platform.
📆 Date & Time: September 17th, 2025 | 08:00 AM PST
🚀 Register here: https://www.linkedin.com/events/evaluatingllmsafety-qualitywith7368982109979389952/
Speakers:
• Lior Cohen & Rajath Narasimha from the NVIDIA team will demonstrate NVIDIA Garak & NeMo capabilities.
• Philip Tannor & Alon Mecilati from Deepchecks will give a detailed walkthrough of the Deepchecks evaluation system.
Topics that will be covered:
✅ The evaluation landscape: quality vs safety checks for LLMs
✅ NVIDIA’s “safety recipe” with Garak, Guardrails SDK, NeMo + NIMs
✅ How Deepchecks’ ORION safety SLMs and version comparison workflows tie into the pipeline
✅ Live demo: end-to-end evaluation for security and output quality

Evaluating LLM Safety & Quality with NVIDIA NeMo & Deepchecks