Evaluating your RAG Chat App

RAG (Retrieval Augmented Generation) is the most popular approach used to get LLMs to answer user questions grounded in a domain. How can you be sure that the answers are accurate, clear, and well formatted? Evaluation!
In this session, we'll show you how to use Azure AI Studio and the Promptflow SDK to generate synthetic data and run bulk evaluations on your RAG app. Learn about different GPT metrics like groundedness and fluency, and consider other ways you can measure the quality of your RAG app answers.

Presented by Nitya Narasimhan, AI Advocate, and Pamela Fox, Python Advocate

** Part of RAGHack, a free global hackathon to develop RAG applications. Join at https://aka.ms/raghack **

**📌 Check out the RAGHack 2024 series here! **

Pre-requisites:

• Read the official rules and join the hack at https://aka.ms/raghack. No Purchase Necessary. Must be 18+ to enter. Contest ends 9/16/24.

• Want more hands-on RAG training? Visit the Reactor series home page to see all the RAGHack 2024 sessions!