Observability for GenAI Apps (Grafana ❤️‍🔥 OTel Community Call #4)

In this episode, we’re diving into observability for Generative AI apps. AI helps us write code and monitor applications in production - but how do we observe the AI itself? And how do we make sense of complex, non-deterministic AI systems?

🎙️ We’re joined by two great guests: Ishan Jain, working on GenAI observability and Luccas Quadros, working on Grafana Assistant.

Together, they bring both platform-level insights and real-world perspectives.

🚀 We’ll explore the fast-evolving space of observability for generative AI apps, including:

• How non-deterministic responses change the way we think about observability
• Recording prompts and completions in telemetry: when it’s useful, when it’s not, and how to do it safely
• Using automated evaluations to understand whether things actually work
• Monitoring agentic workflows and multi-step reasoning
• What OTel GenAI group works on

💬 Join us live for an open conversation! Bring your questions, opinions, and hot takes - it’s going to be a fun one 🤖

This event will be livestreamed on YouTube at https://www.youtube.com/watch?v=LfDVygRWQJU