The Unspoken Challenge: Testing Gen AI & the Software That Uses It | AI Webinar
Details
Building with AI is getting easier. Knowing whether it works reliably is a different challenge.
How do you test an AI application when the same prompt can produce different answers? How do you evaluate accuracy, spot hallucinations and check whether an AI agent is doing what it should?
Join AI Learners Club and Paul Maxwell-Walters, QA Engineer and Consultant, for a practical webinar exploring generative AI testing, LLM evaluation and quality assurance for AI applications and agents.
Using real-world examples and a live demonstration, Paul will explain what makes testing AI different from traditional software testing and how teams can approach it.
What we’ll cover
- Generative AI testing: The challenges of testing large language models (LLMs) and software built around them.
- AI reliability: Assessing hallucinations, bias, inappropriate responses and inconsistent outputs.
- Practical testing techniques: Using constrained responses and structured outputs to make automated testing easier.
- LLM evaluations and benchmarks: Understanding human evaluation, rule-based checks and LLM-as-a-judge approaches.
- Testing AI agents: Why multi-step workflows, tool use and changing outcomes need a different evaluation approach.
- Guardrails and monitoring: How safeguards, logs and traces support AI quality.
- Real-world examples and a live demo, followed by Q&A.
Who should attend?
Software testers, QA engineers, developers, AI builders, product managers and anyone moving from an AI prototype towards a more reliable application.
Some familiarity with generative AI will help you get more from the session.
About the speaker
Paul Maxwell-Walters is a QA Engineer and Consultant with experience at DroneShield, Practera and The Yield. He co-runs Sydney Testers and brings practical experience testing AI-powered software, including AI-generated feedback and assessment systems.
Bring your questions, meet fellow AI learners and discover practical ways to evaluate what you build.
RSVP to join us online!
Hosted by
Paul Walters
https://www.linkedin.com/in/paulwaltersuk/
