Ensuring Quality in the Age of Generative AI: Beyond Traditional Metrics

The rapid adoption of generative AI is transforming industries, with companies embedding AI models and services into their products at unprecedented rates.

With the barrier to entry for AI tools now lower than ever, it is critical to establish quality standards, ethical guidelines, and comprehensive testing practices that address usability, fairness, safety, and robustness. These attributes require innovative testing approaches, combining manual exploratory methods with automated strategies.

Join Carlos Kidman as he explores the risks and biases inherent in AI development pipelines. This session will cover techniques to evaluate a model's behavior, robustness against security threats, and fairness across diverse user scenarios. By applying these methods to real-world challenges and state-of-the-art models, you'll gain actionable insights into designing and testing responsible AI systems that align with customer expectations.

Key Takeaways:

• Understanding AI risks and biases throughout the development lifecycle.
• Techniques for assessing model behavior, robustness, and fairness.
• Applying new quality attributes to ensure AI systems are usable, ethical, and secure.

Whether you're a developer, tester, or AI enthusiast, this session will equip you with the tools to define and test responsible AI systems that stand out in today's competitive landscape.

If you are able, please join us online or in-person for an engaging presentation followed by a lively networking session with food and drinks—don’t miss this chance to connect and collaborate!

Location: Chicago 200 East Randolph Street Suite 3700, Chicago, IL 60601
Check-in at the front desk and meet us at the 38th floor.

Online: Join the Teams meeting
Meeting ID: 255 734 287 153
Passcode: wn6gQ68o

Presenter info: Carlos Kidman is Senior Quality Architect at SeekWell but was formerly the Director of Engineering and AI at [Qualiti.ai](http://qualiti.ai/) and Engineering Manager at Adobe. He is also an instructor at Test Automation University with courses around architecture, design, containerization, and Machine Learning. He is the founder of QA at the Point, which is the Testing and Quality Community in Utah, and does consulting, workshops, and speaking events all over the world. He has a YouTube channel, builds open-source software like Pylenium and PyClinic, and is an ML/AI practitioner. He loves soccer and Barcelona, anime, gaming, and building products in his free time.