Understanding and testing LLM output is becoming an art-form. Current methods to improve LLM prompt outputs has suffered from the inability to systematically test outputs. To get towards a data driven prompt testing methodology, a framework is required. Since prompts are the foundation of AI agents, prompt testing methods are essential.

This presentation will focus on testing and test driven prompt engineering. We will discuss the state of prompt engineering, current AI prompt testing methods, available testing frameworks, and a deep dive into promptfoo.

MadAI

Christopher Harrison

David Padbury

Arturo Polanco

Test driven LLM Prompts 

Madison Public Library - Central

Search {networkName}

Groups

{PRO_NETWORK_NAME} is on Meetup Pro with more than {PRO_MEMBER_COUNT} members across {PRO_GROUP_COUNT} Meetups worldwide. Meetup Pro is the professional tool for organizing and communicating a network of users, partners, contributors and members.

MadAI

MadAI

Who we are

Search MadAI

Upcoming events

Groups