"AI Agents and Evals for all languages" - Craig West


Details
"AI Agents and Evals for all languages" - Craig West
Tonight we are delighted to have Craig West presenting his talk on evaluating AI Agents and how you can apply them to your web development tasks.
Talk Description:
What actually is an AI Agent and how can we test/evaluate its reliability, latency, cost and performance in our Web Applications?
In this talk, Craig West will demystify and simplify what an AI Agent is with slides and code, as well as elaborate on 'Evals' - how we carry out evaluations not just once our app is built but at every stage in the software development lifecycle with an emphasis on ROI.
The talk will be language agnostic, as observability and evaluations are more process than tooling. However, the examples will be in Python and are more snippets than complex code, understandable for any dev, translatable to other languages through ChatGPT.
All slides and code will be available through a GitHub repo.
Bio:
Craig specialises in Evaluating AI Agents, ranging from agent design to evaluations. He lives in Brighton and is a coach at codebar.io. His spare time is taken up with training his now adolescent Fox Red Labrador, as well as being involved in community kitchens.
https://evaluating-ai-agents.com/
https://craig-west.netlify.app/
Doors open at 6:30m and Craig will start his talk around 7pm.
As usual there will be free pizzas and drinks on the night, please sign up so we can keep track of numbers.
Many thanks.
I hope to see you there.
Thanks, Gavin

"AI Agents and Evals for all languages" - Craig West