About us
CTM: Continuous Testing Meetup is a community for testers, developers, and anyone interested in testing to share ideas and learn from peers. Join us if you are interested in Continuous Testing, Selenium, WebDriver, Appium, Espresso, XCUITest, Testing and automation, and any other related tools and techniques.
We bring people together to discuss not only technical topics but also the soft skills required to succeed in today's testing industry.
Check our principles and propose a talk at www.continuoustestingmeetup.com
Upcoming events
1
- Network event
LLM evaluation: A live demo
·OnlineOnline55 attendees from 4 groupsHi all!
Join our next CTM Online event!
Agenda
7 - 7:10 pm (UTC+2): Intro
7:10 - 8:00 pm (UTC+2): LLM evaluation: A live demo (Anupam Krishnamurthy)LLM evaluation: A live demo
As test automation engineers, we’ve relied on a bedrock of consistency to test software. We tried our best to isolate and eliminate non-deterministic behaviour from our systems. And now we’re faced with the challenge of testing software that is non-deterministic by design.
In this session, I will demonstrate the inner workings of a Retrieval Augmented Generation (RAG) model, and how you can subject it to automated evaluation by using another LLM-as-a-judge. Once we run the evals, we will prop up the hood and examine the stack traces of the evaluation framework, so that we can debug an unexpected result. We will then subject the RAG model to an indirect injection attack.
Join me in this live demonstration, where we pit one LLM against another, and try to expose a security flaw in the bargain.8:00 - 8:15 pm (UTC+2) - Q&A - Open Discussion
Join Zoom Meeting:
https://us06web.zoom.us/j/89442999005
Meeting ID: 894 4299 9005
Passcode: 159057See you there! 🙂
25 attendees from this group
Past events
16
