The Non-Determinism of Small LLMs
Details
We don’t slow down after our October meetup - the next PyData Yerevan meetup is already on the way.
This time, we’ll host Claudio Pinhanez, Principal Research Scientist at IBM, who will discuss:
🔷 “The Non-Determinism of Small LLMs: Evidence of Low Answer Consistency in Repetition Trials of Standard Multiple-Choice Benchmarks.”
The talk will dive into how small language models (2B–8B) perform when asked the same questions multiple times, exploring what their answer consistency reveals about accuracy and reliability.
📅 Date: Thursday, November 6
🕖 Time: 7:00 PM
📍 Venue: 213W, PAB, American University of Armenia
🔗 Register here: https://forms.gle/bCAxuD3XjQ98Rztc9
Don’t miss this chance to hear from an IBM researcher and discuss the latest findings on LLM behavior.
#pydatayerevan #AI #machinelearning #LLMs #AUA #ASCE #datascience