Name: Introduction to AI Evals
Start: 2025-06-11T16:00:00-07:00
End: 2025-06-11T18:00:00-07:00
Location: McLaren Conference Center

Join our interactive AI Evaluations Workshop to learn practical skills in evaluating large language models (LLMs) and AI agents! This is a free workshop open to the public!

We’ll cover key concepts including using LLM APIs, understanding jailbreaks, why evaluations (evals) are essential yet challenging, and insights from the alignment faking paper. The session features live coding exercises based on the ARENA materials (section 3.1), using Python and Jupyter notebooks.

Prior Python experience is required. Ideal for AI practitioners, researchers, or enthusiasts looking to deepen their understanding of AI safety and evaluations.

Noah

AI Safety Awareness Group San Francisco

Technology

Artificial Intelligence

New Technology

Big Data

Machine Learning

Data Analytics

Data Visualization

Predictive Analytics

Data Mining

Artificial Intelligence Applications

Data Science

AI and Society

AI Algorithms

Future Progress in Artificial Intelligence

Adarsh Abhinav

Adam

Henry Fisher

Sarah

Hannibal Marcellus Munk

Дмитрий Пак

Robert Domondon

Introduction to AI Evals

McLaren Conference Center                

Share

AI Safety Awareness Group San Francisco

Introduction to AI Evals

AI Safety Awareness Group San Francisco

Details

Members are also interested in