How to Build Better Products with AI Evals by Hamel Husain & Shreya Shankar
Details
RSVPing "yes" on Meetup will NOT reserve your spot at this event. You must purchase your ticket on TicketLeap:
https://events.ticketleap.com/tickets/dan-olsen/evals
Join us for this exciting AI Evals book launch event! As AI becomes central to product development, teams need a systematic way to know whether their AI features are actually working. Evals (short for evaluations) are the testing and measurement practices that let you do this. Evals experts Hamel Husain and Shreya Shankar will share practical frameworks for designing eevals, interpreting results, and using them to make faster, more confident product decisions.
Thanks to our sponsor Raindrop, each in-person attendee will receive a free copy of Hemal and Shreya's new book Evals for AI Engineers ! And Hemal and Shreya will sign your book for you!
We'll meet IN-PERSON at Intuit's HQ in Mountain View and also stream via Zoom for remote attendees, so there are separate tickets for each. I'll send the Zoom link the morning of the event to everyone registered for a Zoom ticket on TicketLeap.
If you join in person, there will be dinner and networking before the talk and more networking after the talk.
For remote attendees: Our sponsors Deloitte and Vapi are raffling off 20+ free copies of the ebook Evals for AI Engineers! You can enter the raffle as part of online registration.
Purchase your ticket on TicketLeap:
https://events.ticketleap.com/tickets/dan-olsen/evals
SCHEDULE
- 4:30 to 6:00 pm: Book signing and networking over dinner
- 6:00 pm: In-person and Zoom session starts
- 6:00 to 7:30 pm: Hamel & Shreyas's talk followed by Q&A
- 7:30 to 8:00 pm: Networking
Note: There are separate tickets for IN-PERSON (which includes dinner) and for the Zoom webinar: please select the correct type of ticket. Tickets are non-refundable. The Zoom link will be emailed the morning of the event to everyone who has registered for a Zoom ticket.
Purchase your ticket on TicketLeap:
https://events.ticketleap.com/tickets/dan-olsen/evals
ABOUT HAMSEL HUSAIN
Hamel Husain is an ML Engineer with over 25 years of experience. He's worked with innovative companies such as Airbnb and GitHub, which included early LLM research used by OpenAI, for code understanding. He has also led and contributed to numerous popular open-source machine-learning tools. Hamel is currently an independent consultant helping companies build AI products.
ABOUT SHREYA SHANKAR
Shreya Shankar builds systems for AI-powered data processing. She holds a PhD in Computer Science from UC Berkeley and will join Carnegie Mellon University as an Assistant Professor of Computer Science in 2027. Shreya created DocETL , an open-source system for analyzing unstructured text at scale, deployed across journalism, law, medicine, policy, finance, and urban planning. Her research has been published at top computer science venues including VLDB, SIGMOD, and UIST (including a Best Paper award), and has influenced systems at Snowflake, BigQuery, LangChain, and OpenAI. Before her PhD, Shreya worked as a ML and data engineer at startups. She holds a BS in Computer Science from Stanford University.
Shreya & Hamel are co-authors of the O'Reilly book Evals for AI Engineers.
ABOUT OUR SPONSORS
Raindrop helps you detect agent issues and prevent them from happening. Find silent failures in production, investigate what went wrong, and simulate changes in CI. Learn more about Raindrop
Deloitte is developing advanced, agentic AI-enabled solutions that are redefining the future of work. We are committed to being the career destination of choice for the world’s best product innovators. We’re hiring! View and apply for Deloitte's Product Management remote job opportunities
Vapi is the leading platform for creating advanced voice AI agents that handle calls for customer support, lead qualification, and appointment scheduling. Trusted by companies like Amazon Ring and Intuit, Vapi has powered over 1 billion calls, letting teams go from prompt to production in minutes. Learn more about Vapi
Enterprises want outcomes but end up paying for time and effort with no way to measure the gap between the two. Rezoomex helps AI Product Builders close that gap: crafting blueprints that guide discovery to define the "why," building agents that deliver real outcomes, and paying agent builders only on verified business results.
Our sponsor Coreography provides corporate video & webinar solutions.
Our sponsor Intuit, who hosts our meetups, is hiring.
RSVPing "yes" on Meetup will NOT reserve your spot at this event. You must purchase your ticket on TicketLeap:
https://events.ticketleap.com/tickets/dan-olsen/evals