Name: *in-person* Roberta Raileanu (Google DeepMind) - Automating Scientific Discovery
Start: 2025-07-24T18:00:00+01:00
End: 2025-07-24T20:00:00+01:00
Location: Riverbank House

_Title_: Automating Scientific Discovery: How Far Are We?

_Speaker_: Roberta Raileanu (Google DeepMind)

_Abstract_: This talk provides an overview of using LLMs to automate scientific discovery, arguing that current models fall short of their ambitious goals. To rigorously measure these limitations, we introduce MLGym, a comprehensive benchmark for diverse, open-ended AI research tasks, and the LLM Speedrunning Benchmark, which specifically tests an agent's ability to reproduce known innovations. Our findings show that even frontier models struggle significantly on these benchmarks. Beyond just evaluation, we demonstrate how to improve AI research agents by formalizing their process as a search problem, showing that enhancing exploration, generalization, and search strategies can lead to state-of-the-art performance. Ultimately, this work presents a comprehensive view of current limitations while offering promising directions and approaches needed to advance the field.

_Bio_: Roberta Raileanu is a Senior Staff Research Scientist at Google DeepMind and Honorary Lecturer at UCL where she’s co-teaching a course on Open-Endedness and Artificial General Intelligence. Her work focuses on designing open-ended learning systems drawing from different fields such as reinforcement learning, self-supervised learning, evolutionary search, and foundation models. Previously, Roberta was a Research Scientist at Meta, where she led tool use for Llama and worked on accelerating AI research. Roberta received her PhD in computer science at NYU, where she worked on generalization in deep reinforcement learning.

**Agenda:**
5:15pm - Registration opens
6pm - Talk
6:40pm - Q&A session
7pm - Networking + refreshments (soft/alcoholic drinks + pizza)
8pm - Close

Please note that the live talk will be recorded and uploaded to the Meetup YouTube channel.
*Many thanks to our sponsors, [Man Group](https://www.man.com/) and [ArcticDB](https://arcticdb.io/), for hosting this Meetup.*

Martin Goodson

London Machine Learning Meetup

London Machine Learning and Artificial Intelligence Talks

The organiser, Evolution AI, is an award-winning data extraction firm.

Evolution AI

Man Group

G-Research

ArcticDB

Technology

Machine Learning

Natural Language Processing

London

Software Development

Artificial Intelligence

Computer Vision

Applied Statistics

Computer Science

Data Science

Deep Learning

Artificial Intelligence Applications

Neural Networks

Machine Intelligence

Artificial Intelligence Programming

*in-person* Roberta Raileanu (Google DeepMind) - Automating Scientific Discovery

London Machine Learning Meetup

in-person Roberta Raileanu (Google DeepMind) - Automating Scientific Discovery

London Machine Learning Meetup

Details

Sponsors

Members are also interested in