Name: PyData Zurich: Attention Special
Start: 2024-03-12T18:00:00+01:00
End: 2024-03-12T20:00:00+01:00
Location: Google EURB

In this edition of the meetup, we'll have a single talk - great for catching up on or revisiting developments in Machine Learning.

**The Versatility of Attention-Based Autoregressive Models**

In this talk, François will first introduce the attention operator and attention layers, which are key components of modern large-scale models such as GPTs or ViTs. François will illustrate the capabilities of these modules with toy examples, and then present some work done in his group that puts transformers to use in applications ranging from wind speed prediction to world models.

Please note that our host requires you to provide a first and last name when signing up.

Kevin Klein

PyData Zurich

PyData

Promoting accessible and reproducible computing in science & technology

NumFOCUS

Technology

Machine Learning

Open Source

Software Engineering

Database Applications

Data Science

Data Engineering

François Fleuret is Full Professor and head of the Machine Learning group in the department of Computer Science at the University of Geneva where he holds the chair of machine learning, Adjunct Professor in the School of Engineering of the École Polytechnique Fédérale de Lausanne, and External Research Fellow at the Idiap research institute. He received his PhD in Mathematics from INRIA and the University of Paris VI in 2000, and his Habilitation degree in Mathematics from the University of Paris XIII in 2006.

He has published more than 80 papers in peer-reviewed international conferences and journals, was Associate Editor of the IEEE Transactions on Pattern Analysis and Machine Intelligence, between 2012 and 2022, serves as Area Chair for NeurIPS, ICML, AAAI, and ICCV, and in the program committees of many top-tier international conferences in machine learning and computer vision. He was or is expert for multiple funding agencies.

He is the inventor of several patents in the field of machine learning, and co-founder of Neural Concept SA, a company specializing in the development and commercialization of deep learning solutions for engineering design.

PyData Zurich

PyData Zurich: Attention Special

PyData Zurich

Details

Sponsors

Members are also interested in