MLOps Community Amsterdam Meetup @ Prosus

🎉 Welcome to a new live get-together for the global MLOps.community in Amsterdam! Together with our hosts, Prosus, we will enjoy a talk from our host, a roundtable/panel community discussion, a series of lightning talks, and of course, time to socialize with others in the community!

📅 Schedule
18:00-18:20: Walk-in 🚶‍♂️
18:20 - 18:30: Welcome
18:30-18:45: ProLLM: LLM Benchmarks for Real-World Use-Cases by Nidhish Shah from Prosus AI team
18:45-19:00 Intelligent Agents: The Future of LLMs by Donné Stevenson from Prosus AI team
19:00-19:30: Roundtable : Community Discussion on the Impact of Large Language Models (LLMs) on their MLOps Careers
19:30-20:00: Networking + drinks and bites 🍹🍴

📋 Sign-up Instructions:

• Get your free ticket via Luma: https://lu.ma/lcqgs07q
• Sign up on the meetup page
• Let us know if you have any strict dietary restrictions (e.g., vegan 🌱)

🎤 ProLLM: LLM Benchmarks for Real-World Use-Cases by Nidhish Shah from Prosus AI team

Abstract:
Explore the necessity of real-world benchmarks in LLM evaluations through our ProLLM leaderboard. This talk will highlight how to design benchmarks for practical applications and evaluate LLMs against them, focusing on the unique challenges of real-world data and the importance of metrics that reflect true usability and effectiveness.

🎤 Intelligent Agents: The Future of LLMs by Donné Stevenson from Prosus AI team

Abstract:
This presentation delves into the transformative potential of agents in advancing artificial intelligence, focusing on their ability to overcome the inherent limitations of single-shot Large Language Models (LLMs). We will also look at a how our Toqan is using this integration of agents with advanced AI models to enhance decision-making, improve contextual understanding, and deliver more reliable and nuanced interactions.

🎤 Roundtable: Community Discussion on the Impact of Large Language Models (LLMs) on their MLOps Careers

For the first time, we will have a community roundtable/panel. To engage all members of the community, anyone can sign-up to join the roundtable (see below for how to sign-up) or you can just ask questions during the Q&A.
In this roundtable, we will answer questions like:

• How do ML/AI teams collaborate with LLMOps roles (prompt engineers, MLOps engineer, etc??
• What key skills are essential for a successful MLOps career currently?
• How do LLMs impact MLOps workflows and what challenges arise?
• What strategies ensure the reliability and scalability of LLMs in production?

Roundtable Participants

• Carlo Provinciali - Technical Product Manager- ML Platform at Booking.com
• Maria Vechtomova - MLOps Tech Lead at Ahold Delhaize
• Panos Athanasiou - Sr. Manager, Field Engineering - Digital Natives at Databricks
• Julian de Ruiter - Principal Machine Learning Engineer at Xebia