From Kubernetes(SKS by Exoscale) under the hood to AI Journey with KubeRay

THIS MEETUP WILL BE IN PERSON

What to expect:

🗣️ Two or Three speakers

👥 Meet old and new friends from the community

🍕 Free food

🎉 Open-end and free drinks afterwards

✔️ Just RSVP!

Agenda:

• 17:30 - Doors open
• 18:00 - Welcome
• 18:05 - 🗣️ Remy Rojas - Managed Kubernetes under the hood at Exoscale
• 18:45 - Break
• 19:00 - 🗣️ Jakub Hlavačka - A Journey of AI Workloads from Cloud VMs to Kubernetes: Peculiarities of a Reliable Setup with KubeRay Operator
• 19:55 - 🎉 Open-end

🧑‍💻 Speakers:

Remy Rojas - Software Engineer at Exoscale

Remy is young enough to have worked with containers his whole career but old enough to have opinions on how to deploy them. Nowadays he works in the team responsible for developing and maintaining Exoscale's managed Kubernetes offering SKS

Remys's session

SKS - the Scalable Kubernetes Service - is Exoscale's managed Kubernetes offering. In this talk, we will look at the current architecture of SKS. How customer workloads are provisioned and maintained. Then, we will look at the design choices that shaped the product, their motivation, and challenges

Jakub Hlavačka - Cloud Engineer at BerOps

Jakub's session

This talk is a journey of AI workloads that used to run in the comfortable environment of cloud VMs and eventually landed in the dynamic world of Kubernetes. Initially, these workloads used to run on a RayCluster made of cloud instances. The applications have been deployed as Ray Jobs via the CLI and run as Ray Serve deployments. At first, we simply lifted and shifted this setup into Kubernetes. A move that worked, but revealed new pitfalls lurking behind the scenes. From there, we had to embrace KubeRay’s RayService, which reshaped our operations and made running Ray on K8s far more manageable. Along the way, we stumbled, learned, and collected a list of “gotchas” that might be handy for you before you decide to run your own Ray workloads in Kubernetes.

---

Location:

SQUER Solutions (NEW OFFICE!), Althanstraße 4/3/63, 1090, Wien

------------

Got something to say? 📢

Are you a seasoned speaker, or is this the first time you hit the stage?

Want to give a talk at one of our next events? We would like to have you.

Our formats:

• Full talks (~30 to 45 min.)

• Short talks (~15 min.)