Skip to content

Details

Register now to attend! => https://konfhub.com/ksug-au-2026-03-18-1 <=

Latest promotions discovered by our community!

We're excited to welcome you to the upcoming Hands-on workshop โ€” happening in-person at at Amazon ! ๐ŸŽ‰

We're actively seeking more awesome AI topic speakers!
๐Ÿ‘‰ https://speaker.ksug.ai

About the event
Learn how to deploy and scale AI applications using Amazon EKS (Elastic Kubernetes Service). This hands-on workshop demonstrates how to build a complete generative AI platform with automated cluster management, hybrid infrastructure, and enterprise-grade observability.

What You'll Learn:

  • Leverage EKS Auto Mode for automated Kubernetes cluster management
  • Architect hybrid node pools for optimal performance and cost efficiency
  • Implement end-to-end observability and LLM serving with vLLM

Hands-on Lab Experience:
Learn directly from AWS experts who have helped organizations successfully deploy and manage large-scale GenAI infrastructure.
Through hands-on labs and real-world examples, you'll learn to master:

  • EKS cluster setup optimized for NVIDIA GPU workloads
  • Efficient model serving and scaling using vLLM
  • Distributed inference architecture implementation with Ray
  • Comprehensive monitoring and observability using Prometheus and Grafana
  • Best practices for production GenAI deployments on Kubernetes.

Who Should Attend:
Whether you're looking to deploy your first language model or scale existing GenAI workloads, this workshop will provide you with best practices and hands-on experience using industry-leading tools and frameworks.

Requirements:

  • Bring your laptop and power adapter
  • AWS account access will be provided
  • Basic familiarity with cloud infrastructure concepts
  • Basic Kubernetes concepts

Through guided exercises, you'll gain practical experience deploying and managing enterprise AI applications on AWS infrastructure.

Full Agenda

Introduction - AI Platform on Kubernetes
09:30 - 09:45 GMT+11
Nikola Cuca & Hantzley Tauckoor
Explore the fundamentals of running AI/ML workloads on Kubernetes and understand why container orchestration is crucial for GenAI deployments. Learn key concepts and benefits of running AI platforms on Amazon EKS.

Hosting inference workloads on Amazon EKS
09:45 - 10:30 GMT+11
Frank Fan & Faisal Masood
Deep dive into designing scalable AI architectures that combine cloud and on-premises resources using Amazon EKS, focusing on inferencing.

Hands-on: Explore environment, vLLM model loading, scaling vLLM
10:30 - 12:00 GMT+11
Frank, Faisal & Parikshit
Hand-on labs on inferencing on EKS using vLLM

Lunch Break
12:00 - 13:00 GMT+11

Voice of customers & panel discussion
13:00 - 14:00 GMT+11
Panel
Hear from existing customers who implemented similar architectures in their production environment.

Introduction to monitoring and observability
14:00 - 14:15 GMT+11
Melchi , Frank and Parikshit
Explore observsability stack for AI on EKS

Hands-on: Observing LLM Inference workloads
14:15 - 15:45 GMT+11
Faisal, Frank & Don
Hand-on labs on observsability stack for AI on EKS

Quiz & Wrap-up
15:45 - 16:00 GMT+11
Nikola & Hantzley
Interactive knowledge check covering key concepts learned throughout the workshop. Review of best practices, Q&A session, and discussion of next steps for implementing GenAI workloads on EKS.

Register here to secure your spot! See you all there!

Location: AWS Sydney Office
Level 5 2 Park St, Sydney NSW 2000

๐Ÿ‘‰ Join our Discord and WhatsApp for latest update!

๐Ÿ”– ๐Ž๐ง๐ ๐จ๐ข๐ง๐  ๐ƒ๐ข๐ฌ๐œ๐จ๐ฎ๐ง๐ญ๐ฌ:
โ˜ธ 30% OFF Kubernetes Certs - Code: 30K8SUG
โ˜ธ 37% OFF KodeKloud Plans - Code: K8SUGKK

๐–๐ก๐ฒ ๐–๐ž ๐ƒ๐จ ๐“๐ก๐ข๐ฌ:
โœ… Learn ๐…๐€๐’๐“๐„๐‘ โšก
โœ… Certify ๐’๐Œ๐€๐‘๐“๐„๐‘ ๐Ÿ’ฐ
โœ… Grow ๐’๐“๐‘๐Ž๐๐†๐„๐‘ ๐Ÿ’ช
๐Ÿ๐ŸŽ๐ŸŽ,๐ŸŽ๐ŸŽ๐ŸŽ+ follow KSUG.AI ๐Ÿ”ฅ linktr.ee/ksug.ai

By registering, you consent to the management of your personal information in accordance with KSUG.AI Meetup's Privacy Policy. Additionally, you agree that our sponsors may contact you.

KSUG.AI is an independent community and not affiliated with or endorsed by CNCF. Kubernetes, K8s, Kubestronaut are registered trademarks of The Linux Foundation.

Related topics

Events in Sydney
Cloud Computing
Microservices
DevOps
Kubernetes
Technology

Sponsors

KSUG AI

KSUG AI

KSUG.AI | KubeSmart, Cloud Native & AI Community

You may also like