Name: GenAI in the Modern Enterprise and LLMs on GKE
Start: 2025-03-25T16:30:00+01:00
End: 2025-03-25T18:30:00+01:00
Location: Google Oslo

16:30: Welcome, food, and mingle
17:00: TALK 1, by Abdel, 30 min
Generative AI adoption starts from business needs, not technological aspects.
Enterprises constantly strive for a competitive edge through technology, and LLM solutions offer unique potential. However, this happens only once we clearly understand that our business requirements transcend our current technical capabilities.

Let's roll up our sleeves and learn hands-on how to build, test and deploy cutting-edge, powerful Gen AI applications in the Modern Enterprise, in a Serverless environment, using Java, AI orchestration frameworks and multiple LLMs, with a concrete, real-world production use-case as a backdrop. The workshop empowers the enterprise Java developer to unlock new, creative possibilities for their Java apps and build features in novel ways. It caters to the seasoned Java developer in equal measure as to the curious newcomer to GenAI and is crafted as a follow-along workshop. What are you going to leave this session with:

a well-balanced, end-to-end, multi-modal RAG application built in Java, ready to run in the cloud and serve as a reference architecture for a modern generative AI enterprise app

an idempotent solution built in BOTH SpringAI and Langchain4J, today's dominant Java AI orchestration frameworks

deploy Gen AI apps in Cloud Run, a serverless environment

use multiple LLMs deployed in

Managed environments - Google VertexAI

Local environments - Ollama, Testcontainers

Kubernetes - vLLM - an optimized LLM serving engine

full codebase, configuration and deployment instructions.

17:30: TALK 2, by Mofi, 30 min
Serving All The LLMs on GKE
In this session we will talk about all* the ways to serve a Large Language Model on GKE. From smaller models that fit on a single GPU to models that require Multiple GPU nodes. We will use open source tools like vLLM, TGI, Ollama to serve a number of Open Models like Gemma, Llama, DeepSeek in a GKE cluster using both GPU and TPU. We will discuss optimization techniques for speed and cost.

18:00: More mingle.

Agenda

4:30 PM: Networking and Food

5:00 PM: Presentations

6:00 PM: Mingle and discussions

---

Speakers

Abdelfettah Sghiouar - Google (Google Cloud Engineer)

Abdellfetah SGHIOUAR is a Google Cloud Engineer based out of Stockholm, Sweden. Working on everything Serverless, Kubernetes, Service Mesh and containers with background in Infrastructure and Security. You can follow him on twitter.com/boredabdel for random tweets about technology and other stuff.

Mofi Rahman - Google (Developer Relations Engineer)

Host

Rustam Mehmandarov - Google Developer Expert for Cloud (Senior Software Engineer)

Passionate computer scientist. Java Champion, Google Developers Expert for Cloud and Docker Captain. Public speaker. Community builder. Mentor.

Complete your event RSVP here: https://gdg.community.dev/events/details/google-gdg-cloud-oslo-norway-presents-genai-in-the-modern-enterprise-and-llms-on-gke/.

GDG Global

GDG Cloud Oslo, Norway

Technology

Software Development

Google

Google Cloud

Cloud Computing

High Scalability Computing

Google Developer Group

DevOps

Technology Startups

Cloud Security

Cloud Integration

GenAI in the Modern Enterprise and LLMs on GKE

Google Oslo

Share

GDG Cloud Oslo, Norway

GenAI in the Modern Enterprise and LLMs on GKE

GDG Cloud Oslo, Norway

Details

Members are also interested in