Building Secure AI Locally: Hands-on Hack-Along with Google Gemma
Details
Join GDG Cloud Oslo for an exciting, hands-on hack-along focused on running Large Language Models (LLMs) securely in your local environment using Google's open weights model, Gemma. Dive into the mechanics of local LLMs, exploring essential practices to ensure security, predictability, and robustness. This workshop will provide architectural patterns and Java-based code examples, but feel free to use your preferred language to implement these security measures.
To kickstart the workshop, we have prepared complete architectural patterns and code examples implemented in Java. However, this is a polyglot-friendly event! We highly welcome and encourage you to take these blueprints and implement the same security and predictability patterns in Python, Go, TypeScript, Rust, or any language of your choice.
š Agenda
Part 1: Gemma Intro & The Anatomy of Local LLMs
Get up to speed with Google's Gemma model family. We'll discuss why running models locally is a game-changer, how the architecture works, and why local execution helps keep your data private.
Part 2: The Core Challenge ā Security & Predictability
Using practical concepts and real-world vulnerabilities (inspired by OWASP Top 10 for LLMs), we will discuss why AI models can sometimes behave unpredictably. Learn how to tame non-deterministic outputs, avoid injection risks, and configure boundaries to ensure predictable behavior.
Part 3: Hands-On Hack-Along! š»
Bring your laptops! We will provide ready-to-run Java architectural patterns to guide your implementation. You can dive straight into the Java codebase or use it as a reference blueprint to rebuild the same secure LLM pipelines in your favorite programming language.
š What to Bring
Your laptop and charger.
Your IDE of choice configured for your preferred language (Java, Python, Node, etc.).
A curious mindset ready to code and break things safely!
(Optional) Pre-install Ollama or Docker if you want a head start on running Gemma locally.
Food and drinks will be provided! Space is limited, so make sure to RSVP early.
Agenda
---
Speaker
Rustam Mehmandarov - Google Developer Expert for Cloud (Senior Software Engineer)
Passionate computer scientist ā¢ Java Champion ā¢ Google Developer Expert (GDE) for Cloud ā¢ Docker Captain ā¢ Public speaker ā¢ Developer ā¢ Architect ā¢ Mentor ā¢ Community builder.
Follow Rustam at https://rustam.no.
Hosted By
Rustam Mehmandarov, GDG Organizer
Passionate computer scientist. Java Champions, Google Developer Expert (GDE) for Cloud, and Docker Captain. Public speaker. Mentor. GDG Cloud Oslo, Norway organiser.
Leonard Sheng Sheng Lee, Co-organiser
Complete your event RSVP here: https://gdg.community.dev/events/details/google-gdg-cloud-oslo-norway-presents-building-secure-ai-locally-hands-on-hack-along-with-google-gemma/.