Running LLMs Locally with Docker Model Runner

Curious how to run LLMs locally using the same Docker tools you (might) already know? Join SoCal RUG with Rami Krispin, a data science leader and Docker expert, for a hands-on walkthrough of Docker Model Runner (DMR), a new capability in Docker Desktop that makes local LLM experimentation simple, reproducible, and container-native.

This session will show how you can download, run, and interact with LLMs entirely on your local machine, no GPUs in the cloud, no fragile micro-services, and no complex infrastructure. Rami will focus on an R-based workflow using R's ellmer for this presentation, demonstrating how DMR fits naturally into modern data science and applied AI development.

***

### What you’ll learn:

• What Docker Model Runner is and when local LLMs make sense
• How to enable and configure DMR in Docker Desktop
• Finding and running LLMs from HuggingFace and Docker Hub
• Launching and managing models via the Docker CLI and UI
• Calling local LLMs programmatically from R and the ellmer package
• Tips for reproducible, container-based GenAI workflows
• Trade-offs vs cloud-hosted models (performance, privacy, cost)

***

### Who should attend:

• R users exploring GenAI and LLM workflows
• Data Scientists who want local, reproducible AI setups
• Docker users curious about AI without complex infrastructure
• Anyone tired of juggling cloud keys, notebooks, and brittle services

Bring your R, Docker, and GenAI questions! This will be a practical, demo-driven session with plenty of time for Q&A.

For ONLINE attendees:
We will be broadcasting this presentation via YouTube Live. We will begin promptly at 7:00 pm PT. Please RSVP for online attendance to get the YouTube Live link. We have disabled YouTube Live Chat for this event. If you want to ask questions, please submit those via Slido here: https://app.sli.do/event/j86a6cmC9Uy63AvQSa9jGr

For IN-PERSON attendees, meeting location info:
We'll be meeting at the Keck Center @ Chapman University room N107/N109. The space has a 40-person limit - If you RSVP but are unable to attend, please update your RSVP promptly to accommodate others interested in attending. Food and beverages will be catered by SoCal RUG for this event and served at 6:30 pm PT. The main presentation will begin at 7:00 pm PT. The best parking option will be the Anderson Parking Structure conveniently next to the Chapman's Keck Center. From the entrance of the Anderson Parking Structure, navigate to the elevator on the far side of the parking structure. Take the elevator to the 1st floor, and you'll find yourself in an outdoor atrium. As you’re exiting the elevator, turn left through the glass doors into Swenson Hall. Continue down the hallway past the MakerSpace and the Ideation Zone (rooms N107/109) will be on your left. While street parking is an option, it may require a valid Chapman parking pass depending on the street you're on - Please pay attention to street signage and see everyone soon!

Legal Disclaimer:
The advice and/or information provided at this event is not endorsed by nor should it be construed as educational/legal advice from Chapman University.