Name: llm-d: Making AI a First-Class Citizen in Modern Infrastructure / AI Decentered
Start: 2025-08-28T18:00:00-07:00
End: 2025-08-28T21:00:00-07:00
Location: O'Briens Irish Pub

For the August L.A. DevOps Meetup [Christopher Nuland](https://www.linkedin.com/in/cjnuland/) from [Red Hat](https://www.linkedin.com/company/red-hat/posts/?feedView=all) will be discussing [llm-d ](https://llm-d.ai/)a Kubernetes-native distributed inference serving stack, built by leaders in the Kubernetes and vLLM projects.

In the second presentation [Ali Razeghi](https://www.linkedin.com/in/alirazeghi/) will be discuusing “Decentralize AI (Without Rug-Pulling Your Compliance Team)”.

See the Presentation Details section below for more info.

**Sponsored by Red Hat!**
Thanks to [Red Hat](https://www.linkedin.com/company/red-hat/posts/?feedView=all) for sponsoring LA DevOps!
Join the [Los Angeles Red Hat User Group](https://www.meetup.com/los-angeles-rhug/) on meetup.com at https://www.meetup.com/los-angeles-rhug/ to keep up with LA-RHUG events.

**Event Details:**
**6:00 - 6:30 Attendees arrive. Networking/Mingle**
**6:30 - 6:45 LA DevOps Welcome,Attendee Introductions**
**6:45 - 7:30** **llm-d: Making AI a First-Class Citizen in Modern Infrastructure - Christopher Nuland**
**7:30 - 8:00 Decentralize AI (Without Rug-Pulling Your Compliance Team) - Ali Razeghi**
**8:00 - 9:00 Networking/Mingle**

**Presentation Details:**
**Title:** **llm-d: Making AI a First-Class Citizen in Modern Infrastructure**
**Presented by: Christopher Nuland**
**Description:**

Deploying large language models at scale presents challenges, including high GPU costs, unpredictable latency, and black-box infrastructure that doesn’t align with cloud-native practices. The solution? **[`llm-d`](https://llm-d.ai/)**, a new open-source framework developed in collaboration with Red Hat, Google, NVIDIA, and Hugging Face. Built on Kubernetes, [`llm-d`](https://llm-d.ai/)disaggregates LLM inference into composable, observable services — like prefill, decode, and shared caching — all orchestrated by an intelligent Inference Gateway. In this session, we’ll explore the architecture behind [`llm-d`](https://llm-d.ai/), compare it to traditional inference stacks, and show how it empowers enterprises to run GenAI workloads with greater efficiency, flexibility, and control.

**About Christopher:**
[Christopher Nuland](https://www.linkedin.com/in/cjnuland/) is a Principal Technical Marketing Manager for AI at [Red Hat](https://www.linkedin.com/company/red-hat/posts/?feedView=all) and has been with the company for over six years. Before Red Hat, he focused on machine learning and big data analytics for companies in the finance and agriculture sectors. Once coming to Red Hat, he specialized in cloud native migrations, metrics-driven transformations, and the deployment and management of modern AI platforms as a Senior Architect for Red Hat’s consulting services, working almost exclusively with Fortune 50 companies until recently moving into his current role. Christopher has spoken worldwide on AI at conferences like KubeCon EU/US and Red Hat’s Summit events.

**Title: Decentralize AI (Without Rug-Pulling Your Compliance Team)**

**Description:**
This talk covers compliance & regulations,with respect to the new NIST AI security framework, how it works, the principals of Hal Finney’s Reusable Proofs of Work and Nick Szabo’s “Trusted Third Parties Are Security Holes,”, and its application to AI.

**About Ali:**
[Ali Razeghi](https://www.linkedin.com/in/alirazeghi/) is a technology architect and customer-facing technical leader with a proven track record of delivering secure, scalable, and compliant solutions for enterprise and emerging markets.and Founder of Immutable Labs.

**About O'Brien's Pub on Wilshire:**

The covered patio at [Obrien's Pub](https://www.obriensla.com/) has been a great place to host LA DevOps meetups for our post covid revival. The food and drink are great and the staff are very friendly. O'brien's is also the LA home of Manchester United Football Club Supporters.
You may want to bring a jacket for the cooler months.
Regarding parking, there are meters on Wilshire and the side streets that expire at 6.

**Hangout at Code and Cocktails Santa Monica at Obrien's on Most Friday Nights:**
The [Santa Monica Code and Cocktails ](https://www.meetup.com/code-and-cocktails/)meetup is a great informal tech meetup that meets at Obrien's on most Friday nights. Join their page on meetup.com and discord channel to keep up on their meetups.

**Present at an Upcoming LA DevOps Meetup:**

If you would like to present at an upcoming LA DevOps meetup please send a message in meetup to the organizers with a proposed title and a sentence or two about the talk.

**Subscribe to the LA DevOps Meetup Calendar at [lu.ma](http://lu.ma%2A%2A/)**

The LA DevOps events are also listed on [lu.ma](http://lu.ma/) which has an interesting interface. Subscribe to LA DevOps on [lu.ma](http://lu.ma/) at [https://lu.ma/calendar/cal-F7BPqBLAe80T5nS](https://lu.ma/calendar/cal-F7BPqBLAe80T5nS)

Jordan Schwartz

Rich Horace

LA DevOps

Technology

Linux

Open Source

New In Town

System Administration

Software Development

Social Networking

New Technology

Internet Professionals

Cloud Computing

Web Development

Professional Networking

Software Engineering

Configuration Management

DevOps

llm-d: Making AI a First-Class Citizen in Modern Infrastructure / AI Decentered

AI Algorithms

Machine Learning

O'Briens Irish Pub

Share

llm-d: Making AI a First-Class Citizen in Modern Infrastructure / AI Decentered

LA DevOps

Details

Members are also interested in