PyLadies San Francisco Virtual Workshop

Virtual Workshop: Advanced Safeguarding for AI Inference Pipelines

OpenAI recently received a court order to retain output logs, highlighting that AI privacy can no longer be an afterthought, it must be front and center when deploying AI workloads.

However, privacy in AI is still evolving, with much of the focus currently on training-time privacy and far less attention paid to privacy during inference. As we begin scaling prototypes into production-ready systems, it is essential to analyze our workflows and intentionally integrate privacy-preserving techniques.

In this workshop, we will focus on practical use cases for building AI applications, explore what can go wrong, and experiment with various privacy-enhancing methods tailored to different use cases.

In this workshop, you will learn:
1. The basics of LLMs and how production-ready applications are built using them
2. The various privacy risks that can arise when using LLMs
3. A conceptual overview of privacy-preserving techniques: Differential Privacy, Federated Learning, and Homomorphic Encryption
4. How to build an AI pipeline that includes integrated privacy safeguards
The session will include live demos and self-paced exercises. Attendees should be comfortable
with Python

Tentative Agenda

6:00 pm: Intro
6:05 pm: Community Announcements
6:15 pm: Workshop
6:50 pm: Q&A
7:00 pm: Community Announcements
7:10 pm: Networking and Debrief
7:30 pm: End