Skip to content

Details

TOPIC:Fulfilling your LLM Deployment dreams
Join us for a virtual session featuring Aaron Ansari, Managing Partner at Answer Consulting Inc., with insights into deploying LLMs in real world environments, followed by live Q&A and community discussion.

ABSTRACT: As organizations rush to integrate Large Language Models (LLMs) into their core business processes, they face a critical dilemma: embrace the 66% productivity boost offered by generative AI or mitigate the serious risks of data exfiltration and "shadow AI". This session provides a dive into the technical foundations of a robust generative AI system, moving beyond basic chat interfaces to a comprehensive enterprise architecture.

We will explore the flegdling LLM Stack, identifying critical trust boundaries between organizational tenants and the public internet. Attendees will learn:

  • The Risk Landscape: An analysis of top threats including prompt injection (OWASP LLM01), insecure output handling, and training data poisoning.
  • Architectural Defenses: How to implement Retrieval-Augmented Generation (RAG) to maintain data accuracy and avoid the security pitfalls of fine-tuning on sensitive PII.
  • Data Governance: Strategies for applying fine-grained access controls and role-based accounting to vector databases to ensure that AI only serves information to authorized users.
  • Operational Security: A "layered onion" approach to security, from model hyperparameter tuning to outer-layer rate limiting and semantic caching.

Leave this session with a foundational framework for deploying AI that is not only innovative but also compliant, secure, and resilient.

CODE OF CONDUCT
We hope you enjoy the event, we care deeply about inclusivity and diversity so that OWASP is a comfortable and welcoming community for everyone. Please reach out to one of our chapter leaders if you have any feedback/concerns or would like to speak to us, we take these matters very seriously. You can find out more about our policies here:
https://owasp.org/www-policy/operational/conferences-events.html#conference-and-event-anti-harassment-policy

SPONSORSHIP Opportunities Available
*Vendors interested in sponsoring please send an email to sponsorship.la@owasp.org*

AI summary

By Meetup

Online OWASP LA monthly virtual session for security practitioners and AI teams to learn robust LLM deployment and a framework for compliant, secure AI.

Related topics

Computer Security
OWASP
Web Security
Ethical Hacking
Software Development

Sponsors

OWASP - LA

OWASP - LA

sponsorship.la@owasp.org

Kodem

Kodem

Helping AppSec Teams Make Security a Priority

Semgrep

Semgrep

Protect your code with secure guardrails

Fastly

Fastly

Create fast, secure, and scalable sites and apps

You may also like