Skip to content

Details

Think your LLM application is secure and reliable? Let's put it to the test!
Join us for a live hands-on demo and retrospective on AI Red Teaming, where we'll explore how to identify vulnerabilities, stress-test LLM applications, and strengthen their security using open-source tools like Giskard and Garak.

### In this session, you'll learn:

  • How to perform red teaming on an LLM application from scratch.
  • How to use Giskard and Garak to stress-test LLM applications.
  • Why you can't always blindly trust an LLM judge when evaluating model outputs.
  • How to harden prompts against role-play exploits and potential vulnerabilities.
  • How to automate local regression testing to improve the reliability and security of LLM applications.
  • Practical lessons learned and challenges encountered while testing and securing an LLM-powered bot.

This is a practical, hands-on session featuring a live demonstration and real-world lessons learned. You'll gain insights into identifying LLM vulnerabilities, improving prompt security, and building more robust AI applications.
šŸ”¹ Format: Live Hands-on Demo + Retrospective + Q&A
šŸ”¹ Presenter: Sai Thummala
šŸ”¹ Tools Covered: Giskard and Garak
šŸ”¹ Who's it for: AI engineers, developers, ML engineers, security enthusiasts, and anyone interested in building secure and reliable LLM applications.
šŸ”¹ Takeaway: A practical understanding of LLM red teaming, prompt hardening, vulnerability testing, and automated regression testing using open-source tools.

Related topics

Machine Learning
High Scalability Computing
Data Science
New Technology
Web Technology

Sponsors

Cerebrone AI

Cerebrone AI

Cerebrone AI provides Gen AI consulting solutions

You may also like