Building GenAI Products with Sensitive Data: A Production-ready Approach

## About this talk

Sensitive data is the lifeblood of many industries, guiding strategic decisions and driving growth. However, with the advent of Generative AI (GenAI), managing and exploiting this data has become increasingly complex. Balancing innovation with compliance, scalability, and security is no easy task.
While building a proof of concept (PoC) based on public APIs is one thing, creating an actionable GenAI product—especially with sensitive data—is an entirely different challenge.

ABOUT THE EVENT
Building GenAI Products with Sensitive Data: A Production-ready Approach
Date: 05.02.2025
Time: 18:00 - 20:00 CET
Agenda:

• 18:00 - Arrival & networking
• 18:10 - Welcome note ProductTank Heidelberg
• 18:20 - First talk about EU AI-Act und Trustworthy AI - Ingo Macht (SAS)
• 18:50 - Keynote presentation & Q&A - Christoph Hiemenz, Julia Morstadt
• 19:40 - Closing words & networking (optional)

Organizations face critical questions such as:

• How do I choose the right GenAI model and determine the best hosting solution (on-prem/cloud) for my needs?
• What best practices will ensure fast, scalable, and cost-effective deployment of LLMs on my infrastructure?
• How do I create added value with my GenAI system without frustrating my users?
• How can I systematically evaluate and optimize Generative AI applications end-to-end?
• How do GenAI products differ from traditional software and classical AI products in terms of development and deployment?
• How can I ensure product safety and regulatory compliance while addressing hallucinations and privacy?

Join our upcoming talk as we explore these questions and provide practical strategies for using GenAI in sensitive data environments. Christoph Hiemenz, Senior Data Scientist at CBTW, will share real-world case studies and reveal the frameworks necessary to transition from AI projects to impactful AI products, even when dealing with sensitive data.

Key takeaways:

• ROI on AI Products: How to create sustainable business value with AI products
• GenAI Compliance: Key considerations (GDPR, EU AI Act, etc.)
• Cost-effective AI systems: Ensuring fast, scalable, and cost-efficient LLM deployment
• Creating and maintaining high-quality AI: End-to-end optimization of GenAI products
• Client Case Studies: Practical insights on RAG (Retrieval Augmented Generation) in the Banking and Financial Services Industry