Applied GenAI: A Real-World Story of Shipping Software Products

In this talk, our speaker will be sharing their real-world journey of applying Azure OpenAI Models such as GPT-3.5-Turbo and GPT-4 to both customer-facing applications and internal use cases. This will include a discussion of the actual challenges faced, the steps taken to achieve a production-ready implementation and what lies ahead.

This talk will cover:

1. The problem statement and the challenges faced by the Presenter and his team in the fast-moving AI space
2. Guardrail specifications, prevention of prompt injection attacks, dataset pre-processing capability and pipeline, decisions on the right custom dataset and the technology used for indexing, querying, and updating content datasets
3. The technology stack used and it's architecture
4. The App capabilities used for a conversational assistant, such as response streaming, response retries, response formatting, user feedback per assistant response and Evaluation flows
5. The tooling used, the infrastructure setup, application and penetration testing, load and performance testing, and more.

Your speaker tonight is local community member Vin Kamat, a Principal Architect at H&R Block. Vin is based in Houston and will be presenting in-person!

Agenda

• 5:30pm Food served, pre-Meetup chit-chat for those in-person
• 6:00pm Meetup Starts: Welcome, Introductions, Announcements
• 6:15pm Applied GenAI in the Real-World
• 7:30pm Q&A
• 8:00pm Conclude

Food and soft drinks will be served at ~5:30pm on the 10th floor - we will kick off the discussion there ~6pm after everyone has had a chance to eat, meet anyone else you'd like to and have a chat :-). Feel free to start arriving from 5pm on if you are nearby. PLEASE RSVP so we have an accurate food count.

PARKING: For free parking please park across the street on the third and fourth floors of the parking garage at 12711 Queensbury; parking in the Microsoft building is not free

In-person: 750 Town and Country Blvd #1000 · Houston, TX
Virtual Live-Stream: Join the meeting now
Recording: https://www.youtube.com/@HoustonAzureUserGroup