Applied GenAI: A Real-World Story of Shipping Software Products
Details
In this talk, our speaker will be sharing their real-world journey of applying Azure OpenAI Models such as GPT-3.5-Turbo and GPT-4 to both customer-facing applications and internal use cases. This will include a discussion of the actual challenges faced, the steps taken to achieve a production-ready implementation and what lies ahead.
This talk will cover:
- The problem statement and the challenges faced by the Presenter and his team in the fast-moving AI space
- Guardrail specifications, prevention of prompt injection attacks, dataset pre-processing capability and pipeline, decisions on the right custom dataset and the technology used for indexing, querying, and updating content datasets
- The technology stack used and it's architecture
- The App capabilities used for a conversational assistant, such as response streaming, response retries, response formatting, user feedback per assistant response and Evaluation flows
- The tooling used, the infrastructure setup, application and penetration testing, load and performance testing, and more.
Your speaker tonight is local community member Vin Kamat, a Principal Architect at H&R Block. Vin is based in Houston and will be presenting in-person!
Agenda
• 5:30pm Food served, pre-Meetup chit-chat for those in-person
• 6:00pm Meetup Starts: Welcome, Introductions, Announcements
• 6:15pm Applied GenAI in the Real-World
• 7:30pm Q&A
• 8:00pm Conclude
Food and soft drinks will be served at ~5:30pm on the 10th floor - we will kick off the discussion there ~6pm after everyone has had a chance to eat, meet anyone else you'd like to and have a chat :-). Feel free to start arriving from 5pm on if you are nearby. PLEASE RSVP so we have an accurate food count.
PARKING: For free parking please park across the street on the third and fourth floors of the parking garage at 12711 Queensbury; parking in the Microsoft building is not free
In-person: 750 Town and Country Blvd #1000 · Houston, TX
Virtual Live-Stream: Join the meeting now
Recording: https://www.youtube.com/@HoustonAzureUserGroup