Augmenting PromptOPS:Comprehensive Framework for Input-Output Guardrails in LLMs

To access this webinar, please register here: https://hubs.li/Q024Z12d0

Topic: "Augmenting PromptOPS with Partner Products: A Comprehensive Framework for Input-Output Guardrails in Large Language Models"

Speaker: Dr. Sanjay Basu, Senior Director – AI/ML at Oracle Cloud Engineering

Dr. Basu is a highly accomplished leader with superior strengths in setting technology direction, managing customer relationships, managing large, diverse teams and delivering results. He is an industry-recognized Artificial Intelligence / Machine Learning / Quantum Computing subject matter expert.

Abstract:
In recent years, the deployment of Large Language Models (LLMs) in enterprise environments has surged, providing unprecedented capabilities for natural language understanding and generation. However, the governance of these models, particularly in terms of controlling and ensuring the quality and security of input-output operations, remains a critical concern.

In this session, we introduce a robust framework, developed at Oracle, for augmenting PromptOPS, a prominent orchestration system for LLMs, with integrated solutions from our strategic partners. Our approach involves encapsulating LLMs within a well-defined boundary of operational guardrails, helping to safeguard the integrity, confidentiality, and accountability of data processed through these models. We demonstrate the modular integration of partner products to provide a suite of pre-processing and post-processing tools, that can support sanitized input and output, robust error handling, and compliance with regulatory standards.

Through extensive evaluations, we exhibit the efficacy of our framework in maintaining the desired operational guardrails while enabling enhanced functionality and scalability in deploying LLMs across various enterprise use-cases. Our contributions present a significant stride towards establishing a secure and controlled operational environment for LLMs, fostering their broader adoption in critical enterprise applications.

ODSC Links:
• Get free access to more talks/trainings like this at Ai+ Training platform:
https://hubs.li/H0Zycsf0
• ODSC blog: https://opendatascience.com/
• Facebook: https://www.facebook.com/OPENDATASCI
• Twitter: https://twitter.com/_ODSC & @odsc
• LinkedIn: https://www.linkedin.com/company/open-data-science
• Slack Channel: https://hubs.li/Q026R01W0
• Code of conduct: https://odsc.com/code-of-conduct/