LLMs @ Coinbase - the journey from prompt engineering to AI agents

Explore Coinbase's journey of using LLMs to enhance customer experience and improve employee productivity.

Coinbase built an internal platform: “CB-GPT” to enable LLM applications. It provides easy access to LLM of your choice, evaluation frameworks, guardrails, knowledge bases, RAG, internal tooling and API for developers.

The presentation delves into the journey of developing LLM applications for both internal and external use cases. Starting with simple prompt engineering and RAG and developing into large AI agent flows to accommodate scale and personalization needs.