MI.NET — Dev J. Shah - Cosine Similarity with Azure AI Search & Azure AI Foundry
Details
Agenda
- 5:30 - 6:30pm Networking
- 6:30 - 7:30pm Presentation
- 7:30 - 7:45pm Closing
Abstract
Retrieval-Augmented Generation (RAG) has quickly become one of the most practical approaches for building AI applications, yet many developers treat it as a “black box.” In this talk, I peel back the layers and dive into the math and mechanics that make RAG work.
I begin with a brief overview of RAG and then focus on its two core components: embeddings stored in a vector database and the retrieval of relevant data using cosine similarity. I explain how text is transformed into embeddings, which are arrays of numbers that capture semantic meaning, and compare different methods of generating embeddings, highlighting why vector representations are essential in this context.
Next, I explore cosine similarity as the retrieval mechanism. By plotting embeddings in a 3D graph, I show how measuring the angle (cos θ) between vectors determines relevance.
Finally, I walk through a live coding demo to build a simple RAG pipeline, showing how embeddings are stored in a vector database and retrieved in real time.
Bio
Dev is a detail-oriented Software Engineer and GenAI Evangelist passionate about building scalable, cloud-based applications and AI-powered solutions. With a strong focus on engineering best practices and client collaboration, he delivers tailored solutions that meet unique needs. He channels that same passion into helping developers adopt GenAI technologies through technical blogs, videos, and conference talks.
