Samuel Jaja - AI Observability as the Engine of Production-Ready AI
Details
LeedsSharp are proud to present Samuel Jaja in "From Black Box to Glass Box: Systems Thinking & Observability as the Engine of Production-Ready AI"
Abstract:
Observability is not an afterthought in AI systems. It is how you build them.
Using a real multi-agent financial compliance system as the case study, I walk through what observability actually looks like inside a production AI pipeline: five specialized agents handling OFAC sanctions screening, AML detection, and regulatory rules enforcement, with every agent decision captured in an immutable Langfuse audit trail showing token usage, latency, cost, and data lineage in real time.
The talk covers three architecturally distinct ways to build the same system: raw SDK with custom parallel orchestration using asyncio, the OpenAI Agents SDK for rapid prototyping, and MCP (Model Context Protocol) for exposing tools across team and organisational boundaries. Each trades differently, and knowing which to reach for is the real engineering skill.
Attendees will leave with a clear mental model for when multi-agent architecture is genuinely necessary (not just fashionable), why observability is the feedback loop that compresses build-debug-ship cycles, and how Azure OpenAI changes the calculus when data sovereignty and auditability are non-negotiable in regulated industries.
Bio:
Samuel Jaja is a Generative AI Engineer at Capgemini UK. He founded PyData Hull, the youngest NumFOCUS chapter in Yorkshire, holds an MSc in AI and Data Science with Distinction from the University of Hull, and is the founder of Atlasync AI Ltd. He spoke at DDD North 2026 and builds production AI systems across regulated industries, including finance, energy, and construction.
PLEASE NOTE WE ARE MEETING AT A NEW VENUE!!
Access Details Please go to the Enablis offices, they are on the first floor of the building, both front door and office doors should be open. If there is a problem then press the buzzer. We will meet at 6pm for pizza and drinks, the talks will start at 7. Some of us go to the either the editors draft pub afterwards at 8pm (vote to be taken).
