Solving the challenges of using LLMs in production with financial services data


Details
If you are building NLP pipelines for processing financial services data, you will know how hard it can be to manage vector databases in production, reliably process large tables, and evaluate your LLM performance for reliability and accuracy.
At this event during London Tech Week, we’re delighted to have three amazing experts share their cutting edge expertise:
-
Topic: Solving the challenges of scaling vector databases in production.
Speaker: JP Hwang from Weaviate
His talk and demo will cover advanced topics such as quantization, model selection and database sharding. -
Topic: Solving the challenges of handling doing RAG on top of financial data.
Speaker: Pierre-Loic Doulcet from LlamaIndex
His talk and demo will cover new techniques for better handling of financial data with a focus on tabular data and charts. -
Topic: Solving the challenges of experimentation and evaluation of LLMs for production.
Speaker: Ryan McConville from Weights & Biases
His talk and demo will cover approaches for LLM experimentation and evaluation.
By the end of the meetup we will have gained practical, actionable insights and takeaways that can accelerate development and deployment of NLP in production.
Schedule
18.00: Doors Open
18:00-18.30: Networking (food, drink)
18.30-20.00: Talks
20.00-21.00: More networking
Extra special thanks to our sponsors and speakers:
- AutogenAI for co-organising and providing the amazing venue
- Weaviate for generously sponsoring food & beverages
- Weights & Biases for running a fun competition with prizes during the event
About the speakers
JP Hwang is a developer, tech educator, and communicator at Weaviate. He aims to ensure that learning is fun and empowering for both sides. To this end, he brings a combination of technical expertise, empathy, and commitment, whether it’s through hands-on coding projects or engaging and informative talks.
Pierre-Loic Doulcet is a Founding AI Engineer at LlamaIndex, and a Stanford Codex Affiliate.
Ryan McConville is a Senior Machine Learning Engineer at Weights & Biases, where he helps customers to implement best practices and improve their machine learning workflows. He has a PhD in Machine Learning and was a Senior Lecturer in Machine Learning and AI at the University of Bristol. He has published over 60 peer-reviewed papers in AI across a range of applications and approaches.

Solving the challenges of using LLMs in production with financial services data