Name: Talk Series: Event Streaming with Mantis & Scaling Computations with Ray
Start: 2024-03-27T18:00:00-07:00
End: 2024-03-27T20:00:00-07:00
Location: Writing Lab

Whether you're a seasoned data engineer or just starting out, this event will provide valuable insights and practical tips on the work we do. Come network and hear from like-minded professionals in the Bay Area who are passionate about all things data engineering!

**Title:** Scaling Embedding Computations for RAG apps with Ray
**Speaker:** Cheng Su, Ray Data Lead Engineer @ Anyscale
**Abstract:** Developing a Retrieval Augmented Generation (RAG) app requires an integration of multiple components, including the LLM, a vector database, and embeddings from very large datasets. The embedding process involves distributed read of numerous documents, chunking and tokenizing them, using an embedding model to compute embeddings (on multiple GPUs), and upserting embeddings into the vector DB.

We will introduce Ray Data, an open-source, distributed ML data processing library, that enables building data pipelines to generate 1 billion embeddings in under a day with a limited budget. We'll cover Ray Data basics, its application to scalable data ingestion for RAG apps, managing heterogeneous clusters (CPU and GPU), throughput optimization, and pipeline design choices.

**Title:** Mantis: Stream processing for operational data
**Speaker:** Sundaram Ananthanarayanan, Senior Software Engineer @ Netflix and Harshit Mittal, Senior Data Engineer @ Netflix
**Abstract:** TBA

\-\-\-

*Data Engineer Things, founded by Xinran Waibel, is a global online data engineering community for data professionals to connect and learn. Join us to grow together!*

Slack: [http://join.det.life](http://join.det.life)
Medium: [https://blog.det.life](https://blog.det.life)
Youtube Channel: [https://www.youtube.com/@data-engineer-things/streams](https://www.youtube.com/@data-engineer-things/streams)
Newsletter: [https://dataengineerthings.substack.com/](https://dataengineerthings.substack.com/)

By attending this meetup, you agree to abide by our [Code of Conduct](https://docs.google.com/document/d/1vcvPwERVPx_RqFHNWgBqEZBufnp-7crSwAy1TvukAE0/edit?usp=sharing). Failure to comply with our CoC may result in removal from current and future DET events.

\-\-\-

Special thanks to [Datastrato](https://datastrato.ai/) and [Real-Time Analytics Summit](https://www.rtasummit.com/) for sponsoring this meetup.

Hao Xu

Lisa N. Cao

Data Engineer Things Bay Area Meetup

Technology

Open Source

Database Engineers

Data Science

Machine Learning

Big Data

Data Engineering

Software Engineering

Talk Series: Event Streaming with Mantis & Scaling Computations with Ray

Writing Lab

Share

Data Engineer Things Bay Area Meetup

Talk Series: Event Streaming with Mantis & Scaling Computations with Ray

Data Engineer Things Bay Area Meetup

Details

Members are also interested in