Name: Develop a Private GenaAI Q&A Systems using Dolly, Spark, MongoDB & Dataworkz
Start: 2023-08-01T16:00:00-07:00
End: 2023-08-01T19:00:00-07:00
Location: FalconX Incubator

This talk and workshop will show you how to create and privately host an LLM to power a Q&A system like ChatGPT.

In this workshop, you will learn how to assemble a Generative AI stack to power an LLM for the purpose of building a Q&A system from data stored in your own database (ex: MongoDB Atlas). In the workshop portion of the session, you will build your own Q&A system on top of MongoDB in less than 30 minutes.

What we will cover:

* Pre-processing of your data - Get it into a shape where it can be used by LLMs (For the purpose of the workshop, you will have access to pre-processed data).
* Create chunks and embeddings.
* Store chunks in MongoDB Atlas for fast retrieval and search.
* Store embeddings in a vector database, such as MongoDB Vector Search.
* Privately hosted LLM.
* Use commercially available open-source models like Dolly, ChatGPT, etc. in a private VPC.

Takeaways from this session include:

* How to assemble and operationalize a Q&A system using open-source LLMs
* Data quality impacts the LLM response
* How to rapidly experiment with different LLM models for your specific use case

Links to resources:

* [Dolly](https://huggingface.co/databricks/dolly-v2-12b)
* [ChatGPT](https://chat.openai.com/)
* [Apache Spark](https://spark.apache.org)
* [MongoDB Atlas Vector Search](https://www.mongodb.com/developer/products/atlas/semantic-search-mongodb-atlas-vector-search/)
* [Dataworkz](https://www.dataworkz.com/product/)

Agenda:
4:00 pm Registration, Networking & Coffee
4:15 pm Intro to Generative AI
4:45 pm Demo
5:00 pm Hands on workshop
5:30 pm Pizza and beverages
6:00 pm Wrap-up

Speakers:
\- Nikhil Smotra\, CTO\, Dataworkz
\- Dave Nielsen\, Head of Community\, MongoDB

About Nikhil
*Nikhil is driven by the potential for innovation and really excited about leveraging advanced technologies such as artificial intelligence, especially LLMs and applying them to extract valuable insights from customer data. Nikhil’s robust experience working with data management at scale led him to co-found Dataworkz. His vision is to create self-service experience that brings together -- data, transformation and AI applications -- for users of different skill levels.*

*Prior to Dataworkz, Nikhil worked as SVP, Head of Data Engineering at iQor, a leader in BPO and Product Support, where he led development and management of BigData platforms. Nikhil helped launch the enterprise data initiative and built a high-performing global data engineering team. During his tenure at iQor, Nikhil also managed QeyMetrics – a Business Intelligence and Operational Analytics SaaS offering. Nikhil spent several years at Lockheed Martin(R&D) where he harnessed the potential of NoSQL technology, prior to it gaining popularity, and used it along with semantic web technologies to build a massively scalable Digital Archive with automated data preservation, curation and classification.*

*Nikhil is an executive alumnus of Haas School of Business, UC Berkeley (Data Science and Analytics Program) and holds a B.E in Computer Science from University of Pune, India. Nikhil also served on Advisory Board of Rutgers University’s BigData certificate program for executives from 2018-2022.*

Dave Nielsen (Big Data)

Silicon Valley GenAI

Technology

Social Networking

New Technology

Web Development

Cloud Computing

NoSQL

Database Professionals

Database Development

Artificial Intelligence

Generative Design

Develop a Private GenaAI Q&A Systems using Dolly, Spark, MongoDB & Dataworkz

AI/ML

Machine Learning

Big Data

Data Science

MongoDB

FalconX Incubator

Share

Silicon Valley GenAI

Develop a Private GenaAI Q&A Systems using Dolly, Spark, MongoDB & Dataworkz

Silicon Valley GenAI

Details

Members are also interested in