DoK Town Hall | Your Object Store is Your VectorDB

Join us for the Data on Kubernetes Town Hall on July 17th. We host monthly town halls to feature use cases and advancements in the DoK ecosystem.

AGENDA
[10:00 AM]
Welcome and Community Updates
Presented by Paul Au, Head of Community

[10:05 AM]
Speaker:
Yuval Lifshitz, Senior Technical Staff Member, IBM

Title:
Your Object Store is Your VectorDB

Description:
Object storage allows for large amounts of your organization's data to be stored at low cost. But, is this unstructured data searchable? Could you use it for your AI/ML applications without duplicating it at a high cost of compute and space? Or is the data accessible only to the applications that use it in the first place?

Can we get the best of both worlds?

In this talk we present an innovative approach where we use existing CNCF projects to create a data pipeline that does exactly that, at minimal cost.

We will show how data governance complexity of your AI systems could be simplified by existing mechanisms of the object store.
We would use the Ceph storage system orchestrated by the Rook operator as our object store. knative as our serverless framework to do the vector embedding of the data and Milvus as the vectordb.