Elastic x Apache Kafka®

IMPORTANT PLEASE RSVP @ https://www.meetup.com/washington-dc-elastic-fantastics/events/312487028/?eventOrigin=group_upcoming_events

***
Agenda:

• 5:30 pm: Doors open; say hi, grab a seat, and eat some food.
• 6:00 pm: Talk 1
• 6:30 pm: Q&A
• 6:40 pm: Talk 2
• 7:10 pm: Q&A
• 7:20-7:30 pm: Networking & refreshments

Sandon Jacobs, Sr. Developer Advocate
Streaming Context: Powering Semantic Search with Kafka and Elasticsearch

As the de facto platform for event streaming, we’ve seen how data from Apache Kafka can easily empower basic keyword search. But let's be real, modern semantic search applications need context to interpret the real meaning and intent of a user's query. We could wait around for the next batch job to kick off and provide that context... or we could serve it up in near real-time right from our data streams.

In this talk, we'll discuss how to leverage data streams from Kafka to power much smarter semantic search with Elasticsearch. We’ll follow a simple event from a Kafka topic and see how it transforms into a powerful vector embedding. Then, we’ll see this whole flow in action using a k-Nearest Neighbor search to instantly find similar items in milliseconds.

While my code examples will be in Java or Kotlin using the Spring Boot and Spring AI ecosystem, FEAR NOT! The core concepts—getting data into a vector format via a stream—are totally language agnostic. Join us to grab a few practical ideas you can take and use in your next project!