One Does Not Simply Query a Stream | Elastic Meetup in Stockholm

Join us on Tuesday, June 10th for a new meetup with the Elastic Stockholm User Group!

We'll meet each other at Foo Café: doors open at 18.00 and we'll serve pizza and drinks. Presentations begin at 18.30. We wrap up at 20.15.

Address: Foo Café, Internetstiftelsen i Sverige, Hammarby Kajgata 10D, 120 30 Stockholm (website)

Agenda:
18.00 Doors open
18.15 Welcome, pizza and drinks
18.30 One Does Not Simply Query a Stream
19.15 Elastic talk
20.00 Q&A
20.15 Wrap up

Talks:
One Does Not Simply Query a Stream
Streaming data with Apache Kafka® has become the backbone of modern applications. While streams are ideal for continuous data flow, they lack built-in querying capabilities. Unlike databases with indexed lookups, Kafka’s append-only logs are designed for high-throughput processing—not for on-demand queries. This necessitates additional infrastructure to query streaming data effectively.Traditional approaches replicate stream data into external stores: relational databases like PostgreSQL for operational queries, object storage like S3 accessed via Flink, Spark, or Trino for analytics, and Elasticsearch for full-text search and log analytics. Each serves a purpose—but they also introduce silos, schema mismatches, freshness issues, and complex ETL pipelines that increase system fragility.In this session, we’ll explore solutions that aim to unify operational, analytical, and search workloads across real-time data. We'll demonstrate stream processing with Kafka Streams, Apache Flink®, and SQL engines; real-time analytics with Apache Pinot® and ClickHouse; search capabilities with Elasticsearch; and modern lakehouse approaches using Apache Iceberg® with Tableflow to represent Kafka topics as queryable tables. While there's no one-size-fits-all solution, understanding the tools and trade-offs will help you design more robust and flexible architectures.

Speaker: Viktor Gamov, Principal Developer Advocate, Confluent

Elastic talk tbc
Speaker: Eric Westberg (Principal Solution Architect, Elastic)