Making stream processing scale; Docker and Kubernetes + full text search

Hosted by Paris In-Memory Computing Meetup

Public group

This is a past event

26 people went

Location image of event venue


Join us 21 February for the inaugural gathering of the Paris In-Memory Computing Meetup!

Cocktails, beer and wine will be served -- along with a sumptuous hot buffet and a raffle for a raffle for a €300 Amazon gift card. This free event is sponsored by GridGain Systems. The address is:
PARIS, Spaces La defense
Le Belvédère
1-7 cours Valmy

You can register for the raffle here:

> Courtney Robinson, CTO of Hypi (
> Chris Jenkins, senior director of in-memory technology at Oracle
> GridGain technology evangelist Akmal Chaudhri
Talk 1
>> “Scalable Full Text Search with Apache Ignite,” Courtney Robinson, CTO of Hypi.

Summary: Many modern applications provide full text search as a core feature of the overall product. There are good open source and commercial options available already, but what if all your data is in Apache Ignite? Do you really need to pull in another system to solve this problem?

The short answer is no. Ignite has built in support for fulltext indexing of content. If you use the SQL APIs there is an off the shelf option which just works and suits many use cases. If you use the key value APIs this is less true.

At Hypi we make heavy use of the key value APIs and we needed even more than what the SQL APIs had to offer. In this talk, we'll have a look at how Ignite enables you to build full text search and how Hypi's implemented (in 1 class), full text search support with boolean logic, phrase, keyword matches and more. The end solution delivers same features available in popular open source search technologies with Ignite's scalability and very little storage overhead.

Talk II
>> “Running TimesTen Scaleout in Docker and Kubernetes,” Chris Jenkins, senior director of in-memory technology at Oracle.

Summary: In this talk I will give a brief overview of TimesTen Scaleout and then explain how to deploy a Scaleout environment using Docker and Kubernetes. I will present a concrete example based on Oracle Cloud and Container Engine For Kubernetes; this will include a live demo. The techniques that I will illustrate are not specific to Oracle Cloud and can easily be adapted to any Kubernetes / Docker environment including on premises, private cloud etc.
* * *
>> Talk III
"Best practices for stream processing at scale," GridGain technology evangelist Akmal Chaudhri.

Summary: Making stream processing scale requires making all the components (messaging, processing and storage) scale together. Easier said than done. Until now. Akmal will share some of the best practices companies have used for making Apache Kafka and Apache Ignite scale.

Apache Kafka is a community distributed streaming platform capable of handling trillions of events a day. Apache® Ignite™ is a memory-centric distributed database, caching, and processing platform for transactional, analytical, and streaming workloads delivering in-memory speeds at petabyte scale.

During his talk, Akmal will provide:
* Working examples of how Ignite and Kafka are used together
* Recommended approaches for deployment, monitoring and management
* Tips and tricks for performance and scalability tuning
* Answers to your questions