Name: Every Shard Deserves a Home - Deep Dive into Shard Allocation in Elasticsearch
Start: 2016-02-09T18:30:00+01:00
End: 2016-02-09T21:30:00+01:00
Location: Crowne Plaza

Hi all,

After a few great user stories meetup it's time for a deep dive into shard allocation in Elasticsearch. Our next meetup will be just before Elastic{ON} and will coincide with an Amsterdam training - meaning we'll hopefully see some new faces.

The talk will be given by me this time (abstract bellow). As always we'll start with some drinks and snacks at 18:30. Talk start on 19:00.

Cheers,

Boaz

Every Shard Deserves a Home - Shard Allocation in Elasticsearch

This talk is about the journey of a shard in Elasticsearch. It will cover the mechanics and the reasons for how ES decides to allocate shards to nodes and how those decisions are executed.

We will start with the assignment of new shards, conforming to the current Allocation Filtering, disk space usage and other factors. Once shards are started, they may be needed to be moved around. This can be due to a cluster topology change, data volumes or when someone instructed ES to so through the index management APIs.

We will cover these triggers and how ES executes on those decisions, moving potentially tens of gigabytes of data from one node to another, without dropping any search or an indexing request. We will finalize with the mechanics of full/rolling cluster restarts and the recent improvements such as synced flush, delayed assignment on node leave and cancelling ongoing relocations if a perfect match is found.

As always there will be ample room for Q&A about practically anything.

Boaz Leskes

Elastic Netherlands User Group

Elastic

Technology

Software Development

Distributed Systems

NoSQL

Elasticsearch

Cloud Computing

Every Shard Deserves a Home - Deep Dive into Shard Allocation in Elasticsearch

Crowne Plaza

Share

Elastic Netherlands User Group

Every Shard Deserves a Home - Deep Dive into Shard Allocation in Elasticsearch

Elastic Netherlands User Group

Details

Members are also interested in