Skip to content

Conversation

@idegtiarenko
Copy link
Contributor

Backports the following commits to 8.8:

When reconciling a balance with a lot of shards on undesired nodes there is a
possibility of causing node hot spots due to usage of
nodeInterleavedShardIterator. This iterator orders shards based on nodes they
are located and order nodes based hash map iteration. This means it tends
to pick shards returned first by the iterator. This change uses OrderedShardsIterator
that applies custom shards order based on allocation recency.

(cherry picked from commit 6ecd74d)
@idegtiarenko idegtiarenko added >bug :Distributed Coordination/Allocation All issues relating to the decision making around placing a shard (both master logic & on the nodes) backport Team:Distributed (Obsolete) Meta label for distributed team (obsolete). Replaced by Distributed Indexing/Coordination. v8.8.0 labels May 16, 2023
@idegtiarenko idegtiarenko merged commit a4e59ae into elastic:8.8 May 16, 2023
@idegtiarenko idegtiarenko deleted the backport/8.8/pr-95454 branch May 16, 2023 12:35
@gmarouli gmarouli removed the v8.8.1 label May 17, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport >bug :Distributed Coordination/Allocation All issues relating to the decision making around placing a shard (both master logic & on the nodes) Team:Distributed (Obsolete) Meta label for distributed team (obsolete). Replaced by Distributed Indexing/Coordination. v8.8.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants