Skip to content

Conversation

@joegallo
Copy link
Contributor

@joegallo joegallo commented Mar 4, 2021

Related to #63026

Also some changes to the docs so that max_primary_shard_size is advertised a little more.

@joegallo joegallo added :Data Management/ILM+SLM Index and Snapshot lifecycle management v8.0.0 v7.13.0 labels Mar 4, 2021
@joegallo joegallo requested a review from dakrone March 4, 2021 19:29
@elasticmachine elasticmachine added the Team:Data Management Meta label for data/management team label Mar 4, 2021
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-core-features (Team:Core/Features)

Copy link
Member

@dakrone dakrone left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@joegallo
Copy link
Contributor Author

joegallo commented Apr 8, 2021

elastic/beats#25000 will switch elastic/beats over to max_primary_shard_size, too.

@joegallo
Copy link
Contributor Author

joegallo commented Apr 8, 2021

logstash-plugins/logstash-output-elasticsearch#1008 covers switching logstash over.

ph added a commit to elastic/beats that referenced this pull request May 31, 2022
* Use max_primary_shard_size instead of max_size

Based on change from elastic/elasticsearch#69995

Users are having a hard time to have the "right sized shards" (~50gb),
but they also need to adjust the number of primaries to keep up with the
ingest load. This doesn't well with the `max_size` option but it should
work nicely with the newly introduced `max_primary_shard_size`.

This change the default ILM policy shipped with beats.

* Fix the test suite
chrisberkhout pushed a commit to elastic/beats that referenced this pull request Jun 1, 2023
* Use max_primary_shard_size instead of max_size

Based on change from elastic/elasticsearch#69995

Users are having a hard time to have the "right sized shards" (~50gb),
but they also need to adjust the number of primaries to keep up with the
ingest load. This doesn't well with the `max_size` option but it should
work nicely with the newly introduced `max_primary_shard_size`.

This change the default ILM policy shipped with beats.

* Fix the test suite
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

:Data Management/ILM+SLM Index and Snapshot lifecycle management >enhancement Team:Data Management Meta label for data/management team v7.13.0 v8.0.0-alpha1

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants