Skip to content

Conversation

@mayya-sharipova
Copy link
Contributor

PR #75195 added segment sorter on @timestamp desc for datastream indices.
This PR applies segment sorter to all indices that have @timestamp
field.

The presence of @timestamp field can serve as a strong
indication that we are dealing with timeseries indices. The most
common type of query for timeseries indices is to get the latest data,
that is data sorted by @timestamp desc. This PR sorts segments
by @timestamp desc which allows to speed up this kind of queries.

Backport for #78639
Relates to #75195

PR elastic#75195 added segment sorter on @timestamp desc for datastream indices.
This PR applies segment sorter to all indices that have @timestamp
field.

The presence of @timestamp field can serve as a strong
indication that we are dealing with timeseries indices. The most
common type of query for timeseries indices is to get the latest data,
that is data sorted by @timestamp desc. This PR sorts segments
by @timestamp desc which allows to speed up this kind of queries.

Backport for elastic#78639
Relates to elastic#75195
@mayya-sharipova mayya-sharipova added the :Search/Search Search-related issues that do not fall into other categories label Oct 5, 2021
@elasticmachine elasticmachine added the Team:Search Meta label for search team label Oct 5, 2021
@mayya-sharipova mayya-sharipova added backport and removed Team:Search Meta label for search team labels Oct 5, 2021
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-search (Team:Search)

@mayya-sharipova mayya-sharipova merged commit fd9ddfc into elastic:7.x Oct 5, 2021
@mayya-sharipova mayya-sharipova deleted the sort-timestamp-7.x branch October 5, 2021 23:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport :Search/Search Search-related issues that do not fall into other categories v7.16.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants