Skip to content

Conversation

@dnhatn
Copy link
Member

@dnhatn dnhatn commented Aug 21, 2019

If soft-deletes is enabled, we will trim translog above the local checkpoint of the safe commit immediately. However, if the translog durability is async, the last commit might not be the safe commit as the local checkpoint won't advance until translog is synced. We can't verify translog stats in this case.

Closes #45801
Relates #45473

@dnhatn dnhatn added >test Issues or PRs that are addressing/adding tests :Distributed Indexing/Distributed A catch all label for anything in the Distributed Indexing Area. Please avoid if you can. v8.0.0 v7.4.0 labels Aug 21, 2019
@dnhatn dnhatn requested a review from henningandersen August 21, 2019 16:51
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-distributed

Copy link
Contributor

@original-brownbear original-brownbear left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks @dnhatn LGTM!

@dnhatn
Copy link
Member Author

dnhatn commented Aug 21, 2019

Thanks @original-brownbear.

@dnhatn dnhatn changed the title Do not verify translog stats if durability is async Assert translog stats busily Aug 21, 2019
@dnhatn dnhatn merged commit 34d6913 into elastic:master Aug 21, 2019
@dnhatn dnhatn deleted the fix-translog-stats branch August 21, 2019 22:14
dnhatn added a commit to dnhatn/elasticsearch that referenced this pull request Aug 22, 2019
If soft-deletes is enabled, we will trim translog above the local
checkpoint of the safe commit immediately. However, if the translog
durability is async, the last commit might not be the safe commit as the
local checkpoint won't advance until translog is synced. Therefore, we
need to verify translog stats busily.

Closes elastic#45801
Relates elastic#45473
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

:Distributed Indexing/Distributed A catch all label for anything in the Distributed Indexing Area. Please avoid if you can. >test Issues or PRs that are addressing/adding tests v7.4.0 v8.0.0-alpha1

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[CI] OpenCloseIndexIT testTranslogStats failures

4 participants