Skip to content

Conversation

@dnhatn
Copy link
Member

@dnhatn dnhatn commented Apr 20, 2018

Today we always add no-ops to translog regardless of its origin, thus a
noop may appear in the translog multiple times. This is not a big deal
as noops are small and rare.

This commit ensures to add a noop to translog only if its origin is not
from local translog. This restriction has been applied for index and
delete.

Today we always add no-ops to translog regardless of its origin, thus a
noop may appear in the translog multiple times. This is not a big deal
as noops are small and rare to appear.

This commit ensures to add a noop to translog only if its origin is not
from local translog. This restriction has been applied for index and
delete.
@dnhatn dnhatn added >enhancement v7.0.0 v6.3.0 :Distributed Indexing/Engine Anything around managing Lucene and the Translog in an open shard. labels Apr 20, 2018
@dnhatn dnhatn requested review from bleskes and jasontedor April 20, 2018 15:15
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-distributed

Copy link
Contributor

@bleskes bleskes left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Any specific reason to look at this now?

@dnhatn
Copy link
Member Author

dnhatn commented Apr 20, 2018

Any specific reason to look at this now?

@bleskes I am working to index a tombstone for no-op in the soft-deletes branch as we would like to have a complete sequence history in Lucene.

@dnhatn dnhatn changed the title Do not add Noop from local translog to translog again Do not add noop from local translog to translog again Apr 20, 2018
@dnhatn dnhatn added v6.4.0 and removed v6.3.0 labels Apr 24, 2018
@dnhatn
Copy link
Member Author

dnhatn commented Apr 26, 2018

Thanks @bleskes

@dnhatn dnhatn merged commit 52c50e3 into elastic:master Apr 26, 2018
@dnhatn dnhatn deleted the not-add-noops branch April 26, 2018 01:02
dnhatn added a commit that referenced this pull request Apr 26, 2018
Today we always add no-ops to translog regardless of its origin, thus a
noop may appear in the translog multiple times. This is not a big deal
as noops are small and rare to appear.

This commit ensures to add a noop to translog only if its origin is not
from local translog. This restriction has been applied for index and
delete.
martijnvg added a commit that referenced this pull request Apr 26, 2018
* es/master:
  Watcher: Fold two smoke test projects into smoke-test-watcher (#30137)
  In the field capabilities API, deprecate support for providing fields in the request body. (#30157)
  Set JAVA_HOME before forking setup commands (#29647)
  Remove animal sniffer from low-level REST client (#29646)
  Cleanup .gitignore (#30145)
  Do not add noop from local translog to translog again (#29637)
  Build: Assert jar LICENSE and NOTICE files match
  Correct transport compression algorithm in docs (#29645)
  [Test] Fix docs check for DEB package in packaging tests (#30126)
  Painless: Docs Clean Up (#29592)
  Fixes Eclipse build for sql jdbc project (#30114)
  Remove reference to `not_analyzed`.
  [Docs] Add community analysis plugin (#29612)
martijnvg added a commit that referenced this pull request Apr 26, 2018
* es/6.x:
  In the field capabilities API, deprecate support for providing fields in the request body. (#30157)
  Set JAVA_HOME before forking setup commands (#29647)
  Remove animal sniffer from low-level REST client (#29646)
  Cleanup .gitignore (#30145)
  Do not add noop from local translog to translog again (#29637)
  Painless: Docs Clean Up (#29592)
  Build: Assert jar LICENSE and NOTICE files match
  Correct transport compression algorithm in docs (#29645)
  AwaitsFix for testGradleVersionsMatchVersionUtils
  [Test] Fix docs check for DEB package in packaging tests (#30126)
  Remove reference to `not_analyzed`.
  [Docs] Add community analysis plugin (#29612)
  [DOCS] Removed differencies between text and code (#27993)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

:Distributed Indexing/Engine Anything around managing Lucene and the Translog in an open shard. >enhancement v6.4.0 v7.0.0-beta1

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants