HBASE-26482 HMaster may clean wals that is replicating in rare cases #3876

zhengzhuobinzzb · 2021-11-23T15:29:24Z

No description provided.

Apache-HBase · 2021-11-23T16:01:50Z

🎊 +1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	1m 9s	Docker mode activated.
-0 ⚠️	yetus	0m 3s	Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
		_ Prechecks _
		_ master Compile Tests _
+1 💚	mvninstall	4m 47s	master passed
+1 💚	compile	0m 17s	master passed
+1 💚	shadedjars	9m 3s	branch has no errors when building our shaded downstream artifacts.
+1 💚	javadoc	0m 17s	master passed
		_ Patch Compile Tests _
+1 💚	mvninstall	4m 25s	the patch passed
+1 💚	compile	0m 18s	the patch passed
+1 💚	javac	0m 18s	the patch passed
+1 💚	shadedjars	9m 19s	patch has no errors when building our shaded downstream artifacts.
+1 💚	javadoc	0m 14s	the patch passed
		_ Other Tests _
+1 💚	unit	0m 42s	hbase-replication in the patch passed.
		31m 27s

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3876/1/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile
GITHUB PR	#3876
Optional Tests	javac javadoc unit shadedjars compile
uname	Linux 1e3339c1b921 4.15.0-147-generic #151-Ubuntu SMP Fri Jun 18 19:21:19 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	master / `96d699a`
Default Java	AdoptOpenJDK-1.8.0_282-b08
Test Results	https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3876/1/testReport/
Max. process+thread count	310 (vs. ulimit of 30000)
modules	C: hbase-replication U: hbase-replication
Console output	https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3876/1/console
versions	git=2.17.1 maven=3.6.3
Powered by	Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase · 2021-11-23T16:08:25Z

🎊 +1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	1m 31s	Docker mode activated.
-0 ⚠️	yetus	0m 3s	Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
		_ Prechecks _
		_ master Compile Tests _
+1 💚	mvninstall	6m 6s	master passed
+1 💚	compile	0m 21s	master passed
+1 💚	shadedjars	10m 4s	branch has no errors when building our shaded downstream artifacts.
+1 💚	javadoc	0m 23s	master passed
		_ Patch Compile Tests _
+1 💚	mvninstall	5m 58s	the patch passed
+1 💚	compile	0m 21s	the patch passed
+1 💚	javac	0m 21s	the patch passed
+1 💚	shadedjars	11m 7s	patch has no errors when building our shaded downstream artifacts.
+1 💚	javadoc	0m 19s	the patch passed
		_ Other Tests _
+1 💚	unit	0m 44s	hbase-replication in the patch passed.
		37m 59s

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3876/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile
GITHUB PR	#3876
Optional Tests	javac javadoc unit shadedjars compile
uname	Linux 9478596e36e6 4.15.0-142-generic #146-Ubuntu SMP Tue Apr 13 01:11:19 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	master / `96d699a`
Default Java	AdoptOpenJDK-11.0.10+9
Test Results	https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3876/1/testReport/
Max. process+thread count	285 (vs. ulimit of 30000)
modules	C: hbase-replication U: hbase-replication
Console output	https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3876/1/console
versions	git=2.17.1 maven=3.6.3
Powered by	Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

zhengzhuobinzzb · 2021-11-24T01:36:20Z

Precommit check failed: ' /home/jenkins/jenkins-home/workspace/HBase: Read-only file system '
Should i force push to re-trigger checks?

zhengzhuobinzzb · 2021-11-24T01:39:07Z

@Apache9 @apurtell @sunhelly @clarax @comnetwork
Please help review in your free time, Thanks~

...replication/src/main/java/org/apache/hadoop/hbase/replication/ZKReplicationQueueStorage.java

...ication/src/test/java/org/apache/hadoop/hbase/replication/TestZKReplicationQueueStorage.java

Apache-HBase · 2021-11-24T08:12:58Z

🎊 +1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	1m 21s	Docker mode activated.
-0 ⚠️	yetus	0m 3s	Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
		_ Prechecks _
		_ master Compile Tests _
+1 💚	mvninstall	4m 7s	master passed
+1 💚	compile	0m 18s	master passed
+1 💚	shadedjars	8m 22s	branch has no errors when building our shaded downstream artifacts.
+1 💚	javadoc	0m 19s	master passed
		_ Patch Compile Tests _
+1 💚	mvninstall	3m 50s	the patch passed
+1 💚	compile	0m 19s	the patch passed
+1 💚	javac	0m 19s	the patch passed
+1 💚	shadedjars	8m 25s	patch has no errors when building our shaded downstream artifacts.
+1 💚	javadoc	0m 16s	the patch passed
		_ Other Tests _
+1 💚	unit	0m 30s	hbase-replication in the patch passed.
		28m 50s

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3876/2/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile
GITHUB PR	#3876
Optional Tests	javac javadoc unit shadedjars compile
uname	Linux f68df581339d 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	master / `e702aae`
Default Java	AdoptOpenJDK-1.8.0_282-b08
Test Results	https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3876/2/testReport/
Max. process+thread count	325 (vs. ulimit of 30000)
modules	C: hbase-replication U: hbase-replication
Console output	https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3876/2/console
versions	git=2.17.1 maven=3.6.3
Powered by	Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase · 2021-11-24T08:16:40Z

🎊 +1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	1m 6s	Docker mode activated.
-0 ⚠️	yetus	0m 3s	Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
		_ Prechecks _
		_ master Compile Tests _
+1 💚	mvninstall	5m 20s	master passed
+1 💚	compile	0m 19s	master passed
+1 💚	shadedjars	9m 16s	branch has no errors when building our shaded downstream artifacts.
+1 💚	javadoc	0m 19s	master passed
		_ Patch Compile Tests _
+1 💚	mvninstall	5m 0s	the patch passed
+1 💚	compile	0m 20s	the patch passed
+1 💚	javac	0m 20s	the patch passed
+1 💚	shadedjars	9m 5s	patch has no errors when building our shaded downstream artifacts.
+1 💚	javadoc	0m 16s	the patch passed
		_ Other Tests _
+1 💚	unit	0m 40s	hbase-replication in the patch passed.
		32m 40s

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3876/2/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile
GITHUB PR	#3876
Optional Tests	javac javadoc unit shadedjars compile
uname	Linux 82cc4e322bc2 4.15.0-143-generic #147-Ubuntu SMP Wed Apr 14 16:10:11 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	master / `e702aae`
Default Java	AdoptOpenJDK-11.0.10+9
Test Results	https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3876/2/testReport/
Max. process+thread count	250 (vs. ulimit of 30000)
modules	C: hbase-replication U: hbase-replication
Console output	https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3876/2/console
versions	git=2.17.1 maven=3.6.3
Powered by	Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase · 2021-11-24T08:26:38Z

🎊 +1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	1m 3s	Docker mode activated.
		_ Prechecks _
+1 💚	dupname	0m 0s	No case conflicting files found.
+1 💚	hbaseanti	0m 0s	Patch does not have any anti-patterns.
+1 💚	@author	0m 0s	The patch does not contain any @author tags.
		_ master Compile Tests _
+1 💚	mvninstall	4m 15s	master passed
+1 💚	compile	0m 26s	master passed
+1 💚	checkstyle	0m 12s	master passed
+1 💚	spotbugs	0m 33s	master passed
		_ Patch Compile Tests _
+1 💚	mvninstall	4m 14s	the patch passed
+1 💚	compile	0m 24s	the patch passed
+1 💚	javac	0m 24s	the patch passed
+1 💚	checkstyle	0m 11s	the patch passed
+1 💚	whitespace	0m 0s	The patch has no whitespace issues.
+1 💚	hadoopcheck	21m 39s	Patch does not cause any errors with Hadoop 3.1.2 3.2.2 3.3.1.
+1 💚	spotbugs	0m 40s	the patch passed
		_ Other Tests _
+1 💚	asflicense	0m 11s	The patch does not generate ASF License warnings.
		42m 26s

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3876/2/artifact/yetus-general-check/output/Dockerfile
GITHUB PR	#3876
Optional Tests	dupname asflicense javac spotbugs hadoopcheck hbaseanti checkstyle compile
uname	Linux d5524c0a8f0c 4.15.0-147-generic #151-Ubuntu SMP Fri Jun 18 19:21:19 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	master / `e702aae`
Default Java	AdoptOpenJDK-1.8.0_282-b08
Max. process+thread count	86 (vs. ulimit of 30000)
modules	C: hbase-replication U: hbase-replication
Console output	https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3876/2/console
versions	git=2.17.1 maven=3.6.3 spotbugs=4.2.2
Powered by	Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase · 2021-11-24T08:59:36Z

🎊 +1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	1m 30s	Docker mode activated.
-0 ⚠️	yetus	0m 2s	Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
		_ Prechecks _
		_ master Compile Tests _
+1 💚	mvninstall	4m 47s	master passed
+1 💚	compile	0m 18s	master passed
+1 💚	shadedjars	9m 21s	branch has no errors when building our shaded downstream artifacts.
+1 💚	javadoc	0m 16s	master passed
		_ Patch Compile Tests _
+1 💚	mvninstall	4m 24s	the patch passed
+1 💚	compile	0m 18s	the patch passed
+1 💚	javac	0m 18s	the patch passed
+1 💚	shadedjars	9m 14s	patch has no errors when building our shaded downstream artifacts.
+1 💚	javadoc	0m 14s	the patch passed
		_ Other Tests _
+1 💚	unit	0m 43s	hbase-replication in the patch passed.
		32m 4s

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3876/3/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile
GITHUB PR	#3876
Optional Tests	javac javadoc unit shadedjars compile
uname	Linux b937c9bcd41c 4.15.0-147-generic #151-Ubuntu SMP Fri Jun 18 19:21:19 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	master / `e702aae`
Default Java	AdoptOpenJDK-1.8.0_282-b08
Test Results	https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3876/3/testReport/
Max. process+thread count	310 (vs. ulimit of 30000)
modules	C: hbase-replication U: hbase-replication
Console output	https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3876/3/console
versions	git=2.17.1 maven=3.6.3
Powered by	Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase · 2021-11-24T09:00:26Z

🎊 +1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	1m 8s	Docker mode activated.
-0 ⚠️	yetus	0m 3s	Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
		_ Prechecks _
		_ master Compile Tests _
+1 💚	mvninstall	5m 25s	master passed
+1 💚	compile	0m 19s	master passed
+1 💚	shadedjars	9m 11s	branch has no errors when building our shaded downstream artifacts.
+1 💚	javadoc	0m 18s	master passed
		_ Patch Compile Tests _
+1 💚	mvninstall	5m 7s	the patch passed
+1 💚	compile	0m 19s	the patch passed
+1 💚	javac	0m 19s	the patch passed
+1 💚	shadedjars	9m 10s	patch has no errors when building our shaded downstream artifacts.
+1 💚	javadoc	0m 17s	the patch passed
		_ Other Tests _
+1 💚	unit	0m 43s	hbase-replication in the patch passed.
		32m 53s

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3876/3/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile
GITHUB PR	#3876
Optional Tests	javac javadoc unit shadedjars compile
uname	Linux c201f4265b1f 4.15.0-143-generic #147-Ubuntu SMP Wed Apr 14 16:10:11 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	master / `e702aae`
Default Java	AdoptOpenJDK-11.0.10+9
Test Results	https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3876/3/testReport/
Max. process+thread count	252 (vs. ulimit of 30000)
modules	C: hbase-replication U: hbase-replication
Console output	https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3876/3/console
versions	git=2.17.1 maven=3.6.3
Powered by	Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase · 2021-11-24T09:11:05Z

🎊 +1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	1m 28s	Docker mode activated.
		_ Prechecks _
+1 💚	dupname	0m 0s	No case conflicting files found.
+1 💚	hbaseanti	0m 0s	Patch does not have any anti-patterns.
+1 💚	@author	0m 0s	The patch does not contain any @author tags.
		_ master Compile Tests _
+1 💚	mvninstall	4m 29s	master passed
+1 💚	compile	0m 25s	master passed
+1 💚	checkstyle	0m 12s	master passed
+1 💚	spotbugs	0m 30s	master passed
		_ Patch Compile Tests _
+1 💚	mvninstall	4m 20s	the patch passed
+1 💚	compile	0m 25s	the patch passed
+1 💚	javac	0m 25s	the patch passed
+1 💚	checkstyle	0m 11s	the patch passed
+1 💚	whitespace	0m 0s	The patch has no whitespace issues.
+1 💚	hadoopcheck	21m 58s	Patch does not cause any errors with Hadoop 3.1.2 3.2.2 3.3.1.
+1 💚	spotbugs	0m 40s	the patch passed
		_ Other Tests _
+1 💚	asflicense	0m 11s	The patch does not generate ASF License warnings.
		43m 32s

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3876/3/artifact/yetus-general-check/output/Dockerfile
GITHUB PR	#3876
Optional Tests	dupname asflicense javac spotbugs hadoopcheck hbaseanti checkstyle compile
uname	Linux 3d71ab048187 4.15.0-147-generic #151-Ubuntu SMP Fri Jun 18 19:21:19 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	master / `e702aae`
Default Java	AdoptOpenJDK-1.8.0_282-b08
Max. process+thread count	86 (vs. ulimit of 30000)
modules	C: hbase-replication U: hbase-replication
Console output	https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3876/3/console
versions	git=2.17.1 maven=3.6.3 spotbugs=4.2.2
Powered by	Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

…3876) Signed-off-by: Duo Zhang <[email protected]>

…pache#3876)

…pache#3876) Signed-off-by: Duo Zhang <[email protected]>

Apache9 reviewed Nov 24, 2021

View reviewed changes

...replication/src/main/java/org/apache/hadoop/hbase/replication/ZKReplicationQueueStorage.java Show resolved Hide resolved

...ication/src/test/java/org/apache/hadoop/hbase/replication/TestZKReplicationQueueStorage.java Show resolved Hide resolved

zhengzhuobinzzb force-pushed the HBASE-26482 branch from 0508378 to 668b2b3 Compare November 24, 2021 07:43

HBASE-26482 HMaster may clean wals that is replicating in rare cases

1e0b85a

zhengzhuobinzzb force-pushed the HBASE-26482 branch from 668b2b3 to 1e0b85a Compare November 24, 2021 07:58

Apache9 approved these changes Nov 24, 2021

View reviewed changes

Apache9 merged commit 25fc701 into apache:master Nov 24, 2021

Apache9 pushed a commit that referenced this pull request Nov 24, 2021

HBASE-26482 HMaster may clean wals that is replicating in rare cases (#…

9275159

…3876) Signed-off-by: Duo Zhang <[email protected]>

Apache9 pushed a commit that referenced this pull request Nov 24, 2021

HBASE-26482 HMaster may clean wals that is replicating in rare cases (#…

60e263e

…3876) Signed-off-by: Duo Zhang <[email protected]>

guangxuCheng pushed a commit to guangxuCheng/hbase that referenced this pull request Mar 28, 2022

HBASE-26482 HMaster may clean wals that is replicating in rare cases (a…

0be7eb8

…pache#3876)

vinayakphegde pushed a commit to vinayakphegde/hbase that referenced this pull request Apr 4, 2024

HBASE-26482 HMaster may clean wals that is replicating in rare cases (a…

eeaab0d

…pache#3876) Signed-off-by: Duo Zhang <[email protected]>

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Uh oh!

HBASE-26482 HMaster may clean wals that is replicating in rare cases #3876

HBASE-26482 HMaster may clean wals that is replicating in rare cases #3876

Uh oh!

zhengzhuobinzzb commented Nov 23, 2021

Uh oh!

Apache-HBase commented Nov 23, 2021

Uh oh!

Apache-HBase commented Nov 23, 2021

Uh oh!

zhengzhuobinzzb commented Nov 24, 2021

Uh oh!

zhengzhuobinzzb commented Nov 24, 2021

Uh oh!

Uh oh!

Uh oh!

Apache-HBase commented Nov 24, 2021

Uh oh!

Apache-HBase commented Nov 24, 2021

Uh oh!

Apache-HBase commented Nov 24, 2021

Uh oh!

Apache-HBase commented Nov 24, 2021

Uh oh!

Apache-HBase commented Nov 24, 2021

Uh oh!

Apache-HBase commented Nov 24, 2021

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Uh oh!

HBASE-26482 HMaster may clean wals that is replicating in rare cases #3876

HBASE-26482 HMaster may clean wals that is replicating in rare cases #3876

Uh oh!

Conversation

zhengzhuobinzzb commented Nov 23, 2021

Uh oh!

Apache-HBase commented Nov 23, 2021

Uh oh!

Apache-HBase commented Nov 23, 2021

Uh oh!

zhengzhuobinzzb commented Nov 24, 2021

Uh oh!

zhengzhuobinzzb commented Nov 24, 2021

Uh oh!

Uh oh!

Uh oh!

Apache-HBase commented Nov 24, 2021

Uh oh!

Apache-HBase commented Nov 24, 2021

Uh oh!

Apache-HBase commented Nov 24, 2021

Uh oh!

Apache-HBase commented Nov 24, 2021

Uh oh!

Apache-HBase commented Nov 24, 2021

Uh oh!

Apache-HBase commented Nov 24, 2021

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants