HDFS-15385 Upgrade boost library to 1.72 #2051

GauthamBanasandra · 2020-06-03T16:30:20Z

Hi all,

I've upgraded the boost library to the latest. Please do take a look.
Also, I need some help with the CI. I saw that the whole boost library was checked in as part of the Hadoop codebase. From what I've learned, the third party code must be kept separate or must be pulled at the time of build and should definitely not be part of the codebase.
So, my changes expect that the boost libraries be installed in the system. Could someone with access to the CI machines please install the latest version of boost by running the following command -

$ sudo apt-get install libboost-all-dev

hadoop-yetus · 2020-06-03T17:32:29Z

💔 -1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	0m 37s	Docker mode activated.
		_ Prechecks _
+1 💚	dupname	0m 9s	No case conflicting files found.
+1 💚	@author	0m 0s	The patch does not contain any @author tags.
-1 ❌	test4tests	0m 0s	The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
		_ trunk Compile Tests _
+1 💚	mvninstall	19m 13s	trunk passed
+1 💚	compile	1m 51s	trunk passed
+1 💚	mvnsite	0m 26s	trunk passed
+1 💚	shadedclient	36m 6s	branch has no errors when building and testing our client artifacts.
+1 💚	javadoc	0m 23s	trunk passed
		_ Patch Compile Tests _
+1 💚	mvninstall	0m 16s	the patch passed
-1 ❌	compile	0m 21s	hadoop-hdfs-native-client in the patch failed.
-1 ❌	cc	0m 21s	hadoop-hdfs-native-client in the patch failed.
-1 ❌	golang	0m 21s	hadoop-hdfs-native-client in the patch failed.
-1 ❌	javac	0m 21s	hadoop-hdfs-native-client in the patch failed.
+1 💚	mvnsite	0m 16s	the patch passed
+1 💚	whitespace	0m 0s	The patch has no whitespace issues.
+1 💚	shadedclient	13m 42s	patch has no errors when building and testing our client artifacts.
+1 💚	javadoc	0m 18s	the patch passed
		_ Other Tests _
-1 ❌	unit	0m 26s	hadoop-hdfs-native-client in the patch failed.
+1 💚	asflicense	0m 33s	The patch does not generate ASF License warnings.
		57m 2s

Subsystem	Report/Notes
Docker	ClientAPI=1.40 ServerAPI=1.40 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/1/artifact/out/Dockerfile
GITHUB PR	#2051
Optional Tests	dupname asflicense compile cc mvnsite javac unit golang javadoc mvninstall shadedclient
uname	Linux 216787dedfe4 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	personality/hadoop.sh
git revision	trunk / `40d63e0`
Default Java	Private Build-1.8.0_252-8u252-b09-1~18.04-b09
compile	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/1/artifact/out/patch-compile-hadoop-hdfs-project_hadoop-hdfs-native-client.txt
cc	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/1/artifact/out/patch-compile-hadoop-hdfs-project_hadoop-hdfs-native-client.txt
golang	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/1/artifact/out/patch-compile-hadoop-hdfs-project_hadoop-hdfs-native-client.txt
javac	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/1/artifact/out/patch-compile-hadoop-hdfs-project_hadoop-hdfs-native-client.txt
unit	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/1/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs-native-client.txt
Test Results	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/1/testReport/
Max. process+thread count	413 (vs. ulimit of 5500)
modules	C: hadoop-hdfs-project/hadoop-hdfs-native-client U: hadoop-hdfs-project/hadoop-hdfs-native-client
Console output	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/1/console
versions	git=2.17.1 maven=3.6.0
Powered by	Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

aajisaka · 2020-06-03T21:02:15Z

Could someone with access to the CI machines please install the latest version of boost by running the following command

The CI job runs on docker container and the dockerfile is at dev-support/docker/Dockerfile. You can install the required libraries there.

hadoop-yetus · 2020-06-04T06:41:53Z

(!) A patch to the testing environment has been detected.
Re-executing against the patched versions to perform further tests.
The console is at https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/2/console in case of problems.

hadoop-yetus · 2020-06-04T08:02:51Z

💔 -1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	23m 22s	Docker mode activated.
		_ Prechecks _
+1 💚	dupname	0m 10s	No case conflicting files found.
+1 💚	@author	0m 0s	The patch does not contain any @author tags.
-1 ❌	test4tests	0m 0s	The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
		_ trunk Compile Tests _
+1 💚	mvninstall	19m 32s	trunk passed
+1 💚	compile	1m 56s	trunk passed
+1 💚	mvnsite	0m 31s	trunk passed
+1 💚	shadedclient	14m 1s	branch has no errors when building and testing our client artifacts.
+1 💚	javadoc	0m 28s	trunk passed
		_ Patch Compile Tests _
+1 💚	mvninstall	0m 19s	the patch passed
-1 ❌	compile	0m 38s	hadoop-hdfs-native-client in the patch failed.
-1 ❌	cc	0m 38s	hadoop-hdfs-native-client in the patch failed.
-1 ❌	golang	0m 38s	hadoop-hdfs-native-client in the patch failed.
-1 ❌	javac	0m 38s	hadoop-hdfs-native-client in the patch failed.
+1 💚	hadolint	0m 5s	There were no new hadolint issues.
+1 💚	mvnsite	0m 20s	the patch passed
+1 💚	shellcheck	0m 0s	There were no new shellcheck issues.
+1 💚	shelldocs	0m 18s	The patch generated 0 new + 104 unchanged - 132 fixed = 104 total (was 236)
+1 💚	whitespace	0m 0s	The patch has no whitespace issues.
+1 💚	shadedclient	14m 2s	patch has no errors when building and testing our client artifacts.
+1 💚	javadoc	0m 22s	the patch passed
		_ Other Tests _
-1 ❌	unit	0m 44s	hadoop-hdfs-native-client in the patch failed.
+1 💚	asflicense	0m 35s	The patch does not generate ASF License warnings.
		82m 10s

Subsystem	Report/Notes
Docker	ClientAPI=1.40 ServerAPI=1.40 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/2/artifact/out/Dockerfile
GITHUB PR	#2051
Optional Tests	dupname asflicense hadolint shellcheck shelldocs compile cc mvnsite javac unit golang javadoc mvninstall shadedclient
uname	Linux 1305e955d5fb 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	personality/hadoop.sh
git revision	trunk / `704409d`
Default Java	Private Build-1.8.0_252-8u252-b09-1~18.04-b09
compile	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/2/artifact/out/patch-compile-hadoop-hdfs-project_hadoop-hdfs-native-client.txt
cc	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/2/artifact/out/patch-compile-hadoop-hdfs-project_hadoop-hdfs-native-client.txt
golang	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/2/artifact/out/patch-compile-hadoop-hdfs-project_hadoop-hdfs-native-client.txt
javac	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/2/artifact/out/patch-compile-hadoop-hdfs-project_hadoop-hdfs-native-client.txt
unit	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/2/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs-native-client.txt
Test Results	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/2/testReport/
Max. process+thread count	414 (vs. ulimit of 5500)
modules	C: hadoop-hdfs-project/hadoop-hdfs-native-client U: hadoop-hdfs-project/hadoop-hdfs-native-client
Console output	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/2/console
versions	git=2.17.1 maven=3.6.0 shellcheck=0.4.6 hadolint=1.11.1-0-g0e692dd
Powered by	Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus · 2020-06-04T13:16:51Z

(!) A patch to the testing environment has been detected.
Re-executing against the patched versions to perform further tests.
The console is at https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/3/console in case of problems.

hadoop-yetus · 2020-06-04T13:17:04Z

💔 -1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	0m 0s	Docker mode activated.
-1 ❌	docker	0m 6s	Docker failed to build yetus/hadoop:5157118bd7f.

Subsystem	Report/Notes
GITHUB PR	#2051
Console output	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/3/console
versions	git=2.17.1
Powered by	Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus · 2020-06-04T14:46:58Z

(!) A patch to the testing environment has been detected.
Re-executing against the patched versions to perform further tests.
The console is at https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/4/console in case of problems.

hadoop-yetus · 2020-06-04T14:52:56Z

💔 -1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	0m 0s	Docker mode activated.
-1 ❌	docker	5m 52s	Docker failed to build yetus/hadoop:5157118bd7f.

Subsystem	Report/Notes
GITHUB PR	#2051
Console output	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/4/console
versions	git=2.17.1
Powered by	Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus · 2020-06-04T18:17:04Z

(!) A patch to the testing environment has been detected.
Re-executing against the patched versions to perform further tests.
The console is at https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/5/console in case of problems.

hadoop-yetus · 2020-06-04T20:11:56Z

💔 -1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	34m 7s	Docker mode activated.
		_ Prechecks _
+1 💚	dupname	0m 9s	No case conflicting files found.
+1 💚	@author	0m 0s	The patch does not contain any @author tags.
-1 ❌	test4tests	0m 0s	The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
		_ trunk Compile Tests _
+1 💚	mvninstall	25m 34s	trunk passed
+1 💚	compile	2m 25s	trunk passed
+1 💚	mvnsite	0m 29s	trunk passed
+1 💚	shadedclient	17m 39s	branch has no errors when building and testing our client artifacts.
+1 💚	javadoc	0m 26s	trunk passed
		_ Patch Compile Tests _
+1 💚	mvninstall	0m 20s	the patch passed
+1 💚	compile	2m 19s	the patch passed
+1 💚	cc	2m 19s	the patch passed
+1 💚	golang	2m 19s	the patch passed
+1 💚	javac	2m 19s	the patch passed
-1 ❌	hadolint	0m 7s	The patch generated 27 new + 0 unchanged - 0 fixed = 27 total (was 0)
+1 💚	mvnsite	0m 21s	the patch passed
+1 💚	shellcheck	0m 0s	There were no new shellcheck issues.
+1 💚	shelldocs	0m 18s	The patch generated 0 new + 104 unchanged - 132 fixed = 104 total (was 236)
+1 💚	whitespace	0m 0s	The patch has no whitespace issues.
+1 💚	shadedclient	17m 52s	patch has no errors when building and testing our client artifacts.
+1 💚	javadoc	0m 23s	the patch passed
		_ Other Tests _
+1 💚	unit	8m 19s	hadoop-hdfs-native-client in the patch passed.
+1 💚	asflicense	0m 36s	The patch does not generate ASF License warnings.
		116m 13s

Subsystem	Report/Notes
Docker	ClientAPI=1.40 ServerAPI=1.40 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/5/artifact/out/Dockerfile
GITHUB PR	#2051
Optional Tests	dupname asflicense hadolint shellcheck shelldocs compile cc mvnsite javac unit golang javadoc mvninstall shadedclient
uname	Linux e3463c1b9185 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	personality/hadoop.sh
git revision	trunk / `5157118`
Default Java	Private Build-1.8.0_252-8u252-b09-1~18.04-b09
hadolint	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/5/artifact/out/diff-patch-hadolint.txt
Test Results	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/5/testReport/
Max. process+thread count	414 (vs. ulimit of 5500)
modules	C: hadoop-hdfs-project/hadoop-hdfs-native-client U: hadoop-hdfs-project/hadoop-hdfs-native-client
Console output	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/5/console
versions	git=2.17.1 maven=3.6.0 shellcheck=0.4.6 hadolint=1.11.1-0-g0e692dd
Powered by	Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus · 2020-06-06T17:01:49Z

(!) A patch to the testing environment has been detected.
Re-executing against the patched versions to perform further tests.
The console is at https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/6/console in case of problems.

hadoop-yetus · 2020-06-06T18:33:50Z

💔 -1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	26m 0s	Docker mode activated.
		_ Prechecks _
+1 💚	dupname	0m 10s	No case conflicting files found.
+1 💚	@author	0m 1s	The patch does not contain any @author tags.
-1 ❌	test4tests	0m 0s	The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
		_ trunk Compile Tests _
+1 💚	mvninstall	19m 27s	trunk passed
+1 💚	compile	1m 55s	trunk passed
+1 💚	mvnsite	0m 30s	trunk passed
+1 💚	shadedclient	14m 38s	branch has no errors when building and testing our client artifacts.
+1 💚	javadoc	0m 24s	trunk passed
		_ Patch Compile Tests _
+1 💚	mvninstall	0m 16s	the patch passed
+1 💚	compile	1m 56s	the patch passed
+1 💚	cc	1m 56s	the patch passed
+1 💚	golang	1m 56s	the patch passed
+1 💚	javac	1m 56s	the patch passed
+1 💚	hadolint	0m 5s	There were no new hadolint issues.
+1 💚	mvnsite	0m 17s	the patch passed
+1 💚	shellcheck	0m 0s	There were no new shellcheck issues.
+1 💚	shelldocs	0m 16s	The patch generated 0 new + 104 unchanged - 132 fixed = 104 total (was 236)
+1 💚	whitespace	0m 0s	The patch has no whitespace issues.
+1 💚	shadedclient	13m 49s	patch has no errors when building and testing our client artifacts.
+1 💚	javadoc	0m 19s	the patch passed
		_ Other Tests _
+1 💚	unit	8m 0s	hadoop-hdfs-native-client in the patch passed.
+1 💚	asflicense	0m 34s	The patch does not generate ASF License warnings.
		93m 14s

Subsystem	Report/Notes
Docker	ClientAPI=1.40 ServerAPI=1.40 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/6/artifact/out/Dockerfile
GITHUB PR	#2051
Optional Tests	dupname asflicense hadolint shellcheck shelldocs compile cc mvnsite javac unit golang javadoc mvninstall shadedclient
uname	Linux e45419e0bbf7 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	personality/hadoop.sh
git revision	trunk / `3ca1529`
Default Java	Private Build-1.8.0_252-8u252-b09-1~18.04-b09
Test Results	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/6/testReport/
Max. process+thread count	454 (vs. ulimit of 5500)
modules	C: hadoop-hdfs-project/hadoop-hdfs-native-client U: hadoop-hdfs-project/hadoop-hdfs-native-client
Console output	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/6/console
versions	git=2.17.1 maven=3.6.0 shellcheck=0.4.6 hadolint=1.11.1-0-g0e692dd
Powered by	Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus · 2020-06-07T06:31:37Z

(!) A patch to the testing environment has been detected.
Re-executing against the patched versions to perform further tests.
The console is at https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/7/console in case of problems.

hadoop-yetus · 2020-06-07T12:01:39Z

(!) A patch to the testing environment has been detected.
Re-executing against the patched versions to perform further tests.
The console is at https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/8/console in case of problems.

GauthamBanasandra · 2020-06-07T16:53:22Z

I've addressed all the mentioned issues and the build + tests are passing - #2051 (comment) except for the test4tests. I believe this patch doesn't require any tests to be added as it doesn't change any of the component's behaviour(s). Passing of the existing tests itself should be sufficient.
@aajisaka could you please have a look at my patch?

BUILDING.txt

dev-support/docker/Dockerfile

aajisaka · 2020-06-19T04:54:18Z

Thank you @GauthamBanasandra for cleaning up the code!

* Upgraded boost library to version 1.72. * Removed the asio-1.10.2 that was checked in under libhdfspp/third_party directory.

* Changed version 1.76 to 1.72 in the comments.

GauthamBanasandra · 2020-06-19T05:22:52Z

Thank you @GauthamBanasandra for cleaning up the code!

It's my pleasure @aajisaka 😄. I believe Hadoop is a very mature code base. Even though I just started with Hadoop quite recently, it has really taught me a lot. I think there's a lot to be gained by contributing to this wonderful community.
I've been working on some more library upgrades. I'll be pushing them out soon, I'm hoping that you would get a chance to review it 😁.

aajisaka · 2020-06-22T05:29:01Z

The timeout setting is here:

hadoop/Jenkinsfile

Line 26 in 9821b94

timeout (time: 5, unit: 'HOURS')

I think the timeout can be increased to 20 hours.

* The CI run was timing out, hence increasing it to 20 hours.

hadoop-yetus · 2020-06-22T07:43:25Z

(!) A patch to the testing environment has been detected.
Re-executing against the patched versions to perform further tests.
The console is at https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/11/console in case of problems.

hadoop-yetus · 2020-06-22T21:04:58Z

💔 -1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	0m 35s	Docker mode activated.
		_ Prechecks _
+1 💚	dupname	0m 10s	No case conflicting files found.
+1 💚	@author	0m 0s	The patch does not contain any @author tags.
-1 ❌	test4tests	0m 0s	The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
		_ trunk Compile Tests _
+0 🆗	mvndep	1m 6s	Maven dependency ordering for branch
+1 💚	mvninstall	19m 32s	trunk passed
+1 💚	compile	20m 31s	trunk passed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04
+1 💚	compile	17m 59s	trunk passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
+1 💚	mvnsite	18m 1s	trunk passed
+1 💚	shadedclient	15m 5s	branch has no errors when building and testing our client artifacts.
-1 ❌	javadoc	0m 34s	root in trunk failed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.
+1 💚	javadoc	5m 42s	trunk passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
-0 ⚠️	patch	21m 43s	Used diff version of patch file. Binary files and potentially other changes not applied. Please rebase and squash commits if necessary.
		_ Patch Compile Tests _
+0 🆗	mvndep	0m 32s	Maven dependency ordering for patch
+1 💚	mvninstall	20m 20s	the patch passed
+1 💚	compile	20m 34s	the patch passed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04
-1 ❌	cc	20m 34s	root-jdkUbuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04 with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04 generated 6 new + 156 unchanged - 6 fixed = 162 total (was 162)
+1 💚	golang	20m 34s	the patch passed
+1 💚	javac	20m 34s	the patch passed
+1 💚	compile	18m 2s	the patch passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
-1 ❌	cc	18m 2s	root-jdkPrivateBuild-1.8.0_252-8u252-b09-1~~18.04-b09 with JDK Private Build-1.8.0_252-8u252-b09-1~~18.04-b09 generated 10 new + 152 unchanged - 10 fixed = 162 total (was 162)
+1 💚	golang	18m 2s	the patch passed
+1 💚	javac	18m 2s	the patch passed
+1 💚	hadolint	0m 5s	There were no new hadolint issues.
+1 💚	mvnsite	18m 28s	the patch passed
+1 💚	shellcheck	0m 0s	There were no new shellcheck issues.
+1 💚	shelldocs	0m 18s	There were no new shelldocs issues.
+1 💚	whitespace	0m 0s	The patch has no whitespace issues.
+1 💚	shadedclient	13m 46s	patch has no errors when building and testing our client artifacts.
-1 ❌	javadoc	0m 39s	root in the patch failed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.
+1 💚	javadoc	5m 44s	the patch passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
		_ Other Tests _
-1 ❌	unit	597m 50s	root in the patch passed.
-1 ❌	asflicense	1m 28s	The patch generated 1 ASF License warnings.
		802m 44s

Reason	Tests
Failed junit tests	hadoop.hdfs.server.federation.router.TestRouterFaultTolerant
	hadoop.hdfs.TestFileChecksum
	hadoop.hdfs.server.namenode.TestNameNodeRetryCacheMetrics
	hadoop.hdfs.TestReconstructStripedFile
	hadoop.hdfs.TestReconstructStripedFileWithRandomECPolicy
	hadoop.hdfs.TestDecommission
	hadoop.hdfs.TestGetFileChecksum
	hadoop.hdfs.server.namenode.ha.TestEditLogTailer
	hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFSStriped
	hadoop.hdfs.TestSafeModeWithStripedFileWithRandomECPolicy
	hadoop.yarn.server.resourcemanager.scheduler.fair.TestFairScheduler
	hadoop.yarn.server.resourcemanager.scheduler.fair.TestFairSchedulerPreemption
	hadoop.yarn.applications.distributedshell.TestDistributedShell
	hadoop.mapred.gridmix.TestGridmixSubmission

Subsystem	Report/Notes
Docker	ClientAPI=1.40 ServerAPI=1.40 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/11/artifact/out/Dockerfile
GITHUB PR	#2051
Optional Tests	dupname asflicense shellcheck shelldocs hadolint compile cc mvnsite javac unit golang javadoc mvninstall shadedclient
uname	Linux 809a42acf3fa 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	personality/hadoop.sh
git revision	trunk / `ce1008f`
Default Java	Private Build-1.8.0_252-8u252-b09-1~18.04-b09
Multi-JDK versions	/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_252-8u252-b09-1~18.04-b09
javadoc	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/11/artifact/out/branch-javadoc-root-jdkUbuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.txt
cc	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/11/artifact/out/diff-compile-cc-root-jdkUbuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.txt
cc	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/11/artifact/out/diff-compile-cc-root-jdkPrivateBuild-1.8.0_252-8u252-b09-1~18.04-b09.txt
javadoc	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/11/artifact/out/patch-javadoc-root-jdkUbuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.txt
unit	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/11/artifact/out/patch-unit-root.txt
Test Results	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/11/testReport/
asflicense	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/11/artifact/out/patch-asflicense-problems.txt
Max. process+thread count	4025 (vs. ulimit of 5500)
modules	C: hadoop-hdfs-project/hadoop-hdfs-native-client . U: .
Console output	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/11/console
versions	git=2.17.1 maven=3.6.0 shellcheck=0.4.6 hadolint=1.11.1-0-g0e692dd
Powered by	Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

oss-maker · 2020-06-26T14:14:44Z

Just went through the change list, it's strange how nobody thought of dependency cleanup till now. I always thought of giving a similar patch but didn't make time. Checking out the entire code of a dependency should never be done, especially in a project of this size. Going forward, we should not allow anyone to checkout the dependency, we should expect the user to install the dependency.

hadoop-yetus · 2020-06-27T15:17:30Z

(!) A patch to the testing environment has been detected.
Re-executing against the patched versions to perform further tests.
The console is at https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/12/console in case of problems.

hadoop-yetus · 2020-06-28T04:30:34Z

💔 -1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	23m 33s	Docker mode activated.
		_ Prechecks _
+1 💚	dupname	0m 10s	No case conflicting files found.
+1 💚	@author	0m 0s	The patch does not contain any @author tags.
-1 ❌	test4tests	0m 0s	The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
		_ trunk Compile Tests _
+0 🆗	mvndep	1m 18s	Maven dependency ordering for branch
+1 💚	mvninstall	19m 31s	trunk passed
+1 💚	compile	19m 39s	trunk passed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04
+1 💚	compile	16m 57s	trunk passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
+1 💚	mvnsite	17m 14s	trunk passed
+1 💚	shadedclient	14m 15s	branch has no errors when building and testing our client artifacts.
-1 ❌	javadoc	0m 38s	root in trunk failed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.
+1 💚	javadoc	5m 35s	trunk passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
-0 ⚠️	patch	20m 51s	Used diff version of patch file. Binary files and potentially other changes not applied. Please rebase and squash commits if necessary.
		_ Patch Compile Tests _
+0 🆗	mvndep	0m 32s	Maven dependency ordering for patch
+1 💚	mvninstall	19m 34s	the patch passed
+1 💚	compile	19m 9s	the patch passed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04
-1 ❌	cc	19m 9s	root-jdkUbuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04 with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04 generated 28 new + 126 unchanged - 36 fixed = 154 total (was 162)
+1 💚	golang	19m 9s	the patch passed
+1 💚	javac	19m 9s	the patch passed
+1 💚	compile	17m 16s	the patch passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
-1 ❌	cc	17m 16s	root-jdkPrivateBuild-1.8.0_252-8u252-b09-1~~18.04-b09 with JDK Private Build-1.8.0_252-8u252-b09-1~~18.04-b09 generated 31 new + 123 unchanged - 39 fixed = 154 total (was 162)
+1 💚	golang	17m 16s	the patch passed
+1 💚	javac	17m 16s	the patch passed
+1 💚	hadolint	0m 4s	There were no new hadolint issues.
+1 💚	mvnsite	17m 25s	the patch passed
+1 💚	shellcheck	0m 1s	There were no new shellcheck issues.
+1 💚	shelldocs	0m 17s	There were no new shelldocs issues.
+1 💚	whitespace	0m 0s	The patch has no whitespace issues.
+1 💚	shadedclient	14m 0s	patch has no errors when building and testing our client artifacts.
-1 ❌	javadoc	0m 37s	root in the patch failed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.
+1 💚	javadoc	5m 47s	the patch passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
		_ Other Tests _
-1 ❌	unit	573m 26s	root in the patch passed.
-1 ❌	asflicense	1m 32s	The patch generated 1 ASF License warnings.
		794m 14s

Reason	Tests
Failed junit tests	hadoop.hdfs.server.namenode.ha.TestPipelinesFailover
	hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFSStriped
	hadoop.yarn.server.resourcemanager.scheduler.fair.TestFairScheduler
	hadoop.yarn.server.resourcemanager.scheduler.fair.TestFairSchedulerPreemption
	hadoop.yarn.applications.distributedshell.TestDistributedShell
	hadoop.yarn.sls.appmaster.TestAMSimulator

Subsystem	Report/Notes
Docker	ClientAPI=1.40 ServerAPI=1.40 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/12/artifact/out/Dockerfile
GITHUB PR	#2051
Optional Tests	dupname asflicense shellcheck shelldocs hadolint compile cc mvnsite javac unit golang javadoc mvninstall shadedclient
uname	Linux 8df2a85234f2 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	personality/hadoop.sh
git revision	trunk / `8db38c9`
Default Java	Private Build-1.8.0_252-8u252-b09-1~18.04-b09
Multi-JDK versions	/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_252-8u252-b09-1~18.04-b09
javadoc	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/12/artifact/out/branch-javadoc-root-jdkUbuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.txt
cc	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/12/artifact/out/diff-compile-cc-root-jdkUbuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.txt
cc	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/12/artifact/out/diff-compile-cc-root-jdkPrivateBuild-1.8.0_252-8u252-b09-1~18.04-b09.txt
javadoc	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/12/artifact/out/patch-javadoc-root-jdkUbuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.txt
unit	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/12/artifact/out/patch-unit-root.txt
Test Results	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/12/testReport/
asflicense	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/12/artifact/out/patch-asflicense-problems.txt
Max. process+thread count	4109 (vs. ulimit of 5500)
modules	C: hadoop-hdfs-project/hadoop-hdfs-native-client hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-nativetask . U: .
Console output	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/12/console
versions	git=2.17.1 maven=3.6.0 shellcheck=0.4.6 hadolint=1.11.1-0-g0e692dd
Powered by	Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

…to upgrade-boost

dev-support/docker/Dockerfile

...p-mapreduce-client/hadoop-mapreduce-client-nativetask/src/main/native/src/util/StringUtil.cc

aajisaka · 2020-07-13T08:47:48Z

Hi @GauthamBanasandra

Thank you for your update. The patch mostly looks good.
Would you rebase for the latest trunk and address the above comments from me? I'm +1 those are addressed.

Sorry for the late response.

…to upgrade-boost

* WORKDIR is set to /root and must not be overridden. Using cd command instead.

GauthamBanasandra · 2020-07-13T17:00:37Z

@aajisaka I've rebased and addressed the comments.

hadoop-yetus · 2020-07-13T17:34:09Z

(!) A patch to the testing environment has been detected.
Re-executing against the patched versions to perform further tests.
The console is at https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/13/console in case of problems.

hadoop-yetus · 2020-07-14T07:25:10Z

💔 -1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	23m 35s	Docker mode activated.
		_ Prechecks _
+1 💚	dupname	0m 7s	No case conflicting files found.
+1 💚	@author	0m 0s	The patch does not contain any @author tags.
-1 ❌	test4tests	0m 0s	The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
		_ trunk Compile Tests _
+0 🆗	mvndep	1m 15s	Maven dependency ordering for branch
+1 💚	mvninstall	22m 4s	trunk passed
+1 💚	compile	20m 37s	trunk passed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04
+1 💚	compile	17m 32s	trunk passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
+1 💚	mvnsite	18m 8s	trunk passed
+1 💚	shadedclient	15m 46s	branch has no errors when building and testing our client artifacts.
-1 ❌	javadoc	0m 31s	root in trunk failed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.
+1 💚	javadoc	5m 35s	trunk passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
-0 ⚠️	patch	22m 13s	Used diff version of patch file. Binary files and potentially other changes not applied. Please rebase and squash commits if necessary.
		_ Patch Compile Tests _
+0 🆗	mvndep	0m 29s	Maven dependency ordering for patch
+1 💚	mvninstall	21m 54s	the patch passed
+1 💚	compile	20m 17s	the patch passed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04
-1 ❌	cc	20m 17s	root-jdkUbuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04 with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04 generated 9 new + 153 unchanged - 9 fixed = 162 total (was 162)
+1 💚	golang	20m 17s	the patch passed
+1 💚	javac	20m 17s	the patch passed
+1 💚	compile	17m 43s	the patch passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
-1 ❌	cc	17m 43s	root-jdkPrivateBuild-1.8.0_252-8u252-b09-1~~18.04-b09 with JDK Private Build-1.8.0_252-8u252-b09-1~~18.04-b09 generated 27 new + 135 unchanged - 27 fixed = 162 total (was 162)
+1 💚	golang	17m 43s	the patch passed
+1 💚	javac	17m 43s	the patch passed
-1 ❌	hadolint	0m 4s	The patch generated 2 new + 0 unchanged - 0 fixed = 2 total (was 0)
+1 💚	mvnsite	18m 2s	the patch passed
+1 💚	shellcheck	0m 0s	There were no new shellcheck issues.
+1 💚	shelldocs	0m 13s	There were no new shelldocs issues.
+1 💚	whitespace	0m 0s	The patch has no whitespace issues.
+1 💚	shadedclient	15m 35s	patch has no errors when building and testing our client artifacts.
-1 ❌	javadoc	0m 31s	root in the patch failed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.
+1 💚	javadoc	5m 30s	the patch passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
		_ Other Tests _
-1 ❌	unit	595m 42s	root in the patch passed.
-1 ❌	asflicense	2m 28s	The patch generated 1 ASF License warnings.
		831m 59s

Reason	Tests
Failed junit tests	hadoop.mapreduce.lib.input.TestCombineFileInputFormat
	hadoop.yarn.sls.appmaster.TestAMSimulator
	hadoop.yarn.applications.distributedshell.TestDistributedShell
	hadoop.yarn.server.resourcemanager.placement.TestUserGroupMappingPlacementRule
	hadoop.security.TestFixKerberosTicketOrder
	hadoop.security.TestRaceWhenRelogin
	hadoop.hdfs.server.federation.router.TestRouterRpc
	hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFSStriped
	hadoop.hdfs.server.namenode.TestNameNodeRetryCacheMetrics
	hadoop.fs.contract.hdfs.TestHDFSContractMultipartUploader

Subsystem	Report/Notes
Docker	ClientAPI=1.40 ServerAPI=1.40 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/13/artifact/out/Dockerfile
GITHUB PR	#2051
Optional Tests	dupname asflicense hadolint shellcheck shelldocs compile cc mvnsite javac unit golang javadoc mvninstall shadedclient
uname	Linux 0daecfc694a4 4.15.0-101-generic #102-Ubuntu SMP Mon May 11 10:07:26 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	personality/hadoop.sh
git revision	trunk / `b9fa5e0`
Default Java	Private Build-1.8.0_252-8u252-b09-1~18.04-b09
Multi-JDK versions	/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_252-8u252-b09-1~18.04-b09
javadoc	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/13/artifact/out/branch-javadoc-root-jdkUbuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.txt
cc	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/13/artifact/out/diff-compile-cc-root-jdkUbuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.txt
cc	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/13/artifact/out/diff-compile-cc-root-jdkPrivateBuild-1.8.0_252-8u252-b09-1~18.04-b09.txt
hadolint	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/13/artifact/out/diff-patch-hadolint.txt
javadoc	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/13/artifact/out/patch-javadoc-root-jdkUbuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.txt
unit	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/13/artifact/out/patch-unit-root.txt
Test Results	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/13/testReport/
asflicense	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/13/artifact/out/patch-asflicense-problems.txt
Max. process+thread count	3665 (vs. ulimit of 5500)
modules	C: hadoop-hdfs-project/hadoop-hdfs-native-client . U: .
Console output	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/13/console
versions	git=2.17.1 maven=3.6.0 shellcheck=0.4.6 hadolint=1.11.1-0-g0e692dd
Powered by	Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

aajisaka · 2020-07-14T09:10:36Z

Would you add # hadolint ignore=DL3003 to ignore the following hadolint warnings?
https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/13/artifact/out/diff-patch-hadolint.txt

dev-support/docker/Dockerfile:98 DL3003 Use WORKDIR to switch to a directory
dev-support/docker/Dockerfile_aarch64:101 DL3003 Use WORKDIR to switch to a directory

* Suppressing the warning DL3003 that is caused by Boost.

GauthamBanasandra · 2020-07-14T09:54:33Z

@aajisaka I've now added # hadolint ignore=DL3003 to suppress the hadolint warnings.

hadoop-yetus · 2020-07-14T10:07:22Z

(!) A patch to the testing environment has been detected.
Re-executing against the patched versions to perform further tests.
The console is at https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/14/console in case of problems.

hadoop-yetus · 2020-07-14T23:42:33Z

💔 -1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	22m 37s	Docker mode activated.
		_ Prechecks _
+1 💚	dupname	0m 9s	No case conflicting files found.
+1 💚	@author	0m 0s	The patch does not contain any @author tags.
-1 ❌	test4tests	0m 0s	The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
		_ trunk Compile Tests _
+0 🆗	mvndep	1m 19s	Maven dependency ordering for branch
+1 💚	mvninstall	21m 3s	trunk passed
+1 💚	compile	19m 22s	trunk passed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04
+1 💚	compile	17m 8s	trunk passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
+1 💚	mvnsite	17m 36s	trunk passed
+1 💚	shadedclient	14m 8s	branch has no errors when building and testing our client artifacts.
-1 ❌	javadoc	0m 40s	root in trunk failed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.
+1 💚	javadoc	5m 40s	trunk passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
-0 ⚠️	patch	20m 50s	Used diff version of patch file. Binary files and potentially other changes not applied. Please rebase and squash commits if necessary.
		_ Patch Compile Tests _
+0 🆗	mvndep	0m 32s	Maven dependency ordering for patch
+1 💚	mvninstall	19m 56s	the patch passed
+1 💚	compile	19m 56s	the patch passed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04
-1 ❌	cc	19m 56s	root-jdkUbuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04 with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04 generated 26 new + 136 unchanged - 26 fixed = 162 total (was 162)
+1 💚	golang	19m 56s	the patch passed
+1 💚	javac	19m 56s	the patch passed
+1 💚	compile	22m 35s	the patch passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
-1 ❌	cc	22m 35s	root-jdkPrivateBuild-1.8.0_252-8u252-b09-1~~18.04-b09 with JDK Private Build-1.8.0_252-8u252-b09-1~~18.04-b09 generated 13 new + 149 unchanged - 13 fixed = 162 total (was 162)
+1 💚	golang	22m 35s	the patch passed
+1 💚	javac	22m 35s	the patch passed
+1 💚	hadolint	0m 5s	There were no new hadolint issues.
+1 💚	mvnsite	22m 59s	the patch passed
+1 💚	shellcheck	0m 0s	There were no new shellcheck issues.
+1 💚	shelldocs	0m 18s	There were no new shelldocs issues.
+1 💚	whitespace	0m 0s	The patch has no whitespace issues.
+1 💚	shadedclient	17m 33s	patch has no errors when building and testing our client artifacts.
-1 ❌	javadoc	0m 32s	root in the patch failed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.
+1 💚	javadoc	6m 55s	the patch passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
		_ Other Tests _
-1 ❌	unit	578m 11s	root in the patch passed.
-1 ❌	asflicense	1m 51s	The patch generated 1 ASF License warnings.
		816m 25s

Reason	Tests
Failed junit tests	hadoop.yarn.applications.distributedshell.TestDistributedShell
	hadoop.yarn.server.resourcemanager.placement.TestUserGroupMappingPlacementRule
	hadoop.yarn.server.resourcemanager.security.TestDelegationTokenRenewer
	hadoop.yarn.sls.TestReservationSystemInvariants
	hadoop.hdfs.server.namenode.ha.TestPipelinesFailover
	hadoop.fs.contract.hdfs.TestHDFSContractMultipartUploader
	hadoop.hdfs.TestErasureCodingMultipleRacks
	hadoop.hdfs.qjournal.client.TestQuorumJournalManager
	hadoop.hdfs.qjournal.client.TestQuorumJournalManagerUnit
	hadoop.hdfs.server.sps.TestExternalStoragePolicySatisfier
	hadoop.hdfs.TestDistributedFileSystem
	hadoop.hdfs.TestDecommissionWithStriped
	hadoop.hdfs.TestSafeModeWithStripedFileWithRandomECPolicy
	hadoop.fs.http.client.TestHttpFSFWithSWebhdfsFileSystem
	hadoop.mapreduce.lib.input.TestCombineFileInputFormat

Subsystem	Report/Notes
Docker	ClientAPI=1.40 ServerAPI=1.40 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/14/artifact/out/Dockerfile
GITHUB PR	#2051
Optional Tests	dupname asflicense hadolint shellcheck shelldocs compile cc mvnsite javac unit golang javadoc mvninstall shadedclient
uname	Linux 215503cde4c1 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	personality/hadoop.sh
git revision	trunk / `48f9011`
Default Java	Private Build-1.8.0_252-8u252-b09-1~18.04-b09
Multi-JDK versions	/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_252-8u252-b09-1~18.04-b09
javadoc	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/14/artifact/out/branch-javadoc-root-jdkUbuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.txt
cc	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/14/artifact/out/diff-compile-cc-root-jdkUbuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.txt
cc	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/14/artifact/out/diff-compile-cc-root-jdkPrivateBuild-1.8.0_252-8u252-b09-1~18.04-b09.txt
javadoc	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/14/artifact/out/patch-javadoc-root-jdkUbuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.txt
unit	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/14/artifact/out/patch-unit-root.txt
Test Results	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/14/testReport/
asflicense	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/14/artifact/out/patch-asflicense-problems.txt
Max. process+thread count	4947 (vs. ulimit of 5500)
modules	C: hadoop-hdfs-project/hadoop-hdfs-native-client . U: .
Console output	https://builds.apache.org/job/hadoop-multibranch/job/PR-2051/14/console
versions	git=2.17.1 maven=3.6.0 shellcheck=0.4.6 hadolint=1.11.1-0-g0e692dd
Powered by	Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

aajisaka

+1

aajisaka · 2020-07-15T04:41:43Z

Thank you @GauthamBanasandra for your work. I really appreciate it.

GauthamBanasandra force-pushed the upgrade-boost branch from 974afc7 to 12f58ae Compare June 4, 2020 06:37

GauthamBanasandra force-pushed the upgrade-boost branch from 12f58ae to 988edce Compare June 4, 2020 12:58

GauthamBanasandra force-pushed the upgrade-boost branch from 988edce to 82e1ace Compare June 4, 2020 14:21

GauthamBanasandra force-pushed the upgrade-boost branch from 82e1ace to 53b5944 Compare June 4, 2020 17:54

GauthamBanasandra force-pushed the upgrade-boost branch from 53b5944 to 857ee1b Compare June 6, 2020 16:30

GauthamBanasandra force-pushed the upgrade-boost branch from 857ee1b to 74340c7 Compare June 7, 2020 06:12

GauthamBanasandra force-pushed the upgrade-boost branch from 74340c7 to 6fad8ff Compare June 7, 2020 11:58

aajisaka reviewed Jun 19, 2020

View reviewed changes

BUILDING.txt Outdated Show resolved Hide resolved

aajisaka reviewed Jun 19, 2020

View reviewed changes

dev-support/docker/Dockerfile Outdated Show resolved Hide resolved

HDFS-15385 Upgrade boost library

4dcc89a

* Upgraded boost library to version 1.72. * Removed the asio-1.10.2 that was checked in under libhdfspp/third_party directory.

aajisaka self-requested a review June 19, 2020 05:04

Fix Boost version in comment

9af2c17

* Changed version 1.76 to 1.72 in the comments.

GauthamBanasandra force-pushed the upgrade-boost branch from 6fad8ff to 9af2c17 Compare June 19, 2020 05:05

Increase CI timeout to 20 hours

e362cb3

* The CI run was timing out, hence increasing it to 20 hours.

Fix C++11 warning in hadoop-mapreduce-project

259f286

Merge branch 'trunk' of https://gitbox.apache.org/repos/asf/hadoop in…

ae5a066

…to upgrade-boost

aajisaka reviewed Jul 13, 2020

View reviewed changes

dev-support/docker/Dockerfile Outdated Show resolved Hide resolved

aajisaka reviewed Jul 13, 2020

View reviewed changes

...p-mapreduce-client/hadoop-mapreduce-client-nativetask/src/main/native/src/util/StringUtil.cc Show resolved Hide resolved

GauthamBanasandra added 3 commits July 13, 2020 19:59

Merge branch 'trunk' of https://gitbox.apache.org/repos/asf/hadoop in…

94b11ef

…to upgrade-boost

Remove WORKDIR overrides

5265741

* WORKDIR is set to /root and must not be overridden. Using cd command instead.

Remove unrelated changes

8050a3e

GauthamBanasandra requested a review from aajisaka July 13, 2020 16:59

Suppress hadolint warnings

dd79b9f

* Suppressing the warning DL3003 that is caused by Boost.

aajisaka approved these changes Jul 15, 2020

View reviewed changes

aajisaka merged commit cce5a6f into apache:trunk Jul 15, 2020

aajisaka changed the title ~~HDFS-15385 Upgrade boost library~~ HDFS-15385 Upgrade boost library to 1.72 Jul 15, 2020

GauthamBanasandra deleted the upgrade-boost branch July 15, 2020 15:03

GauthamBanasandra mentioned this pull request Oct 1, 2021

HADOOP-17880. Build 2.10.x with docker #3349

Closed

4 tasks

HDFS-15385 Upgrade boost library to 1.72 #2051

HDFS-15385 Upgrade boost library to 1.72 #2051

Uh oh!

Conversation

GauthamBanasandra commented Jun 3, 2020 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

hadoop-yetus commented Jun 3, 2020

Uh oh!

aajisaka commented Jun 3, 2020

Uh oh!

hadoop-yetus commented Jun 4, 2020

Uh oh!

hadoop-yetus commented Jun 4, 2020

Uh oh!

hadoop-yetus commented Jun 4, 2020

Uh oh!

hadoop-yetus commented Jun 4, 2020

Uh oh!

hadoop-yetus commented Jun 4, 2020

Uh oh!

hadoop-yetus commented Jun 4, 2020

Uh oh!

hadoop-yetus commented Jun 4, 2020

Uh oh!

hadoop-yetus commented Jun 4, 2020

Uh oh!

hadoop-yetus commented Jun 6, 2020

Uh oh!

hadoop-yetus commented Jun 6, 2020

Uh oh!

hadoop-yetus commented Jun 7, 2020

Uh oh!

hadoop-yetus commented Jun 7, 2020

Uh oh!

GauthamBanasandra commented Jun 7, 2020

Uh oh!

Uh oh!

Uh oh!

aajisaka commented Jun 19, 2020

Uh oh!

GauthamBanasandra commented Jun 19, 2020

Uh oh!

aajisaka commented Jun 22, 2020

Uh oh!

hadoop-yetus commented Jun 22, 2020

Uh oh!

hadoop-yetus commented Jun 22, 2020

Uh oh!

oss-maker commented Jun 26, 2020

Uh oh!

hadoop-yetus commented Jun 27, 2020

Uh oh!

hadoop-yetus commented Jun 28, 2020

Uh oh!

Uh oh!

Uh oh!

aajisaka commented Jul 13, 2020 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

GauthamBanasandra commented Jul 13, 2020

Uh oh!

hadoop-yetus commented Jul 13, 2020

Uh oh!

hadoop-yetus commented Jul 14, 2020

Uh oh!

aajisaka commented Jul 14, 2020

Uh oh!

GauthamBanasandra commented Jul 14, 2020

Uh oh!

hadoop-yetus commented Jul 14, 2020

Uh oh!

hadoop-yetus commented Jul 14, 2020

Uh oh!

aajisaka left a comment

Choose a reason for hiding this comment

Uh oh!

aajisaka commented Jul 15, 2020

Uh oh!

Reviewers

GauthamBanasandra commented Jun 3, 2020 •

edited

Loading

aajisaka commented Jul 13, 2020 •

edited

Loading