Skip to content

Conversation

aajisaka
Copy link
Member

@aajisaka
Copy link
Member Author

I'll update the dependencies shortly.

@aajisaka aajisaka requested a review from iwasakims August 16, 2019 11:26
LICENSE-binary Outdated
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

no version specified.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't know the version of the leveldb libraries included in leveldbjni-all.jar.
There is no information in the GitHub repository: https://github.com/fusesource/leveldbjni
It seems that the leveldb version depends on the release manager's environment.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hadoop bundles leveldbjni-all-1.8.jar which contains pre-built libraries for each platform. leveldb is build from the code in github.com/chirino/leveldb and its version is 1.13.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for the information! Included the version.

LICENSE-binary Outdated
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These lines are not covered in LICENSE.txt. These could be sorted with above lines.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sorted. Thanks.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 41 Docker mode activated.
_ Prechecks _
+1 dupname 2 No case conflicting files found.
0 shelldocs 2 Shelldocs was not available.
+1 @author 0 The patch does not contain any @author tags.
-1 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ trunk Compile Tests _
0 mvndep 74 Maven dependency ordering for branch
+1 mvninstall 1155 trunk passed
+1 compile 1092 trunk passed
+1 mvnsite 884 trunk passed
+1 shadedclient 612 branch has no errors when building and testing our client artifacts.
+1 javadoc 360 trunk passed
_ Patch Compile Tests _
0 mvndep 25 Maven dependency ordering for patch
+1 mvninstall 1076 the patch passed
+1 compile 1041 the patch passed
+1 javac 1041 the patch passed
+1 mvnsite 848 the patch passed
+1 shellcheck 2 There were no new shellcheck issues.
+1 whitespace 0 The patch has no whitespace issues.
+1 xml 6 The patch has no ill-formed XML file.
+1 shadedclient 634 patch has no errors when building and testing our client artifacts.
+1 javadoc 375 the patch passed
_ Other Tests _
-1 unit 9140 root in the patch failed.
-1 asflicense 49 The patch generated 18 ASF License warnings.
17567
Reason Tests
Failed junit tests hadoop.hdfs.TestMaintenanceState
hadoop.hdfs.server.diskbalancer.TestDiskBalancerWithMockMover
hadoop.hdfs.server.namenode.TestFsck
hadoop.hdfs.server.sps.TestExternalStoragePolicySatisfier
hadoop.hdfs.TestReconstructStripedFile
hadoop.hdfs.server.diskbalancer.TestDiskBalancer
hadoop.hdfs.tools.TestDFSZKFailoverController
hadoop.hdfs.TestSafeModeWithStripedFile
hadoop.hdfs.server.namenode.TestQuotaByStorageType
hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics
hadoop.hdfs.TestErasureCodingPolicyWithSnapshotWithRandomECPolicy
hadoop.hdfs.server.aliasmap.TestSecureAliasMap
hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFSStriped
hadoop.hdfs.server.diskbalancer.TestConnectors
hadoop.hdfs.server.diskbalancer.command.TestDiskBalancerCommand
hadoop.hdfs.server.namenode.TestNameNodeRecovery
hadoop.hdfs.server.namenode.TestReencryptionHandler
hadoop.hdfs.TestDFSStripedOutputStreamWithRandomECPolicy
hadoop.hdfs.server.blockmanagement.TestReplicationPolicy
hadoop.hdfs.TestMultiThreadedHflush
hadoop.hdfs.TestErasureCodingPolicyWithSnapshot
hadoop.hdfs.TestDistributedFileSystem
hadoop.hdfs.TestFileChecksumCompositeCrc
hadoop.hdfs.server.blockmanagement.TestPendingReconstruction
Subsystem Report/Notes
Docker Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-1307/3/artifact/out/Dockerfile
GITHUB PR #1307
Optional Tests dupname asflicense shellcheck shelldocs compile javac javadoc mvninstall mvnsite unit shadedclient xml
uname Linux 9051b2e522e9 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality personality/hadoop.sh
git revision trunk / 4f925af
Default Java 1.8.0_222
unit https://builds.apache.org/job/hadoop-multibranch/job/PR-1307/3/artifact/out/patch-unit-root.txt
Test Results https://builds.apache.org/job/hadoop-multibranch/job/PR-1307/3/testReport/
asflicense https://builds.apache.org/job/hadoop-multibranch/job/PR-1307/3/artifact/out/patch-asflicense-problems.txt
Max. process+thread count 4008 (vs. ulimit of 5500)
modules C: hadoop-assemblies hadoop-tools/hadoop-sls . U: .
Console output https://builds.apache.org/job/hadoop-multibranch/job/PR-1307/3/console
versions git=2.7.4 maven=3.3.9 shellcheck=0.4.6
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 43 Docker mode activated.
_ Prechecks _
+1 dupname 3 No case conflicting files found.
0 shelldocs 3 Shelldocs was not available.
+1 @author 0 The patch does not contain any @author tags.
-1 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ trunk Compile Tests _
0 mvndep 70 Maven dependency ordering for branch
+1 mvninstall 1049 trunk passed
+1 compile 1130 trunk passed
+1 mvnsite 844 trunk passed
+1 shadedclient 602 branch has no errors when building and testing our client artifacts.
+1 javadoc 356 trunk passed
-0 patch 980 Used diff version of patch file. Binary files and potentially other changes not applied. Please rebase and squash commits if necessary.
_ Patch Compile Tests _
0 mvndep 28 Maven dependency ordering for patch
+1 mvninstall 1075 the patch passed
+1 compile 1053 the patch passed
+1 javac 1053 the patch passed
+1 mvnsite 942 the patch passed
+1 shellcheck 0 There were no new shellcheck issues.
+1 whitespace 0 The patch has no whitespace issues.
+1 xml 7 The patch has no ill-formed XML file.
+1 shadedclient 665 patch has no errors when building and testing our client artifacts.
+1 javadoc 370 the patch passed
_ Other Tests _
-1 unit 8937 root in the patch failed.
+1 asflicense 51 The patch does not generate ASF License warnings.
17394
Reason Tests
Failed junit tests hadoop.yarn.server.nodemanager.amrmproxy.TestFederationInterceptor
hadoop.hdfs.TestStripedFileAppend
hadoop.hdfs.server.namenode.TestFsck
hadoop.hdfs.TestDecommissionWithStriped
hadoop.hdfs.TestSafeModeWithStripedFile
hadoop.hdfs.server.datanode.TestDirectoryScanner
hadoop.hdfs.server.namenode.TestNameNodeMetadataConsistency
hadoop.hdfs.TestUnsetAndChangeDirectoryEcPolicy
hadoop.hdfs.TestDistributedFileSystem
Subsystem Report/Notes
Docker Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-1307/5/artifact/out/Dockerfile
GITHUB PR #1307
Optional Tests dupname asflicense shellcheck shelldocs compile javac javadoc mvninstall mvnsite unit shadedclient xml
uname Linux f247041d42ca 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality personality/hadoop.sh
git revision trunk / 30ce854
Default Java 1.8.0_222
unit https://builds.apache.org/job/hadoop-multibranch/job/PR-1307/5/artifact/out/patch-unit-root.txt
Test Results https://builds.apache.org/job/hadoop-multibranch/job/PR-1307/5/testReport/
Max. process+thread count 4658 (vs. ulimit of 5500)
modules C: hadoop-assemblies hadoop-tools/hadoop-sls . U: .
Console output https://builds.apache.org/job/hadoop-multibranch/job/PR-1307/5/console
versions git=2.7.4 maven=3.3.9 shellcheck=0.4.6
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 51 Docker mode activated.
_ Prechecks _
+1 dupname 2 No case conflicting files found.
0 shelldocs 2 Shelldocs was not available.
+1 @author 0 The patch does not contain any @author tags.
-1 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ trunk Compile Tests _
0 mvndep 70 Maven dependency ordering for branch
+1 mvninstall 1114 trunk passed
+1 compile 1231 trunk passed
+1 mvnsite 887 trunk passed
+1 shadedclient 628 branch has no errors when building and testing our client artifacts.
+1 javadoc 415 trunk passed
-0 patch 1064 Used diff version of patch file. Binary files and potentially other changes not applied. Please rebase and squash commits if necessary.
_ Patch Compile Tests _
0 mvndep 27 Maven dependency ordering for patch
+1 mvninstall 1116 the patch passed
+1 compile 1090 the patch passed
+1 javac 1090 the patch passed
+1 mvnsite 890 the patch passed
+1 shellcheck 1 There were no new shellcheck issues.
+1 whitespace 0 The patch has no whitespace issues.
+1 xml 5 The patch has no ill-formed XML file.
+1 shadedclient 670 patch has no errors when building and testing our client artifacts.
+1 javadoc 370 the patch passed
_ Other Tests _
-1 unit 8409 root in the patch failed.
+1 asflicense 48 The patch does not generate ASF License warnings.
17181
Reason Tests
Failed junit tests hadoop.hdfs.TestErasureCodingPolicies
hadoop.hdfs.TestFileChecksum
Subsystem Report/Notes
Docker Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-1307/7/artifact/out/Dockerfile
GITHUB PR #1307
Optional Tests dupname asflicense shellcheck shelldocs compile javac javadoc mvninstall mvnsite unit shadedclient xml
uname Linux d08200ea91bc 4.4.0-157-generic #185-Ubuntu SMP Tue Jul 23 09:17:01 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality personality/hadoop.sh
git revision trunk / ee7c261
Default Java 1.8.0_212
unit https://builds.apache.org/job/hadoop-multibranch/job/PR-1307/7/artifact/out/patch-unit-root.txt
Test Results https://builds.apache.org/job/hadoop-multibranch/job/PR-1307/7/testReport/
Max. process+thread count 4094 (vs. ulimit of 5500)
modules C: hadoop-assemblies hadoop-tools/hadoop-sls . U: .
Console output https://builds.apache.org/job/hadoop-multibranch/job/PR-1307/7/console
versions git=2.7.4 maven=3.3.9 shellcheck=0.4.6
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

LICENSE-binary Outdated
junit:junit:4.12


Eclipse Public License 2.0
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

should be CDDL + GPLv2 with classpath exception?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes. Thank you for your comment.
The libraries have been moved to eclipse repository and now the license is EPL, however, Apache Hadoop is using the old version of the libraries and the licenses were CDDL + GPLv2 with classpath exception.

@iwasakims
Copy link
Member

I built dists with latest patch. Assembly part looks good overall.

  • built tarball and source-taball by "mvn package -Psrc,dist".
  • ran dev-support/bin/verify-license-files.
  • tarball and source-tarball built from source-tarball contains L&N files.

@iwasakims
Copy link
Member

CDDLs are not contained in licenses-binary.

@aajisaka
Copy link
Member Author

CDDLs are not contained in licenses-binary.

Added licenses-binary/LICENSE-cddl-gplv2-ce.txt

@iwasakims
Copy link
Member

+1. Thanks for the update. Further nits (of original LICENSE.txt) should be fixed in follow-ups. Once the split is done, reviewing the update would be much easier.

@aajisaka aajisaka closed this in 567091a Aug 27, 2019
@aajisaka
Copy link
Member Author

Committed. Thank you, @iwasakims !

@aajisaka aajisaka deleted the HADOOP-15958 branch August 27, 2019 04:50
amahussein pushed a commit to amahussein/hadoop that referenced this pull request Oct 29, 2019
RogPodge pushed a commit to RogPodge/hadoop that referenced this pull request Mar 25, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants