Skip to content

Conversation

@aajisaka
Copy link
Member

Manually tested with CentOS 7.9.

JIRA: HDFS-15977

@aajisaka
Copy link
Member Author

@GauthamBanasandra @goiri Would you review this?

@GauthamBanasandra
Copy link
Member

Thanks @aajisaka for the fix. Is there a list of OS that we need to support? I'll compile my PRs against them to avoid these issues in the future.

@aajisaka
Copy link
Member Author

IMO, it would be better for Hadoop to support the list in Apache Bigtop:

  • centos7
  • centos8
  • debian9
  • debian10
  • fedora31
  • ubuntu16 (soon EoL at the end of 2021/4, I'm okay to drop the support)
  • ubuntu18

I think @iwasakims has more context.

@aajisaka
Copy link
Member Author

aajisaka commented Apr 15, 2021

I found the latest list: https://ci.bigtop.apache.org/job/Bigtop-trunk-repos/

  • centos 7, 8
  • debian 10
  • fedora 33
  • ubuntu 18, 20

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 51s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 codespell 0m 1s codespell was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
-1 ❌ test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ trunk Compile Tests _
+1 💚 mvninstall 37m 1s trunk passed
+1 💚 compile 2m 58s trunk passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
+1 💚 compile 2m 49s trunk passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
+1 💚 mvnsite 0m 22s trunk passed
+1 💚 shadedclient 59m 6s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+1 💚 mvninstall 0m 14s the patch passed
+1 💚 compile 2m 43s the patch passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
+1 💚 cc 2m 43s the patch passed
+1 💚 golang 2m 43s the patch passed
+1 💚 javac 2m 43s the patch passed
+1 💚 compile 2m 50s the patch passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
+1 💚 cc 2m 50s the patch passed
+1 💚 golang 2m 50s the patch passed
+1 💚 javac 2m 50s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
+1 💚 mvnsite 0m 15s the patch passed
+1 💚 shadedclient 15m 43s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 💚 unit 104m 53s hadoop-hdfs-native-client in the patch passed.
+1 💚 asflicense 0m 31s The patch does not generate ASF License warnings.
189m 10s
Subsystem Report/Notes
Docker ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2914/1/artifact/out/Dockerfile
GITHUB PR #2914
Optional Tests dupname asflicense compile cc mvnsite javac unit codespell golang
uname Linux 0bc1e9739f1a 4.15.0-136-generic #140-Ubuntu SMP Thu Jan 28 05:20:47 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / b316e64
Default Java Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2914/1/testReport/
Max. process+thread count 522 (vs. ulimit of 5500)
modules C: hadoop-hdfs-project/hadoop-hdfs-native-client U: hadoop-hdfs-project/hadoop-hdfs-native-client
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2914/1/console
versions git=2.25.1 maven=3.6.3
Powered by Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

@iwasakims
Copy link
Member

I found the latest list: https://ci.bigtop.apache.org/job/Bigtop-trunk-repos/

Yeah. You can see the discussion on BIGTOP-3471. Ubuntu 16.04 and Debian 9 will be dropped in the next release of Bigtop. Debian 11 might be added.

Copy link
Member

@iwasakims iwasakims left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1. I got no issue on CentOS 7, CentOS 8 and Fedora 33.

@aajisaka aajisaka merged commit f0241ec into apache:trunk Apr 16, 2021
@aajisaka aajisaka deleted the HDFS-15977 branch April 16, 2021 04:26
@aajisaka
Copy link
Member Author

Merged. Thank you @GauthamBanasandra, @iwasakims, and @goiri.

aajisaka added a commit that referenced this pull request Sep 24, 2021
Reviewed-by: Masatake Iwasaki <[email protected]>
Reviewed-by: Inigo Goiri <[email protected]>
(cherry picked from commit f0241ec)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/lib/x-platform/syscall_linux.cc
bbeaudreault pushed a commit to HubSpot/hadoop that referenced this pull request Sep 24, 2021
…able. (apache#2914)

Reviewed-by: Masatake Iwasaki <[email protected]>
Reviewed-by: Inigo Goiri <[email protected]>
(cherry picked from commit f0241ec)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/lib/x-platform/syscall_linux.cc
kiran-maturi pushed a commit to kiran-maturi/hadoop that referenced this pull request Nov 24, 2021
hswong3i added a commit to alvistack/ceph-ceph that referenced this pull request Apr 24, 2023
    git clean -xdf
    git submodule sync --recursive
    git submodule update --recursive --init
    git submodule foreach --recursive git checkout -- .
    git submodule foreach --recursive git clean -xdf
    ./make-debs.sh
    cp /tmp/release/Ubuntu/WORKDIR/*ceph*17.2.6*.{bz2,xz,dsc} /osc/home\:alvistack/ceph-ceph-17.2.6/
    cp ceph.spec /osc/home\:alvistack/ceph-ceph-17.2.6/ceph_17.2.6-1.spec
    cp ceph.rpmlintrc /osc/home\:alvistack/ceph-ceph-17.2.6/
    cp debian/patches/*.patch /osc/home\:alvistack/ceph-ceph-17.2.6/
    cp _constraints /osc/home\:alvistack/ceph-ceph-17.2.6/
    rm -rf /tmp/release/Ubuntu/WORKDIR

See spdk/spdk#2637
See ceph#47712
See ceph#47982
See apache/hadoop#2914
See https://build.opensuse.org/package/show/filesystems:ceph:quincy:upstream/ceph
See https://src.fedoraproject.org/rpms/ceph/tree/rawhide
See https://packages.ubuntu.com/source/lunar/ceph

Signed-off-by: Wong Hoi Sing Edison <[email protected]>
hswong3i added a commit to alvistack/ceph-ceph that referenced this pull request Apr 24, 2023
    git clean -xdf
    git submodule sync --recursive
    git submodule update --recursive --init
    git submodule foreach --recursive git checkout -- .
    git submodule foreach --recursive git clean -xdf
    ./make-debs.sh
    cp /tmp/release/Ubuntu/WORKDIR/*ceph*17.2.6*.{bz2,xz,dsc} /osc/home\:alvistack/ceph-ceph-17.2.6/
    cp ceph.spec /osc/home\:alvistack/ceph-ceph-17.2.6/ceph_17.2.6-1.spec
    cp ceph.rpmlintrc /osc/home\:alvistack/ceph-ceph-17.2.6/
    cp debian/patches/*.patch /osc/home\:alvistack/ceph-ceph-17.2.6/
    cp _constraints /osc/home\:alvistack/ceph-ceph-17.2.6/
    rm -rf /tmp/release/Ubuntu/WORKDIR

See spdk/spdk#2637
See ceph#47712
See ceph#47982
See apache/hadoop#2914
See https://stackoverflow.com/a/39353581
See https://build.opensuse.org/package/show/filesystems:ceph:quincy:upstream/ceph
See https://src.fedoraproject.org/rpms/ceph/tree/rawhide
See https://packages.ubuntu.com/source/lunar/ceph

Signed-off-by: Wong Hoi Sing Edison <[email protected]>
hswong3i added a commit to alvistack/ceph-ceph that referenced this pull request Apr 24, 2023
    git clean -xdf
    git submodule sync --recursive
    git submodule update --recursive --init
    git submodule foreach --recursive git checkout -- .
    git submodule foreach --recursive git clean -xdf
    ./make-debs.sh
    cp /tmp/release/Ubuntu/WORKDIR/*ceph*17.2.6*.{bz2,xz,dsc} /osc/home\:alvistack/ceph-ceph-17.2.6/
    cp ceph.spec /osc/home\:alvistack/ceph-ceph-17.2.6/ceph_17.2.6-1.spec
    cp ceph.rpmlintrc /osc/home\:alvistack/ceph-ceph-17.2.6/
    cp debian/patches/*.patch /osc/home\:alvistack/ceph-ceph-17.2.6/
    cp _constraints /osc/home\:alvistack/ceph-ceph-17.2.6/
    rm -rf /tmp/release/Ubuntu/WORKDIR

See spdk/spdk#2637
See ceph#47712
See ceph#47982
See apache/hadoop#2914
See https://build.opensuse.org/package/show/filesystems:ceph:quincy:upstream/ceph
See https://src.fedoraproject.org/rpms/ceph/tree/rawhide
See https://packages.ubuntu.com/source/lunar/ceph

Signed-off-by: Wong Hoi Sing Edison <[email protected]>
hswong3i added a commit to alvistack/ceph-ceph that referenced this pull request Apr 24, 2023
    git clean -xdf
    git submodule sync --recursive
    git submodule update --recursive --init
    git submodule foreach --recursive git checkout -- .
    git submodule foreach --recursive git clean -xdf
    ./make-debs.sh
    cp /tmp/release/Ubuntu/WORKDIR/*ceph*17.2.6*.{bz2,xz,dsc} /osc/home\:alvistack/ceph-ceph-17.2.6/
    cp ceph.spec /osc/home\:alvistack/ceph-ceph-17.2.6/ceph_17.2.6-1.spec
    cp ceph.rpmlintrc /osc/home\:alvistack/ceph-ceph-17.2.6/
    cp debian/patches/*.patch /osc/home\:alvistack/ceph-ceph-17.2.6/
    cp _constraints /osc/home\:alvistack/ceph-ceph-17.2.6/
    rm -rf /tmp/release/Ubuntu/WORKDIR

See spdk/spdk#2637
See ceph#47712
See ceph#47982
See apache/hadoop#2914
See https://build.opensuse.org/package/show/filesystems:ceph:quincy:upstream/ceph
See https://src.fedoraproject.org/rpms/ceph/tree/rawhide
See https://packages.ubuntu.com/source/lunar/ceph

Signed-off-by: Wong Hoi Sing Edison <[email protected]>
hswong3i added a commit to alvistack/ceph-ceph that referenced this pull request Apr 24, 2023
    git clean -xdf
    git submodule sync --recursive
    git submodule update --recursive --init
    git submodule foreach --recursive git checkout -- .
    git submodule foreach --recursive git clean -xdf
    ./make-debs.sh
    cp /tmp/release/Ubuntu/WORKDIR/*ceph*17.2.6*.{bz2,xz,dsc} /osc/home\:alvistack/ceph-ceph-17.2.6/
    cp ceph.spec /osc/home\:alvistack/ceph-ceph-17.2.6/ceph_17.2.6-1.spec
    cp ceph.rpmlintrc /osc/home\:alvistack/ceph-ceph-17.2.6/
    cp debian/patches/*.patch /osc/home\:alvistack/ceph-ceph-17.2.6/
    cp _constraints /osc/home\:alvistack/ceph-ceph-17.2.6/
    rm -rf /tmp/release/Ubuntu/WORKDIR

See spdk/spdk#2637
See ceph#47712
See ceph#47982
See apache/hadoop#2914
See https://build.opensuse.org/package/show/filesystems:ceph:quincy:upstream/ceph
See https://src.fedoraproject.org/rpms/ceph/tree/rawhide
See https://packages.ubuntu.com/source/lunar/ceph

Signed-off-by: Wong Hoi Sing Edison <[email protected]>
hswong3i added a commit to alvistack/ceph-ceph that referenced this pull request Apr 24, 2023
    git clean -xdf
    git submodule sync --recursive
    git submodule update --recursive --init
    git submodule foreach --recursive git checkout -- .
    git submodule foreach --recursive git clean -xdf
    ./make-debs.sh
    cp /tmp/release/Ubuntu/WORKDIR/*ceph*17.2.6*.{bz2,xz,dsc} /osc/home\:alvistack/ceph-ceph-17.2.6/
    cp ceph.spec /osc/home\:alvistack/ceph-ceph-17.2.6/ceph_17.2.6-1.spec
    cp ceph.rpmlintrc /osc/home\:alvistack/ceph-ceph-17.2.6/
    cp debian/patches/*.patch /osc/home\:alvistack/ceph-ceph-17.2.6/
    cp _constraints /osc/home\:alvistack/ceph-ceph-17.2.6/
    rm -rf /tmp/release/Ubuntu/WORKDIR

See spdk/spdk#2637
See ceph#47712
See ceph#47982
See apache/hadoop#2914
See https://build.opensuse.org/package/show/filesystems:ceph:quincy:upstream/ceph
See https://src.fedoraproject.org/rpms/ceph/tree/rawhide
See https://packages.ubuntu.com/source/lunar/ceph

Signed-off-by: Wong Hoi Sing Edison <[email protected]>
hswong3i added a commit to alvistack/ceph-ceph that referenced this pull request Apr 24, 2023
    git clean -xdf
    git submodule sync --recursive
    git submodule update --recursive --init
    git submodule foreach --recursive git checkout -- .
    git submodule foreach --recursive git clean -xdf
    ./make-debs.sh
    cp /tmp/release/Ubuntu/WORKDIR/*ceph*17.2.6*.{bz2,xz,dsc} /osc/home\:alvistack/ceph-ceph-17.2.6/
    cp ceph.spec /osc/home\:alvistack/ceph-ceph-17.2.6/ceph_17.2.6-1.spec
    cp ceph.rpmlintrc /osc/home\:alvistack/ceph-ceph-17.2.6/
    cp debian/patches/*.patch /osc/home\:alvistack/ceph-ceph-17.2.6/
    cp _constraints /osc/home\:alvistack/ceph-ceph-17.2.6/
    rm -rf /tmp/release/Ubuntu/WORKDIR

See spdk/spdk#2637
See ceph#47712
See ceph#47982
See apache/hadoop#2914
See https://build.opensuse.org/package/show/filesystems:ceph:quincy:upstream/ceph
See https://src.fedoraproject.org/rpms/ceph/tree/rawhide
See https://packages.ubuntu.com/source/lunar/ceph

Signed-off-by: Wong Hoi Sing Edison <[email protected]>
hswong3i added a commit to alvistack/ceph-ceph that referenced this pull request Apr 24, 2023
    git clean -xdf
    git submodule sync --recursive
    git submodule update --recursive --init
    git submodule foreach --recursive git checkout -- .
    git submodule foreach --recursive git clean -xdf
    ./make-debs.sh
    cp /tmp/release/Ubuntu/WORKDIR/*ceph*17.2.6*.{bz2,xz,dsc} /osc/home\:alvistack/ceph-ceph-17.2.6/
    cp ceph.spec /osc/home\:alvistack/ceph-ceph-17.2.6/ceph_17.2.6-1.spec
    cp ceph.rpmlintrc /osc/home\:alvistack/ceph-ceph-17.2.6/
    cp debian/patches/*.patch /osc/home\:alvistack/ceph-ceph-17.2.6/
    cp _constraints /osc/home\:alvistack/ceph-ceph-17.2.6/
    rm -rf /tmp/release/Ubuntu/WORKDIR

See spdk/spdk#2637
See ceph#47712
See ceph#47982
See apache/hadoop#2914
See https://build.opensuse.org/package/show/filesystems:ceph:quincy:upstream/ceph
See https://src.fedoraproject.org/rpms/ceph/tree/rawhide
See https://packages.ubuntu.com/source/lunar/ceph

Signed-off-by: Wong Hoi Sing Edison <[email protected]>
hswong3i added a commit to alvistack/ceph-ceph that referenced this pull request Apr 24, 2023
    git clean -xdf
    git submodule sync --recursive
    git submodule update --recursive --init
    git submodule foreach --recursive git checkout -- .
    git submodule foreach --recursive git clean -xdf
    ./make-debs.sh
    cp /tmp/release/Ubuntu/WORKDIR/*ceph*17.2.6*.{bz2,xz,dsc} /osc/home\:alvistack/ceph-ceph-17.2.6/
    cp ceph.spec /osc/home\:alvistack/ceph-ceph-17.2.6/ceph_17.2.6-1.spec
    cp ceph.rpmlintrc /osc/home\:alvistack/ceph-ceph-17.2.6/
    cp debian/patches/*.patch /osc/home\:alvistack/ceph-ceph-17.2.6/
    cp _constraints /osc/home\:alvistack/ceph-ceph-17.2.6/
    rm -rf /tmp/release/Ubuntu/WORKDIR

See spdk/spdk#2637
See ceph#47712
See ceph#47982
See apache/hadoop#2914
See https://build.opensuse.org/package/show/filesystems:ceph:quincy:upstream/ceph
See https://src.fedoraproject.org/rpms/ceph/tree/rawhide
See https://packages.ubuntu.com/source/lunar/ceph

Signed-off-by: Wong Hoi Sing Edison <[email protected]>
deepakdamri pushed a commit to acceldata-io/hadoop that referenced this pull request Oct 28, 2024
Reviewed-by: Masatake Iwasaki <[email protected]>
Reviewed-by: Inigo Goiri <[email protected]>
(cherry picked from commit f0241ec)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/lib/x-platform/syscall_linux.cc
deepakdamri pushed a commit to acceldata-io/hadoop that referenced this pull request Nov 20, 2024
Reviewed-by: Masatake Iwasaki <[email protected]>
Reviewed-by: Inigo Goiri <[email protected]>
(cherry picked from commit f0241ec)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/lib/x-platform/syscall_linux.cc
deepakdamri pushed a commit to acceldata-io/hadoop that referenced this pull request Nov 27, 2024
Reviewed-by: Masatake Iwasaki <[email protected]>
Reviewed-by: Inigo Goiri <[email protected]>
(cherry picked from commit f0241ec)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/lib/x-platform/syscall_linux.cc
deepakdamri pushed a commit to acceldata-io/hadoop that referenced this pull request Nov 28, 2024
Reviewed-by: Masatake Iwasaki <[email protected]>
Reviewed-by: Inigo Goiri <[email protected]>
(cherry picked from commit f0241ec)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/lib/x-platform/syscall_linux.cc
deepakdamri pushed a commit to acceldata-io/hadoop that referenced this pull request Dec 2, 2024
Reviewed-by: Masatake Iwasaki <[email protected]>
Reviewed-by: Inigo Goiri <[email protected]>
(cherry picked from commit f0241ec)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/lib/x-platform/syscall_linux.cc
deepakdamri pushed a commit to acceldata-io/hadoop that referenced this pull request Dec 2, 2024
Reviewed-by: Masatake Iwasaki <[email protected]>
Reviewed-by: Inigo Goiri <[email protected]>
(cherry picked from commit f0241ec)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/lib/x-platform/syscall_linux.cc
deepakdamri pushed a commit to acceldata-io/hadoop that referenced this pull request Dec 2, 2024
Reviewed-by: Masatake Iwasaki <[email protected]>
Reviewed-by: Inigo Goiri <[email protected]>
(cherry picked from commit f0241ec)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/lib/x-platform/syscall_linux.cc
deepakdamri pushed a commit to acceldata-io/hadoop that referenced this pull request Dec 2, 2024
Reviewed-by: Masatake Iwasaki <[email protected]>
Reviewed-by: Inigo Goiri <[email protected]>
(cherry picked from commit f0241ec)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/lib/x-platform/syscall_linux.cc
deepakdamri pushed a commit to acceldata-io/hadoop that referenced this pull request Dec 3, 2024
Reviewed-by: Masatake Iwasaki <[email protected]>
Reviewed-by: Inigo Goiri <[email protected]>
(cherry picked from commit f0241ec)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/lib/x-platform/syscall_linux.cc
harshith-212 added a commit to acceldata-io/hadoop that referenced this pull request Mar 5, 2025
shubhluck pushed a commit to acceldata-io/hadoop that referenced this pull request Mar 5, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants