Skip to content

ODP-2462: HDFS-3246|HDFS-14564|HDFS-14304|HDFS-14033|HDFS-14267|HDFS-15977|HDFS-14846|HDFS-14111|HDFS-14478 Making Hadoop 3.2.3.3.2.3.3-2 compatible with Impala 4.4.0 #60

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 40 commits into from
Closed

ODP-2462: HDFS-3246|HDFS-14564|HDFS-14304|HDFS-14033|HDFS-14267|HDFS-15977|HDFS-14846|HDFS-14111|HDFS-14478 Making Hadoop 3.2.3.3.2.3.3-2 compatible with Impala 4.4.0 #60

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
40 commits
Select commit Hold shift + click to select a range
12d7d26
HDFS-14564: Add libhdfs APIs for readFully; add readFully to ByteBuff…
sahilTakiar Sep 27, 2019
57202cc
HDFS-3246: pRead equivalent for direct read path (#597)
sahilTakiar Apr 30, 2019
5a6d88b
HDFS-14033. [libhdfs++] Disable libhdfs++ build on systems that do no…
sunilgovind Oct 31, 2018
d1664a7
HDFS-14267. Add test_libhdfs_ops to libhdfs tests, mark libhdfs_read/…
Feb 20, 2019
350ffec
HDFS-14304: High lock contention on hdfsHashMutex in libhdfs
Mar 19, 2019
a277946
HDFS-15977. Call explicit_bzero only if it is available. (#2914)
aajisaka Apr 16, 2021
b1a36dc
ODP-2663: Comment override in CryptoInputStream.java for readFully me…
deepakdamri Oct 29, 2024
2a6fd6c
HDFS-14846: libhdfs tests are failing on trunk due to jni usage bugs
deepakdamri Dec 2, 2024
4eb7768
HDFS-14111: hdfsOpenFile on HDFS causes unnecessary IO from file offs…
deepakdamri Dec 2, 2024
f1c610f
HDFS-14478: Add libhdfs APIs for openFile
deepakdamri Dec 2, 2024
56442e7
ODP-2583: HADOOP-11616 : bump up Curator to 5.2.0 #33
basapuram-kumar Nov 13, 2024
66ff1bd
ODP-2633: YARN-11702: Fix Yarn over allocating containers (#6990) Con…
shameersss1 Sep 25, 2024
4f26b36
ODP-2635: HADOOP-16167: Fixed Hadoop shell script for Ubuntu 18. (#44)
prabhjyotsingh Nov 20, 2024
57b8078
ODP-2634: YARN-10352: Skip schedule on not heartbeated nodes in Multi…
prabhjyotsingh Nov 20, 2024
c56ed11
ODP-2636: MAPREDUCE-7431: ShuffleHandler refactor and fix after Netty…
prabhjyotsingh Nov 20, 2024
170ee4b
ODP-2638: MAPREDUCE-7433: Remove unused mapred/LoggingHttpResponseEnc…
prabhjyotsingh Nov 20, 2024
f9636ef
ODP-2637: MAPREDUCE-7434: Fix ShuffleHandler tests. Contributed by Ta…
prabhjyotsingh Nov 20, 2024
1730833
ODP-2639: MAPREDUCE-7441: Race condition in closing FadvisedFileRegio…
prabhjyotsingh Nov 20, 2024
6c76302
ODP-2640: HADOOP-16647: Support OpenSSL 1.1.1 LTS - patch-0
prabhjyotsingh Nov 20, 2024
8b87382
ODP-1434 Fixing case sensitivity issue with jackson upgrade on regist…
shubhluck Nov 21, 2024
fde040a
ODP-3.2.3.3-3 version update.
manishsinghmowall Dec 5, 2024
dd69d2e
fixup! ODP-3.2.3.3-3 version update.
deepakdamri Dec 5, 2024
b36e55c
ODP-2768 : Refactor shebangs for python scripts to ambari-python-wrap
harshith-212 Dec 10, 2024
4f924c2
ODP-2831 : Use CMAKE_CXX_STANDARD instead of -std=c++11 directly
Sourabh-Dilraj Dec 17, 2024
175aabd
HADOOP-15785. [JDK10] Javadoc build fails on JDK 10 in hadoop-common.…
tasanuma Oct 11, 2018
8c8f1b0
HADOOP-15229. Add FileSystem builder-based openFile() API to match cr…
steveloughran Feb 5, 2019
e158c78
HADOOP-16026:Replace incorrect use of system property user.name.
anuengineer Apr 22, 2019
9726b46
HADOOP-15691 Add PathCapabilities to FileSystem and FileContext.
steveloughran Sep 25, 2019
b2f0c3f
HADOOP-16759. Filesystem openFile() builder to take a FileStatus para…
steveloughran Jan 21, 2020
3a39f91
HADOOP-16202. Enhanced openFile(): hadoop-common changes. (#2584/1)
steveloughran Apr 24, 2022
58db33b
HADOOP-17450. Add Public IOStatistics API. (#2577)
steveloughran Dec 31, 2020
eca7b37
HADOOP-14556. S3A to support Delegation Tokens.
steveloughran Jan 14, 2019
a185bf6
HADOOP-13786 Add S3A committer for zero-rename commits to S3 endpoints.
steveloughran Nov 22, 2017
d630ea6
HADOOP-16093. Move DurationInfo from hadoop-aws to hadoop-common org.…
abmodi Feb 26, 2019
b169df3
HADOOP-16665. Filesystems to be closed if they failed during initiali…
steveloughran Nov 12, 2019
938ef7d
HADOOP-14630 Contract Tests to verify create, mkdirs and rename under…
steveloughran Mar 9, 2020
c766e6d
HDFS-15567. [SBN Read] HDFS should expose msync() API to allow downst…
shvachko Oct 13, 2020
87bb758
Add hadoop-shaded-guava jar
deepakdamri Jan 21, 2025
af36221
HADOOP-16279. S3Guard: Implement time-based (TTL) expiry for entries …
Jun 16, 2019
b7ee227
HADOOP-16085. S3Guard: use object version or etags to protect against…
May 19, 2019
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
2 changes: 1 addition & 1 deletion dev-support/bin/checkcompatibility.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
#!/usr/bin/env python3
#!/usr/bin/env ambari-python-wrap
#
# Licensed to the Apache Software Foundation (ASF) under one
# or more contributor license agreements. See the NOTICE file
Expand Down
2 changes: 1 addition & 1 deletion dev-support/git-jira-validation/git_jira_fix_version_check.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
#!/usr/bin/env python3
#!/usr/bin/env ambari-python-wrap
############################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one
Expand Down
4 changes: 2 additions & 2 deletions hadoop-assemblies/pom.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -23,11 +23,11 @@
<parent>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-project</artifactId>
<version>3.2.3.3.2.3.3-2</version>
<version>3.2.3.3.2.3.3-3</version>
<relativePath>../hadoop-project</relativePath>
</parent>
<artifactId>hadoop-assemblies</artifactId>
<version>3.2.3.3.2.3.3-2</version>
<version>3.2.3.3.2.3.3-3</version>
<name>Apache Hadoop Assemblies</name>
<description>Apache Hadoop Assemblies</description>

Expand Down
2 changes: 1 addition & 1 deletion hadoop-build-tools/pom.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@
<parent>
<artifactId>hadoop-main</artifactId>
<groupId>org.apache.hadoop</groupId>
<version>3.2.3.3.2.3.3-2</version>
<version>3.2.3.3.2.3.3-3</version>
</parent>
<modelVersion>4.0.0</modelVersion>
<artifactId>hadoop-build-tools</artifactId>
Expand Down
4 changes: 2 additions & 2 deletions hadoop-client-modules/hadoop-client-api/pom.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,11 +18,11 @@
<parent>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-project</artifactId>
<version>3.2.3.3.2.3.3-2</version>
<version>3.2.3.3.2.3.3-3</version>
<relativePath>../../hadoop-project</relativePath>
</parent>
<artifactId>hadoop-client-api</artifactId>
<version>3.2.3.3.2.3.3-2</version>
<version>3.2.3.3.2.3.3-3</version>
<packaging>jar</packaging>

<description>Apache Hadoop Client</description>
Expand Down
4 changes: 2 additions & 2 deletions hadoop-client-modules/hadoop-client-check-invariants/pom.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,11 +18,11 @@
<parent>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-project</artifactId>
<version>3.2.3.3.2.3.3-2</version>
<version>3.2.3.3.2.3.3-3</version>
<relativePath>../../hadoop-project</relativePath>
</parent>
<artifactId>hadoop-client-check-invariants</artifactId>
<version>3.2.3.3.2.3.3-2</version>
<version>3.2.3.3.2.3.3-3</version>
<packaging>pom</packaging>

<description>
Expand Down
4 changes: 2 additions & 2 deletions hadoop-client-modules/hadoop-client-check-test-invariants/pom.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,11 +18,11 @@
<parent>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-project</artifactId>
<version>3.2.3.3.2.3.3-2</version>
<version>3.2.3.3.2.3.3-3</version>
<relativePath>../../hadoop-project</relativePath>
</parent>
<artifactId>hadoop-client-check-test-invariants</artifactId>
<version>3.2.3.3.2.3.3-2</version>
<version>3.2.3.3.2.3.3-3</version>
<packaging>pom</packaging>

<description>
Expand Down
4 changes: 2 additions & 2 deletions hadoop-client-modules/hadoop-client-integration-tests/pom.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,11 +18,11 @@
<parent>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-project</artifactId>
<version>3.2.3.3.2.3.3-2</version>
<version>3.2.3.3.2.3.3-3</version>
<relativePath>../../hadoop-project</relativePath>
</parent>
<artifactId>hadoop-client-integration-tests</artifactId>
<version>3.2.3.3.2.3.3-2</version>
<version>3.2.3.3.2.3.3-3</version>

<description>Checks that we can use the generated artifacts</description>
<name>Apache Hadoop Client Packaging Integration Tests</name>
Expand Down
4 changes: 2 additions & 2 deletions hadoop-client-modules/hadoop-client-minicluster/pom.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,11 +18,11 @@
<parent>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-project</artifactId>
<version>3.2.3.3.2.3.3-2</version>
<version>3.2.3.3.2.3.3-3</version>
<relativePath>../../hadoop-project</relativePath>
</parent>
<artifactId>hadoop-client-minicluster</artifactId>
<version>3.2.3.3.2.3.3-2</version>
<version>3.2.3.3.2.3.3-3</version>
<packaging>jar</packaging>

<description>Apache Hadoop Minicluster for Clients</description>
Expand Down
4 changes: 2 additions & 2 deletions hadoop-client-modules/hadoop-client-runtime/pom.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,11 +18,11 @@
<parent>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-project</artifactId>
<version>3.2.3.3.2.3.3-2</version>
<version>3.2.3.3.2.3.3-3</version>
<relativePath>../../hadoop-project</relativePath>
</parent>
<artifactId>hadoop-client-runtime</artifactId>
<version>3.2.3.3.2.3.3-2</version>
<version>3.2.3.3.2.3.3-3</version>
<packaging>jar</packaging>

<description>Apache Hadoop Client</description>
Expand Down
4 changes: 2 additions & 2 deletions hadoop-client-modules/hadoop-client/pom.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,11 +18,11 @@
<parent>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-project-dist</artifactId>
<version>3.2.3.3.2.3.3-2</version>
<version>3.2.3.3.2.3.3-3</version>
<relativePath>../../hadoop-project-dist</relativePath>
</parent>
<artifactId>hadoop-client</artifactId>
<version>3.2.3.3.2.3.3-2</version>
<version>3.2.3.3.2.3.3-3</version>

<description>Apache Hadoop Client aggregation pom with dependencies exposed</description>
<name>Apache Hadoop Client Aggregator</name>
Expand Down
2 changes: 1 addition & 1 deletion hadoop-client-modules/pom.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@
<parent>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-project</artifactId>
<version>3.2.3.3.2.3.3-2</version>
<version>3.2.3.3.2.3.3-3</version>
<relativePath>../hadoop-project</relativePath>
</parent>
<artifactId>hadoop-client-modules</artifactId>
Expand Down
4 changes: 2 additions & 2 deletions hadoop-cloud-storage-project/hadoop-cloud-storage/pom.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,11 +18,11 @@
<parent>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-project</artifactId>
<version>3.2.3.3.2.3.3-2</version>
<version>3.2.3.3.2.3.3-3</version>
<relativePath>../../hadoop-project</relativePath>
</parent>
<artifactId>hadoop-cloud-storage</artifactId>
<version>3.2.3.3.2.3.3-2</version>
<version>3.2.3.3.2.3.3-3</version>
<packaging>jar</packaging>

<description>Apache Hadoop Cloud Storage</description>
Expand Down
4 changes: 2 additions & 2 deletions hadoop-cloud-storage-project/pom.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -20,11 +20,11 @@
<parent>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-project</artifactId>
<version>3.2.3.3.2.3.3-2</version>
<version>3.2.3.3.2.3.3-3</version>
<relativePath>../hadoop-project</relativePath>
</parent>
<artifactId>hadoop-cloud-storage-project</artifactId>
<version>3.2.3.3.2.3.3-2</version>
<version>3.2.3.3.2.3.3-3</version>
<description>Apache Hadoop Cloud Storage Project</description>
<name>Apache Hadoop Cloud Storage Project</name>
<packaging>pom</packaging>
Expand Down
4 changes: 2 additions & 2 deletions hadoop-common-project/hadoop-annotations/pom.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -20,11 +20,11 @@
<parent>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-project</artifactId>
<version>3.2.3.3.2.3.3-2</version>
<version>3.2.3.3.2.3.3-3</version>
<relativePath>../../hadoop-project</relativePath>
</parent>
<artifactId>hadoop-annotations</artifactId>
<version>3.2.3.3.2.3.3-2</version>
<version>3.2.3.3.2.3.3-3</version>
<description>Apache Hadoop Annotations</description>
<name>Apache Hadoop Annotations</name>
<packaging>jar</packaging>
Expand Down
4 changes: 2 additions & 2 deletions hadoop-common-project/hadoop-auth-examples/pom.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -20,11 +20,11 @@
<parent>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-project</artifactId>
<version>3.2.3.3.2.3.3-2</version>
<version>3.2.3.3.2.3.3-3</version>
<relativePath>../../hadoop-project</relativePath>
</parent>
<artifactId>hadoop-auth-examples</artifactId>
<version>3.2.3.3.2.3.3-2</version>
<version>3.2.3.3.2.3.3-3</version>
<packaging>war</packaging>

<name>Apache Hadoop Auth Examples</name>
Expand Down
4 changes: 2 additions & 2 deletions hadoop-common-project/hadoop-auth/pom.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -20,11 +20,11 @@
<parent>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-project</artifactId>
<version>3.2.3.3.2.3.3-2</version>
<version>3.2.3.3.2.3.3-3</version>
<relativePath>../../hadoop-project</relativePath>
</parent>
<artifactId>hadoop-auth</artifactId>
<version>3.2.3.3.2.3.3-2</version>
<version>3.2.3.3.2.3.3-3</version>
<packaging>jar</packaging>

<name>Apache Hadoop Auth</name>
Expand Down
8 changes: 6 additions & 2 deletions hadoop-common-project/hadoop-common/pom.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -20,11 +20,11 @@
<parent>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-project-dist</artifactId>
<version>3.2.3.3.2.3.3-2</version>
<version>3.2.3.3.2.3.3-3</version>
<relativePath>../../hadoop-project-dist</relativePath>
</parent>
<artifactId>hadoop-common</artifactId>
<version>3.2.3.3.2.3.3-2</version>
<version>3.2.3.3.2.3.3-3</version>
<description>Apache Hadoop Common</description>
<name>Apache Hadoop Common</name>
<packaging>jar</packaging>
Expand All @@ -44,6 +44,10 @@
<artifactId>hadoop-annotations</artifactId>
<scope>compile</scope>
</dependency>
<dependency>
<groupId>org.apache.hadoop.thirdparty</groupId>
<artifactId>hadoop-shaded-guava</artifactId>
</dependency>
<dependency>
<groupId>com.google.guava</groupId>
<artifactId>guava</artifactId>
Expand Down
12 changes: 12 additions & 0 deletions hadoop-common-project/hadoop-common/src/main/bin/hadoop-functions.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2361,6 +2361,10 @@ function hadoop_verify_user_perm
declare command=$2
declare uvar

if [[ ${command} =~ \. ]]; then
return 1
fi

uvar=$(hadoop_build_custom_subcmd_var "${program}" "${command}" USER)

if [[ -n ${!uvar} ]]; then
Expand Down Expand Up @@ -2392,6 +2396,10 @@ function hadoop_need_reexec
return 1
fi

if [[ ${command} =~ \. ]]; then
return 1
fi

# if we have privilege, and the _USER is defined, and _USER is
# set to someone who isn't us, then yes, we should re-exec.
# otherwise no, don't re-exec and let the system deal with it.
Expand Down Expand Up @@ -2428,6 +2436,10 @@ function hadoop_subcommand_opts
return 1
fi

if [[ ${command} =~ \. ]]; then
return 1
fi

# bash 4 and up have built-in ways to upper and lower
# case the contents of vars. This is faster than
# calling tr.
Expand Down
10 changes: 8 additions & 2 deletions hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/conf/Configurable.java
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -26,9 +26,15 @@
@InterfaceStability.Stable
public interface Configurable {

/** Set the configuration to be used by this object. */
/**
* Set the configuration to be used by this object.
* @param conf configuration to be used
*/
void setConf(Configuration conf);

/** Return the configuration used by this object. */
/**
* Return the configuration used by this object.
* @return Configuration
*/
Configuration getConf();
}
Loading