Skip to content

Commit cf3820b

Browse files
committed
[SPARK-44197][BUILD] Upgrade Hadoop to 3.3.6
### What changes were proposed in this pull request? This PR aims to upgrade Apache Hadoop dependency to 3.3.6. ### Why are the changes needed? To bring the latest bug fixes for Apache Spark 3.5.0 and use the artifacts with SBOM - NEWS: https://hadoop.apache.org/release/3.3.6.html > It contains 117 bug fixes, improvements and enhancements since 3.3.5. - DOCS: https://hadoop.apache.org/docs/r3.3.6/index.html - CHANGELOG: https://hadoop.apache.org/docs/r3.3.6/hadoop-project-dist/hadoop-common/release/3.3.6/CHANGELOG.3.3.6.html ### Does this PR introduce _any_ user-facing change? This is a dependency change. ### How was this patch tested? Pass the CIs. Closes #41744 from dongjoon-hyun/SPARK-44197. Authored-by: Dongjoon Hyun <[email protected]> Signed-off-by: Dongjoon Hyun <[email protected]>
1 parent cb9f6bf commit cf3820b

File tree

2 files changed

+12
-12
lines changed

2 files changed

+12
-12
lines changed

dev/deps/spark-deps-hadoop-3-hive-2.3

Lines changed: 11 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -24,7 +24,7 @@ audience-annotations/0.5.0//audience-annotations-0.5.0.jar
2424
avro-ipc/1.11.1//avro-ipc-1.11.1.jar
2525
avro-mapred/1.11.1//avro-mapred-1.11.1.jar
2626
avro/1.11.1//avro-1.11.1.jar
27-
aws-java-sdk-bundle/1.12.316//aws-java-sdk-bundle-1.12.316.jar
27+
aws-java-sdk-bundle/1.12.367//aws-java-sdk-bundle-1.12.367.jar
2828
azure-data-lake-store-sdk/2.3.9//azure-data-lake-store-sdk-2.3.9.jar
2929
azure-keyvault-core/1.0.0//azure-keyvault-core-1.0.0.jar
3030
azure-storage/7.0.1//azure-storage-7.0.1.jar
@@ -66,16 +66,16 @@ gcs-connector/hadoop3-2.2.14/shaded/gcs-connector-hadoop3-2.2.14-shaded.jar
6666
gmetric4j/1.0.10//gmetric4j-1.0.10.jar
6767
gson/2.2.4//gson-2.2.4.jar
6868
guava/14.0.1//guava-14.0.1.jar
69-
hadoop-aliyun/3.3.5//hadoop-aliyun-3.3.5.jar
70-
hadoop-annotations/3.3.5//hadoop-annotations-3.3.5.jar
71-
hadoop-aws/3.3.5//hadoop-aws-3.3.5.jar
72-
hadoop-azure-datalake/3.3.5//hadoop-azure-datalake-3.3.5.jar
73-
hadoop-azure/3.3.5//hadoop-azure-3.3.5.jar
74-
hadoop-client-api/3.3.5//hadoop-client-api-3.3.5.jar
75-
hadoop-client-runtime/3.3.5//hadoop-client-runtime-3.3.5.jar
76-
hadoop-cloud-storage/3.3.5//hadoop-cloud-storage-3.3.5.jar
69+
hadoop-aliyun/3.3.6//hadoop-aliyun-3.3.6.jar
70+
hadoop-annotations/3.3.6//hadoop-annotations-3.3.6.jar
71+
hadoop-aws/3.3.6//hadoop-aws-3.3.6.jar
72+
hadoop-azure-datalake/3.3.6//hadoop-azure-datalake-3.3.6.jar
73+
hadoop-azure/3.3.6//hadoop-azure-3.3.6.jar
74+
hadoop-client-api/3.3.6//hadoop-client-api-3.3.6.jar
75+
hadoop-client-runtime/3.3.6//hadoop-client-runtime-3.3.6.jar
76+
hadoop-cloud-storage/3.3.6//hadoop-cloud-storage-3.3.6.jar
7777
hadoop-shaded-guava/1.1.1//hadoop-shaded-guava-1.1.1.jar
78-
hadoop-yarn-server-web-proxy/3.3.5//hadoop-yarn-server-web-proxy-3.3.5.jar
78+
hadoop-yarn-server-web-proxy/3.3.6//hadoop-yarn-server-web-proxy-3.3.6.jar
7979
hive-beeline/2.3.9//hive-beeline-2.3.9.jar
8080
hive-cli/2.3.9//hive-cli-2.3.9.jar
8181
hive-common/2.3.9//hive-common-2.3.9.jar
@@ -125,7 +125,7 @@ jersey-container-servlet-core/2.36//jersey-container-servlet-core-2.36.jar
125125
jersey-container-servlet/2.36//jersey-container-servlet-2.36.jar
126126
jersey-hk2/2.36//jersey-hk2-2.36.jar
127127
jersey-server/2.36//jersey-server-2.36.jar
128-
jettison/1.5.3//jettison-1.5.3.jar
128+
jettison/1.5.4//jettison-1.5.4.jar
129129
jetty-util-ajax/9.4.51.v20230217//jetty-util-ajax-9.4.51.v20230217.jar
130130
jetty-util/9.4.51.v20230217//jetty-util-9.4.51.v20230217.jar
131131
jline/2.14.6//jline-2.14.6.jar

pom.xml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -122,7 +122,7 @@
122122
<slf4j.version>2.0.7</slf4j.version>
123123
<log4j.version>2.20.0</log4j.version>
124124
<!-- make sure to update IsolatedClientLoader whenever this version is changed -->
125-
<hadoop.version>3.3.5</hadoop.version>
125+
<hadoop.version>3.3.6</hadoop.version>
126126
<!-- SPARK-41247: When updating `protobuf.version`, also need to update `protoVersion` in `SparkBuild.scala` -->
127127
<protobuf.version>3.23.2</protobuf.version>
128128
<protoc-jar-maven-plugin.version>3.11.4</protoc-jar-maven-plugin.version>

0 commit comments

Comments
 (0)