Skip to content

Commit 2baf7a1

Browse files
committed
[SPARK-29608][BUILD] Add hadoop-3.2 profile to release build
### What changes were proposed in this pull request? This PR aims to add `hadoop-3.2` profile to pre-built binary package releases. ### Why are the changes needed? Since Apache Spark 3.0.0, we provides Hadoop 3.2 pre-built binary. ### Does this PR introduce any user-facing change? No. (Although the artifacts are available, this change is for release managers). ### How was this patch tested? Manual. Please note that `DRY_RUN=0` disables these combination. ``` $ dev/create-release/release-build.sh package ... Packages to build: without-hadoop hadoop3.2 hadoop2.7 make_binary_release without-hadoop -Pscala-2.12 -Phadoop-provided 2.12 make_binary_release hadoop3.2 -Pscala-2.12 -Phadoop-3.2 -Phive -Phive-thriftserver 2.12 make_binary_release hadoop2.7 -Pscala-2.12 -Phadoop-2.7 -Phive -Phive-thriftserver withpip,withr 2.12 ``` Closes apache#26260 from dongjoon-hyun/SPARK-29608. Authored-by: Dongjoon Hyun <[email protected]> Signed-off-by: Dongjoon Hyun <[email protected]>
1 parent ae5b60d commit 2baf7a1

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

dev/create-release/release-build.sh

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -280,6 +280,8 @@ if [[ "$1" == "package" ]]; then
280280
BINARY_PKGS_ARGS["without-hadoop"]="-Phadoop-provided"
281281
if [[ $SPARK_VERSION < "3.0." ]]; then
282282
BINARY_PKGS_ARGS["hadoop2.6"]="-Phadoop-2.6 $HIVE_PROFILES"
283+
else
284+
BINARY_PKGS_ARGS["hadoop3.2"]="-Phadoop-3.2 $HIVE_PROFILES"
283285
fi
284286
fi
285287

0 commit comments

Comments
 (0)