Skip to content

Commit e9503c8

Browse files
LuciferYangsrowen
authored andcommitted
[SPARK-41031][BUILD] Upgrade xz to 1.9 for avro 1.11.1
### What changes were proposed in this pull request? This pr aims to upgrade `xz` to 1.9 for `avro` 1.11.1. ### Why are the changes needed? Spark depend on `avro` 1.11.1 and `avro` 1.11.1 use `xz` as an optional dependency, we need to manually check `xz` version when upgrading `avro`. https://github.com/apache/avro/blob/3a9e5a789b5165e0c8c4da799c387fdf84bfb75e/lang/java/pom.xml#L59 https://github.com/apache/avro/blob/3a9e5a789b5165e0c8c4da799c387fdf84bfb75e/lang/java/avro/pom.xml#L238-L242 The release notes as follows: - https://git.tukaani.org/?p=xz-java.git;a=blob;f=NEWS;hb=HEAD ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? Pass Github Actions Closes apache#38538 from LuciferYang/SPARK-41031. Authored-by: yangjie01 <[email protected]> Signed-off-by: Sean Owen <[email protected]>
1 parent 0087a2a commit e9503c8

File tree

3 files changed

+7
-3
lines changed

3 files changed

+7
-3
lines changed

dev/deps/spark-deps-hadoop-2-hive-2.3

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -267,7 +267,7 @@ xbean-asm9-shaded/4.22//xbean-asm9-shaded-4.22.jar
267267
xercesImpl/2.12.2//xercesImpl-2.12.2.jar
268268
xml-apis/1.4.01//xml-apis-1.4.01.jar
269269
xmlenc/0.52//xmlenc-0.52.jar
270-
xz/1.8//xz-1.8.jar
270+
xz/1.9//xz-1.9.jar
271271
zjsonpatch/0.3.0//zjsonpatch-0.3.0.jar
272272
zookeeper-jute/3.6.2//zookeeper-jute-3.6.2.jar
273273
zookeeper/3.6.2//zookeeper-3.6.2.jar

dev/deps/spark-deps-hadoop-3-hive-2.3

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -252,7 +252,7 @@ univocity-parsers/2.9.1//univocity-parsers-2.9.1.jar
252252
velocity/1.5//velocity-1.5.jar
253253
wildfly-openssl/1.0.7.Final//wildfly-openssl-1.0.7.Final.jar
254254
xbean-asm9-shaded/4.22//xbean-asm9-shaded-4.22.jar
255-
xz/1.8//xz-1.8.jar
255+
xz/1.9//xz-1.9.jar
256256
zjsonpatch/0.3.0//zjsonpatch-0.3.0.jar
257257
zookeeper-jute/3.6.2//zookeeper-jute-3.6.2.jar
258258
zookeeper/3.6.2//zookeeper-3.6.2.jar

pom.xml

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1482,10 +1482,14 @@
14821482
</exclusion>
14831483
</exclusions>
14841484
</dependency>
1485+
<!--
1486+
SPARK-41031: `xz` is marked as optional in the dependency tree of `avro`,
1487+
we need to manually check `xz` version when upgrading `avro`.
1488+
-->
14851489
<dependency>
14861490
<groupId>org.tukaani</groupId>
14871491
<artifactId>xz</artifactId>
1488-
<version>1.8</version>
1492+
<version>1.9</version>
14891493
</dependency>
14901494
<!-- See SPARK-23654 for info on this dependency;
14911495
It is used to keep javax.activation at v1.1.1 after dropping

0 commit comments

Comments
 (0)