Skip to content

Conversation

@pan3793
Copy link
Member

@pan3793 pan3793 commented Aug 6, 2024

What changes were proposed in this pull request?

Currently, Spark pulls Gson 2.2.4 from hive-exec, which is pretty old and vulnerable, this PR proposes to upgrade it to the latest version 2.11.0.

image

Why are the changes needed?

For security.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

GHA.

Was this patch authored or co-authored using generative AI tooling?

No.

@github-actions github-actions bot added the BUILD label Aug 6, 2024
@pan3793 pan3793 marked this pull request as ready for review August 6, 2024 09:19
@pan3793
Copy link
Member Author

pan3793 commented Aug 6, 2024

derbyshared/10.16.1.1//derbyshared-10.16.1.1.jar
derbytools/10.16.1.1//derbytools-10.16.1.1.jar
dropwizard-metrics-hadoop-metrics2-reporter/0.1.2//dropwizard-metrics-hadoop-metrics2-reporter-0.1.2.jar
error_prone_annotations/2.18.0//error_prone_annotations-2.18.0.jar
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

please include this in the LICENSE-binary

derbyshared/10.16.1.1//derbyshared-10.16.1.1.jar
derbytools/10.16.1.1//derbytools-10.16.1.1.jar
dropwizard-metrics-hadoop-metrics2-reporter/0.1.2//dropwizard-metrics-hadoop-metrics2-reporter-0.1.2.jar
error_prone_annotations/2.18.0//error_prone_annotations-2.18.0.jar
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we have to add this dependency?

Copy link
Member Author

@pan3793 pan3793 Aug 6, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

short answer, no, but Gson changed it to compile scope in google/gson#2346

I'm okay with either include or exclude it from Spark classpath

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1 for removal

@yaooqinn yaooqinn closed this in 9fb9cff Aug 6, 2024
@yaooqinn
Copy link
Member

yaooqinn commented Aug 6, 2024

Thank you @pan3793 @LuciferYang Merged to master

turboFei pushed a commit to turboFei/spark that referenced this pull request Nov 6, 2025
### What changes were proposed in this pull request?

Currently, Spark pulls Gson 2.2.4 from `hive-exec`, which is pretty old and [vulnerable](https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2022-25647), this PR proposes to upgrade it to the latest version 2.11.0.

<img width="697" alt="image" src="https://github.com/user-attachments/assets/f101ab3f-875c-4cc3-9692-48394c9ada3e">

### Why are the changes needed?

For security.

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

GHA.

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes apache#47627 from pan3793/SPARK-49120.

Authored-by: Cheng Pan <[email protected]>
Signed-off-by: Kent Yao <[email protected]>
(cherry picked from commit 9fb9cff)

Co-authored-by: Cheng Pan <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants