-
Notifications
You must be signed in to change notification settings - Fork 28.9k
[SPARK-49120][BUILD] Bump Gson 2.11.0 #47627
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
| derbyshared/10.16.1.1//derbyshared-10.16.1.1.jar | ||
| derbytools/10.16.1.1//derbytools-10.16.1.1.jar | ||
| dropwizard-metrics-hadoop-metrics2-reporter/0.1.2//dropwizard-metrics-hadoop-metrics2-reporter-0.1.2.jar | ||
| error_prone_annotations/2.18.0//error_prone_annotations-2.18.0.jar |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
please include this in the LICENSE-binary
| derbyshared/10.16.1.1//derbyshared-10.16.1.1.jar | ||
| derbytools/10.16.1.1//derbytools-10.16.1.1.jar | ||
| dropwizard-metrics-hadoop-metrics2-reporter/0.1.2//dropwizard-metrics-hadoop-metrics2-reporter-0.1.2.jar | ||
| error_prone_annotations/2.18.0//error_prone_annotations-2.18.0.jar |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Do we have to add this dependency?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
short answer, no, but Gson changed it to compile scope in google/gson#2346
I'm okay with either include or exclude it from Spark classpath
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
+1 for removal
|
Thank you @pan3793 @LuciferYang Merged to master |
### What changes were proposed in this pull request? Currently, Spark pulls Gson 2.2.4 from `hive-exec`, which is pretty old and [vulnerable](https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2022-25647), this PR proposes to upgrade it to the latest version 2.11.0. <img width="697" alt="image" src="https://github.com/user-attachments/assets/f101ab3f-875c-4cc3-9692-48394c9ada3e"> ### Why are the changes needed? For security. ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? GHA. ### Was this patch authored or co-authored using generative AI tooling? No. Closes apache#47627 from pan3793/SPARK-49120. Authored-by: Cheng Pan <[email protected]> Signed-off-by: Kent Yao <[email protected]> (cherry picked from commit 9fb9cff) Co-authored-by: Cheng Pan <[email protected]>
What changes were proposed in this pull request?
Currently, Spark pulls Gson 2.2.4 from
hive-exec, which is pretty old and vulnerable, this PR proposes to upgrade it to the latest version 2.11.0.Why are the changes needed?
For security.
Does this PR introduce any user-facing change?
No.
How was this patch tested?
GHA.
Was this patch authored or co-authored using generative AI tooling?
No.