Skip to content

Conversation

@viirya
Copy link
Member

@viirya viirya commented Aug 2, 2020

What changes were proposed in this pull request?

This PR upgrades Guava to newer 27.0-jre.

Why are the changes needed?

Guava 14.0.1 is pretty old and is among the affected Guava versions of CVE-2018-10237.

All newer Hadoop releases are going to be built with a later guava version, e.g. 27.0-jre, including Hadoop 3.1.3, 3.2.1, 3.3.0.

This PR leaves Hadoop version untouched.

Does this PR introduce any user-facing change?

No

How was this patch tested?

Pass the Jenkins tests.

@viirya
Copy link
Member Author

viirya commented Aug 2, 2020

Hadoop 3.2.0 still uses older Guava 11.0.2. I'm not sure if we can just upgrade Guava without touching Hadoop dependency. I want to run the patch through jenkins (sbt and maven) to see how well it works out.

#29326 upgrades Guava and Hadoop together.

@SparkQA
Copy link

SparkQA commented Aug 2, 2020

Test build #126932 has finished for PR 29325 at commit 4888ca0.

  • This patch fails due to an unknown error code, -9.
  • This patch merges cleanly.
  • This patch adds no public classes.

@maropu
Copy link
Member

maropu commented Aug 2, 2020

retest this please

@SparkQA
Copy link

SparkQA commented Aug 2, 2020

Test build #126936 has finished for PR 29325 at commit 4888ca0.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@maropu
Copy link
Member

maropu commented Aug 2, 2020

hm, it looks a valid failure.

@srowen
Copy link
Member

srowen commented Aug 2, 2020

Is this duplicated by #29326 ?
Yes, this can only happen for Hadoop 3.2.1+

@dongjoon-hyun
Copy link
Member

@dongjoon-hyun
Copy link
Member

dongjoon-hyun commented Aug 7, 2020

I'd like to recommend to close the PR while keeping JIRA is open. you can reopen this PR when it's ready.

@viirya
Copy link
Member Author

viirya commented Aug 7, 2020

Thanks @dongjoon-hyun

@viirya viirya closed this Aug 7, 2020
@viirya viirya deleted the test-guava branch December 27, 2023 18:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants