Skip to content

Conversation

@Fokko
Copy link
Contributor

@Fokko Fokko commented Oct 15, 2019

What changes were proposed in this pull request?

Release blog: https://medium.com/@cowtowncoder/jackson-2-10-features-cd880674d8a2

Fixes the following CVE's:
https://www.cvedetails.com/cve/CVE-2019-16942/
https://www.cvedetails.com/cve/CVE-2019-16943/

Looking back, there were 3 major goals for this minor release:

  • Resolve the growing problem of “endless CVE patches”, a stream of fixes for reported CVEs related to “Polymorphic Deserialization” problem (described in “On Jackson CVEs… ”) that resulted in security tools forcing Jackson upgrades. 2.10 now includes “Safe Default Typing” that is hoped to resolve this problem.
  • Evolve 2.x API towards 3.0, based on changes that were done in master, within limits of 2.x API backwards-compatibility requirements.
  • Add JDK support for versions beyond Java 8: specifically add“module-info.class” for JDK9+, defining proper module definitions for Jackson components

Full changelog: https://github.com/FasterXML/jackson/wiki/Jackson-Release-2.10

Improved Scala 2.13 support: https://github.com/FasterXML/jackson/wiki/Jackson-Release-2.10#scala

Why are the changes needed?

Patches CVE's reported by the vulnerability scanner.

Does this PR introduce any user-facing change?

No

How was this patch tested?

Ran mvn clean install -DskipTests locally.

@Fokko Fokko changed the title [SPARK-29483][BUILD] Bump Jackson to 2.10.0 [SPARK-29483][CORE] Bump Jackson to 2.10.0 Oct 15, 2019
@dongjoon-hyun
Copy link
Member

ok to test

@dongjoon-hyun
Copy link
Member

Please polish the PR description, @Fokko .

Also, cc @srowen since this is Scala 2.13-related.

@dongjoon-hyun dongjoon-hyun changed the title [SPARK-29483][CORE] Bump Jackson to 2.10.0 [SPARK-29483][BUILD] Bump Jackson to 2.10.0 Oct 15, 2019
@dongjoon-hyun
Copy link
Member

BTW, @Fokko . We use [BUILD] instead of [CORE] for this kind of PRs~

jackson-module-jaxb-annotations-2.10.0.jar
jackson-module-paranamer-2.10.0.jar
jackson-module-scala_2.12-2.10.0.jar
jakarta.activation-api-1.2.1.jar
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We'll need an entry in LICENSE-binary for this, under the Eclipse Dist License section. (We seem to already have a copy of the license though in licenses-binary).

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done, thanks for pointing out

@SparkQA
Copy link

SparkQA commented Oct 15, 2019

Test build #112125 has finished for PR 26131 at commit 7314e1e.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

Copy link
Member

@srowen srowen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks OK pending tests.

@SparkQA
Copy link

SparkQA commented Oct 16, 2019

Test build #112152 has finished for PR 26131 at commit 43e3d5c.

  • This patch fails PySpark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Oct 16, 2019

Test build #4898 has finished for PR 26131 at commit 43e3d5c.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

Copy link
Member

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, LGTM. Thank you, @Fokko and @srowen .
Merged to master.

@dongjoon-hyun
Copy link
Member

Could you make a back porting PR, @Fokko ?

@dongjoon-hyun
Copy link
Member

cc @jiangxb1987 since he is the release manager for 3.0.0-preview.

@srowen
Copy link
Member

srowen commented Oct 16, 2019

Not a back port to 2.4 right? We can't update Jackson in 2.4. I don't think we have to back port to the preview branch, even if we keep it.

@dongjoon-hyun
Copy link
Member

Oh, I see. Got it, @srowen .

@krishna-pandey
Copy link
Contributor

@srowen What's the issue in upgrading Jackson in 2.4?

@Fokko
Copy link
Contributor Author

Fokko commented Oct 18, 2019

@krishna-pandey please refer to #21596

Jackson is notorious for having to change their public API, and aggressively deprecating methods. This will conflict with older versions of Hadoop. This might have huge implications for your application.

@Fokko Fokko deleted the SPARK-29483 branch October 18, 2019 12:00
mccheah pushed a commit to palantir/spark that referenced this pull request Nov 26, 2019
Release blog: https://medium.com/cowtowncoder/jackson-2-10-features-cd880674d8a2

Fixes the following CVE's:
https://www.cvedetails.com/cve/CVE-2019-16942/
https://www.cvedetails.com/cve/CVE-2019-16943/

Looking back, there were 3 major goals for this minor release:

- Resolve the growing problem of “endless CVE patches”, a stream of fixes for reported CVEs related to “Polymorphic Deserialization” problem (described in “On Jackson CVEs… ”) that resulted in security tools forcing Jackson upgrades. 2.10 now includes “Safe Default Typing” that is hoped to resolve this problem.
- Evolve 2.x API towards 3.0, based on changes that were done in master, within limits of 2.x API backwards-compatibility requirements.
- Add JDK support for versions beyond Java 8: specifically add“module-info.class” for JDK9+, defining proper module definitions for Jackson components

Full changelog: https://github.com/FasterXML/jackson/wiki/Jackson-Release-2.10

Improved Scala 2.13 support: https://github.com/FasterXML/jackson/wiki/Jackson-Release-2.10#scala

Patches CVE's reported by the vulnerability scanner.

No

Ran `mvn clean install -DskipTests` locally.

Closes apache#26131 from Fokko/SPARK-29483.

Authored-by: Fokko Driesprong <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
robert3005 pushed a commit to palantir/spark that referenced this pull request Dec 4, 2019
Release blog: https://medium.com/cowtowncoder/jackson-2-10-features-cd880674d8a2

Fixes the following CVE's:
https://www.cvedetails.com/cve/CVE-2019-16942/
https://www.cvedetails.com/cve/CVE-2019-16943/

Looking back, there were 3 major goals for this minor release:

- Resolve the growing problem of “endless CVE patches”, a stream of fixes for reported CVEs related to “Polymorphic Deserialization” problem (described in “On Jackson CVEs… ”) that resulted in security tools forcing Jackson upgrades. 2.10 now includes “Safe Default Typing” that is hoped to resolve this problem.
- Evolve 2.x API towards 3.0, based on changes that were done in master, within limits of 2.x API backwards-compatibility requirements.
- Add JDK support for versions beyond Java 8: specifically add“module-info.class” for JDK9+, defining proper module definitions for Jackson components

Full changelog: https://github.com/FasterXML/jackson/wiki/Jackson-Release-2.10

Improved Scala 2.13 support: https://github.com/FasterXML/jackson/wiki/Jackson-Release-2.10#scala

Patches CVE's reported by the vulnerability scanner.

No

Ran `mvn clean install -DskipTests` locally.

Closes apache#26131 from Fokko/SPARK-29483.

Authored-by: Fokko Driesprong <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants