Skip to content

Conversation

@JoshRosen
Copy link
Contributor

There's an unused classTag val in the AtomicType base class which is causing unnecessary slowness in deserialization because it needs to grab ScalaReflectionLock and create a new runtime reflection mirror. Removing this unused code gives a small but measurable performance boost in SQL task deserialization.

@SparkQA
Copy link

SparkQA commented Aug 30, 2016

Test build #64605 has finished for PR 14869 at commit da28f08.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@rxin
Copy link
Contributor

rxin commented Aug 30, 2016

LGTM - merging in master/2.0.

asfgit pushed a commit that referenced this pull request Aug 30, 2016
…class

There's an unused `classTag` val in the AtomicType base class which is causing unnecessary slowness in deserialization because it needs to grab ScalaReflectionLock and create a new runtime reflection mirror. Removing this unused code gives a small but measurable performance boost in SQL task deserialization.

Author: Josh Rosen <[email protected]>

Closes #14869 from JoshRosen/remove-unused-classtag.

(cherry picked from commit 48b459d)
Signed-off-by: Reynold Xin <[email protected]>
@asfgit asfgit closed this in 48b459d Aug 30, 2016
@JoshRosen JoshRosen deleted the remove-unused-classtag branch August 30, 2016 06:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants