Commit 5903257
[SPARK-17301][SQL] Remove unused classTag field from AtomicType base class
There's an unused `classTag` val in the AtomicType base class which is causing unnecessary slowness in deserialization because it needs to grab ScalaReflectionLock and create a new runtime reflection mirror. Removing this unused code gives a small but measurable performance boost in SQL task deserialization.
Author: Josh Rosen <[email protected]>
Closes #14869 from JoshRosen/remove-unused-classtag.
(cherry picked from commit 48b459d)
Signed-off-by: Reynold Xin <[email protected]>1 parent 976a43d commit 5903257
File tree
1 file changed
+1
-9
lines changed- sql/catalyst/src/main/scala/org/apache/spark/sql/types
1 file changed
+1
-9
lines changedLines changed: 1 addition & 9 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
17 | 17 | | |
18 | 18 | | |
19 | 19 | | |
20 | | - | |
21 | | - | |
| 20 | + | |
22 | 21 | | |
23 | 22 | | |
24 | | - | |
25 | 23 | | |
26 | | - | |
27 | 24 | | |
28 | 25 | | |
29 | 26 | | |
| |||
130 | 127 | | |
131 | 128 | | |
132 | 129 | | |
133 | | - | |
134 | | - | |
135 | | - | |
136 | | - | |
137 | | - | |
138 | 130 | | |
139 | 131 | | |
140 | 132 | | |
| |||
0 commit comments