Skip to content

Commit 809c785

Browse files
Davies Liumengxr
authored andcommitted
[SPARK-2652] [PySpark] donot use KyroSerializer as default serializer
KyroSerializer can not serialize customized class without registered explicitly, use it as default serializer in PySpark will introduce some regression in MLlib. cc mengxr Author: Davies Liu <[email protected]> Closes #2916 from davies/revert and squashes the following commits: 43eb6d3 [Davies Liu] donot use KyroSerializer as default serializer
1 parent 0aea228 commit 809c785

File tree

1 file changed

+0
-1
lines changed

1 file changed

+0
-1
lines changed

python/pyspark/context.py

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -43,7 +43,6 @@
4343
# These are special default configs for PySpark, they will overwrite
4444
# the default ones for Spark if they are not configured by user.
4545
DEFAULT_CONFIGS = {
46-
"spark.serializer": "org.apache.spark.serializer.KryoSerializer",
4746
"spark.serializer.objectStreamReset": 100,
4847
"spark.rdd.compress": True,
4948
}

0 commit comments

Comments
 (0)