Skip to content

Commit c39b06f

Browse files
committed
Add explanation of change to migration note
1 parent caad54d commit c39b06f

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

docs/core-migration-guide.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -30,3 +30,4 @@ license: |
3030

3131
- In Spark 3.0, deprecated method `AccumulableInfo.apply` have been removed because creating `AccumulableInfo` is disallowed.
3232

33+
- In Spark 3.0, event log file will be written as UTF-8 encoding, and Spark History Server will replay event log files as UTF-8 encoding. Previously Spark writes event log file as default charset of driver JVM process, so SHS of Spark 2.x is needed to read the old event log files in case of incompatible encoding.

0 commit comments

Comments
 (0)