Skip to content

Commit 484a17e

Browse files
committed
add migration guide
1 parent 9b08de1 commit 484a17e

File tree

1 file changed

+4
-0
lines changed

1 file changed

+4
-0
lines changed

docs/sql-migration-guide.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -22,6 +22,10 @@ license: |
2222
* Table of contents
2323
{:toc}
2424

25+
## Upgrading from Spark SQL 3.2 to 3.3
26+
27+
- In Spark 3.3, spark will fail when parsing a JSON/CSV string with `PERMISSIVE` mode and schema contains non-nullable fields. You can set mode to `FAILFAST/DROPMALFORMED` if you want to read JSON/CSV with a schema that contains nullable fields.
28+
2529
## Upgrading from Spark SQL 3.1 to 3.2
2630

2731
- Since Spark 3.2, ADD FILE/JAR/ARCHIVE commands require each path to be enclosed by `"` or `'` if the path contains whitespaces.

0 commit comments

Comments
 (0)