Skip to content

Commit cd9c7f3

Browse files
committed
[SPARK-18934][SQL] Writing to dynamic partitions does not preserve sort order if spills occur
1 parent 379b0b0 commit cd9c7f3

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileFormatWriter.scala

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -171,7 +171,8 @@ object FileFormatWriter extends Logging {
171171
queryExecution.toRdd
172172
} else {
173173
SortExec(
174-
requiredOrdering.map(SortOrder(_, Ascending)),
174+
requiredOrdering.map(SortOrder(_, Ascending))
175+
++ queryExecution.executedPlan.outputOrdering,
175176
global = false,
176177
child = queryExecution.executedPlan).execute()
177178
}

0 commit comments

Comments
 (0)