Skip to content

Commit 07bb2c9

Browse files
committed
Update comment to clarify circumstances under which shuffle operates on serialized records
1 parent 269089a commit 07bb2c9

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

sql/core/src/main/scala/org/apache/spark/sql/execution/Exchange.scala

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -92,7 +92,7 @@ case class Exchange(
9292
} else if (serializeMapOutputs && serializer.supportsRelocationOfSerializedObjects) {
9393
// SPARK-4550 extended sort-based shuffle to serialize individual records prior to sorting
9494
// them. This optimization is guarded by a feature-flag and is only applied in cases where
95-
// shuffle dependency does not specify an ordering and the record serializer has certain
95+
// shuffle dependency does not specify an aggregator and the record serializer has certain
9696
// properties. If this optimization is enabled, we can safely avoid the copy.
9797
//
9898
// This optimization also applies to UnsafeShuffleManager (added in SPARK-7081).

0 commit comments

Comments
 (0)