Skip to content

Commit 950b417

Browse files
xingchaozhGitHub Enterprise
authored andcommitted
[CARMEL-6148] Adjust Partition Size considering ExpandExec project size in AQE (#1072)
1 parent eb2fd9a commit 950b417

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/CoalesceShufflePartitions.scala

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -131,7 +131,7 @@ case class CoalesceShufflePartitions(session: SparkSession)
131131
case _ =>
132132
})
133133
case _: BroadcastNestedLoopJoinExec => reduceRatio += 3
134-
case _: ExpandExec => reduceRatio += 1
134+
case expand: ExpandExec => reduceRatio += expand.projections.size
135135
case SortMergeJoinExec(_, _, _, Some(condition), _, _, _)
136136
if containsInequalityPredicate(condition) => reduceRatio += 2
137137
case _ =>

0 commit comments

Comments
 (0)