Skip to content

Commit 2e1fd46

Browse files
jtokasrowen
authored andcommitted
[SPARK-20296][TRIVIAL][DOCS] Count distinct error message for streaming
## What changes were proposed in this pull request? Update count distinct error message for streaming datasets/dataframes to match current behavior. These aggregations are not yet supported, regardless of whether the dataset/dataframe is aggregated. Author: jtoka <[email protected]> Closes #17609 from jtoka/master.
1 parent ffc57b0 commit 2e1fd46

File tree

1 file changed

+2
-3
lines changed

1 file changed

+2
-3
lines changed

sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/UnsupportedOperationChecker.scala

Lines changed: 2 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -139,9 +139,8 @@ object UnsupportedOperationChecker {
139139
}
140140
throwErrorIf(
141141
child.isStreaming && distinctAggExprs.nonEmpty,
142-
"Distinct aggregations are not supported on streaming DataFrames/Datasets, unless " +
143-
"it is on aggregated DataFrame/Dataset in Complete output mode. Consider using " +
144-
"approximate distinct aggregation (e.g. approx_count_distinct() instead of count()).")
142+
"Distinct aggregations are not supported on streaming DataFrames/Datasets. Consider " +
143+
"using approx_count_distinct() instead.")
145144

146145
case _: Command =>
147146
throwError("Commands like CreateTable*, AlterTable*, Show* are not supported with " +

0 commit comments

Comments
 (0)