Skip to content

Commit dbb6d1b

Browse files
jtokasrowen
authored andcommitted
[SPARK-20296][TRIVIAL][DOCS] Count distinct error message for streaming
## What changes were proposed in this pull request? Update count distinct error message for streaming datasets/dataframes to match current behavior. These aggregations are not yet supported, regardless of whether the dataset/dataframe is aggregated. Author: jtoka <[email protected]> Closes #17609 from jtoka/master. (cherry picked from commit 2e1fd46) Signed-off-by: Sean Owen <[email protected]>
1 parent b2970d9 commit dbb6d1b

File tree

1 file changed

+2
-3
lines changed

1 file changed

+2
-3
lines changed

sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/UnsupportedOperationChecker.scala

Lines changed: 2 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -103,9 +103,8 @@ object UnsupportedOperationChecker {
103103
}
104104
throwErrorIf(
105105
child.isStreaming && distinctAggExprs.nonEmpty,
106-
"Distinct aggregations are not supported on streaming DataFrames/Datasets, unless " +
107-
"it is on aggregated DataFrame/Dataset in Complete output mode. Consider using " +
108-
"approximate distinct aggregation (e.g. approx_count_distinct() instead of count()).")
106+
"Distinct aggregations are not supported on streaming DataFrames/Datasets. Consider " +
107+
"using approx_count_distinct() instead.")
109108

110109
case _: Command =>
111110
throwError("Commands like CreateTable*, AlterTable*, Show* are not supported with " +

0 commit comments

Comments
 (0)