Skip to content

Commit 9afab9a

Browse files
Riccardo Corbellasrowen
authored andcommitted
[SPARK-21924][DOCS] Update structured streaming programming guide doc
## What changes were proposed in this pull request? Update the line "For example, the data (12:09, cat) is out of order and late, and it falls in windows 12:05 - 12:15 and 12:10 - 12:20." as follow "For example, the data (12:09, cat) is out of order and late, and it falls in windows 12:00 - 12:10 and 12:05 - 12:15." under the programming structured streaming programming guide. Author: Riccardo Corbella <[email protected]> Closes #19137 from riccardocorbella/bugfix. (cherry picked from commit 4ee7dfe) Signed-off-by: Sean Owen <[email protected]>
1 parent 7da8fbf commit 9afab9a

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

docs/structured-streaming-programming-guide.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -977,7 +977,7 @@ at the beginning of every trigger is the red line For example, when the engine
977977
`(12:14, dog)`, it sets the watermark for the next trigger as `12:04`.
978978
This watermark lets the engine maintain intermediate state for additional 10 minutes to allow late
979979
data to be counted. For example, the data `(12:09, cat)` is out of order and late, and it falls in
980-
windows `12:05 - 12:15` and `12:10 - 12:20`. Since, it is still ahead of the watermark `12:04` in
980+
windows `12:00 - 12:10` and `12:05 - 12:15`. Since, it is still ahead of the watermark `12:04` in
981981
the trigger, the engine still maintains the intermediate counts as state and correctly updates the
982982
counts of the related windows. However, when the watermark is updated to `12:11`, the intermediate
983983
state for window `(12:00 - 12:10)` is cleared, and all subsequent data (e.g. `(12:04, donkey)`)

0 commit comments

Comments
 (0)