Skip to content

Commit c78ebe8

Browse files
committed
Addressed comments
1 parent 33bfdcb commit c78ebe8

File tree

3 files changed

+5
-8
lines changed

3 files changed

+5
-8
lines changed

docs/structured-streaming-programming-guide.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -919,8 +919,8 @@ streamingDf = spark.readStream. ...
919919
streamingDf.dropDuplicates("guid")
920920

921921
// With watermark using guid and eventTime columns
922-
streamingDf
923-
.withWatermark("eventTime", "10 seconds")
922+
streamingDf \
923+
.withWatermark("eventTime", "10 seconds") \
924924
.dropDuplicates("guid", "eventTime")
925925
{% endhighlight %}
926926

examples/src/main/java/org/apache/spark/examples/sql/streaming/JavaStructuredSessionization.java

Lines changed: 0 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -253,6 +253,3 @@ public SessionUpdate(String id, long durationMs, int numEvents, boolean expired)
253253
public void setExpired(boolean expired) { this.expired = expired; }
254254
}
255255
}
256-
257-
258-

sql/core/src/main/scala/org/apache/spark/sql/streaming/GroupState.scala

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -54,9 +54,9 @@ import org.apache.spark.sql.catalyst.plans.logical.LogicalGroupState
5454
* `flatMapGroupsWithState` is associated with an operation output mode, which can be either
5555
* `Append` or `Update`. Semantically, this defines whether the output records of one trigger
5656
* is effectively replacing the previously output records (from previous triggers) or is appending
57-
* to the list of previously output records. Essentially, this defines how the semantic Result Table
58-
* (refer to programming guide) is updated, and allows us to reason about the semantics of
59-
* later operations.
57+
* to the list of previously output records. Essentially, this defines how the Result Table (refer
58+
* to the semantics in the programming guide) is updated, and allows us to reason about the
59+
* semantics of later operations.
6060
*
6161
* Important points to note about the function (both mapGroupsWithState and flatMapGroupsWithState).
6262
* - In a trigger, the function will be called only the groups present in the batch. So do not

0 commit comments

Comments
 (0)