Skip to content

Commit 445e8a7

Browse files
authored
DOCSP-30376: Clarified streaming produces a single partition (#161)
* DOCSP-30376: Clarified streaming produces a single partition * Empty build commit * PR feedback
1 parent 68e858e commit 445e8a7

File tree

2 files changed

+11
-0
lines changed

2 files changed

+11
-0
lines changed

source/configuration/read.txt

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -133,6 +133,10 @@ You can configure the following properties to read from MongoDB:
133133
Partitioner Configurations
134134
~~~~~~~~~~~~~~~~~~~~~~~~~~
135135

136+
Partitioners change the read behavior for batch reads with the {+driver-short+}.
137+
They do not affect Structured Streaming because the data stream processing
138+
engine produces a single stream with Structured Streaming.
139+
136140
This section contains configuration information for the following
137141
partitioners:
138142

source/structured-streaming.txt

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -200,6 +200,13 @@ more about continuous processing, see the `Spark documentation <https://spark.ap
200200

201201
.. include:: /includes/fact-read-from-change-stream
202202

203+
.. note::
204+
205+
Since Structured Streaming produces a single partition, it ignores
206+
:ref:`partitioner configurations <partitioner-conf>`. Partitioner
207+
configuration only apply when there are multiple partitions. This is true
208+
for both micro-batch processing and continuous processing streams.
209+
203210
.. tabs-drivers::
204211

205212
tabs:

0 commit comments

Comments
 (0)