Skip to content

Commit 4b91947

Browse files
Chris Choschmalliso
authored andcommitted
DOCSP-12653 add source params (#60)
* DOCSP-12653: add new source config settings
1 parent 7473765 commit 4b91947

File tree

1 file changed

+31
-3
lines changed

1 file changed

+31
-3
lines changed

source/kafka-source.txt

Lines changed: 31 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -165,6 +165,34 @@ an example source connector configuration file, see
165165
| **Default**: ""
166166
| **Accepted Values**: A valid JSON document representing a collection
167167

168+
* - output.format.key
169+
- string
170+
- | Determines which data format the source connector outputs for the key document.
171+
| **Default**: ``json``
172+
| **Accepted Values**: ``bson``, ``json``, ``schema``
173+
174+
* - output.format.value
175+
- string
176+
- | Determines which data format the source connector outputs for the value document.
177+
| **Default**: ``json``
178+
| **Accepted Values**: ``bson``, ``json``, ``schema``
179+
180+
* - output.json.formatter
181+
- string
182+
- | Full class name of the JSON formatter.
183+
| **Default**: ``com.mongodb.kafka.connect.source.json.formatter.ExtendedJson``
184+
| **Accepted Values**:
185+
| - ``com.mongodb.kafka.connect.source.json.formatter.DefaultJson``
186+
| - ``com.mongodb.kafka.connect.source.json.formatter.ExtendedJson``
187+
| - ``com.mongodb.kafka.connect.source.json.formatter.SimplifiedJson``
188+
| - Or other user-provided class name
189+
190+
* - output.schema.infer.value
191+
- boolean
192+
- | Whether the connector should infer the schema for the value. Since each document is processed in isolation, multiple schemas may result. Only valid when ``schema`` is specified in the ``output.format.value`` setting.
193+
| **Default**: ``false``
194+
| **Accepted Values**: ``true`` or ``false``
195+
168196
* - batch.size
169197
- int
170198
- | The cursor batch size.
@@ -264,7 +292,7 @@ an example source connector configuration file, see
264292
- | Name of topic to use as the dead letter queue. If blank, none
265293
of the invalid messages are written to the dead letter queue.
266294
|
267-
| **errors.tolerance** must be set to ``all`` to use this property.
295+
| **errors.tolerance** must be set to ``all`` to use this property.
268296
|
269297
| **Default:** ""
270298
| **Accepted Values**: A valid Kafka topic name
@@ -343,7 +371,7 @@ Multiple Source Example
343371
-----------------------
344372

345373
You can configure the source connector to listen for events from multiple
346-
collections by using the ``pipeline`` configuration with a custom
374+
collections by using the ``pipeline`` configuration with a custom
347375
:manual:`aggregation pipeline </reference/operator/aggregation-pipeline/>`
348376
to match your collection names.
349377

@@ -405,7 +433,7 @@ How to Recover from An Invalid Resume Token
405433
-------------------------------------------
406434

407435
In the event your Connector pauses or shuts down long enough for the Change
408-
Stream resume token to expire from the
436+
Stream resume token to expire from the
409437
:manual:`MongoDB Oplog </core/replica-set-oplog/>`, you may encounter an error
410438
that prevents you from starting up the Connector. If you encounter this
411439
condition, you must delete the topic data referenced by

0 commit comments

Comments
 (0)