Skip to content

Commit e24583a

Browse files
authored
Merge pull request #129 from splunk/readme-updates-deploy
Update README.md
2 parents 0e00e46 + 86029ed commit e24583a

File tree

1 file changed

+18
-14
lines changed

1 file changed

+18
-14
lines changed

README.md

Lines changed: 18 additions & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -144,21 +144,18 @@ Running the Splunk Kafka Connector in a dedicated Kafka Connect Cluster is recom
144144
145145
### Connector in an existing Kafka Connect Cluster
146146
147-
1. Navigate to Splunkbase and download the latest version of [Splunk Kafka Connect](https://splunkbase.splunk.com/app/3862/)
147+
1. Navigate to Splunkbase and download the latest version of [Splunk Kafka Connect](https://splunkbase.splunk.com/app/3862/).
148148
149-
2. Copy downloaded file onto every host into the directory that contains your other connectors or create a folder to store them in. (ex. `/opt/connectors/splunk-kafka-connect`)
149+
2. Copy downloaded file onto every host running Kafka Connect into the directory that contains your other connectors or create a folder to store them in. (ex. `/opt/connectors/splunk-kafka-connect`)
150150
151-
3. Create a properties file called `kafka-connect.properties.` File should be created in directory `$KAFKA_CONNECT_HOME/config/`.
152-
Copy the following contents into the file and modify the <BOOTSTRAP_SERVERS> to point to one of your kafka brokers (ex. `localhost:9092`): and
153-
modify <PLUGIN_PATH> to point to the top level directory of where you are storing your connectors. (ex. `/opt/connectors`)
154-
155-
> Note: - If running Kafka Version 0.10.x - PLUGIN_PATH is not a valid configuration property. To make the connector visible to
156-
Kafka Connect the connectors folder must be added to the classpath. (ex. export `CLASSPATH=/opt/connectors/*`)
151+
3. The Splunk Connector requires the below worker properties to function correctly.
157152
158153
```
154+
#These settings may already be configured if you have deployed a connector in your Kafka Connect Environment
159155
bootstrap.servers=<BOOTSTRAP_SERVERS>
160-
#key.converter=org.apache.kafka.connect.json.JsonConverter
161-
#value.converter=org.apache.kafka.connect.json.JsonConverter
156+
plugin.path=<PLUGIN_PATH>
157+
158+
#Required
162159
key.converter=org.apache.kafka.connect.storage.StringConverter
163160
value.converter=org.apache.kafka.connect.storage.StringConverter
164161
key.converter.schemas.enable=false
@@ -168,7 +165,8 @@ internal.value.converter=org.apache.kafka.connect.json.JsonConverter
168165
internal.key.converter.schemas.enable=false
169166
internal.value.converter.schemas.enable=false
170167
offset.flush.interval.ms=10000
171-
plugin.path=<PLUGIN_PATH>
168+
169+
#Recommended
172170
group.id=kafka-connect-splunk-hec-sink
173171
config.storage.topic=__kafka-connect-splunk-task-configs
174172
config.storage.replication.factor=3
@@ -178,14 +176,20 @@ offset.storage.partitions=25
178176
status.storage.topic=__kafka-connect-splunk-statuses
179177
status.storage.replication.factor=3
180178
status.storage.partitions=5
181-
```
182179

180+
```
183181
> Note - For more information on the worker paramaters please refer to Kafka Connect [documentation](https://kafka.apache.org/documentation/#connect_running).
182+
183+
Please create or modify a Kafka Connect worker properties file to contain these parameters. The default worker properties file is `$KAFKA_CONNECT_HOME/config/connect-distrubuted.properties`. Ensure to replace `<BOOTSTRAP_SERVERS>` to point to your Kafka brokers (ex. `localhost:9092`) and ensure `<PLUGIN_PATH>` points to the top-level directory of where you are storing your connectors. (ex. `/opt/connectors/`).
184184
185-
4. Run `$KAFKA_CONNECT_HOME/bin/connect-distributed.sh $KAFKA_CONNECT_HOME/config/kafka-connect.properties` to start Kafka Connect or restart Kafka Connect with existing configuration file.
185+
> Note: - If running Kafka Version 0.10.x - PLUGIN_PATH is not a valid configuration property. To make the connector visible to Kafka Connect the connectors folder must be added to your Java classpath.
186+
187+
4. Start/Restart Kafka Connect - (for ex. `$KAFKA_CONNECT_HOME/bin/connect-distributed.sh $KAFKA_CONNECT_HOME/config/connect-distrubuted.properties`).
188+
189+
5. Validate your connector deployment by running the following command curl `http://<KAFKA_CONNECT_HOST>:8083/connector-plugins`. Response should have an entry named `com.splunk.kafka.connect.SplunkSinkConnector`.
186190
187191
## Security
188-
The Kafka Connect Splunk Sink supports the following security mechanisms
192+
The Kafka Connect Splunk Sink supports the following security mechanisms:
189193
* `SSL`
190194
* `SASL/GSSAPI (Kerberos)` - starting at version 0.9.0.0
191195
* `SASL/PLAIN` - starting at version 0.10.0.0

0 commit comments

Comments
 (0)