Skip to content

Commit 71a8e9d

Browse files
koeningersrowen
authored andcommitted
[SPARK-20036][DOC] Note incompatible dependencies on org.apache.kafka artifacts
## What changes were proposed in this pull request? Note that you shouldn't manually add dependencies on org.apache.kafka artifacts ## How was this patch tested? Doc only change, did jekyll build and looked at the page. Author: cody koeninger <[email protected]> Closes #17675 from koeninger/SPARK-20036.
1 parent 3537876 commit 71a8e9d

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

docs/streaming-kafka-0-10-integration.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -12,6 +12,8 @@ For Scala/Java applications using SBT/Maven project definitions, link your strea
1212
artifactId = spark-streaming-kafka-0-10_{{site.SCALA_BINARY_VERSION}}
1313
version = {{site.SPARK_VERSION_SHORT}}
1414

15+
**Do not** manually add dependencies on `org.apache.kafka` artifacts (e.g. `kafka-clients`). The `spark-streaming-kafka-0-10` artifact has the appropriate transitive dependencies already, and different versions may be incompatible in hard to diagnose ways.
16+
1517
### Creating a Direct Stream
1618
Note that the namespace for the import includes the version, org.apache.spark.streaming.kafka010
1719

0 commit comments

Comments
 (0)