Skip to content

Conversation

@zsxwing
Copy link
Member

@zsxwing zsxwing commented May 27, 2015

Since spark-streaming-kafka now is published for both Scala 2.10 and 2.11, we can move KafkaWordCount and DirectKafkaWordCount from examples/scala-2.10/src/ to examples/src/ so that they will appear in spark-examples-***-jar for Scala 2.11.

@zsxwing
Copy link
Member Author

zsxwing commented May 27, 2015

@tdas should I also remove scala-2.10 profile from examples/pom.xml?

@zsxwing
Copy link
Member Author

zsxwing commented May 27, 2015

@tdas should I also remove scala-2.10 profile from examples/pom.xml?

Ah, I should. Need to move spark-streaming-kafka out of the profile.

@SparkQA
Copy link

SparkQA commented May 27, 2015

Test build #33586 has finished for PR 6436 at commit 0bcfa87.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented May 27, 2015

Test build #33587 has finished for PR 6436 at commit c6052f1.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@srowen
Copy link
Member

srowen commented May 27, 2015

LGTM if in fact SPARK-6154 makes Kafka work for 2.11

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Does this need to change?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think it should be 1000 because the argument is called messagesPerSec.

@pwendell
Copy link
Contributor

LGTM as well - seems like there is one small unrelated change though in here.

@pwendell
Copy link
Contributor

Okay, LGTM

asfgit pushed a commit that referenced this pull request May 28, 2015
…10/src to src

Since `spark-streaming-kafka` now is published for both Scala 2.10 and 2.11, we can move `KafkaWordCount` and `DirectKafkaWordCount` from `examples/scala-2.10/src/` to `examples/src/` so that they will appear in `spark-examples-***-jar` for Scala 2.11.

Author: zsxwing <[email protected]>

Closes #6436 from zsxwing/SPARK-7895 and squashes the following commits:

c6052f1 [zsxwing] Update examples/pom.xml
0bcfa87 [zsxwing] Fix the sleep time
b9d1256 [zsxwing] Move Kafka examples from scala-2.10/src to src

(cherry picked from commit 000df2f)
Signed-off-by: Patrick Wendell <[email protected]>
@asfgit asfgit closed this in 000df2f May 28, 2015
@zsxwing zsxwing deleted the SPARK-7895 branch May 29, 2015 23:47
jeanlyn pushed a commit to jeanlyn/spark that referenced this pull request Jun 12, 2015
…10/src to src

Since `spark-streaming-kafka` now is published for both Scala 2.10 and 2.11, we can move `KafkaWordCount` and `DirectKafkaWordCount` from `examples/scala-2.10/src/` to `examples/src/` so that they will appear in `spark-examples-***-jar` for Scala 2.11.

Author: zsxwing <[email protected]>

Closes apache#6436 from zsxwing/SPARK-7895 and squashes the following commits:

c6052f1 [zsxwing] Update examples/pom.xml
0bcfa87 [zsxwing] Fix the sleep time
b9d1256 [zsxwing] Move Kafka examples from scala-2.10/src to src
nemccarthy pushed a commit to nemccarthy/spark that referenced this pull request Jun 19, 2015
…10/src to src

Since `spark-streaming-kafka` now is published for both Scala 2.10 and 2.11, we can move `KafkaWordCount` and `DirectKafkaWordCount` from `examples/scala-2.10/src/` to `examples/src/` so that they will appear in `spark-examples-***-jar` for Scala 2.11.

Author: zsxwing <[email protected]>

Closes apache#6436 from zsxwing/SPARK-7895 and squashes the following commits:

c6052f1 [zsxwing] Update examples/pom.xml
0bcfa87 [zsxwing] Fix the sleep time
b9d1256 [zsxwing] Move Kafka examples from scala-2.10/src to src
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants