Skip to content

Conversation

@zsxwing
Copy link
Member

@zsxwing zsxwing commented Sep 24, 2015

This is a follow-up PR of #6457 to fix InboxSuite that I forgot to update. I also removed an unnecessary comment.

@zsxwing
Copy link
Member Author

zsxwing commented Sep 24, 2015

/cc @vanzin @rxin

@SparkQA
Copy link

SparkQA commented Sep 24, 2015

Test build #42971 has started for PR 8905 at commit 95c3746.

@zsxwing
Copy link
Member Author

zsxwing commented Sep 24, 2015

I also saw the following exception here: https://amplab.cs.berkeley.edu/jenkins/view/Spark-QA-Test/job/Spark-Master-SBT/3597/AMPLAB_JENKINS_BUILD_PROFILE=hadoop2.2,label=spark-test/:

15/09/24 00:50:13.033 pool-1-thread-1-ScalaTest-running-PageRankSuite ERROR SparkContext: Error initializing SparkContext.
java.net.BindException: Address already in use: Service 'NettyRpcEnv' failed after 100 retries!
    at sun.nio.ch.Net.bind0(Native Method)
    at sun.nio.ch.Net.bind(Net.java:444)
    at sun.nio.ch.Net.bind(Net.java:436)
    at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:214)
    at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
    at io.netty.channel.socket.nio.NioServerSocketChannel.doBind(NioServerSocketChannel.java:125)
    at io.netty.channel.AbstractChannel$AbstractUnsafe.bind(AbstractChannel.java:485)
    at io.netty.channel.DefaultChannelPipeline$HeadContext.bind(DefaultChannelPipeline.java:1089)
    at io.netty.channel.AbstractChannelHandlerContext.invokeBind(AbstractChannelHandlerContext.java:430)
    at io.netty.channel.AbstractChannelHandlerContext.bind(AbstractChannelHandlerContext.java:415)
    at io.netty.channel.DefaultChannelPipeline.bind(DefaultChannelPipeline.java:903)
    at io.netty.channel.AbstractChannel.bind(AbstractChannel.java:198)
    at io.netty.bootstrap.AbstractBootstrap$2.run(AbstractBootstrap.java:348)
    at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357)
    at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357)
    at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
    at java.lang.Thread.run(Thread.java:745)

I'm not sure why it happened since it's bind to 0. Is it possible that the Jenkins worker exhausted all ports?

@shaneknapp
Copy link
Contributor

jenkins, test this please

@zsxwing zsxwing changed the title [SPARK-6028][Core]Fix InboxSuite 'post: multiple threads' [SPARK-10799][Core]Fix InboxSuite 'post: multiple threads' Sep 24, 2015
@SparkQA
Copy link

SparkQA commented Sep 24, 2015

Test build #42973 has finished for PR 8905 at commit 95c3746.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@vanzin
Copy link
Contributor

vanzin commented Sep 24, 2015

Change looks good but I guess it depends on the original change being re-added? You could merge this into that patch.

@zsxwing
Copy link
Member Author

zsxwing commented Sep 30, 2015

Included in #8944

@zsxwing zsxwing closed this Sep 30, 2015
@zsxwing zsxwing deleted the new-rpc-follow-up branch September 30, 2015 06:08
asfgit pushed a commit that referenced this pull request Oct 3, 2015
…#8905

This PR just reverted 02144d6 to remerge #6457 and also included the commits in #8905.

Author: zsxwing <[email protected]>

Closes #8944 from zsxwing/SPARK-6028.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants