[SPARK-2805] Upgrade Akka to 2.3.4

[pwendell]

This is a second rev of the Akka upgrade (earlier merged, but reverted). I made a slight modification which is that I also upgrade Hive to deal with a compatibility issue related to the protocol buffers library.

[pwendell]

Jenkins, test this please.

[SparkQA]

QA tests have started for PR 2752 at commit 4c7ca3f.

• This patch merges cleanly.

[SparkQA]

QA tests have finished for PR 2752 at commit 4c7ca3f.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[AmplabJenkins]

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/21578/Test PASSed.

[pwendell]

Okay let's see if this does better with the nightly maven builds.

[witgo]

This will cause some bug.
It seems to be related to akka.remote.retry-gate-closed-for configuration
the log:

14/10/10 20:56:03 WARN ReliableDeliverySupervisor: Association with remote system [akka.tcp://[email protected]:20412] has failed, address is now gated for [5000] ms. Reason is: [Disassociated].
14/10/10 20:56:03 INFO TaskSetManager: Starting task 60.0 in stage 5427.0 (TID 35496, 10dian71.domain.test, PROCESS_LOCAL, 8062 bytes)
14/10/10 20:56:03 INFO TaskSetManager: Finished task 39.0 in stage 5427.0 (TID 35480) in 539 ms on 10dian71.domain.test (63/72)
14/10/10 20:56:03 INFO TaskSetManager: Finished task 50.0 in stage 5427.0 (TID 35488) in 279 ms on 10dian72.domain.test (64/72)
14/10/10 20:56:03 ERROR YarnClientSchedulerBackend: Yarn application has already exited with state FINISHED!
14/10/10 20:56:03 INFO SparkUI: Stopped Spark web UI at http://10dian71.domain.test:4040
14/10/10 20:56:03 INFO DAGScheduler: Stopping DAGScheduler
14/10/10 20:56:03 INFO YarnClientSchedulerBackend: Shutting down all executors
14/10/10 20:56:03 INFO YarnClientSchedulerBackend: Asking each executor to shut down
14/10/10 20:56:03 INFO DAGScheduler: Job 218 failed: count at TopicModeling.scala:475, took 2.400066 s
14/10/10 20:56:03 INFO YarnClientSchedulerBackend: Stopped