[SPARK-10911] Executors should System.exit on clean shutdown.

zhuol · Tom Graves · commit ae0309a8812a · 2016-01-26T09:40:02.000-06:00
Call system.exit explicitly to make sure non-daemon user threads terminate. Without this, user applications might live forever if the cluster manager does not appropriately kill them. E.g., YARN had this bug: HADOOP-12441. Author: zhuol <zhuol@yahoo-inc.com> Closes #9946 from zhuoliu/10911.
diff --git a/core/src/main/scala/org/apache/spark/executor/CoarseGrainedExecutorBackend.scala b/core/src/main/scala/org/apache/spark/executor/CoarseGrainedExecutorBackend.scala
@@ -241,6 +241,7 @@ private[spark] object CoarseGrainedExecutorBackend extends Logging {
     }
 
     run(driverUrl, executorId, hostname, cores, appId, workerUrl, userClassPath)
+    System.exit(0)
   }
 
   private def printUsageAndExit() = {

Original file line number	Diff line number	Diff line change
`@@ -241,6 +241,7 @@ private[spark] object CoarseGrainedExecutorBackend extends Logging {`
`241`	`241`	`}`
`242`	`242`
`243`	`243`	`run(driverUrl, executorId, hostname, cores, appId, workerUrl, userClassPath)`
	`244`	`+ System.exit(0)`
`244`	`245`	`}`
`245`	`246`
`246`	`247`	`private def printUsageAndExit() = {`