From cf4f1fa5b5ed7cd1f6db2557c5bcafc4e474f9e7 Mon Sep 17 00:00:00 2001 From: Andrew Ash Date: Fri, 24 Feb 2017 01:22:35 -0800 Subject: [PATCH 1/2] Document blocking submit calls https://github.com/apache-spark-on-k8s/spark/pull/53 added these config but didn't document them --- docs/running-on-kubernetes.md | 15 +++++++++++++++ 1 file changed, 15 insertions(+) diff --git a/docs/running-on-kubernetes.md b/docs/running-on-kubernetes.md index cddc7259e6ac3..2472b546212f3 100644 --- a/docs/running-on-kubernetes.md +++ b/docs/running-on-kubernetes.md @@ -202,6 +202,21 @@ from the other deployment modes. See the [configuration page](configuration.html resource. Use alternatives such as Ingress if possible. + + spark.kubernetes.submit.waitAppCompletion + true + + In cluster mode, whether to wait for the application to finish before exiting the launcher process. When changed to + false, the launcher has a "fire-and-forget" behavior when launching the Spark job. + + + + spark.kubernetes.report.interval + 1s + + Interval between reports of the current app status in cluster mode. + + ## Current Limitations From ceb5b0978d9b1abd63f108a14cf559a0781ba2c3 Mon Sep 17 00:00:00 2001 From: Andrew Ash Date: Fri, 24 Feb 2017 13:00:21 -0800 Subject: [PATCH 2/2] Update running-on-kubernetes.md --- docs/running-on-kubernetes.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/running-on-kubernetes.md b/docs/running-on-kubernetes.md index 2472b546212f3..9d49ac6829723 100644 --- a/docs/running-on-kubernetes.md +++ b/docs/running-on-kubernetes.md @@ -214,7 +214,7 @@ from the other deployment modes. See the [configuration page](configuration.html spark.kubernetes.report.interval 1s - Interval between reports of the current app status in cluster mode. + Interval between reports of the current Spark job status in cluster mode.