Skip to content

Commit a7f6979

Browse files
Punya BiswalAndrew Or
authored andcommitted
[SPARK-7515] [DOC] Update documentation for PySpark on YARN with cluster mode
Now PySpark on YARN with cluster mode is supported so let's update doc. Author: Kousuke Saruta <sarutakoss.nttdata.co.jp> Closes #6040 from sarutak/update-doc-for-pyspark-on-yarn and squashes the following commits: ad9f88c [Kousuke Saruta] Brushed up sentences 469fd2e [Kousuke Saruta] Merge branch 'master' of https://github.com/apache/spark into update-doc-for-pyspark-on-yarn fcfdb92 [Kousuke Saruta] Updated doc for PySpark on YARN with cluster mode Author: Punya Biswal <[email protected]> Author: Kousuke Saruta <[email protected]> Closes #6842 from punya/feature/SPARK-7515 and squashes the following commits: 0b83648 [Punya Biswal] Merge remote-tracking branch 'origin/branch-1.4' into feature/SPARK-7515 de025cd [Kousuke Saruta] [SPARK-7515] [DOC] Update documentation for PySpark on YARN with cluster mode
1 parent 320c442 commit a7f6979

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

docs/submitting-applications.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -59,7 +59,7 @@ for applications that involve the REPL (e.g. Spark shell).
5959
Alternatively, if your application is submitted from a machine far from the worker machines (e.g.
6060
locally on your laptop), it is common to use `cluster` mode to minimize network latency between
6161
the drivers and the executors. Note that `cluster` mode is currently not supported for
62-
Mesos clusters or Python applications.
62+
Mesos clusters. Currently only YARN supports cluster mode for Python applications.
6363

6464
For Python applications, simply pass a `.py` file in the place of `<application-jar>` instead of a JAR,
6565
and add Python `.zip`, `.egg` or `.py` files to the search path with `--py-files`.

0 commit comments

Comments
 (0)