Skip to content

[SPARK-7515] [DOC] Update documentation for PySpark on YARN with cluster mode #6040

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 3 commits into from
Closed

[SPARK-7515] [DOC] Update documentation for PySpark on YARN with cluster mode #6040

Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
fcfdb92
Updated doc for PySpark on YARN with cluster mode
sarutak May 10, 2015
469fd2e
Merge branch 'master' of https://github.com/apache/spark into update-…
sarutak May 11, 2015
ad9f88c
Brushed up sentences
sarutak May 11, 2015
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion docs/submitting-applications.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -59,7 +59,7 @@ for applications that involve the REPL (e.g. Spark shell).
Alternatively, if your application is submitted from a machine far from the worker machines (e.g.
locally on your laptop), it is common to use `cluster` mode to minimize network latency between
the drivers and the executors. Note that `cluster` mode is currently not supported for
Mesos clusters or Python applications.
Mesos clusters. Currently only YARN supports cluster mode for Python applications.

For Python applications, simply pass a `.py` file in the place of `<application-jar>` instead of a JAR,
and add Python `.zip`, `.egg` or `.py` files to the search path with `--py-files`.
Expand Down