Skip to content

Commit 8e8db7f

Browse files
author
Neelesh Srinivas Salian
committed
Removed the changes in this commit to help clearly distinguish movement from update
1 parent 151c298 commit 8e8db7f

File tree

1 file changed

+2
-3
lines changed

1 file changed

+2
-3
lines changed

docs/running-on-yarn.md

Lines changed: 2 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -17,10 +17,9 @@ Java system properties or environment variables not managed by YARN, they should
1717
Spark application's configuration (driver, executors, and the AM when running in client mode).
1818

1919
There are two deploy modes that can be used to launch Spark applications on YARN. In yarn-cluster mode, the Spark driver runs inside an application master process which is managed by YARN on the cluster, and the client can go away after initiating the application. In yarn-client mode, the driver runs in the client process, and the application master is only used for requesting resources from YARN.
20-
(Default: --deploy-mode client)
21-
22-
Unlike in Spark standalone and Mesos mode, in which the master's address is specified in the "master" parameter, in YARN mode the ResourceManager's address is picked up from the Hadoop configuration. Thus, the master parameter is yarn.
2320

21+
Unlike in Spark standalone and Mesos mode, in which the master's address is specified in the "master" parameter, in YARN mode the ResourceManager's address is picked up from the Hadoop configuration. Thus, the master parameter is simply “yarn-client” or “yarn-cluster”.
22+
2423
To launch a Spark application in yarn-cluster mode:
2524

2625
./bin/spark-submit --class path.to.your.Class --master yarn-cluster [options] <app jar> [app options]

0 commit comments

Comments
 (0)