Skip to content

Commit 1f75238

Browse files
committed
SPARK_JAVA_OPTS --> SPARK_MASTER_OPTS for master settings
1 parent 4982331 commit 1f75238

File tree

2 files changed

+3
-2
lines changed

2 files changed

+3
-2
lines changed

conf/spark-env.sh.template

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -16,6 +16,7 @@
1616
# If using the standalone deploy mode, you can also set variables for it here:
1717
# - SPARK_MASTER_IP, to bind the master to a different IP address or hostname
1818
# - SPARK_MASTER_PORT / SPARK_MASTER_WEBUI_PORT, to use non-default ports
19+
# - SPARK_MASTER_OPTS, to set config properties at the master (e.g "-Dx=y")
1920
# - SPARK_WORKER_CORES, to set the number of cores to use on this machine
2021
# - SPARK_WORKER_MEMORY, to set how much memory to use (e.g. 1000m, 2g)
2122
# - SPARK_WORKER_PORT / SPARK_WORKER_WEBUI_PORT

docs/configuration.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -575,7 +575,7 @@ Apart from these, the following properties are also available, and may be useful
575575
to consolidate them onto as few nodes as possible. Spreading out is usually better for
576576
data locality in HDFS, but consolidating is more efficient for compute-intensive workloads. <br/>
577577
<b>Note:</b> this setting needs to be configured in the standalone cluster master, not in individual
578-
applications; you can set it through <code>SPARK_JAVA_OPTS</code> in <code>spark-env.sh</code>.
578+
applications; you can set it through <code>SPARK_MASTER_OPTS</code> in <code>spark-env.sh</code>.
579579
</td>
580580
</tr>
581581
<tr>
@@ -588,7 +588,7 @@ Apart from these, the following properties are also available, and may be useful
588588
Set this lower on a shared cluster to prevent users from grabbing
589589
the whole cluster by default. <br/>
590590
<b>Note:</b> this setting needs to be configured in the standalone cluster master, not in individual
591-
applications; you can set it through <code>SPARK_JAVA_OPTS</code> in <code>spark-env.sh</code>.
591+
applications; you can set it through <code>SPARK_MASTER_OPTS</code> in <code>spark-env.sh</code>.
592592
</td>
593593
</tr>
594594
<tr>

0 commit comments

Comments
 (0)