You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/configuration.md
+6-6Lines changed: 6 additions & 6 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -116,7 +116,7 @@ of the most common options to set are:
116
116
Amount of memory to use for the driver process, i.e. where SparkContext is initialized.
117
117
(e.g. <code>512m</code>, <code>2g</code>).
118
118
119
-
<br /><br />Note: setting this with <code>conf.set(...)</code> only works in <code>cluster</code> mode (e.g. YARN deployment). For <code>client</code> driver memory should be configured in the run-time settings ; i.e. --driver-memory 2g or within <code>conf/spark-defaults.conf</code>.
119
+
<br /><em>Note:</em> setting this with <code>conf.set(...)</code> only works in <code>cluster</code> mode (e.g. YARN deployment). For <code>client</code> driver memory should be configured in the run-time settings ; i.e. --driver-memory 2g or within <code>conf/spark-defaults.conf</code>.
120
120
</td>
121
121
</tr>
122
122
<tr>
@@ -138,7 +138,7 @@ of the most common options to set are:
138
138
and memory overhead of objects in JVM). Setting a proper limit can protect the driver from
139
139
out-of-memory errors.
140
140
141
-
<br /><br />Note: setting this with <code>conf.set(...)</code> only works in <code>cluster</code> mode (e.g. YARN deployment). For <code>client</code> driver memory should be configured in <code>conf/spark-defaults.conf</code>.
141
+
<br /><em>Note:</em> setting this with <code>conf.set(...)</code> only works in <code>cluster</code> mode (e.g. YARN deployment). For <code>client</code> driver memory should be configured in <code>conf/spark-defaults.conf</code>.
142
142
143
143
</td>
144
144
</tr>
@@ -220,7 +220,7 @@ Apart from these, the following properties are also available, and may be useful
220
220
<td>
221
221
A string of extra JVM options to pass to the driver. For instance, GC settings or other logging.
222
222
223
-
<br /><br />Note: setting this with <code>conf.set(...)</code> only works in <code>cluster</code> mode (e.g. YARN deployment). For <code>client</code> driver memory should be configured in <code>conf/spark-defaults.conf</code> or via the run-time settings (See Dynamically Loading Spark Properties).
223
+
<br /><em>Note:</em> setting this with <code>conf.set(...)</code> only works in <code>cluster</code> mode (e.g. YARN deployment). For <code>client</code> driver memory should be configured in <code>conf/spark-defaults.conf</code> or via the run-time settings (See Dynamically Loading Spark Properties).
224
224
225
225
</td>
226
226
</tr>
@@ -230,7 +230,7 @@ Apart from these, the following properties are also available, and may be useful
230
230
<td>
231
231
Extra classpath entries to append to the classpath of the driver.
232
232
233
-
<br /><br />Note: setting this with <code>conf.set(...)</code> only works in <code>cluster</code> mode (e.g. YARN deployment). For <code>client</code> driver memory should be configured in <code>conf/spark-defaults.conf</code> or via the run-time settings (See Dynamically Loading Spark Properties).
233
+
<br /><em>Note:</em> setting this with <code>conf.set(...)</code> only works in <code>cluster</code> mode (e.g. YARN deployment). For <code>client</code> driver memory should be configured in <code>conf/spark-defaults.conf</code> or via the run-time settings (See Dynamically Loading Spark Properties).
234
234
</td>
235
235
</tr>
236
236
<tr>
@@ -239,7 +239,7 @@ Apart from these, the following properties are also available, and may be useful
239
239
<td>
240
240
Set a special library path to use when launching the driver JVM.
241
241
242
-
<br /><br />Note: setting this with <code>conf.set(...)</code> only works in <code>cluster</code> mode (e.g. YARN deployment). For <code>client</code> driver memory should be configured in <code>conf/spark-defaults.conf</code> or via the run-time settings (See Dynamically Loading Spark Properties).
242
+
<br /><em>Note:</em> setting this with <code>conf.set(...)</code> only works in <code>cluster</code> mode (e.g. YARN deployment). For <code>client</code> driver memory should be configured in <code>conf/spark-defaults.conf</code> or via the run-time settings (See Dynamically Loading Spark Properties).
243
243
</td>
244
244
</tr>
245
245
<tr>
@@ -250,7 +250,7 @@ Apart from these, the following properties are also available, and may be useful
250
250
classes in the the driver. This feature can be used to mitigate conflicts between Spark's
251
251
dependencies and user dependencies. It is currently an experimental feature.
252
252
253
-
<br /><br />Note: setting this with <code>conf.set(...)</code> only works in <code>cluster</code> mode (e.g. YARN deployment). For <code>client</code> driver memory should be configured in <code>conf/spark-defaults.conf</code> or via the run-time settings (See Dynamically Loading Spark Properties).
253
+
<br /><em>Note:</em> setting this with <code>conf.set(...)</code> only works in <code>cluster</code> mode (e.g. YARN deployment). For <code>client</code> driver memory should be configured in <code>conf/spark-defaults.conf</code> or via the run-time settings (See Dynamically Loading Spark Properties).
0 commit comments