Skip to content

Commit 17b751d

Browse files
author
Ilya Ganelin
committed
Updated documentation for driver-memory to reflect its true behavior in client vs cluster mode
1 parent fa6bdc6 commit 17b751d

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

docs/configuration.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -115,6 +115,8 @@ of the most common options to set are:
115115
<td>
116116
Amount of memory to use for the driver process, i.e. where SparkContext is initialized.
117117
(e.g. <code>512m</code>, <code>2g</code>).
118+
119+
<br /><br />Note: this setting only works in <code>cluster</code> mode (e.g. YARN deployment). In client mode (e.g. spark-shell), this setting has no effect. In client mode, driver memory should be configured in the run-time settings ; i.e. --driver-memory 2g.
118120
</td>
119121
</tr>
120122
<tr>

0 commit comments

Comments
 (0)