Skip to content

Commit 2eaaf42

Browse files
committed
[SPARK-6313] Update config wording doc for spark.files.useFetchCache
1 parent 5de7eb4 commit 2eaaf42

File tree

1 file changed

+5
-5
lines changed

1 file changed

+5
-5
lines changed

docs/configuration.md

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -749,12 +749,12 @@ Apart from these, the following properties are also available, and may be useful
749749
<td><code>spark.files.useFetchCache</code></td>
750750
<td>true</td>
751751
<td>
752-
If file fetching should use local caching. The improves performance when running multiple
753-
executors on the one host and is enabled by default (see
752+
If set to true (default), file fetching will use a local cache that is shared by executors
753+
that belong to the same application, which can improve task launching performance when
754+
running many executors on the same host. If set to false, these caching optimizations will
755+
be disabled and all executors will fetch their own copies of files. This optimization may be
756+
disabled in order to use Spark local directories that reside on NFS filesystems (see
754757
<a href="https://issues.apache.org/jira/browse/SPARK-6313">SPARK-6313</a> for more details).
755-
When set to true (default) caching is enabled. When set to false, caching optimizations are
756-
switched off and no lock files are created, this allows fetchFiles store to reside on a NFS
757-
mount.
758758
</td>
759759
</tr>
760760
<tr>

0 commit comments

Comments
 (0)