Skip to content

Commit e751f8f

Browse files
许鹏Andrew Or
authored andcommitted
fix spark-6033, clarify the spark.worker.cleanup behavior in standalone mode
jira case spark-6033 https://issues.apache.org/jira/browse/SPARK-6033 In standalone deploy mode, the cleanup will only remove the stopped application's directories. The original description about the cleanup behavior is incorrect. Author: 许鹏 <[email protected]> Closes #4803 from hseagle/spark-6033 and squashes the following commits: 927a6a0 [许鹏] fix the incorrect description about the spark.worker.cleanup in standalone mode
1 parent 14e042b commit e751f8f

File tree

1 file changed

+1
-2
lines changed

1 file changed

+1
-2
lines changed

docs/spark-standalone.md

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -209,8 +209,7 @@ SPARK_WORKER_OPTS supports the following system properties:
209209
<td>false</td>
210210
<td>
211211
Enable periodic cleanup of worker / application directories. Note that this only affects standalone
212-
mode, as YARN works differently. Applications directories are cleaned up regardless of whether
213-
the application is still running.
212+
mode, as YARN works differently. Only the directories of stopped applications are cleaned up.
214213
</td>
215214
</tr>
216215
<tr>

0 commit comments

Comments
 (0)