[SPARK-24639][DOC] Add three config in the doc #21624
Conversation
docs/configuration.md
Outdated
| <td><code>spark.python.task.killTimeout</code></td> | ||
| <td>2s</td> | ||
| <td> | ||
| How long to wait before killing the python worker if a task cannot be interrupted. |
There was a problem hiding this comment.
"Timeout to wait before killing the python worker when a task cannot be interrupted."
There was a problem hiding this comment.
updated and fix confilct, please have a review, thanks, @zsxwing @jiangxb1987
|
cc @zsxwing |
|
ok to test |
|
Test build #93064 has finished for PR 21624 at commit
|
srowen
left a comment
srowen
left a comment
There was a problem hiding this comment.
Not every config property is meant to be exposed to users. The sql ones have documentation in the source code, which leads me to believe they are OK to document publicly. The rest do not; they may be more internal or experimental configs to change. It's not wrong to document them, but it kind of means guaranteeing they will persist. The conservative thing would be to restrict this to the sql properties.
| </td> | ||
| </tr> | ||
| <tr> | ||
| <td><code>spark.sql.repl.eagerEval.truncate</code></td> |
There was a problem hiding this comment.
spark.sql.* configs should be in sql-programming-guide.md
| </td> | ||
| </tr> | ||
| <tr> | ||
| <td><code>spark.worker.driverTerminateTimeout</code></td> |
There was a problem hiding this comment.
Likewise spark.worker.* configs are in spark-standalone.md, it appears
5 participants
What changes were proposed in this pull request?
add three config which are mentioned in the pr #21567 , they are
spark.python.task.killTimeout,spark.worker.driverTerminateTimeoutandspark.ui.consoleProgress.update.intervalHow was this patch tested?
doc build