Skip to content

Commit 6447d7b

Browse files
windkitsrowen
authored andcommitted
[SPARK-22133][DOCS] Documentation for Mesos Reject Offer Configurations
## What changes were proposed in this pull request? Documentation about Mesos Reject Offer Configurations ## Related PR #19510 for `spark.mem.max` Author: Li, YanKit | Wilson | RIT <[email protected]> Closes #19555 from windkit/spark_22133.
1 parent 87343e1 commit 6447d7b

File tree

1 file changed

+25
-1
lines changed

1 file changed

+25
-1
lines changed

docs/running-on-mesos.md

Lines changed: 25 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -203,7 +203,7 @@ details and default values.
203203

204204
Executors are brought up eagerly when the application starts, until
205205
`spark.cores.max` is reached. If you don't set `spark.cores.max`, the
206-
Spark application will reserve all resources offered to it by Mesos,
206+
Spark application will consume all resources offered to it by Mesos,
207207
so we of course urge you to set this variable in any sort of
208208
multi-tenant cluster, including one which runs multiple concurrent
209209
Spark applications.
@@ -680,6 +680,30 @@ See the [configuration page](configuration.html) for information on Spark config
680680
driver disconnects, the master immediately tears down the framework.
681681
</td>
682682
</tr>
683+
<tr>
684+
<td><code>spark.mesos.rejectOfferDuration</code></td>
685+
<td><code>120s</code></td>
686+
<td>
687+
Time to consider unused resources refused, serves as a fallback of
688+
`spark.mesos.rejectOfferDurationForUnmetConstraints`,
689+
`spark.mesos.rejectOfferDurationForReachedMaxCores`
690+
</td>
691+
</tr>
692+
<tr>
693+
<td><code>spark.mesos.rejectOfferDurationForUnmetConstraints</code></td>
694+
<td><code>spark.mesos.rejectOfferDuration</code></td>
695+
<td>
696+
Time to consider unused resources refused with unmet constraints
697+
</td>
698+
</tr>
699+
<tr>
700+
<td><code>spark.mesos.rejectOfferDurationForReachedMaxCores</code></td>
701+
<td><code>spark.mesos.rejectOfferDuration</code></td>
702+
<td>
703+
Time to consider unused resources refused when maximum number of cores
704+
<code>spark.cores.max</code> is reached
705+
</td>
706+
</tr>
683707
</table>
684708

685709
# Troubleshooting and Debugging

0 commit comments

Comments
 (0)