File tree Expand file tree Collapse file tree 1 file changed +3
-3
lines changed
core/src/main/scala/org/apache/spark/scheduler Expand file tree Collapse file tree 1 file changed +3
-3
lines changed Original file line number Diff line number Diff line change @@ -189,9 +189,9 @@ private[spark] class DAGScheduler(
189189 * Tracks the latest epoch of a fully processed error where shuffle files have been lost from
190190 * the given executor.
191191 *
192- * This is closely related to executorFailureEpoch.
193- * They only differ for the executor when there is a Standalone worker or an external shuffle
194- * service serving shuffle files . In that case, when an executor is lost, we do not update
192+ * This is closely related to executorFailureEpoch. They only differ for the executor when
193+ * there is an external shuffle service serving shuffle files and we haven't been notified that
194+ * the entire worker has been lost . In that case, when an executor is lost, we do not update
195195 * the shuffleFileLostEpoch; we wait for a fetch failure. This way, if only the executor
196196 * fails, we do not unregister the shuffle data as it can still be served; but if there is
197197 * a failure in the shuffle service (resulting in fetch failure), we unregister the shuffle
You can’t perform that action at this time.
0 commit comments