Skip to content

Commit dc39658

Browse files
XuTingjuntdas
authored andcommitted
[SPARK-10311] [STREAMING] Reload appId and attemptId when app starts with checkpoint file in cluster mode
Author: xutingjun <[email protected]> Closes #8477 from XuTingjun/streaming-attempt.
1 parent 09e08db commit dc39658

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

streaming/src/main/scala/org/apache/spark/streaming/Checkpoint.scala

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -49,6 +49,8 @@ class Checkpoint(@transient ssc: StreamingContext, val checkpointTime: Time)
4949
// Reload properties for the checkpoint application since user wants to set a reload property
5050
// or spark had changed its value and user wants to set it back.
5151
val propertiesToReload = List(
52+
"spark.yarn.app.id",
53+
"spark.yarn.app.attemptId",
5254
"spark.driver.host",
5355
"spark.driver.port",
5456
"spark.master",

0 commit comments

Comments
 (0)