Skip to content

Commit d75c53d

Browse files
MingfeiAndrew Or
authored andcommitted
[SPARK-8161] Set externalBlockStoreInitialized to be true, after ExternalBlockStore is initialized
externalBlockStoreInitialized is never set to be true, which causes the blocks stored in ExternalBlockStore can not be removed. Author: Mingfei <[email protected]> Closes #6702 from shimingfei/SetTrue and squashes the following commits: add61d8 [Mingfei] Set externalBlockStoreInitialized to be true, after ExternalBlockStore is initialized (cherry picked from commit 7ad8c5d) Signed-off-by: Andrew Or <[email protected]>
1 parent a7f6979 commit d75c53d

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

core/src/main/scala/org/apache/spark/storage/BlockManager.scala

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -83,8 +83,10 @@ private[spark] class BlockManager(
8383
private var externalBlockStoreInitialized = false
8484
private[spark] val memoryStore = new MemoryStore(this, maxMemory)
8585
private[spark] val diskStore = new DiskStore(this, diskBlockManager)
86-
private[spark] lazy val externalBlockStore: ExternalBlockStore =
86+
private[spark] lazy val externalBlockStore: ExternalBlockStore = {
87+
externalBlockStoreInitialized = true
8788
new ExternalBlockStore(this, executorId)
89+
}
8890

8991
private[spark]
9092
val externalShuffleServiceEnabled = conf.getBoolean("spark.shuffle.service.enabled", false)

0 commit comments

Comments
 (0)