Skip to content

Conversation

@wangyum
Copy link
Member

@wangyum wangyum commented May 2, 2020

What changes were proposed in this pull request?

This pr port HIVE-10415: hive.start.cleanup.scratchdir configuration is not taking effect.

Why are the changes needed?

I encountered this issue:
image
I'd like to make hive.start.cleanup.scratchdir effective to reduce this issue.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Unit test

@SparkQA
Copy link

SparkQA commented May 2, 2020

Test build #122217 has finished for PR 28436 at commit 59310c3.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@HyukjinKwon
Copy link
Member

Merged to master and branch-3.0.

HyukjinKwon pushed a commit that referenced this pull request May 4, 2020
…figuration is not taking effect

### What changes were proposed in this pull request?
This pr port [HIVE-10415](https://issues.apache.org/jira/browse/HIVE-10415): `hive.start.cleanup.scratchdir` configuration is not taking effect.

### Why are the changes needed?

I encountered this issue:
![image](https://user-images.githubusercontent.com/5399861/80869375-aeafd080-8cd2-11ea-8573-93ec4b422be1.png)
I'd like to make `hive.start.cleanup.scratchdir` effective to reduce this issue.

### Does this PR introduce _any_ user-facing change?
No.

### How was this patch tested?
Unit test

Closes #28436 from wangyum/SPARK-31626.

Authored-by: Yuming Wang <[email protected]>
Signed-off-by: HyukjinKwon <[email protected]>
(cherry picked from commit 7ef0b69)
Signed-off-by: HyukjinKwon <[email protected]>
@wangyum wangyum deleted the SPARK-31626 branch May 4, 2020 06:15
huaxingao pushed a commit to huaxingao/spark that referenced this pull request May 4, 2020
…figuration is not taking effect

### What changes were proposed in this pull request?
This pr port [HIVE-10415](https://issues.apache.org/jira/browse/HIVE-10415): `hive.start.cleanup.scratchdir` configuration is not taking effect.

### Why are the changes needed?

I encountered this issue:
![image](https://user-images.githubusercontent.com/5399861/80869375-aeafd080-8cd2-11ea-8573-93ec4b422be1.png)
I'd like to make `hive.start.cleanup.scratchdir` effective to reduce this issue.

### Does this PR introduce _any_ user-facing change?
No.

### How was this patch tested?
Unit test

Closes apache#28436 from wangyum/SPARK-31626.

Authored-by: Yuming Wang <[email protected]>
Signed-off-by: HyukjinKwon <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants