Skip to content

Conversation

@agrawaldevesh
Copy link

@agrawaldevesh agrawaldevesh commented Aug 8, 2020

What changes were proposed in this pull request?

As reported by @HyukjinKwon, BlockManagerDecommissionIntegrationSuite test is apparently still flaky (even after #29226): #29226 (comment).

The new flakyness is because the executors are not launching in the 6 seconds time out I had given them when run under github checks.

Bumped up the timeouts.

Why are the changes needed?

To make this test not flaky so that it can give us high signal if decommissioning regresses.

Does this PR introduce any user-facing change?

No, unit test only check.

How was this patch tested?

No new tests. Just github and jenkins.

@SparkQA
Copy link

SparkQA commented Aug 8, 2020

Test build #127220 has finished for PR 29388 at commit f69da10.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@srowen
Copy link
Member

srowen commented Aug 8, 2020

Please fill out the description

@agrawaldevesh
Copy link
Author

Thanks @srowen.

cc: @HyukjinKwon and @holdenk ... this PR is ready for review but first it would be great if someone could whitelist it to run on jenkins.

@agrawaldevesh agrawaldevesh changed the title [WIP] more bm test hardening tweaking Bump up timeouts in BlockManagerDecommissionIntegrationSuite to reduce flakyness Aug 9, 2020
@holdenk
Copy link
Contributor

holdenk commented Aug 9, 2020

Jenkins add to white list

@holdenk
Copy link
Contributor

holdenk commented Aug 9, 2020

Jenkins ok to test

Copy link
Member

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi, @agrawaldevesh .
Since you are one of the active contributor, it would be great if you file a JIRA and use it in the PR title. :)

@agrawaldevesh agrawaldevesh changed the title Bump up timeouts in BlockManagerDecommissionIntegrationSuite to reduce flakyness [SPARK-32575] Bump up timeouts in BlockManagerDecommissionIntegrationSuite to reduce flakyness Aug 10, 2020
@SparkQA
Copy link

SparkQA commented Aug 10, 2020

Test build #127245 has finished for PR 29388 at commit f69da10.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@dongjoon-hyun
Copy link
Member

I observed the failure here, too.

@dongjoon-hyun dongjoon-hyun changed the title [SPARK-32575] Bump up timeouts in BlockManagerDecommissionIntegrationSuite to reduce flakyness [SPARK-32575][CORE][TESTS] Bump up timeouts in BlockManagerDecommissionIntegrationSuite to reduce flakyness Aug 10, 2020
Copy link
Member

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, LGTM. Thank you, @agrawaldevesh .
Merged to master.

Copy link
Member

@HyukjinKwon HyukjinKwon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ah, late LGTM. Thanks

@holdenk
Copy link
Contributor

holdenk commented Aug 10, 2020

Thanks for taking care of this :)

holdenk pushed a commit to holdenk/spark that referenced this pull request Oct 27, 2020
…onIntegrationSuite to reduce flakyness

### What changes were proposed in this pull request?

As reported by HyukjinKwon, BlockManagerDecommissionIntegrationSuite test is apparently still flaky (even after apache#29226): apache#29226 (comment).

The new flakyness is because the executors are not launching in the 6 seconds time out I had given them when run under github checks.

Bumped up the timeouts.

### Why are the changes needed?

To make this test not flaky so that it can give us high signal if decommissioning regresses.

### Does this PR introduce _any_ user-facing change?

No, unit test only check.

### How was this patch tested?

No new tests. Just github and jenkins.

Closes apache#29388 from agrawaldevesh/more_bm_harden.

Authored-by: Devesh Agrawal <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants