Skip to content

Conversation

@HeartSaVioR
Copy link
Contributor

What changes were proposed in this pull request?

This patch is a follow-up to fill the gap in #29272 which missed to also provide default.api.timeout.ms as well. #29272 unintentionally changed the behavior on Kafka side timeout which is incompatible with the test timeout. (default.api.timeout.ms gets default value which is 60 seconds, longer than test timeout.)

Why are the changes needed?

We realized the PR for SPARK-32468 (#29272) doesn't work as we expect. See #29272 (comment) for more details.

Does this PR introduce any user-facing change?

No, as it only touches the tests.

How was this patch tested?

Will trigger builds from Jenkins or Github Action multiple time and confirm.

…s well when specifying "request.timeout.ms" to replace "default.api.timeout.ms"
@HeartSaVioR
Copy link
Contributor Author

Let's make sure Jenkins builds pass multiple times, and Github Action passes.

@HeartSaVioR
Copy link
Contributor Author

retest this, please

@HeartSaVioR
Copy link
Contributor Author

cc. @zsxwing as he reviewed #29272
also cc. @HyukjinKwon as he indicated me the Kafka tests become flaky

@HeartSaVioR
Copy link
Contributor Author

retest this, please

@SparkQA
Copy link

SparkQA commented Aug 4, 2020

Test build #127015 has finished for PR 29343 at commit 4929439.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@HeartSaVioR
Copy link
Contributor Author

retest this, please

@SparkQA
Copy link

SparkQA commented Aug 4, 2020

Test build #127017 has finished for PR 29343 at commit 4929439.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@HeartSaVioR
Copy link
Contributor Author

retest this, please

@HyukjinKwon
Copy link
Member

Looks good given the description and explanation.

@HyukjinKwon
Copy link
Member

Thanks for working on this @HeartSaVioR.

@SparkQA
Copy link

SparkQA commented Aug 4, 2020

Test build #127018 has finished for PR 29343 at commit 4929439.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Aug 4, 2020

Test build #127020 has finished for PR 29343 at commit 4929439.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@HeartSaVioR
Copy link
Contributor Author

retest this, please

@gaborgsomogyi
Copy link
Contributor

Had a look, the explanation and solution makes sense. Thank you guys helping me out!

Copy link
Contributor

@gaborgsomogyi gaborgsomogyi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

@HyukjinKwon
Copy link
Member

I am going to merge this unblock other PRs.

@HyukjinKwon
Copy link
Member

Merged to master.

@HeartSaVioR
Copy link
Contributor Author

Thanks for the quick reviews & reaction!

@HeartSaVioR HeartSaVioR deleted the SPARK-32468-FOLLOWUP branch August 4, 2020 05:54
@SparkQA
Copy link

SparkQA commented Aug 4, 2020

Test build #127028 has finished for PR 29343 at commit 4929439.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

jdcasale pushed a commit to palantir/spark that referenced this pull request Jun 22, 2021
…s well when specifying "request.timeout.ms" on replacing "default.api.timeout.ms"

### What changes were proposed in this pull request?

This patch is a follow-up to fill the gap in apache#29272 which missed to also provide `default.api.timeout.ms` as well.  apache#29272 unintentionally changed the behavior on Kafka side timeout which is incompatible with the test timeout. (`default.api.timeout.ms` gets default value which is 60 seconds, longer than test timeout.)

### Why are the changes needed?

We realized the PR for SPARK-32468 (apache#29272) doesn't work as we expect. See apache#29272 (comment) for more details.

### Does this PR introduce _any_ user-facing change?

No, as it only touches the tests.

### How was this patch tested?

Will trigger builds from Jenkins or Github Action multiple time and confirm.

Closes apache#29343 from HeartSaVioR/SPARK-32468-FOLLOWUP.

Authored-by: Jungtaek Lim (HeartSaVioR) <[email protected]>
Signed-off-by: HyukjinKwon <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants