Skip to content

Conversation

@c21
Copy link
Contributor

@c21 c21 commented Mar 11, 2021

What changes were proposed in this pull request?

Per comment in #31802 (comment) , we would like to exercise whole stage code-gen enabled and disabled code paths in join unit test suites. This is for better test coverage of shuffled hash join.

Why are the changes needed?

Better test coverage.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Existing and added unit tests here.

@c21
Copy link
Contributor Author

c21 commented Mar 11, 2021

cc @dongjoon-hyun could you help take a look when you have time, thanks.

Copy link
Member

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you, @c21 .
+1, LGTM. (Pending CIs)

@dongjoon-hyun dongjoon-hyun changed the title [SPARK-34711][SQL] Exercise code-gen enable/disable code paths for SHJ in join test suites [SPARK-34711][SQL][TESTS] Exercise code-gen enable/disable code paths for SHJ in join test suites Mar 11, 2021
@github-actions github-actions bot added the SQL label Mar 11, 2021
@dongjoon-hyun
Copy link
Member

This is a test PR and I verified this manually. Merged to master/3.1.

dongjoon-hyun pushed a commit that referenced this pull request Mar 11, 2021
… for SHJ in join test suites

### What changes were proposed in this pull request?

Per comment in #31802 (comment) , we would like to exercise whole stage code-gen enabled and disabled code paths in join unit test suites. This is for better test coverage of shuffled hash join.

### Why are the changes needed?

Better test coverage.

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Existing and added unit tests here.

Closes #31806 from c21/test-minor.

Authored-by: Cheng Su <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
(cherry picked from commit 9aa8f06)
Signed-off-by: Dongjoon Hyun <[email protected]>
@AmplabJenkins
Copy link

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135963/

@AmplabJenkins
Copy link

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40547/

@c21
Copy link
Contributor Author

c21 commented Mar 11, 2021

Thank you @dongjoon-hyun for review!

@c21 c21 deleted the test-minor branch March 11, 2021 08:50
flyrain pushed a commit to flyrain/spark that referenced this pull request Sep 21, 2021
… for SHJ in join test suites

### What changes were proposed in this pull request?

Per comment in apache#31802 (comment) , we would like to exercise whole stage code-gen enabled and disabled code paths in join unit test suites. This is for better test coverage of shuffled hash join.

### Why are the changes needed?

Better test coverage.

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Existing and added unit tests here.

Closes apache#31806 from c21/test-minor.

Authored-by: Cheng Su <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
(cherry picked from commit 9aa8f06)
Signed-off-by: Dongjoon Hyun <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants