Skip to content

[SPARK-17991] [SQL] Enable metastore partition pruning by default. #15475

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 1 commit into from
Closed

[SPARK-17991] [SQL] Enable metastore partition pruning by default. #15475

wants to merge 1 commit into from

Conversation

@ericl
Copy link
Contributor

@ericl ericl commented Oct 14, 2016

What changes were proposed in this pull request?

This should apply to non-converted metastore relations. WIP to see if this causes any test failures.

How was this patch tested?

Existing tests.

@ericl
Copy link
Contributor Author

ericl commented Oct 14, 2016

cc @yhuai

@SparkQA
Copy link

SparkQA commented Oct 14, 2016

Test build #66927 has finished for PR 15475 at commit 2581380.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@ericl
Copy link
Contributor Author

ericl commented Oct 14, 2016

Jenkins test this please

1 similar comment
@ericl
Copy link
Contributor Author

ericl commented Oct 14, 2016

Jenkins test this please

@SparkQA
Copy link

SparkQA commented Oct 14, 2016

Test build #66947 has finished for PR 15475 at commit 2581380.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Oct 14, 2016

Test build #66951 has finished for PR 15475 at commit 2581380.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@yhuai
Copy link
Contributor

yhuai commented Oct 14, 2016

Jenkins test this please

2 similar comments
@yhuai
Copy link
Contributor

yhuai commented Oct 14, 2016

Jenkins test this please

@yhuai
Copy link
Contributor

yhuai commented Oct 14, 2016

Jenkins test this please

@SparkQA
Copy link

SparkQA commented Oct 14, 2016

Test build #66971 has finished for PR 15475 at commit 2581380.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@ericl
Copy link
Contributor Author

ericl commented Oct 14, 2016

Jenkins test this please

On Fri, Oct 14, 2016, 1:15 PM UCB AMPLab [email protected] wrote:

Test PASSed.
Refer to this link for build results (access rights to CI server needed):

https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66971/
Test PASSed.

—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
#15475 (comment), or mute
the thread
https://github.com/notifications/unsubscribe-auth/AAA6SpfxrbMSW_MJRGcvmbHqibSqtK03ks5qz-LKgaJpZM4KWih7
.

@SparkQA
Copy link

SparkQA commented Oct 14, 2016

Test build #66979 has finished for PR 15475 at commit a5626f6.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@ericl ericl force-pushed the try-enabling-pruning branch from a5626f6 to 2581380 Compare October 18, 2016 19:34
@ericl ericl changed the title [WIP] [SQL] Enable metastore partition pruning by default. [SPARK-17991] [SQL] Enable metastore partition pruning by default. Oct 18, 2016
@ericl
Copy link
Contributor Author

ericl commented Oct 18, 2016

Jenkins test this please

@SparkQA
Copy link

SparkQA commented Oct 18, 2016

Test build #67138 has finished for PR 15475 at commit 2581380.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@ericl
Copy link
Contributor Author

ericl commented Oct 19, 2016

@liancheng

@rxin
Copy link
Contributor

rxin commented Oct 20, 2016

Merging in master.

@asfgit asfgit closed this in 4bd17c4 Oct 20, 2016
robert3005 pushed a commit to palantir/spark that referenced this pull request Nov 1, 2016
@ericl
[SPARK-17991][SQL] Enable metastore partition pruning by default.
d4ad5c3 
## What changes were proposed in this pull request?

This should apply to non-converted metastore relations. WIP to see if this causes any test failures.

## How was this patch tested?

Existing tests.

Author: Eric Liang <[email protected]>

Closes apache#15475 from ericl/try-enabling-pruning.
uzadude pushed a commit to uzadude/spark that referenced this pull request Jan 27, 2017
@ericl @uzadude
[SPARK-17991][SQL] Enable metastore partition pruning by default.
958bcd8 
## What changes were proposed in this pull request?

This should apply to non-converted metastore relations. WIP to see if this causes any test failures.

## How was this patch tested?

Existing tests.

Author: Eric Liang <[email protected]>

Closes apache#15475 from ericl/try-enabling-pruning.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@ericl @SparkQA @yhuai @rxin