Skip to content

[SPARK-5049][SQL] Fix ordering of partition columns in ParquetTableScan #3990

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 1 commit into from
Closed

[SPARK-5049][SQL] Fix ordering of partition columns in ParquetTableScan #3990

wants to merge 1 commit into from

Conversation

@marmbrus
Copy link
Contributor

@marmbrus marmbrus commented Jan 11, 2015

Followup to #3870. Props to @rahulaggarwalguavus for identifying the issue.

@SparkQA
Copy link

SparkQA commented Jan 11, 2015

Test build #25366 has started for PR 3990 at commit dd03e4e.

  • This patch merges cleanly.

@marmbrus marmbrus mentioned this pull request Jan 11, 2015
Closed
@SparkQA
Copy link

SparkQA commented Jan 11, 2015

Test build #25366 has finished for PR 3990 at commit dd03e4e.

  • This patch fails PySpark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@AmplabJenkins
Copy link

AmplabJenkins commented Jan 11, 2015

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/25366/
Test FAILed.

@yhuai
Copy link
Contributor

yhuai commented Jan 12, 2015

retest this please

@SparkQA
Copy link

SparkQA commented Jan 12, 2015

Test build #25391 has started for PR 3990 at commit dd03e4e.

  • This patch merges cleanly.

@yhuai
Copy link
Contributor

yhuai commented Jan 12, 2015

The fix looks good to me.

@SparkQA
Copy link

SparkQA commented Jan 12, 2015

Test build #25391 has finished for PR 3990 at commit dd03e4e.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@AmplabJenkins
Copy link

AmplabJenkins commented Jan 12, 2015

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/25391/
Test PASSed.

@marmbrus
Copy link
Contributor Author

marmbrus commented Jan 12, 2015

I'm merging this to master and branch-1.2

asfgit pushed a commit that referenced this pull request Jan 12, 2015
@marmbrus
[SPARK-5049][SQL] Fix ordering of partition columns in ParquetTableScan
6d23af6 
Followup to #3870.  Props to rahulaggarwalguavus for identifying the issue.

Author: Michael Armbrust <[email protected]>

Closes #3990 from marmbrus/SPARK-5049 and squashes the following commits:

dd03e4e [Michael Armbrust] Fill in the partition values of parquet scans instead of using JoinedRow

(cherry picked from commit 5d9fa55)
Signed-off-by: Michael Armbrust <[email protected]>
@asfgit asfgit closed this in 5d9fa55 Jan 12, 2015
@marmbrus marmbrus deleted the SPARK-5049 branch February 17, 2015 20:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@marmbrus @SparkQA @AmplabJenkins @yhuai