Skip to content

Conversation

@cloud-fan
Copy link
Contributor

In SPARK-10743 we wrap cast with UnresolvedAlias to give Cast a better alias if possible. However, for cases like filter, the UnresolvedAlias can't be resolved and actually we don't need a better alias for this case. This PR move the cast wrapping logic to Column.named so that we will only do it when we need a alias name.

backport #10781 to 1.6

@cloud-fan
Copy link
Contributor Author

cc @yhuai

@rxin
Copy link
Contributor

rxin commented Jan 18, 2016

Can you update the pull request description to include more information? The old pull request description is good.

@SparkQA
Copy link

SparkQA commented Jan 18, 2016

Test build #49633 has finished for PR 10819 at commit 4e3269b.

  • This patch fails to build.
  • This patch merges cleanly.
  • This patch adds no public classes.

@cloud-fan
Copy link
Contributor Author

retest this please

@SparkQA
Copy link

SparkQA commented Jan 19, 2016

Test build #49635 has finished for PR 10819 at commit 4e3269b.

  • This patch fails to build.
  • This patch merges cleanly.
  • This patch adds no public classes.

@yhuai
Copy link
Contributor

yhuai commented Jan 19, 2016

test this please

@SparkQA
Copy link

SparkQA commented Jan 19, 2016

Test build #49638 has finished for PR 10819 at commit 4e3269b.

  • This patch fails to build.
  • This patch merges cleanly.
  • This patch adds no public classes.

@cloud-fan
Copy link
Contributor Author

something wrong with branch 1.6? cc @JoshRosen

@JoshRosen
Copy link
Contributor

There might be something wrong with that build workspace's Ivy cache. If you have Jenkins access, you should be able to SSH in and wipe it away.

@cloud-fan
Copy link
Contributor Author

retest this please

@SparkQA
Copy link

SparkQA commented Jan 19, 2016

Test build #49655 has finished for PR 10819 at commit 4e3269b.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@yhuai
Copy link
Contributor

yhuai commented Jan 19, 2016

Thanks! Merging to branch 1.6.

asfgit pushed a commit that referenced this pull request Jan 19, 2016
In SPARK-10743 we wrap cast with `UnresolvedAlias` to give `Cast` a better alias if possible. However, for cases like filter, the `UnresolvedAlias` can't be resolved and actually we don't need a better alias for this case. This PR move the cast wrapping logic to `Column.named` so that we will only do it when we need a alias name.

backport #10781 to 1.6

Author: Wenchen Fan <[email protected]>

Closes #10819 from cloud-fan/bug.
@rxin
Copy link
Contributor

rxin commented Jan 19, 2016

@cloud-fan you'd need to close this pull request yourself since it was not merged into master.

@cloud-fan cloud-fan closed this Jan 19, 2016
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants