-
Notifications
You must be signed in to change notification settings - Fork 28.9k
[SPARK-9295] Analysis should detect sorting on unsupported column types #7633
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
Test build #38306 has finished for PR 7633 at commit
|
|
Ah, it looks like this broke sorting by a |
|
Actually, I think I'll just explicitly allow NullType. |
|
Jenkins, retest this please. |
|
Test build #38328 has finished for PR 7633 at commit
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
why not just embed this in foreach?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This matches the style of Aggregate above.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think aggregate was only doing it because it was recursive. Not that big a of deal.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Meh, I can update it.
|
Test build #38373 has finished for PR 7633 at commit
|
|
I'm going to merge this into master. Thanks! |
This patch extends CheckAnalysis to throw errors for queries that try to sort on unsupported column types, such as ArrayType.