Skip to content

Conversation

@JoshRosen
Copy link
Contributor

This patch extends CheckAnalysis to throw errors for queries that try to sort on unsupported column types, such as ArrayType.

@SparkQA
Copy link

SparkQA commented Jul 24, 2015

Test build #38306 has finished for PR 7633 at commit 2f1b802.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@JoshRosen
Copy link
Contributor Author

Ah, it looks like this broke sorting by a null literal, which is valid SQL and which should be supported. I think that we can fix this by making NullType into an AtomicType (I think we've already done this in Python).

@JoshRosen
Copy link
Contributor Author

Actually, I think I'll just explicitly allow NullType.

@JoshRosen
Copy link
Contributor Author

Jenkins, retest this please.

@SparkQA
Copy link

SparkQA commented Jul 24, 2015

Test build #38328 has finished for PR 7633 at commit bfe1451.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why not just embed this in foreach?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This matches the style of Aggregate above.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think aggregate was only doing it because it was recursive. Not that big a of deal.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Meh, I can update it.

@SparkQA
Copy link

SparkQA commented Jul 24, 2015

Test build #38373 has finished for PR 7633 at commit 23b2fbf.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@JoshRosen
Copy link
Contributor Author

I'm going to merge this into master. Thanks!

@asfgit asfgit closed this in 6aceaf3 Jul 24, 2015
@JoshRosen JoshRosen deleted the SPARK-9295 branch July 24, 2015 19:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants