[SPARK-19490][SQL] ignore case sensitivity when filtering hive partition columns

[cenyuhai]

What changes were proposed in this pull request?

ignore hive column names case-sensitive when comparing with partition columns

How was this patch tested?

[rxin]

hm is it safe to just do this change?

[SparkQA]

Test build #72501 has finished for PR 16832 at commit efb0b4b.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[cenyuhai]

@rxin I think it is safe, it is only used to check whether the schema contains the columns. Hive columns are not case-sensitive.

[SparkQA]

Test build #72689 has started for PR 16832 at commit 6884ad3.

[SparkQA]

Test build #72750 has finished for PR 16832 at commit 7214b8a.

• This patch fails Spark unit tests.
• This patch merges cleanly.
• This patch adds no public classes.

[SparkQA]

Test build #72755 has finished for PR 16832 at commit b734646.

• This patch fails Spark unit tests.
• This patch merges cleanly.
• This patch adds no public classes.

[SparkQA]

Test build #72758 has finished for PR 16832 at commit 358769c.

• This patch fails Spark unit tests.
• This patch merges cleanly.
• This patch adds no public classes.

[SparkQA]

Test build #72763 has started for PR 16832 at commit 5e91877.

[SparkQA]

Test build #73267 has started for PR 16832 at commit f790821.

[SparkQA]

Test build #73275 has finished for PR 16832 at commit c3f7444.

• This patch fails Spark unit tests.
• This patch merges cleanly.
• This patch adds no public classes.

[SparkQA]

Test build #73278 has finished for PR 16832 at commit c9dd09b.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[janua]

👍
Just bumped into this issue. The error message doesn't make it obvious what's wrong.

[taklwu]

any updates on this PR?

[cenyuhai]

@taklwu this pr is completed, you can merge this pr by yourself. A committer told me that other pr has fixed this bug, my pr will not be merged......

[taklwu]

May I get the link of which commit/pr fix this issue? thanks a lot

[LantaoJin]

Duplicates to SPARK-18572