Skip to content

Conversation

@seancxmao
Copy link
Contributor

What changes were proposed in this pull request?

In HiveExternalCatalogVersionsSuite, latest version of 2.2.x is updated from 2.2.0 to 2.2.1

How was this patch tested?

N/A

@SparkQA
Copy link

SparkQA commented Feb 13, 2018

Test build #4094 has finished for PR 20597 at commit 047e119.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@srowen
Copy link
Member

srowen commented Feb 13, 2018

Hm:

[info] - backward compatibility *** FAILED *** (34 seconds, 96 milliseconds)
[info]   spark-submit returned with exit code 1.
[info]   Command line: './bin/spark-submit' '--class' 'org.apache.spark.sql.hive.PROCESS_TABLES' '--name' 'HiveExternalCatalog backward compatibility test' '--master' 'local[2]' '--conf' 'spark.ui.enabled=false' '--conf' 'spark.master.rest.enabled=false' '--conf' 'spark.sql.warehouse.dir=/home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/warehouse-a76e4f7b-3ab5-463f-83be-7e95b5172271' '--driver-java-options' '-Dderby.system.home=/home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/warehouse-a76e4f7b-3ab5-463f-83be-7e95b5172271' 'file:/home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/spark-f34f7048-27da-4dea-bbad-dec833d34fb4/testJar-1518521748609.jar'
...
[info]   2018-02-13 03:38:04.528 - stderr> Exception in thread "main" org.apache.spark.sql.AnalysisException: Operation not allowed: MSCK REPAIR TABLE only works on partitioned tables: `default`.`tbl_with_col_overlap_2`;

@SparkQA
Copy link

SparkQA commented Feb 13, 2018

Test build #4096 has finished for PR 20597 at commit 047e119.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@gatorsmile
Copy link
Member

Let me take this over and do more investigation. This looks suspicious. I think we are changing the behaviors in 2.3 and 2.2.1

@gatorsmile
Copy link
Member

This is a behavior change introduced in #19579. We need to add a migration guide for this case. Will do it by myself.

@seancxmao Thanks for your contribution!

@gatorsmile
Copy link
Member

Just submitted a PR #20606

@seancxmao seancxmao closed this Feb 24, 2018
@seancxmao seancxmao deleted the wrong_versions branch February 24, 2018 09:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants