Skip to content

Conversation

@gatorsmile
Copy link
Member

What changes were proposed in this pull request?

This is a follow-up of enabling test cases in DDLSuite with Hive Metastore. It consists of the following remaining tasks:

  • Run all the alter table and drop table DDL tests against data source tables when using Hive metastore.
  • Do not run any alter table and drop table DDL test against Hive serde tables when using InMemoryCatalog.
  • Reenable alter table: set serde partition and alter table: set serde tests for Hive serde tables.

How was this patch tested?

N/A

@SparkQA
Copy link

SparkQA commented Apr 4, 2017

Test build #75500 has started for PR 17524 at commit 8382228.

@SparkQA
Copy link

SparkQA commented Apr 4, 2017

Test build #75501 has started for PR 17524 at commit c102187.

@SparkQA
Copy link

SparkQA commented Apr 4, 2017

Test build #75502 has started for PR 17524 at commit 427741f.

@gatorsmile
Copy link
Member Author

gatorsmile commented Apr 4, 2017

retest this please

@SparkQA
Copy link

SparkQA commented Apr 5, 2017

Test build #75523 has finished for PR 17524 at commit 427741f.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds the following public classes (experimental):
  • public class JavaImputerExample

@gatorsmile
Copy link
Member Author

retest this please

@gatorsmile
Copy link
Member Author

ok to test

@SparkQA
Copy link

SparkQA commented Apr 12, 2017

Test build #75727 has started for PR 17524 at commit 427741f.

@gatorsmile
Copy link
Member Author

retest this please

@gatorsmile
Copy link
Member Author

ok to test

@SparkQA
Copy link

SparkQA commented Apr 16, 2017

Test build #75841 has finished for PR 17524 at commit 427741f.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds the following public classes (experimental):
  • public class JavaImputerExample

@SparkQA
Copy link

SparkQA commented Apr 30, 2017

Test build #76320 has finished for PR 17524 at commit 7ad9a22.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

// the new table path will be removed after DROP TABLE.
assert(!dir.exists())
} finally {
Utils.deleteRecursively(new File(defaultTablePath))
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We need to explicitly drop the original table location.


test("drop table - data source table") {
testDropTable(isDatasourceTable = true)
}
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Both Hive and SQL packages support data source tables.


test("drop table") {
testDropTable(isDatasourceTable = false)
}
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Only Hive package supports Hive-serde tables

@gatorsmile
Copy link
Member Author

cc @cloud-fan

@asfgit asfgit closed this in b1e639a May 2, 2017
@cloud-fan
Copy link
Contributor

LGTM, merging to master/2.2

asfgit pushed a commit that referenced this pull request May 2, 2017
…h Hive Metastore

### What changes were proposed in this pull request?
This is a follow-up of enabling test cases in DDLSuite with Hive Metastore. It consists of the following remaining tasks:
- Run all the `alter table` and `drop table` DDL tests against data source tables when using Hive metastore.
- Do not run any `alter table` and `drop table` DDL test against Hive serde tables when using InMemoryCatalog.
- Reenable `alter table: set serde partition` and `alter table: set serde` tests for Hive serde tables.

### How was this patch tested?
N/A

Author: Xiao Li <[email protected]>

Closes #17524 from gatorsmile/cleanupDDLSuite.

(cherry picked from commit b1e639a)
Signed-off-by: Wenchen Fan <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants