Skip to content

Conversation

@gatorsmile
Copy link
Member

What changes were proposed in this pull request?

#19579 introduces a behavior change. We need to document it in the migration guide.

How was this patch tested?

Also update the HiveExternalCatalogVersionsSuite to verify it.

@gatorsmile
Copy link
Member Author

cc @cloud-fan

@SparkQA
Copy link

SparkQA commented Feb 14, 2018

Test build #87442 has finished for PR 20606 at commit 02275a3.

  • This patch fails PySpark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@kiszk
Copy link
Member

kiszk commented Feb 14, 2018

Retest this please

@SparkQA
Copy link

SparkQA commented Feb 14, 2018

Test build #87448 has finished for PR 20606 at commit 02275a3.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

object PROCESS_TABLES extends QueryTest with SQLTestUtils {
// Tests the latest version of every release line.
val testingVersions = Seq("2.0.2", "2.1.2", "2.2.0")
val testingVersions = Seq("2.0.2", "2.1.2", "2.2.0", "2.2.1")
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please don't mix this into a PR with title Document.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is to verify what we explained in doc is correct.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yep. Please update the title to include that, too.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Already has it in the PR description.

Copy link
Member Author

@gatorsmile gatorsmile Feb 14, 2018

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The main goal of this PR is not to test it but to document it. We need another backport PR to SPARK 2.2 without the test.

@cloud-fan
Copy link
Contributor

LGTM

asfgit pushed a commit that referenced this pull request Feb 15, 2018
## What changes were proposed in this pull request?
#19579 introduces a behavior change. We need to document it in the migration guide.

## How was this patch tested?
Also update the HiveExternalCatalogVersionsSuite to verify it.

Author: gatorsmile <[email protected]>

Closes #20606 from gatorsmile/addMigrationGuide.

(cherry picked from commit a77ebb0)
Signed-off-by: gatorsmile <[email protected]>
@gatorsmile
Copy link
Member Author

Thanks! Merged to master/2.3

@asfgit asfgit closed this in a77ebb0 Feb 15, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants