Skip to content

Conversation

@cloud-fan
Copy link
Contributor

What changes were proposed in this pull request?

Since Spark 2.4.0 is released, we should test it in HiveExternalCatalogVersionsSuite

How was this patch tested?

N/A

@cloud-fan cloud-fan changed the title [minor ]update HiveExternalCatalogVersionsSuite to test 2.4.0 [minor] update HiveExternalCatalogVersionsSuite to test 2.4.0 Nov 8, 2018
@cloud-fan
Copy link
Contributor Author

cc @gatorsmile @srowen

object PROCESS_TABLES extends QueryTest with SQLTestUtils {
// Tests the latest version of every release line.
val testingVersions = Seq("2.1.3", "2.2.2", "2.3.2")
val testingVersions = Seq("2.1.3", "2.2.2", "2.3.2", "2.4.0")
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

when will we drop 2.1 officially?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

2.1 should be removed actually. At least according to our default 18-month support rule, it ended support in June 2018, and I see no desire for a 2.1.4 release. 2.2 will end in Jan 2019 according to the same guideline. It's not a hard rule, but probably the right guidance to follow.

Certainly, as this test takes a while and can be flaky I'd like to keep it to 3 versions.

@SparkQA
Copy link

SparkQA commented Nov 8, 2018

Test build #98608 has finished for PR 22984 at commit 30ff297.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Nov 8, 2018

Test build #98604 has finished for PR 22984 at commit b9817b4.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@dongjoon-hyun
Copy link
Member

Retest this please.

@SparkQA
Copy link

SparkQA commented Nov 8, 2018

Test build #98617 has finished for PR 22984 at commit 30ff297.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@dongjoon-hyun
Copy link
Member

It's an irrelevant failure.

*** glibc detected *** /usr/java/jdk1.8.0_60/bin/java: free(): invalid pointer: 0x00000007c05d6828 ***
======= Backtrace: =========
/lib64/libc.so.6[0x347c475dee]
/lib64/libc.so.6[0x347c478c3d]
/usr/java/jdk1.8.0_60/jre/lib/amd64/server/libjvm.so(+0x62bda1)[0x7f287574dda1]
/usr/java/jdk1.8.0_60/jre/lib/amd64/server/libjvm.so(+0x9b1b5c)[0x7f2875ad3b5c]
/usr/java/jdk1.8.0_60/jre/lib/amd64/server/libjvm.so(+0x9b2856)[0x7f2875ad4856]
/usr/java/jdk1.8.0_60/jre/lib/amd64/server/libjvm.so(+0xac137f)[0x7f2875be337f]
/usr/java/jdk1.8.0_60/jre/lib/amd64/server/libjvm.so(+0xac1800)[0x7f2875be3800]
/usr/java/jdk1.8.0_60/jre/lib/amd64/server/libjvm.so(+0x91cb88)[0x7f2875a3eb88]
/lib64/libpthread.so.0[0x347cc07aa1]
/lib64/libc.so.6(clone+0x6d)[0x347c4e8bcd]

@dongjoon-hyun
Copy link
Member

Retest this please.

@SparkQA
Copy link

SparkQA commented Nov 8, 2018

Test build #98626 has finished for PR 22984 at commit 30ff297.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@dongjoon-hyun
Copy link
Member

dongjoon-hyun commented Nov 8, 2018

Thank you, @cloud-fan and @srowen .

Merged to master/branch-2.4.

asfgit pushed a commit that referenced this pull request Nov 8, 2018
## What changes were proposed in this pull request?

Since Spark 2.4.0 is released, we should test it in HiveExternalCatalogVersionsSuite

## How was this patch tested?

N/A

Closes #22984 from cloud-fan/minor.

Authored-by: Wenchen Fan <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
(cherry picked from commit 973f7c0)
Signed-off-by: Dongjoon Hyun <[email protected]>
@asfgit asfgit closed this in 973f7c0 Nov 8, 2018
jackylee-ch pushed a commit to jackylee-ch/spark that referenced this pull request Feb 18, 2019
## What changes were proposed in this pull request?

Since Spark 2.4.0 is released, we should test it in HiveExternalCatalogVersionsSuite

## How was this patch tested?

N/A

Closes apache#22984 from cloud-fan/minor.

Authored-by: Wenchen Fan <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
kai-chi pushed a commit to kai-chi/spark that referenced this pull request Jul 23, 2019
## What changes were proposed in this pull request?

Since Spark 2.4.0 is released, we should test it in HiveExternalCatalogVersionsSuite

## How was this patch tested?

N/A

Closes apache#22984 from cloud-fan/minor.

Authored-by: Wenchen Fan <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
(cherry picked from commit 973f7c0)
Signed-off-by: Dongjoon Hyun <[email protected]>
kai-chi pushed a commit to kai-chi/spark that referenced this pull request Aug 1, 2019
## What changes were proposed in this pull request?

Since Spark 2.4.0 is released, we should test it in HiveExternalCatalogVersionsSuite

## How was this patch tested?

N/A

Closes apache#22984 from cloud-fan/minor.

Authored-by: Wenchen Fan <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
(cherry picked from commit 973f7c0)
Signed-off-by: Dongjoon Hyun <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants