Skip to content

Conversation

@jmchung
Copy link
Contributor

@jmchung jmchung commented Oct 30, 2017

What changes were proposed in this pull request?

This PR fixes the conversion error when transforming array types of uuid, inet and cidr to StingType in PostgreSQL.

How was this patch tested?

Added test in PostgresIntegrationSuite.

… types of uuid, inet and cidr to StingType in PostgreSQL
@jmchung
Copy link
Contributor Author

jmchung commented Oct 30, 2017

cc @cloud-fan, the PR for 2.2, thanks!

(array: Object) =>
array.asInstanceOf[Array[java.lang.String]]
.map(UTF8String.fromString)
// some underling types are not String such as uuid, inet, cidr, etc.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

underlying?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oops, a typo occurred, thanks @viirya !!

@jmchung
Copy link
Contributor Author

jmchung commented Oct 30, 2017

I found in this branch the Docker-based integration test suites will fail due to it can not pull the image wnameless/oracle-xe-11g:14.04.4, should we move on to wnameless/oracle-xe-11g?

Error response from daemon: manifest for wnameless/oracle-xe-11g:14.04.4 not found

@HyukjinKwon
Copy link
Member

Ah, let's remove [FOLLOWUP] or replace it to something like [BRANCH-2.2] in the PR title.

@jmchung jmchung changed the title [SPARK-22291][SQL][FOLLOWUP] Conversion error when transforming array types of uuid, inet and cidr to StingType in PostgreSQL [SPARK-22291][SQL][BRANCH-2.2] Conversion error when transforming array types of uuid, inet and cidr to StingType in PostgreSQL Oct 30, 2017
@jmchung jmchung changed the title [SPARK-22291][SQL][BRANCH-2.2] Conversion error when transforming array types of uuid, inet and cidr to StingType in PostgreSQL [SPARK-22291][SQL] Conversion error when transforming array types of uuid, inet and cidr to StingType in PostgreSQL Oct 30, 2017
@SparkQA
Copy link

SparkQA commented Oct 30, 2017

Test build #83200 has finished for PR 19604 at commit 549cb81.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Oct 30, 2017

Test build #83201 has finished for PR 19604 at commit 995e38e.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@viirya
Copy link
Member

viirya commented Oct 30, 2017

LGTM

@cloud-fan
Copy link
Contributor

thanks, merging to 2.2!

asfgit pushed a commit that referenced this pull request Oct 30, 2017
…uuid, inet and cidr to StingType in PostgreSQL

## What changes were proposed in this pull request?

This PR fixes the conversion error when transforming array types of `uuid`, `inet` and `cidr` to `StingType` in PostgreSQL.

## How was this patch tested?

Added test in `PostgresIntegrationSuite`.

Author: Jen-Ming Chung <[email protected]>

Closes #19604 from jmchung/SPARK-22291-FOLLOWUP.
@cloud-fan
Copy link
Contributor

can you close it? PR merged to non-master branch will not be closed automatically. thanks

@jmchung
Copy link
Contributor Author

jmchung commented Oct 30, 2017

Sure, I'll close it and thank you and @viirya.

@jmchung jmchung closed this Oct 30, 2017
MatthewRBruce pushed a commit to Shopify/spark that referenced this pull request Jul 31, 2018
…uuid, inet and cidr to StingType in PostgreSQL

## What changes were proposed in this pull request?

This PR fixes the conversion error when transforming array types of `uuid`, `inet` and `cidr` to `StingType` in PostgreSQL.

## How was this patch tested?

Added test in `PostgresIntegrationSuite`.

Author: Jen-Ming Chung <[email protected]>

Closes apache#19604 from jmchung/SPARK-22291-FOLLOWUP.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants