Skip to content

Conversation

@nastra
Copy link
Contributor

@nastra nastra commented Jan 10, 2025

What changes were proposed in this pull request?

Noticed that this was missing when using this in Iceberg. See additional details in apache/iceberg#11815 (comment)

Why are the changes needed?

To be able to read TimestampNTZType when using ColumnarRow

Does this PR introduce any user-facing change?

no

How was this patch tested?

Added some unit tests that failed without the fix

Was this patch authored or co-authored using generative AI tooling?

No

@github-actions github-actions bot added the SQL label Jan 10, 2025
@nastra
Copy link
Contributor Author

nastra commented Jan 10, 2025

@cloud-fan could you take a look please?

@nastra nastra force-pushed the SPARK-50624 branch 3 times, most recently from a0f04ea to 73db5f7 Compare January 10, 2025 08:27
@nastra nastra changed the title [SPARK-50624][SQL] Add TimestampNTZType to ColumnarRow [SPARK-50624][SQL] Add TimestampNTZType to ColumnarRow/MutableColumnarRow Jan 10, 2025
Copy link
Member

@MaxGekk MaxGekk left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm except of a minor comment

@nastra nastra closed this Jan 10, 2025
@nastra nastra reopened this Jan 10, 2025
@cloud-fan
Copy link
Contributor

thanks, merging to master/3.5!

@cloud-fan cloud-fan closed this in d7545d0 Jan 13, 2025
cloud-fan pushed a commit that referenced this pull request Jan 13, 2025
…rRow

### What changes were proposed in this pull request?

Noticed that this was missing when using this in Iceberg. See additional details in apache/iceberg#11815 (comment)

### Why are the changes needed?

To be able to read `TimestampNTZType` when using `ColumnarRow`

### Does this PR introduce _any_ user-facing change?

no

### How was this patch tested?

Added some unit tests that failed without the fix

### Was this patch authored or co-authored using generative AI tooling?

No

Closes #49437 from nastra/SPARK-50624.

Authored-by: Eduard Tudenhoefner <[email protected]>
Signed-off-by: Wenchen Fan <[email protected]>
(cherry picked from commit d7545d0)
Signed-off-by: Wenchen Fan <[email protected]>
@nastra nastra deleted the SPARK-50624 branch January 13, 2025 08:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants