Skip to content

Conversation

@viirya
Copy link
Member

@viirya viirya commented Aug 23, 2024

What changes were proposed in this pull request?

This patch modifies ProtobufFunctionsSuite's test case SPARK-49121: from_protobuf and to_protobuf SQL functions to check the stop index depending on the file path length.

Why are the changes needed?

During debugging CI failure in #47843, we found that ProtobufFunctionsSuite's test case SPARK-49121: from_protobuf and to_protobuf SQL functions is environment-dependent.
In the test, it checks the start and stop indices of SQL text fragment but the fragment length depends on the repo name of the author of a PR.

Does this PR introduce any user-facing change?

No, test only.

How was this patch tested?

Unit test

Was this patch authored or co-authored using generative AI tooling?

No

@viirya viirya changed the title SPARK-49373: ProtobufFunctionsSuite test case should not be environment-dependent [SPARK-49373][SQL][TEST]: ProtobufFunctionsSuite test case should not be environment-dependent Aug 23, 2024
@viirya viirya changed the title [SPARK-49373][SQL][TEST]: ProtobufFunctionsSuite test case should not be environment-dependent [SPARK-49373][CONNECTOR][TEST]: ProtobufFunctionsSuite test case should not be environment-dependent Aug 23, 2024
@dongjoon-hyun dongjoon-hyun changed the title [SPARK-49373][CONNECTOR][TEST]: ProtobufFunctionsSuite test case should not be environment-dependent [SPARK-49373][CONNECTOR][TESTS] ProtobufFunctionsSuite test case should not be environment-dependent Aug 23, 2024
Copy link
Member

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, LGTM. I also verified locally. Thank you, @viirya .

@dongjoon-hyun dongjoon-hyun changed the title [SPARK-49373][CONNECTOR][TESTS] ProtobufFunctionsSuite test case should not be environment-dependent [SPARK-49373][CONNECTOR][TESTS] Fix ProtobufFunctionsSuite test case to be environment-independent Aug 23, 2024
@dongjoon-hyun dongjoon-hyun changed the title [SPARK-49373][CONNECTOR][TESTS] Fix ProtobufFunctionsSuite test case to be environment-independent [SPARK-49373][CONNECTOR][TESTS] Fix ProtobufFunctionsSuite to be environment-independent Aug 23, 2024
@dongjoon-hyun
Copy link
Member

This only updates ProtobufFunctionsSuite. It already passes the CI.

Let me merge this.

@dongjoon-hyun dongjoon-hyun changed the title [SPARK-49373][CONNECTOR][TESTS] Fix ProtobufFunctionsSuite to be environment-independent [SPARK-49373][PROTOBUF][TESTS] Fix ProtobufFunctionsSuite to be environment-independent Aug 23, 2024
@dongjoon-hyun
Copy link
Member

Merged to master.

@viirya
Copy link
Member Author

viirya commented Aug 23, 2024

Thank you @dongjoon-hyun

@HyukjinKwon
Copy link
Member

Thanks LGTM

@viirya
Copy link
Member Author

viirya commented Aug 24, 2024

Thank you @HyukjinKwon

@itholic
Copy link
Contributor

itholic commented Aug 26, 2024

Late LGTM. Thanks for addressing this

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants