Skip to content

Conversation

@panbingkun
Copy link
Contributor

@panbingkun panbingkun commented Aug 14, 2024

What changes were proposed in this pull request?

The pr aims to remove 3.4.2 from SKIP_SPARK_RELEASE_VERSIONS(build_maven.yml).

Why are the changes needed?

Does this PR introduce any user-facing change?

No, only for GA's tests.

How was this patch tested?

Pass GA.

Was this patch authored or co-authored using generative AI tooling?

No.

@panbingkun
Copy link
Contributor Author

cc @dongjoon-hyun @LuciferYang

@panbingkun panbingkun marked this pull request as ready for review August 14, 2024 02:53
.filterNot(_.contains("preview"))
.map("""<a href="spark-(\d.\d.\d)/">""".r.findFirstMatchIn(_).get.group(1))
.filter(_ < org.apache.spark.SPARK_VERSION)
.filterNot(skipReleaseVersions.contains).toImmutableArraySeq
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe we can keep this function. I am not sure if there will be similar needs in the future that allow us to reuse it again.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Okay

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Updated.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should update pr title and pr description to match the change

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yea, updated.

@github-actions github-actions bot removed the SQL label Aug 14, 2024
Copy link
Member

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for revision according to @LuciferYang 's comment.

Could you revise the PR title and description as suggested, @panbingkun ?

@panbingkun panbingkun changed the title [SPARK-49232][INFRA][TESTS] Remove the logic related to SKIP_SPARK_RELEASE_VERSIONS [SPARK-49232][INFRA][TESTS] Remove 3.4.2 from SKIP_SPARK_RELEASE_VERSIONS Aug 14, 2024
@panbingkun
Copy link
Contributor Author

Thank you for revision according to @LuciferYang 's comment.

Could you revise the PR title and description as suggested, @panbingkun ?

Oh, I'm sorry, I miss to synchronize this update (Jira's title has also been updated).
It's now completed.

@dongjoon-hyun
Copy link
Member

Merged to master~

IvanK-db pushed a commit to IvanK-db/spark that referenced this pull request Sep 20, 2024
…ERSIONS`

### What changes were proposed in this pull request?
The pr aims to remove `3.4.2` from `SKIP_SPARK_RELEASE_VERSIONS(build_maven.yml)`.

### Why are the changes needed?
- Why was `SKIP_SPARK_RELEASE_VERSIONS` introduced? See here: https://issues.apache.org/jira/browse/SPARK-46400

- [SPARK-46400](apache#45017) has already merged into Spark `3.4.3`, and the corresponding issue no longer exists for Spark `3.4.3+`

- The following location only includes `the version` we have `fixed` for this issue
  https://dist.apache.org/repos/dist/release/spark/
  <img width="433" alt="image" src="https://github.com/user-attachments/assets/bfdf8bca-b972-490a-bc19-cb95eb83a352">

### Does this PR introduce _any_ user-facing change?
No, only for GA's tests.

### How was this patch tested?
Pass GA.

### Was this patch authored or co-authored using generative AI tooling?
No.

Closes apache#47748 from panbingkun/SPARK-49232.

Authored-by: panbingkun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
attilapiros pushed a commit to attilapiros/spark that referenced this pull request Oct 4, 2024
…ERSIONS`

### What changes were proposed in this pull request?
The pr aims to remove `3.4.2` from `SKIP_SPARK_RELEASE_VERSIONS(build_maven.yml)`.

### Why are the changes needed?
- Why was `SKIP_SPARK_RELEASE_VERSIONS` introduced? See here: https://issues.apache.org/jira/browse/SPARK-46400

- [SPARK-46400](apache#45017) has already merged into Spark `3.4.3`, and the corresponding issue no longer exists for Spark `3.4.3+`

- The following location only includes `the version` we have `fixed` for this issue
  https://dist.apache.org/repos/dist/release/spark/
  <img width="433" alt="image" src="https://github.com/user-attachments/assets/bfdf8bca-b972-490a-bc19-cb95eb83a352">

### Does this PR introduce _any_ user-facing change?
No, only for GA's tests.

### How was this patch tested?
Pass GA.

### Was this patch authored or co-authored using generative AI tooling?
No.

Closes apache#47748 from panbingkun/SPARK-49232.

Authored-by: panbingkun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
himadripal pushed a commit to himadripal/spark that referenced this pull request Oct 19, 2024
…ERSIONS`

### What changes were proposed in this pull request?
The pr aims to remove `3.4.2` from `SKIP_SPARK_RELEASE_VERSIONS(build_maven.yml)`.

### Why are the changes needed?
- Why was `SKIP_SPARK_RELEASE_VERSIONS` introduced? See here: https://issues.apache.org/jira/browse/SPARK-46400

- [SPARK-46400](apache#45017) has already merged into Spark `3.4.3`, and the corresponding issue no longer exists for Spark `3.4.3+`

- The following location only includes `the version` we have `fixed` for this issue
  https://dist.apache.org/repos/dist/release/spark/
  <img width="433" alt="image" src="https://github.com/user-attachments/assets/bfdf8bca-b972-490a-bc19-cb95eb83a352">

### Does this PR introduce _any_ user-facing change?
No, only for GA's tests.

### How was this patch tested?
Pass GA.

### Was this patch authored or co-authored using generative AI tooling?
No.

Closes apache#47748 from panbingkun/SPARK-49232.

Authored-by: panbingkun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants