Skip to content

Conversation

@JoshRosen
Copy link
Contributor

Spark's release packaging scripts used to live in a separate repository. Although these scripts are now part of the Spark repo, there are some minor patches made against the old repos that are missing in Spark's copy of the script. This PR ports those changes.

/cc @shivaram, who originally submitted these changes against https://github.com/rxin/spark-utils

@JoshRosen JoshRosen changed the title [SPARK-10932] Port two minor changes to release-build.sh from scripts' old home repo [SPARK-10932] [PROJECT INFRA] Port two minor changes to release-build.sh from scripts' old home repo Oct 5, 2015
@JoshRosen JoshRosen changed the title [SPARK-10932] [PROJECT INFRA] Port two minor changes to release-build.sh from scripts' old home repo [SPARK-10932] [PROJECT INFRA] Port two minor changes to release-build.sh from scripts' old repo Oct 5, 2015
@shivaram
Copy link
Contributor

shivaram commented Oct 5, 2015

Can we add some code here to check the return code of make_binary_release ? i.e. we could fail the entire release if one of the binary releases fail ?

@JoshRosen
Copy link
Contributor Author

@shivaram, good idea. Note, however, that the build that was used to publish the 0.5.1 binary releases did actually fail in Jenkins.

Aside from adding additional return code checks, do these changes of yours look fine to pull into Spark's version of this script?

@SparkQA
Copy link

SparkQA commented Oct 6, 2015

Test build #43248 has finished for PR 8986 at commit fa19e44.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@shivaram
Copy link
Contributor

shivaram commented Oct 6, 2015

Ah I see - didn't know it was failing Jenkins as well.
Code changes from rxin/spark-utils LGTM.

@JoshRosen
Copy link
Contributor Author

Going to merge this now so that it doesn't become stale or get forgotten. I'll address return code checks if the problem re-occurs once we're closer to the release.

@asfgit asfgit closed this in d0482f6 Oct 13, 2015
asfgit pushed a commit that referenced this pull request Oct 13, 2015
….sh from scripts' old repo

Spark's release packaging scripts used to live in a separate repository. Although these scripts are now part of the Spark repo, there are some minor patches made against the old repos that are missing in Spark's copy of the script. This PR ports those changes.

/cc shivaram, who originally submitted these changes against https://github.com/rxin/spark-utils

Author: Josh Rosen <[email protected]>

Closes #8986 from JoshRosen/port-release-build-fixes-from-rxin-repo.
@JoshRosen JoshRosen deleted the port-release-build-fixes-from-rxin-repo branch October 16, 2015 21:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants