Skip to content

[SPARK-7515] [DOC] Update documentation for PySpark on YARN with cluster mode #6040

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 3 commits into from
Closed

[SPARK-7515] [DOC] Update documentation for PySpark on YARN with cluster mode #6040

wants to merge 3 commits into from

Conversation

@sarutak
Copy link
Member

@sarutak sarutak commented May 10, 2015

Now PySpark on YARN with cluster mode is supported so let's update doc.

@AmplabJenkins
Copy link

AmplabJenkins commented May 10, 2015

Merged build triggered.

@AmplabJenkins
Copy link

AmplabJenkins commented May 10, 2015

Merged build started.

@SparkQA
Copy link

SparkQA commented May 10, 2015

Test build #32335 has started for PR 6040 at commit fcfdb92.

@SparkQA
Copy link

SparkQA commented May 10, 2015

Test build #32335 has finished for PR 6040 at commit fcfdb92.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@AmplabJenkins
Copy link

AmplabJenkins commented May 10, 2015

Merged build finished. Test PASSed.

@AmplabJenkins
Copy link

AmplabJenkins commented May 10, 2015

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32335/
Test PASSed.

sryza
sryza reviewed May 11, 2015
View reviewed changes
docs/submitting-applications.md Outdated
Copy link
Contributor

@sryza sryza May 11, 2015

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this might be a little clearer as two sentences. "cluster mode is currently not supported for Mesos clusters. Currently only YARN supports cluster mode for Python applications."

Copy link
Member Author

@sarutak sarutak May 11, 2015

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oh, it's clearer. Thanks!

@AmplabJenkins
Copy link

AmplabJenkins commented May 11, 2015

Merged build triggered.

@AmplabJenkins
Copy link

AmplabJenkins commented May 11, 2015

Merged build started.

@SparkQA
Copy link

SparkQA commented May 11, 2015

Test build #32415 has started for PR 6040 at commit ad9f88c.

@andrewor14
Copy link
Contributor

andrewor14 commented May 11, 2015

Looks good.

@sryza
Copy link
Contributor

sryza commented May 11, 2015

LGTM

@SparkQA
Copy link

SparkQA commented May 11, 2015

Test build #32415 has finished for PR 6040 at commit ad9f88c.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@AmplabJenkins
Copy link

AmplabJenkins commented May 11, 2015

Merged build finished. Test PASSed.

@AmplabJenkins
Copy link

AmplabJenkins commented May 11, 2015

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32415/
Test PASSed.

@asfgit asfgit closed this in 6e9910c May 11, 2015
@sarutak sarutak deleted the update-doc-for-pyspark-on-yarn branch May 18, 2015 01:52
jeanlyn pushed a commit to jeanlyn/spark that referenced this pull request May 28, 2015
@sarutak @jeanlyn
[SPARK-7515] [DOC] Update documentation for PySpark on YARN with clus…
5355db7 
…ter mode

Now PySpark on YARN with cluster mode is supported so let's update doc.

Author: Kousuke Saruta <[email protected]>

Closes apache#6040 from sarutak/update-doc-for-pyspark-on-yarn and squashes the following commits:

ad9f88c [Kousuke Saruta] Brushed up sentences
469fd2e [Kousuke Saruta] Merge branch 'master' of https://github.com/apache/spark into update-doc-for-pyspark-on-yarn
fcfdb92 [Kousuke Saruta] Updated doc for PySpark on YARN with cluster mode
jeanlyn pushed a commit to jeanlyn/spark that referenced this pull request Jun 12, 2015
@sarutak @jeanlyn
[SPARK-7515] [DOC] Update documentation for PySpark on YARN with clus…
f675e90 
…ter mode

Now PySpark on YARN with cluster mode is supported so let's update doc.

Author: Kousuke Saruta <[email protected]>

Closes apache#6040 from sarutak/update-doc-for-pyspark-on-yarn and squashes the following commits:

ad9f88c [Kousuke Saruta] Brushed up sentences
469fd2e [Kousuke Saruta] Merge branch 'master' of https://github.com/apache/spark into update-doc-for-pyspark-on-yarn
fcfdb92 [Kousuke Saruta] Updated doc for PySpark on YARN with cluster mode
@punya punya mentioned this pull request Jun 16, 2015
Closed
asfgit pushed a commit that referenced this pull request Jun 17, 2015
[SPARK-7515] [DOC] Update documentation for PySpark on YARN with clus…
a7f6979 
…ter mode

Now PySpark on YARN with cluster mode is supported so let's update doc.

Author: Kousuke Saruta <sarutakoss.nttdata.co.jp>

Closes #6040 from sarutak/update-doc-for-pyspark-on-yarn and squashes the following commits:

ad9f88c [Kousuke Saruta] Brushed up sentences
469fd2e [Kousuke Saruta] Merge branch 'master' of https://github.com/apache/spark into update-doc-for-pyspark-on-yarn
fcfdb92 [Kousuke Saruta] Updated doc for PySpark on YARN with cluster mode

Author: Punya Biswal <[email protected]>
Author: Kousuke Saruta <[email protected]>

Closes #6842 from punya/feature/SPARK-7515 and squashes the following commits:

0b83648 [Punya Biswal] Merge remote-tracking branch 'origin/branch-1.4' into feature/SPARK-7515
de025cd [Kousuke Saruta] [SPARK-7515] [DOC] Update documentation for PySpark on YARN with cluster mode
nemccarthy pushed a commit to nemccarthy/spark that referenced this pull request Jun 19, 2015
@sarutak @nemccarthy
[SPARK-7515] [DOC] Update documentation for PySpark on YARN with clus…
d6f31a6 
…ter mode

Now PySpark on YARN with cluster mode is supported so let's update doc.

Author: Kousuke Saruta <[email protected]>

Closes apache#6040 from sarutak/update-doc-for-pyspark-on-yarn and squashes the following commits:

ad9f88c [Kousuke Saruta] Brushed up sentences
469fd2e [Kousuke Saruta] Merge branch 'master' of https://github.com/apache/spark into update-doc-for-pyspark-on-yarn
fcfdb92 [Kousuke Saruta] Updated doc for PySpark on YARN with cluster mode
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

5 participants

@sarutak @AmplabJenkins @SparkQA @andrewor14 @sryza