Skip to content

Spark 1818 #805

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 2 commits into from
Closed

Spark 1818 #805

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
19e61c5
Put Apache Mesos section above Mesosphere prebuilt package section
ash211 May 16, 2014
bbe1f6f
Emphasize third party vs Apache more heavily
ash211 May 16, 2014
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
33 changes: 18 additions & 15 deletions docs/running-on-mesos.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -37,22 +37,10 @@ require any special patches of Mesos.
If you already have a Mesos cluster running, you can skip this Mesos installation step.

Otherwise, installing Mesos for Spark is no different than installing Mesos for use by other
frameworks. You can install Mesos using either prebuilt packages or by compiling from source.
frameworks. You can install Mesos either from source packages from the Apache Mesos project or from
prebuilt packages from third parties.

## Prebuilt packages

The Apache Mesos project only publishes source package releases, no binary releases. But other
third party projects publish binary releases that may be helpful in setting Mesos up.

One of those is Mesosphere. To install Mesos using the binary releases provided by Mesosphere:

1. Download Mesos installation package from [downloads page](http://mesosphere.io/downloads/)
2. Follow their instructions for installation and configuration

The Mesosphere installation documents suggest setting up ZooKeeper to handle Mesos master failover,
but Mesos can be run without ZooKeeper using a single master as well.

## From source
## From Apache source

To install Mesos directly from the upstream project rather than a third party, install from source.

Expand All @@ -66,6 +54,21 @@ To install Mesos directly from the upstream project rather than a third party, i
`--prefix` option to `configure` to tell it where to install. For example, pass
`--prefix=/home/user/mesos`. By default the prefix is `/usr/local`.


## Prebuilt packages from third parties

The Apache Mesos project currently publishes only source packages, no binary releases. But other
third-party projects publish binary releases that may be helpful in setting Mesos up.

One of those is Mesosphere. To install Mesos using the binary releases provided by Mesosphere:

1. Download Mesos installation package from [downloads page](http://mesosphere.io/downloads/)
2. Follow their instructions for installation and configuration

The Mesosphere installation documents suggest setting up ZooKeeper to handle Mesos master failover,
but Mesos can be run without ZooKeeper using a single master as well.


## Verification

To verify that the Mesos cluster is ready for Spark, navigate to the Mesos master webui at port
Expand Down