Skip to content
This repository was archived by the owner on Jan 9, 2020. It is now read-only.

Conversation

@ash211
Copy link

@ash211 ash211 commented Jan 26, 2017

Fixes #35

- Intel
- Palantir
- Pepperdata
- Red Hat
Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

if I've left anyone off, or anyone wants this list changed, please let me know either here or in private

Copy link

@mccheah mccheah left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Small wording thing but overall seems ok.

README.md Outdated

## Why does this fork exist?

Adding native integration for a new cluster manager is a large undertaking. If poorly executed, it could introduce bugs into Spark when run on other cluster managers, cause release blockers slowing down the overall Spark project, or require hotfixes which divert attention away from development towards managing additional releases. Any work this core in Spark needs to be done carefully to minimize the risk of those negative externalities.
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"Any work this core in Spark" - what does this mean?

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Changed to "Any work this deep inside Spark"

README.md Outdated

- [Usage guide](docs/running-on-kubernetes.md) shows how to run the code
- [Development docs](resource-managers/kubernetes/README.md) shows how to get set up for development
- Code is primarily located in the [resource-managers/kubernetes](resource-managers/kubernetes) module
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: We have multiple modules within that directory, but I think you don't mean module here in the maven sense.

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

using folder instead

README.md Outdated

Adding native integration for a new cluster manager is a large undertaking. If poorly executed, it could introduce bugs into Spark when run on other cluster managers, cause release blockers slowing down the overall Spark project, or require hotfixes which divert attention away from development towards managing additional releases. Any work this core in Spark needs to be done carefully to minimize the risk of those negative externalities.

At the same time, an increasing number of people from varying companies and organizations desire to work together to natively run Spark on Kubernetes. The group needs a code repository, communication forum, issue tracking, and continuous integration, all in order to work together effectively on an open source product.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

s/varying/various/?

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done

@ash211
Copy link
Author

ash211 commented Jan 28, 2017

Responded to both your comments @foxish and @mccheah . Anything else?

@foxish
Copy link
Member

foxish commented Jan 28, 2017

LGTM

@mccheah
Copy link

mccheah commented Jan 28, 2017

Looks great! I'm going to merge.

@mccheah mccheah merged commit ccb2e2f into k8s-support-alternate-incremental Jan 28, 2017
@mccheah mccheah deleted the docs/README branch January 28, 2017 00:20
ash211 added a commit that referenced this pull request Feb 8, 2017
* Create README to better describe project purpose

* Add links to usage guide and dev docs

* Minor changes
ash211 added a commit that referenced this pull request Mar 8, 2017
* Create README to better describe project purpose

* Add links to usage guide and dev docs

* Minor changes
foxish pushed a commit that referenced this pull request Jul 24, 2017
* Create README to better describe project purpose

* Add links to usage guide and dev docs

* Minor changes
ifilonenko pushed a commit to ifilonenko/spark that referenced this pull request Feb 25, 2019
)

* Create README to better describe project purpose

* Add links to usage guide and dev docs

* Minor changes
ifilonenko pushed a commit to ifilonenko/spark that referenced this pull request Feb 26, 2019
puneetloya pushed a commit to puneetloya/spark that referenced this pull request Mar 11, 2019
)

* Create README to better describe project purpose

* Add links to usage guide and dev docs

* Minor changes
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants