Skip to content
This repository was archived by the owner on Jan 9, 2020. It is now read-only.

Conversation

@mccheah
Copy link

@mccheah mccheah commented Feb 16, 2017

Pull out waiting for components to be ready to a separate class.

Part of #109

@mccheah mccheah changed the title Refactor component readiness Pull component readiness logic to another class Feb 16, 2017
@mccheah mccheah force-pushed the refactor-component-readiness branch from 8ac8ede to 583bfe0 Compare February 16, 2017 01:48
@mccheah
Copy link
Author

mccheah commented Feb 16, 2017

Soft dependency on #123 to fix merge conflicts as we go along.

@iyanuobidele
Copy link

At first look:
This is awesome! I really love how you've pulled out and separated the different logics in the client. This will definitely make unit testing easier.

I'll review them (the refactor PRs) more closely tomorrow.

@mccheah mccheah force-pushed the refactor-component-readiness branch from 583bfe0 to fe97704 Compare February 16, 2017 22:49
Create a KubernetesComponentsCleaner which can register arbitrary pods,
services, secrets, and ingresses. When an exception is thrown or the JVM
shuts down, the cleaner automatically purges any of its registered
components from Kubernetes. The components can be unregistered when the
driver successfully begins running, so that the application persists
beyond the lifetime of the spark-submit process.
@mccheah mccheah force-pushed the refactor-component-readiness branch from 00a5823 to 1ed7ad2 Compare February 17, 2017 01:44
@ash211
Copy link

ash211 commented Feb 24, 2017

Now that the SSL refactoring PR is in this one is ready for rebase and separation from the Ingress PR

@mccheah
Copy link
Author

mccheah commented Feb 25, 2017

This seems difficult to rebase though - I'm fine just re-building this from scratch, especially after the code churn from #147 .

@mccheah mccheah closed this Feb 25, 2017
ifilonenko pushed a commit to ifilonenko/spark that referenced this pull request Feb 25, 2019
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants