Skip to content

Conversation

@foxish
Copy link
Member

@foxish foxish commented Sep 25, 2017

can be added to the classpath by referencing them with `local://` URIs and/or setting the `SPARK_EXTRA_CLASSPATH`
environment variable in your Dockerfiles.
environment variable in your Dockerfiles. For any remote dependencies that aren't baked into the driver and executor
docker images, whether they are supplied via http, or hdfs, or the resource staging server, the
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

any remote dependencies (not using the local:// scheme) ...

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done

@liyinan926
Copy link
Member

LGTM with a minor comment.

@erikerlandson
Copy link
Member

erikerlandson commented Sep 25, 2017

so the image tags for python got a spark- prefix now? I'm not seeing that up on the docker registry, the 0.4.0 images are still driver-py and executor-py

@foxish
Copy link
Member Author

foxish commented Sep 25, 2017

Yes, they were standing out - the script that pushes images now pushes them up as spark-driver-py and spark-executor-py, in line with the other images.

@erikerlandson
Copy link
Member

I'm not seeing spark-driver-py or spark-executor-py up on docker, its still the old names

@liyinan926
Copy link
Member

No, I just realized that we now have that script but I didn't use the script. Will repush driver-py and executor-py.

@liyinan926
Copy link
Member

Done.

@erikerlandson
Copy link
Member

LGTM

@foxish foxish merged commit 9dbd15a into master Sep 25, 2017
@foxish foxish deleted the update-oss-docs branch September 25, 2017 22:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants