Skip to content

Conversation

@ets
Copy link

@ets ets commented Jul 8, 2018

Without setting Master to "local" the example throws a SparkException "A master URL must be set in your configuration"

What changes were proposed in this pull request?

explicitly set SparkConf master to "local"

How was this patch tested?

Running the main method using Spark 2.3.1 without the change produces an exception. With the change, the main method executes without error.

Please review http://spark.apache.org/contributing.html before opening a pull request.

With setting Master to "local" the example throws a SparkException "A master URL must be set in your configuration"
@AmplabJenkins
Copy link

Can one of the admins verify this patch?

@jerryshao
Copy link
Contributor

This seems not a necessary fix. master can be configured via spark-submit argument --master, not a best practice to set it in code.

@HyukjinKwon
Copy link
Member

ping @ets, mind closing this?

@asfgit asfgit closed this in 1a4fda8 Jul 19, 2018
@ets ets deleted the patch-1 branch July 19, 2018 14:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants