Skip to content

Commit e4c5fb1

Browse files
author
Marcin Kurczych
committed
[SPARK-23464][MESOS] Fix mesos cluster scheduler options double-escaping
Don't enclose --conf option value with "", as they are already escaped by shellEscape and additional wrapping cancels out this escaping, causing driver fail to start. This reverts commit 9b377aa [SPARK-18114]. Manual test with driver command logging added. Author: Marcin Kurczych <[email protected]>
1 parent aadf953 commit e4c5fb1

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosClusterScheduler.scala

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -530,7 +530,7 @@ private[spark] class MesosClusterScheduler(
530530
.filter { case (key, _) => !replicatedOptionsBlacklist.contains(key) }
531531
.toMap
532532
(defaultConf ++ driverConf).foreach { case (key, value) =>
533-
options ++= Seq("--conf", s""""$key=${shellEscape(value)}"""".stripMargin) }
533+
options ++= Seq("--conf", s"$key=${shellEscape(value)}") }
534534

535535
options
536536
}

0 commit comments

Comments
 (0)