Fix: sbt test throw an java.lang.OutOfMemoryError: PermGen space

[witgo]

No description provided.

[witgo]

log:

[info] ReplSuite:
[info] - propagation of local properties (4 seconds, 979 milliseconds)
[info] - simple foreach with accumulator (4 seconds, 150 milliseconds)
[info] - external vars (3 seconds, 420 milliseconds)
[info] - external classes (2 seconds, 689 milliseconds)
[info] - external functions (2 seconds, 495 milliseconds)
[info] - external functions that access vars (2 seconds, 730 milliseconds)
[info] - broadcast vars (2 seconds, 696 milliseconds)
[info] - interacting with files (2 seconds, 315 milliseconds)
Exception in thread "ExecutorRunner for app-20140515003943-0000/0" java.lang.OutOfMemoryError: PermGen space
    at java.lang.ClassLoader.defineClass1(Native Method)
    at java.lang.ClassLoader.defineClassCond(ClassLoader.java:637)
    at java.lang.ClassLoader.defineClass(ClassLoader.java:621)
    at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141)
    at java.net.URLClassLoader.defineClass(URLClassLoader.java:283)
    at java.net.URLClassLoader.access$000(URLClassLoader.java:58)
    at java.net.URLClassLoader$1.run(URLClassLoader.java:197)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
    at com.google.common.io.Files$FileByteSink.<init>(Files.java:218)
    at com.google.common.io.Files$FileByteSink.<init>(Files.java:211)
    at com.google.common.io.Files.asByteSink(Files.java:208)
    at com.google.common.io.Files.asCharSink(Files.java:254)
    at com.google.common.io.Files.write(Files.java:467)
    at org.apache.spark.deploy.worker.ExecutorRunner.fetchAndRunExecutor(ExecutorRunner.scala:138)
    at org.apache.spark.deploy.worker.ExecutorRunner$$anon$1.run(ExecutorRunner.scala:58)

[AmplabJenkins]

Can one of the admins verify this patch?

[pwendell]

We haven't had issues with this on jenkins... I wonder if it's related to the JVM or environment somehow. Anyways, fine to merge this into the master branch. Jenkins, test this please.

[AmplabJenkins]

Merged build triggered.

[AmplabJenkins]

Merged build started.

[AmplabJenkins]

Merged build finished. All automated tests passed.

[AmplabJenkins]

All automated tests passed.
Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14986/

[rxin]

That's a lot of memory for building & testing ...

[rxin]

I merged this.