Skip to content

Commit 79a6e00

Browse files
committed
[SPARK-35825][INFRA][FOLLOWUP] Increase it in build/mvn script
### What changes were proposed in this pull request? This is a follow up of #32961. This PR additionally sets the stack size in `build/mvn`. ### Why are the changes needed? We are still hitting `StackOverflowError` in Jenkins. - https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Test%20(Dashboard)/job/spark-master-test-maven-hadoop-3.2/3064/console ``` [INFO] compiling 166 Scala sources and 19 Java sources to /home/jenkins/workspace/spark-master-test-maven-hadoop-3.2/sql/catalyst/target/scala-2.12/classes ... [ERROR] ## Exception when compiling 480 sources to /home/jenkins/workspace/spark-master-test-maven-hadoop-3.2/sql/catalyst/target/scala-2.12/classes java.lang.StackOverflowError ``` This PR increases the JVM of `mvn` instead of the plugin. ``` $ MAVEN_OPTS="-XX:+PrintFlagsFinal" build/mvn clean | grep 'intx ThreadStackSize' intx ThreadStackSize = 2048 {pd product} $ MAVEN_OPTS="-Xss128m -XX:+PrintFlagsFinal" build/mvn clean | grep 'intx ThreadStackSize' intx ThreadStackSize := 131072 {pd product} ``` ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? N/A Closes #33180 from dongjoon-hyun/SPARK-35825. Authored-by: Dongjoon Hyun <[email protected]> Signed-off-by: Dongjoon Hyun <[email protected]>
1 parent 1fda011 commit 79a6e00

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

build/mvn

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -29,7 +29,7 @@ _DIR="$( cd "$( dirname "${BASH_SOURCE[0]}" )" && pwd )"
2929
# Preserve the calling directory
3030
_CALLING_DIR="$(pwd)"
3131
# Options used during compilation
32-
_COMPILE_JVM_OPTS="-Xmx2g -XX:ReservedCodeCacheSize=1g"
32+
_COMPILE_JVM_OPTS="-Xmx2g -XX:ReservedCodeCacheSize=1g -Xss128m"
3333

3434
# Installs any application tarball given a URL, the expected tarball name,
3535
# and, optionally, a checkable binary path to determine if the binary has

0 commit comments

Comments
 (0)