Skip to content

Conversation

@bric3
Copy link
Contributor

@bric3 bric3 commented Aug 7, 2025

What Does This Do

Allow testJvm property to have paths.

Motivation

Locally this allows to easily use a different JVM from the IDE, without having to set-up an environment variable before. In practice this allows to use either -PtestJvm=JAVAMY_JVM_HOME or -PtestJvm=/path/to-/my-jvm

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@bric3 bric3 requested a review from a team as a code owner August 7, 2025 10:10
@bric3 bric3 requested a review from smola August 7, 2025 10:10
@bric3 bric3 added tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels Aug 7, 2025
@bric3 bric3 changed the title Allow testJvm property to have paths Allow testJvm property to receive paths Aug 7, 2025
@bric3 bric3 enabled auto-merge (squash) August 7, 2025 10:10
@datadog-official
Copy link

datadog-official bot commented Aug 7, 2025

Code coverage: total 57.25%, base diff 0.01%, patch 100.00% (view details)

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 468245a | Docs | Was this helpful? Give us feedback!

@pr-commenter
Copy link

pr-commenter bot commented Aug 7, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bdu/allow-path-in-testJvm
git_commit_date 1754560510 1754561210
git_commit_sha ea85e01 468245a
release_version 1.53.0-SNAPSHOT~ea85e017e4 1.53.0-SNAPSHOT~468245a3af
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1754563132 1754563132
ci_job_id 1068909977 1068909977
ci_pipeline_id 72961940 72961940
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-2oxat9fu 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-2oxat9fu 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 47 metrics, 12 unstable metrics.

Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.53.0-SNAPSHOT~468245a3af, baseline=1.53.0-SNAPSHOT~ea85e017e4

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.057 s) : 0, 1056748
Total [baseline] (8.6 s) : 0, 8599777
Agent [candidate] (1.051 s) : 0, 1051412
Total [candidate] (8.628 s) : 0, 8628409
section iast
Agent [baseline] (1.179 s) : 0, 1179322
Total [baseline] (9.303 s) : 0, 9303090
Agent [candidate] (1.178 s) : 0, 1178155
Total [candidate] (9.277 s) : 0, 9276702
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.057 s -
Agent iast 1.179 s 122.574 ms (11.6%)
Total tracing 8.6 s -
Total iast 9.303 s 703.313 ms (8.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.051 s -
Agent iast 1.178 s 126.743 ms (12.1%)
Total tracing 8.628 s -
Total iast 9.277 s 648.293 ms (7.5%)
gantt
    title insecure-bank - break down per module: candidate=1.53.0-SNAPSHOT~468245a3af, baseline=1.53.0-SNAPSHOT~ea85e017e4

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.452 ms) : 0, 1452
crashtracking [candidate] (1.44 ms) : 0, 1440
BytebuddyAgent [baseline] (737.359 ms) : 0, 737359
BytebuddyAgent [candidate] (735.555 ms) : 0, 735555
GlobalTracer [baseline] (244.77 ms) : 0, 244770
GlobalTracer [candidate] (242.954 ms) : 0, 242954
AppSec [baseline] (30.617 ms) : 0, 30617
AppSec [candidate] (30.224 ms) : 0, 30224
Debugger [baseline] (6.134 ms) : 0, 6134
Debugger [candidate] (6.027 ms) : 0, 6027
Remote Config [baseline] (662.836 µs) : 0, 663
Remote Config [candidate] (657.737 µs) : 0, 658
Telemetry [baseline] (14.559 ms) : 0, 14559
Telemetry [candidate] (13.505 ms) : 0, 13505
section iast
crashtracking [baseline] (1.431 ms) : 0, 1431
crashtracking [candidate] (1.429 ms) : 0, 1429
BytebuddyAgent [baseline] (850.95 ms) : 0, 850950
BytebuddyAgent [candidate] (850.736 ms) : 0, 850736
GlobalTracer [baseline] (233.391 ms) : 0, 233391
GlobalTracer [candidate] (233.216 ms) : 0, 233216
IAST [baseline] (26.812 ms) : 0, 26812
IAST [candidate] (29.172 ms) : 0, 29172
AppSec [baseline] (26.849 ms) : 0, 26849
AppSec [candidate] (27.912 ms) : 0, 27912
Debugger [baseline] (9.977 ms) : 0, 9977
Debugger [candidate] (5.727 ms) : 0, 5727
Remote Config [baseline] (576.932 µs) : 0, 577
Remote Config [candidate] (578.889 µs) : 0, 579
Telemetry [baseline] (8.243 ms) : 0, 8243
Telemetry [candidate] (8.43 ms) : 0, 8430
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.53.0-SNAPSHOT~468245a3af, baseline=1.53.0-SNAPSHOT~ea85e017e4

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.045 s) : 0, 1044567
Total [baseline] (10.739 s) : 0, 10739492
Agent [candidate] (1.053 s) : 0, 1053067
Total [candidate] (10.749 s) : 0, 10749416
section appsec
Agent [baseline] (1.22 s) : 0, 1219885
Total [baseline] (10.734 s) : 0, 10733541
Agent [candidate] (1.221 s) : 0, 1220982
Total [candidate] (10.785 s) : 0, 10784893
section iast
Agent [baseline] (1.173 s) : 0, 1172758
Total [baseline] (10.947 s) : 0, 10946669
Agent [candidate] (1.189 s) : 0, 1188819
Total [candidate] (10.996 s) : 0, 10995596
section profiling
Agent [baseline] (1.192 s) : 0, 1192170
Total [baseline] (10.835 s) : 0, 10834599
Agent [candidate] (1.192 s) : 0, 1192045
Total [candidate] (10.822 s) : 0, 10821506
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.045 s -
Agent appsec 1.22 s 175.318 ms (16.8%)
Agent iast 1.173 s 128.19 ms (12.3%)
Agent profiling 1.192 s 147.603 ms (14.1%)
Total tracing 10.739 s -
Total appsec 10.734 s -5.952 ms (-0.1%)
Total iast 10.947 s 207.177 ms (1.9%)
Total profiling 10.835 s 95.107 ms (0.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.053 s -
Agent appsec 1.221 s 167.914 ms (15.9%)
Agent iast 1.189 s 135.752 ms (12.9%)
Agent profiling 1.192 s 138.978 ms (13.2%)
Total tracing 10.749 s -
Total appsec 10.785 s 35.476 ms (0.3%)
Total iast 10.996 s 246.18 ms (2.3%)
Total profiling 10.822 s 72.09 ms (0.7%)
gantt
    title petclinic - break down per module: candidate=1.53.0-SNAPSHOT~468245a3af, baseline=1.53.0-SNAPSHOT~ea85e017e4

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.437 ms) : 0, 1437
crashtracking [candidate] (1.444 ms) : 0, 1444
BytebuddyAgent [baseline] (730.36 ms) : 0, 730360
BytebuddyAgent [candidate] (737.069 ms) : 0, 737069
GlobalTracer [baseline] (242.208 ms) : 0, 242208
GlobalTracer [candidate] (243.579 ms) : 0, 243579
AppSec [baseline] (29.926 ms) : 0, 29926
AppSec [candidate] (30.33 ms) : 0, 30330
Debugger [baseline] (6.011 ms) : 0, 6011
Debugger [candidate] (6.059 ms) : 0, 6059
Remote Config [baseline] (649.614 µs) : 0, 650
Remote Config [candidate] (641.544 µs) : 0, 642
Telemetry [baseline] (12.895 ms) : 0, 12895
Telemetry [candidate] (12.738 ms) : 0, 12738
section appsec
crashtracking [baseline] (1.427 ms) : 0, 1427
crashtracking [candidate] (1.424 ms) : 0, 1424
BytebuddyAgent [baseline] (752.642 ms) : 0, 752642
BytebuddyAgent [candidate] (753.616 ms) : 0, 753616
GlobalTracer [baseline] (235.055 ms) : 0, 235055
GlobalTracer [candidate] (235.282 ms) : 0, 235282
AppSec [baseline] (169.822 ms) : 0, 169822
AppSec [candidate] (168.322 ms) : 0, 168322
Debugger [baseline] (6.497 ms) : 0, 6497
Debugger [candidate] (7.923 ms) : 0, 7923
Remote Config [baseline] (633.238 µs) : 0, 633
Remote Config [candidate] (615.84 µs) : 0, 616
Telemetry [baseline] (9.15 ms) : 0, 9150
Telemetry [candidate] (9.099 ms) : 0, 9099
IAST [baseline] (23.647 ms) : 0, 23647
IAST [candidate] (23.582 ms) : 0, 23582
section iast
crashtracking [baseline] (1.425 ms) : 0, 1425
crashtracking [candidate] (1.449 ms) : 0, 1449
BytebuddyAgent [baseline] (846.617 ms) : 0, 846617
BytebuddyAgent [candidate] (858.32 ms) : 0, 858320
GlobalTracer [baseline] (233.585 ms) : 0, 233585
GlobalTracer [candidate] (234.469 ms) : 0, 234469
AppSec [baseline] (27.342 ms) : 0, 27342
AppSec [candidate] (25.694 ms) : 0, 25694
Debugger [baseline] (6.529 ms) : 0, 6529
Debugger [candidate] (7.439 ms) : 0, 7439
Remote Config [baseline] (575.368 µs) : 0, 575
Remote Config [candidate] (612.739 µs) : 0, 613
Telemetry [baseline] (8.244 ms) : 0, 8244
Telemetry [candidate] (9.298 ms) : 0, 9298
IAST [baseline] (27.365 ms) : 0, 27365
IAST [candidate] (30.342 ms) : 0, 30342
section profiling
ProfilingAgent [baseline] (108.003 ms) : 0, 108003
ProfilingAgent [candidate] (107.61 ms) : 0, 107610
crashtracking [baseline] (1.396 ms) : 0, 1396
crashtracking [candidate] (1.399 ms) : 0, 1399
BytebuddyAgent [baseline] (759.881 ms) : 0, 759881
BytebuddyAgent [candidate] (759.449 ms) : 0, 759449
GlobalTracer [baseline] (221.606 ms) : 0, 221606
GlobalTracer [candidate] (221.494 ms) : 0, 221494
AppSec [baseline] (29.791 ms) : 0, 29791
AppSec [candidate] (29.792 ms) : 0, 29792
Debugger [baseline] (6.203 ms) : 0, 6203
Debugger [candidate] (6.255 ms) : 0, 6255
Remote Config [baseline] (682.094 µs) : 0, 682
Remote Config [candidate] (680.807 µs) : 0, 681
Telemetry [baseline] (15.157 ms) : 0, 15157
Telemetry [candidate] (15.866 ms) : 0, 15866
Profiling [baseline] (108.622 ms) : 0, 108622
Profiling [candidate] (108.254 ms) : 0, 108254
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bdu/allow-path-in-testJvm
git_commit_date 1754560510 1754561210
git_commit_sha ea85e01 468245a
release_version 1.53.0-SNAPSHOT~ea85e017e4 1.53.0-SNAPSHOT~468245a3af
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1754562806 1754562806
ci_job_id 1068909978 1068909978
ci_pipeline_id 72961940 72961940
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-1nvuwg5h 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-1nvuwg5h 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 1 performance regressions! Performance is the same for 9 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load worse
[+206.588µs; +591.573µs] or [+2.069%; +5.925%]
unstable
[-68.096op/s; +33.034op/s] or [-14.638%; +7.101%]
10.384ms 447.656op/s 9.985ms 465.188op/s
scenario:load:insecure-bank:tracing:high_load better
[-462.699µs; -224.799µs] or [-6.073%; -2.951%]
unstable
[-44.309op/s; +100.559op/s] or [-7.289%; +16.543%]
7.275ms 636.000op/s 7.619ms 607.875op/s
scenario:load:petclinic:no_agent:high_load better
[-1.877ms; -1.222ms] or [-4.981%; -3.244%]
unstable
[-3.663op/s; +14.213op/s] or [-2.951%; +11.449%]
36.130ms 129.425op/s 37.679ms 124.150op/s
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.53.0-SNAPSHOT~468245a3af, baseline=1.53.0-SNAPSHOT~ea85e017e4
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.324 ms) : 4276, 4373
.   : milestone, 4324,
iast (9.401 ms) : 9244, 9557
.   : milestone, 9401,
iast_FULL (13.853 ms) : 13580, 14125
.   : milestone, 13853,
iast_GLOBAL (9.985 ms) : 9809, 10161
.   : milestone, 9985,
profiling (8.498 ms) : 8362, 8634
.   : milestone, 8498,
tracing (7.619 ms) : 7506, 7731
.   : milestone, 7619,
section candidate
no_agent (4.34 ms) : 4289, 4391
.   : milestone, 4340,
iast (9.224 ms) : 9072, 9375
.   : milestone, 9224,
iast_FULL (13.592 ms) : 13319, 13866
.   : milestone, 13592,
iast_GLOBAL (10.384 ms) : 10202, 10566
.   : milestone, 10384,
profiling (8.566 ms) : 8427, 8705
.   : milestone, 8566,
tracing (7.275 ms) : 7167, 7384
.   : milestone, 7275,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.324 ms [4.276 ms, 4.373 ms] -
iast 9.401 ms [9.244 ms, 9.557 ms] 5.076 ms (117.4%)
iast_FULL 13.853 ms [13.58 ms, 14.125 ms] 9.528 ms (220.3%)
iast_GLOBAL 9.985 ms [9.809 ms, 10.161 ms] 5.66 ms (130.9%)
profiling 8.498 ms [8.362 ms, 8.634 ms] 4.173 ms (96.5%)
tracing 7.619 ms [7.506 ms, 7.731 ms] 3.294 ms (76.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.34 ms [4.289 ms, 4.391 ms] -
iast 9.224 ms [9.072 ms, 9.375 ms] 4.884 ms (112.5%)
iast_FULL 13.592 ms [13.319 ms, 13.866 ms] 9.252 ms (213.2%)
iast_GLOBAL 10.384 ms [10.202 ms, 10.566 ms] 6.044 ms (139.3%)
profiling 8.566 ms [8.427 ms, 8.705 ms] 4.226 ms (97.4%)
tracing 7.275 ms [7.167 ms, 7.384 ms] 2.935 ms (67.6%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.53.0-SNAPSHOT~468245a3af, baseline=1.53.0-SNAPSHOT~ea85e017e4
    dateFormat X
    axisFormat %s
section baseline
no_agent (37.679 ms) : 37361, 37998
.   : milestone, 37679,
appsec (46.401 ms) : 45981, 46821
.   : milestone, 46401,
code_origins (44.874 ms) : 44481, 45267
.   : milestone, 44874,
iast (45.445 ms) : 45046, 45844
.   : milestone, 45445,
profiling (48.292 ms) : 47849, 48736
.   : milestone, 48292,
tracing (43.53 ms) : 43157, 43904
.   : milestone, 43530,
section candidate
no_agent (36.13 ms) : 35841, 36418
.   : milestone, 36130,
appsec (46.777 ms) : 46353, 47202
.   : milestone, 46777,
code_origins (44.732 ms) : 44344, 45120
.   : milestone, 44732,
iast (44.852 ms) : 44465, 45239
.   : milestone, 44852,
profiling (46.915 ms) : 46470, 47361
.   : milestone, 46915,
tracing (43.326 ms) : 42961, 43690
.   : milestone, 43326,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 37.679 ms [37.361 ms, 37.998 ms] -
appsec 46.401 ms [45.981 ms, 46.821 ms] 8.722 ms (23.1%)
code_origins 44.874 ms [44.481 ms, 45.267 ms] 7.195 ms (19.1%)
iast 45.445 ms [45.046 ms, 45.844 ms] 7.765 ms (20.6%)
profiling 48.292 ms [47.849 ms, 48.736 ms] 10.613 ms (28.2%)
tracing 43.53 ms [43.157 ms, 43.904 ms] 5.851 ms (15.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 36.13 ms [35.841 ms, 36.418 ms] -
appsec 46.777 ms [46.353 ms, 47.202 ms] 10.648 ms (29.5%)
code_origins 44.732 ms [44.344 ms, 45.12 ms] 8.602 ms (23.8%)
iast 44.852 ms [44.465 ms, 45.239 ms] 8.722 ms (24.1%)
profiling 46.915 ms [46.47 ms, 47.361 ms] 10.786 ms (29.9%)
tracing 43.326 ms [42.961 ms, 43.69 ms] 7.196 ms (19.9%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bdu/allow-path-in-testJvm
git_commit_date 1754560510 1754561210
git_commit_sha ea85e01 468245a
release_version 1.53.0-SNAPSHOT~ea85e017e4 1.53.0-SNAPSHOT~468245a3af
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1754563335 1754563335
ci_job_id 1068909979 1068909979
ci_pipeline_id 72961940 72961940
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-3-sl0ofxt9 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-3-sl0ofxt9 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.53.0-SNAPSHOT~468245a3af, baseline=1.53.0-SNAPSHOT~ea85e017e4
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.477 ms) : 1465, 1488
.   : milestone, 1477,
appsec (3.664 ms) : 3447, 3881
.   : milestone, 3664,
iast (2.203 ms) : 2141, 2266
.   : milestone, 2203,
iast_GLOBAL (2.237 ms) : 2173, 2300
.   : milestone, 2237,
profiling (2.054 ms) : 2003, 2106
.   : milestone, 2054,
tracing (2.004 ms) : 1956, 2053
.   : milestone, 2004,
section candidate
no_agent (1.475 ms) : 1464, 1487
.   : milestone, 1475,
appsec (3.644 ms) : 3426, 3863
.   : milestone, 3644,
iast (2.201 ms) : 2139, 2264
.   : milestone, 2201,
iast_GLOBAL (2.245 ms) : 2182, 2308
.   : milestone, 2245,
profiling (2.059 ms) : 2008, 2111
.   : milestone, 2059,
tracing (2.021 ms) : 1972, 2070
.   : milestone, 2021,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.477 ms [1.465 ms, 1.488 ms] -
appsec 3.664 ms [3.447 ms, 3.881 ms] 2.187 ms (148.1%)
iast 2.203 ms [2.141 ms, 2.266 ms] 726.422 µs (49.2%)
iast_GLOBAL 2.237 ms [2.173 ms, 2.3 ms] 759.6 µs (51.4%)
profiling 2.054 ms [2.003 ms, 2.106 ms] 577.356 µs (39.1%)
tracing 2.004 ms [1.956 ms, 2.053 ms] 527.358 µs (35.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.475 ms [1.464 ms, 1.487 ms] -
appsec 3.644 ms [3.426 ms, 3.863 ms] 2.169 ms (147.0%)
iast 2.201 ms [2.139 ms, 2.264 ms] 726.037 µs (49.2%)
iast_GLOBAL 2.245 ms [2.182 ms, 2.308 ms] 769.981 µs (52.2%)
profiling 2.059 ms [2.008 ms, 2.111 ms] 584.153 µs (39.6%)
tracing 2.021 ms [1.972 ms, 2.07 ms] 545.911 µs (37.0%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.53.0-SNAPSHOT~468245a3af, baseline=1.53.0-SNAPSHOT~ea85e017e4
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.006 s) : 15006000, 15006000
.   : milestone, 15006000,
appsec (14.738 s) : 14738000, 14738000
.   : milestone, 14738000,
iast (18.334 s) : 18334000, 18334000
.   : milestone, 18334000,
iast_GLOBAL (17.957 s) : 17957000, 17957000
.   : milestone, 17957000,
profiling (15.418 s) : 15418000, 15418000
.   : milestone, 15418000,
tracing (14.805 s) : 14805000, 14805000
.   : milestone, 14805000,
section candidate
no_agent (15.487 s) : 15487000, 15487000
.   : milestone, 15487000,
appsec (14.917 s) : 14917000, 14917000
.   : milestone, 14917000,
iast (18.333 s) : 18333000, 18333000
.   : milestone, 18333000,
iast_GLOBAL (18.021 s) : 18021000, 18021000
.   : milestone, 18021000,
profiling (15.72 s) : 15720000, 15720000
.   : milestone, 15720000,
tracing (15.147 s) : 15147000, 15147000
.   : milestone, 15147000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.006 s [15.006 s, 15.006 s] -
appsec 14.738 s [14.738 s, 14.738 s] -268.0 ms (-1.8%)
iast 18.334 s [18.334 s, 18.334 s] 3.328 s (22.2%)
iast_GLOBAL 17.957 s [17.957 s, 17.957 s] 2.951 s (19.7%)
profiling 15.418 s [15.418 s, 15.418 s] 412.0 ms (2.7%)
tracing 14.805 s [14.805 s, 14.805 s] -201.0 ms (-1.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.487 s [15.487 s, 15.487 s] -
appsec 14.917 s [14.917 s, 14.917 s] -570.0 ms (-3.7%)
iast 18.333 s [18.333 s, 18.333 s] 2.846 s (18.4%)
iast_GLOBAL 18.021 s [18.021 s, 18.021 s] 2.534 s (16.4%)
profiling 15.72 s [15.72 s, 15.72 s] 233.0 ms (1.5%)
tracing 15.147 s [15.147 s, 15.147 s] -340.0 ms (-2.2%)

Copy link
Contributor

@jbachorik jbachorik left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks useful

Copy link
Contributor

@PerfectSlayer PerfectSlayer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

❔ question: ‏Dump question but should not we try to stick to the Gradle discovery and provisioning capabilities rather than adding another custom mechanism?

@bric3
Copy link
Contributor Author

bric3 commented Aug 7, 2025

@PerfectSlayer In this case not really because the goal is to use a very specific JVM install.

Ultimately, I agree that the whole feature should be refactored to rely on Gradle discovery mechanism, but that's a different beast.

@bric3 bric3 merged commit b268fde into master Aug 7, 2025
509 checks passed
@bric3 bric3 deleted the bdu/allow-path-in-testJvm branch August 7, 2025 13:52
@github-actions github-actions bot added this to the 1.53.0 milestone Aug 7, 2025
amarziali pushed a commit that referenced this pull request Aug 8, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants