Skip to content

Revert Java 25-EA kotlin workaround #9499

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 2 commits into from
Sep 29, 2025
Merged

Revert Java 25-EA kotlin workaround #9499

merged 2 commits into from
Sep 29, 2025

Conversation

@sarahchen6
Copy link
Contributor

@sarahchen6 sarahchen6 commented Sep 9, 2025

What Does This Do

Revert kotlin workaround put in place for Java 25-ea in #9274.

Motivation

Additional Notes

Waiting until Java 25 GA on Sep 16 to merge.

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@sarahchen6 sarahchen6 added type: enhancement Enhancements and improvements tag: do not merge Do not merge changes tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels Sep 9, 2025
@datadog-official
Copy link

datadog-official bot commented Sep 9, 2025 •
edited
Loading

🎯 Code Coverage
• Patch Coverage: 100.00%
• Total Coverage: 81.18% (+23.22%)

View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 5d856f1 | Docs | Was this helpful? Give us feedback!

@pr-commenter
Copy link

pr-commenter bot commented Sep 9, 2025 •
edited
Loading

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1759155650 1759156008
end_time 2025-09-29T14:22:10 2025-09-29T14:28:09
git_branch master sarahchen6/revert-kotlin-25-ea-workaround
git_commit_sha 1546940 5d856f1
start_time 2025-09-29T14:20:51 2025-09-29T14:26:49
See matching parameters
Baseline Candidate
ci_job_id 1152555179 1152555179
ci_pipeline_id 77836655 77836655
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1759155036 1759155036

Summary

Found 5 performance improvements and 0 performance regressions! Performance is the same for 4 metrics, 6 unstable metrics.

scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:loop better
[-807.604µs; -606.649µs] or [-8.438%; -6.338%]		 better
[-820.067µs; -614.627µs] or [-8.479%; -6.355%]		 better
[-817.935µs; -614.112µs] or [-8.411%; -6.315%]		 better
[-856.188µs; -639.050µs] or [-8.678%; -6.477%]		 better
[+5.544op/s; +9.108op/s] or [+5.405%; +8.881%]
See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-22.434µs; +48.995µs] or [-8.138%; +17.773%]		 unstable
[-34.679µs; +65.445µs] or [-10.931%; +20.628%]		 unstable
[-43.245µs; +72.434µs] or [-13.003%; +21.780%]		 unstable
[-122.168µs; +393.491µs] or [-13.169%; +42.416%]		 same
scenario:basic same same same unstable
[-76.956µs; +113.891µs] or [-10.290%; +15.229%]		 unstable
[-189.682op/s; +189.682op/s] or [-7.208%; +7.208%]
Request duration reports for reports 
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (317.264 µs) : 286, 349
.   : milestone, 317,
basic (280.573 µs) : 274, 287
.   : milestone, 281,
loop (9.672 ms) : 9537, 9807
.   : milestone, 9672,
section candidate
noprobe (332.648 µs) : 273, 392
.   : milestone, 333,
basic (278.505 µs) : 272, 285
.   : milestone, 279,
loop (8.954 ms) : 8949, 8959
.   : milestone, 8954,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 317.264 µs [285.822 µs, 348.707 µs]
basic 280.573 µs [274.087 µs, 287.059 µs]
loop 9.672 ms [9.537 ms, 9.807 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 332.648 µs [273.028 µs, 392.267 µs]
basic 278.505 µs [271.791 µs, 285.219 µs]
loop 8.954 ms [8.949 ms, 8.959 ms]

@pr-commenter
Copy link

pr-commenter bot commented Sep 9, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/revert-kotlin-25-ea-workaround
git_commit_date 1759154643 1759155036
git_commit_sha 1546940 5d856f1
release_version 1.54.0-SNAPSHOT~1546940fb4 1.54.0-SNAPSHOT~5d856f199f
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1759156875 1759156875
ci_job_id 1152555165 1152555165
ci_pipeline_id 77836655 77836655
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-1xswl8uv 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-1xswl8uv 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 61 metrics, 4 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.54.0-SNAPSHOT~5d856f199f, baseline=1.54.0-SNAPSHOT~1546940fb4

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.014 s) : 0, 1014259
Total [baseline] (8.72 s) : 0, 8719779
Agent [candidate] (1.018 s) : 0, 1017991
Total [candidate] (8.679 s) : 0, 8678633
section iast
Agent [baseline] (1.143 s) : 0, 1143192
Total [baseline] (9.243 s) : 0, 9243409
Agent [candidate] (1.153 s) : 0, 1152996
Total [candidate] (9.344 s) : 0, 9343705
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.014 s -
Agent iast 1.143 s 128.933 ms (12.7%)
Total tracing 8.72 s -
Total iast 9.243 s 523.63 ms (6.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.018 s -
Agent iast 1.153 s 135.005 ms (13.3%)
Total tracing 8.679 s -
Total iast 9.344 s 665.071 ms (7.7%) 
gantt
    title insecure-bank - break down per module: candidate=1.54.0-SNAPSHOT~5d856f199f, baseline=1.54.0-SNAPSHOT~1546940fb4

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.467 ms) : 0, 1467
crashtracking [candidate] (1.465 ms) : 0, 1465
BytebuddyAgent [baseline] (689.919 ms) : 0, 689919
BytebuddyAgent [candidate] (693.778 ms) : 0, 693778
GlobalTracer [baseline] (243.402 ms) : 0, 243402
GlobalTracer [candidate] (244.54 ms) : 0, 244540
AppSec [baseline] (31.386 ms) : 0, 31386
AppSec [candidate] (31.45 ms) : 0, 31450
Debugger [baseline] (6.344 ms) : 0, 6344
Debugger [candidate] (6.37 ms) : 0, 6370
Remote Config [baseline] (674.803 µs) : 0, 675
Remote Config [candidate] (670.175 µs) : 0, 670
Telemetry [baseline] (9.08 ms) : 0, 9080
Telemetry [candidate] (9.144 ms) : 0, 9144
Flare Poller [baseline] (10.869 ms) : 0, 10869
Flare Poller [candidate] (9.35 ms) : 0, 9350
section iast
crashtracking [baseline] (1.461 ms) : 0, 1461
crashtracking [candidate] (1.468 ms) : 0, 1468
BytebuddyAgent [baseline] (809.538 ms) : 0, 809538
BytebuddyAgent [candidate] (816.676 ms) : 0, 816676
GlobalTracer [baseline] (231.892 ms) : 0, 231892
GlobalTracer [candidate] (234.109 ms) : 0, 234109
IAST [baseline] (26.151 ms) : 0, 26151
IAST [candidate] (26.5 ms) : 0, 26500
AppSec [baseline] (34.033 ms) : 0, 34033
AppSec [candidate] (33.598 ms) : 0, 33598
Debugger [baseline] (5.977 ms) : 0, 5977
Debugger [candidate] (6.085 ms) : 0, 6085
Remote Config [baseline] (569.909 µs) : 0, 570
Remote Config [candidate] (586.601 µs) : 0, 587
Telemetry [baseline] (7.961 ms) : 0, 7961
Telemetry [candidate] (8.245 ms) : 0, 8245
Flare Poller [baseline] (4.249 ms) : 0, 4249
Flare Poller [candidate] (4.27 ms) : 0, 4270
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.54.0-SNAPSHOT~5d856f199f, baseline=1.54.0-SNAPSHOT~1546940fb4

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.024 s) : 0, 1024136
Total [baseline] (10.76 s) : 0, 10759878
Agent [candidate] (1.023 s) : 0, 1023335
Total [candidate] (10.732 s) : 0, 10732208
section appsec
Agent [baseline] (1.186 s) : 0, 1186405
Total [baseline] (11.068 s) : 0, 11067846
Agent [candidate] (1.187 s) : 0, 1187343
Total [candidate] (11.039 s) : 0, 11038566
section iast
Agent [baseline] (1.148 s) : 0, 1147941
Total [baseline] (10.891 s) : 0, 10890737
Agent [candidate] (1.146 s) : 0, 1145604
Total [candidate] (9.977 s) : 0, 9976840
section profiling
Agent [baseline] (1.155 s) : 0, 1154771
Total [baseline] (11.103 s) : 0, 11102987
Agent [candidate] (1.151 s) : 0, 1151021
Total [candidate] (11.061 s) : 0, 11060936
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.024 s -
Agent appsec 1.186 s 162.269 ms (15.8%)
Agent iast 1.148 s 123.806 ms (12.1%)
Agent profiling 1.155 s 130.635 ms (12.8%)
Total tracing 10.76 s -
Total appsec 11.068 s 307.968 ms (2.9%)
Total iast 10.891 s 130.859 ms (1.2%)
Total profiling 11.103 s 343.109 ms (3.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.023 s -
Agent appsec 1.187 s 164.008 ms (16.0%)
Agent iast 1.146 s 122.269 ms (11.9%)
Agent profiling 1.151 s 127.686 ms (12.5%)
Total tracing 10.732 s -
Total appsec 11.039 s 306.358 ms (2.9%)
Total iast 9.977 s -755.368 ms (-7.0%)
Total profiling 11.061 s 328.728 ms (3.1%) 
gantt
    title petclinic - break down per module: candidate=1.54.0-SNAPSHOT~5d856f199f, baseline=1.54.0-SNAPSHOT~1546940fb4

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.47 ms) : 0, 1470
crashtracking [candidate] (1.496 ms) : 0, 1496
BytebuddyAgent [baseline] (694.454 ms) : 0, 694454
BytebuddyAgent [candidate] (697.354 ms) : 0, 697354
GlobalTracer [baseline] (246.643 ms) : 0, 246643
GlobalTracer [candidate] (244.694 ms) : 0, 244694
AppSec [baseline] (32.071 ms) : 0, 32071
AppSec [candidate] (31.51 ms) : 0, 31510
Debugger [baseline] (6.49 ms) : 0, 6490
Debugger [candidate] (6.338 ms) : 0, 6338
Remote Config [baseline] (695.874 µs) : 0, 696
Remote Config [candidate] (680.36 µs) : 0, 680
Telemetry [baseline] (9.258 ms) : 0, 9258
Telemetry [candidate] (9.045 ms) : 0, 9045
Flare Poller [baseline] (11.704 ms) : 0, 11704
Flare Poller [candidate] (10.868 ms) : 0, 10868
section appsec
crashtracking [baseline] (1.449 ms) : 0, 1449
crashtracking [candidate] (1.471 ms) : 0, 1471
BytebuddyAgent [baseline] (711.983 ms) : 0, 711983
BytebuddyAgent [candidate] (712.744 ms) : 0, 712744
GlobalTracer [baseline] (234.873 ms) : 0, 234873
GlobalTracer [candidate] (235.168 ms) : 0, 235168
AppSec [baseline] (170.783 ms) : 0, 170783
AppSec [candidate] (173.077 ms) : 0, 173077
Debugger [baseline] (6.072 ms) : 0, 6072
Debugger [candidate] (6.012 ms) : 0, 6012
Remote Config [baseline] (629.518 µs) : 0, 630
Remote Config [candidate] (627.19 µs) : 0, 627
Telemetry [baseline] (8.348 ms) : 0, 8348
Telemetry [candidate] (8.319 ms) : 0, 8319
Flare Poller [baseline] (6.309 ms) : 0, 6309
Flare Poller [candidate] (3.987 ms) : 0, 3987
IAST [baseline] (24.815 ms) : 0, 24815
IAST [candidate] (24.812 ms) : 0, 24812
section iast
crashtracking [baseline] (1.461 ms) : 0, 1461
crashtracking [candidate] (1.465 ms) : 0, 1465
BytebuddyAgent [baseline] (812.41 ms) : 0, 812410
BytebuddyAgent [candidate] (811.103 ms) : 0, 811103
GlobalTracer [baseline] (233.486 ms) : 0, 233486
GlobalTracer [candidate] (232.802 ms) : 0, 232802
AppSec [baseline] (33.71 ms) : 0, 33710
AppSec [candidate] (33.783 ms) : 0, 33783
Debugger [baseline] (6.03 ms) : 0, 6030
Debugger [candidate] (6.002 ms) : 0, 6002
Remote Config [baseline] (582.47 µs) : 0, 582
Remote Config [candidate] (572.852 µs) : 0, 573
Telemetry [baseline] (8.136 ms) : 0, 8136
Telemetry [candidate] (7.989 ms) : 0, 7989
Flare Poller [baseline] (4.19 ms) : 0, 4190
Flare Poller [candidate] (4.211 ms) : 0, 4211
IAST [baseline] (26.344 ms) : 0, 26344
IAST [candidate] (26.077 ms) : 0, 26077
section profiling
ProfilingAgent [baseline] (102.807 ms) : 0, 102807
ProfilingAgent [candidate] (101.635 ms) : 0, 101635
crashtracking [baseline] (1.451 ms) : 0, 1451
crashtracking [candidate] (1.442 ms) : 0, 1442
BytebuddyAgent [baseline] (719.868 ms) : 0, 719868
BytebuddyAgent [candidate] (719.045 ms) : 0, 719045
GlobalTracer [baseline] (218.671 ms) : 0, 218671
GlobalTracer [candidate] (217.406 ms) : 0, 217406
AppSec [baseline] (31.539 ms) : 0, 31539
AppSec [candidate] (31.272 ms) : 0, 31272
Debugger [baseline] (6.521 ms) : 0, 6521
Debugger [candidate] (6.539 ms) : 0, 6539
Remote Config [baseline] (719.145 µs) : 0, 719
Remote Config [candidate] (720.724 µs) : 0, 721
Telemetry [baseline] (16.492 ms) : 0, 16492
Telemetry [candidate] (16.401 ms) : 0, 16401
Flare Poller [baseline] (4.161 ms) : 0, 4161
Flare Poller [candidate] (4.11 ms) : 0, 4110
Profiling [baseline] (103.393 ms) : 0, 103393
Profiling [candidate] (102.222 ms) : 0, 102222
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/revert-kotlin-25-ea-workaround
git_commit_date 1759154643 1759155036
git_commit_sha 1546940 5d856f1
release_version 1.54.0-SNAPSHOT~1546940fb4 1.54.0-SNAPSHOT~5d856f199f
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1759156579 1759156579
ci_job_id 1152555166 1152555166
ci_pipeline_id 77836655 77836655
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-3-sp2yh2d7 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-3-sp2yh2d7 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 3 performance regressions! Performance is the same for 6 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:tracing:high_load better
[-503.466µs; -260.684µs] or [-6.393%; -3.310%]		 unstable
[-41.560op/s; +100.810op/s] or [-7.063%; +17.134%]		 7.493ms 618.000op/s 7.875ms 588.375op/s
scenario:load:insecure-bank:profiling:high_load better
[-709.871µs; -399.506µs] or [-7.816%; -4.398%]		 unstable
[-31.725op/s; +97.538op/s] or [-6.207%; +19.083%]		 8.528ms 544.031op/s 9.083ms 511.125op/s
scenario:load:insecure-bank:iast_FULL:high_load worse
[+409.895µs; +1030.273µs] or [+2.868%; +7.208%]		 unstable
[-49.792op/s; +18.855op/s] or [-15.271%; +5.783%]		 15.013ms 310.594op/s 14.293ms 326.062op/s
scenario:load:insecure-bank:iast_GLOBAL:high_load worse
[+636.515µs; +1054.215µs] or [+6.197%; +10.264%]		 unstable
[-82.787op/s; +14.537op/s] or [-18.298%; +3.213%]		 11.116ms 418.312op/s 10.271ms 452.438op/s
scenario:load:petclinic:no_agent:high_load worse
[+0.913ms; +1.559ms] or [+2.444%; +4.172%]		 unstable
[-12.209op/s; +4.259op/s] or [-9.754%; +3.402%]		 38.589ms 121.200op/s 37.354ms 125.175op/s
scenario:load:petclinic:code_origins:high_load better
[-2.040ms; -1.211ms] or [-4.520%; -2.684%]		 unstable
[-3.590op/s; +11.440op/s] or [-3.462%; +11.032%]		 43.500ms 107.625op/s 45.125ms 103.700op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~5d856f199f, baseline=1.54.0-SNAPSHOT~1546940fb4
    dateFormat X
    axisFormat %s
section baseline
no_agent (37.354 ms) : 37054, 37653
.   : milestone, 37354,
appsec (50.603 ms) : 50155, 51050
.   : milestone, 50603,
code_origins (45.125 ms) : 44739, 45512
.   : milestone, 45125,
iast (45.618 ms) : 45196, 46039
.   : milestone, 45618,
profiling (48.047 ms) : 47614, 48479
.   : milestone, 48047,
tracing (43.488 ms) : 43111, 43866
.   : milestone, 43488,
section candidate
no_agent (38.589 ms) : 38289, 38889
.   : milestone, 38589,
appsec (50.117 ms) : 49662, 50571
.   : milestone, 50117,
code_origins (43.5 ms) : 43117, 43883
.   : milestone, 43500,
iast (44.538 ms) : 44152, 44924
.   : milestone, 44538,
profiling (48.967 ms) : 48521, 49414
.   : milestone, 48967,
tracing (43.929 ms) : 43567, 44290
.   : milestone, 43929,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 37.354 ms [37.054 ms, 37.653 ms] -
appsec 50.603 ms [50.155 ms, 51.05 ms] 13.249 ms (35.5%)
code_origins 45.125 ms [44.739 ms, 45.512 ms] 7.772 ms (20.8%)
iast 45.618 ms [45.196 ms, 46.039 ms] 8.264 ms (22.1%)
profiling 48.047 ms [47.614 ms, 48.479 ms] 10.693 ms (28.6%)
tracing 43.488 ms [43.111 ms, 43.866 ms] 6.135 ms (16.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 38.589 ms [38.289 ms, 38.889 ms] -
appsec 50.117 ms [49.662 ms, 50.571 ms] 11.527 ms (29.9%)
code_origins 43.5 ms [43.117 ms, 43.883 ms] 4.91 ms (12.7%)
iast 44.538 ms [44.152 ms, 44.924 ms] 5.949 ms (15.4%)
profiling 48.967 ms [48.521 ms, 49.414 ms] 10.378 ms (26.9%)
tracing 43.929 ms [43.567 ms, 44.29 ms] 5.339 ms (13.8%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~5d856f199f, baseline=1.54.0-SNAPSHOT~1546940fb4
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.55 ms) : 4496, 4604
.   : milestone, 4550,
iast (9.766 ms) : 9596, 9936
.   : milestone, 9766,
iast_FULL (14.293 ms) : 14012, 14574
.   : milestone, 14293,
iast_GLOBAL (10.271 ms) : 10090, 10451
.   : milestone, 10271,
profiling (9.083 ms) : 8937, 9228
.   : milestone, 9083,
tracing (7.875 ms) : 7754, 7996
.   : milestone, 7875,
section candidate
no_agent (4.473 ms) : 4410, 4535
.   : milestone, 4473,
iast (9.78 ms) : 9616, 9944
.   : milestone, 9780,
iast_FULL (15.013 ms) : 14718, 15308
.   : milestone, 15013,
iast_GLOBAL (11.116 ms) : 10909, 11323
.   : milestone, 11116,
profiling (8.528 ms) : 8385, 8671
.   : milestone, 8528,
tracing (7.493 ms) : 7389, 7596
.   : milestone, 7493,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.55 ms [4.496 ms, 4.604 ms] -
iast 9.766 ms [9.596 ms, 9.936 ms] 5.216 ms (114.6%)
iast_FULL 14.293 ms [14.012 ms, 14.574 ms] 9.743 ms (214.1%)
iast_GLOBAL 10.271 ms [10.09 ms, 10.451 ms] 5.721 ms (125.7%)
profiling 9.083 ms [8.937 ms, 9.228 ms] 4.533 ms (99.6%)
tracing 7.875 ms [7.754 ms, 7.996 ms] 3.325 ms (73.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.473 ms [4.41 ms, 4.535 ms] -
iast 9.78 ms [9.616 ms, 9.944 ms] 5.308 ms (118.7%)
iast_FULL 15.013 ms [14.718 ms, 15.308 ms] 10.541 ms (235.7%)
iast_GLOBAL 11.116 ms [10.909 ms, 11.323 ms] 6.643 ms (148.5%)
profiling 8.528 ms [8.385 ms, 8.671 ms] 4.055 ms (90.7%)
tracing 7.493 ms [7.389 ms, 7.596 ms] 3.02 ms (67.5%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/revert-kotlin-25-ea-workaround
git_commit_date 1759154643 1759155036
git_commit_sha 1546940 5d856f1
release_version 1.54.0-SNAPSHOT~1546940fb4 1.54.0-SNAPSHOT~5d856f199f
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1759157099 1759157099
ci_job_id 1152555168 1152555168
ci_pipeline_id 77836655 77836655
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-6-ngdr7fm0 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-6-ngdr7fm0 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~5d856f199f, baseline=1.54.0-SNAPSHOT~1546940fb4
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.482 ms) : 1470, 1493
.   : milestone, 1482,
appsec (3.709 ms) : 3491, 3926
.   : milestone, 3709,
iast (2.214 ms) : 2151, 2278
.   : milestone, 2214,
iast_GLOBAL (2.263 ms) : 2199, 2326
.   : milestone, 2263,
profiling (2.078 ms) : 2026, 2131
.   : milestone, 2078,
tracing (2.027 ms) : 1978, 2076
.   : milestone, 2027,
section candidate
no_agent (1.481 ms) : 1469, 1492
.   : milestone, 1481,
appsec (3.731 ms) : 3512, 3951
.   : milestone, 3731,
iast (2.205 ms) : 2143, 2268
.   : milestone, 2205,
iast_GLOBAL (2.249 ms) : 2186, 2312
.   : milestone, 2249,
profiling (2.083 ms) : 2031, 2136
.   : milestone, 2083,
tracing (2.039 ms) : 1990, 2088
.   : milestone, 2039,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.482 ms [1.47 ms, 1.493 ms] -
appsec 3.709 ms [3.491 ms, 3.926 ms] 2.227 ms (150.3%)
iast 2.214 ms [2.151 ms, 2.278 ms] 732.917 µs (49.5%)
iast_GLOBAL 2.263 ms [2.199 ms, 2.326 ms] 781.119 µs (52.7%)
profiling 2.078 ms [2.026 ms, 2.131 ms] 596.733 µs (40.3%)
tracing 2.027 ms [1.978 ms, 2.076 ms] 545.569 µs (36.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.481 ms [1.469 ms, 1.492 ms] -
appsec 3.731 ms [3.512 ms, 3.951 ms] 2.251 ms (152.0%)
iast 2.205 ms [2.143 ms, 2.268 ms] 724.991 µs (49.0%)
iast_GLOBAL 2.249 ms [2.186 ms, 2.312 ms] 768.06 µs (51.9%)
profiling 2.083 ms [2.031 ms, 2.136 ms] 602.97 µs (40.7%)
tracing 2.039 ms [1.99 ms, 2.088 ms] 558.255 µs (37.7%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~5d856f199f, baseline=1.54.0-SNAPSHOT~1546940fb4
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.885 s) : 14885000, 14885000
.   : milestone, 14885000,
appsec (15.005 s) : 15005000, 15005000
.   : milestone, 15005000,
iast (18.752 s) : 18752000, 18752000
.   : milestone, 18752000,
iast_GLOBAL (18.12 s) : 18120000, 18120000
.   : milestone, 18120000,
profiling (15.361 s) : 15361000, 15361000
.   : milestone, 15361000,
tracing (15.139 s) : 15139000, 15139000
.   : milestone, 15139000,
section candidate
no_agent (15.39 s) : 15390000, 15390000
.   : milestone, 15390000,
appsec (15.109 s) : 15109000, 15109000
.   : milestone, 15109000,
iast (18.478 s) : 18478000, 18478000
.   : milestone, 18478000,
iast_GLOBAL (17.515 s) : 17515000, 17515000
.   : milestone, 17515000,
profiling (15.441 s) : 15441000, 15441000
.   : milestone, 15441000,
tracing (15.414 s) : 15414000, 15414000
.   : milestone, 15414000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.885 s [14.885 s, 14.885 s] -
appsec 15.005 s [15.005 s, 15.005 s] 120.0 ms (0.8%)
iast 18.752 s [18.752 s, 18.752 s] 3.867 s (26.0%)
iast_GLOBAL 18.12 s [18.12 s, 18.12 s] 3.235 s (21.7%)
profiling 15.361 s [15.361 s, 15.361 s] 476.0 ms (3.2%)
tracing 15.139 s [15.139 s, 15.139 s] 254.0 ms (1.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.39 s [15.39 s, 15.39 s] -
appsec 15.109 s [15.109 s, 15.109 s] -281.0 ms (-1.8%)
iast 18.478 s [18.478 s, 18.478 s] 3.088 s (20.1%)
iast_GLOBAL 17.515 s [17.515 s, 17.515 s] 2.125 s (13.8%)
profiling 15.441 s [15.441 s, 15.441 s] 51.0 ms (0.3%)
tracing 15.414 s [15.414 s, 15.414 s] 24.0 ms (0.2%)

@sarahchen6 sarahchen6 marked this pull request as ready for review September 29, 2025 16:04
@sarahchen6 sarahchen6 requested a review from a team as a code owner September 29, 2025 16:04
@sarahchen6 sarahchen6 requested review from jpbempel and removed request for a team September 29, 2025 16:04
@sarahchen6 sarahchen6 merged commit a081948 into master Sep 29, 2025
388 of 391 checks passed
@sarahchen6 sarahchen6 deleted the sarahchen6/revert-kotlin-25-ea-workaround branch September 29, 2025 17:30
@github-actions github-actions bot added this to the 1.54.0 milestone Sep 29, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@jpbempel jpbempel jpbempel approved these changes

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD AlexeyKuznetsov-DD approved these changes

Assignees

No one assigned

Labels

comp: tooling Build & Tooling tag: do not merge Do not merge changes tag: no release notes Changes to exclude from release notes type: enhancement Enhancements and improvements

Projects

None yet

Milestone

1.54.0

Development

Successfully merging this pull request may close these issues.

4 participants

@sarahchen6 @jpbempel @AlexeyKuznetsov-DD