Fix units tests #9829

jpbempel · 2025-10-22T12:02:03Z

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any useful labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

datadog-official · 2025-10-22T12:29:31Z

🎯 Code Coverage
• Patch Coverage: 100.00%
• Total Coverage: 59.71% (-0.00%)

View detailed report

_{This comment will be updated automatically if new data arrives.

🔗 Commit SHA: 0998710 | Docs | Was this helpful? Give us feedback!}

pr-commenter · 2025-10-22T12:38:07Z

Debugger benchmarks

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
ci_job_date	1761136002	1761136347
end_time	2025-10-22T12:28:02	2025-10-22T12:33:49
git_branch	master	jpbempel/fix-tests
git_commit_sha	`6837f84`	`0998710`
start_time	2025-10-22T12:26:43	2025-10-22T12:32:28

See matching parameters

	Baseline	Candidate
ci_job_id	1191219397	1191219397
ci_pipeline_id	79949095	79949095
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date	1761134482	1761134482

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 9 metrics, 6 unstable metrics.

See unchanged results

scenario	Δ mean agg_http_req_duration_min	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p75	Δ mean agg_http_req_duration_p99	Δ mean throughput
scenario:noprobe	unstable [-19.096µs; +32.380µs] or [-6.844%; +11.605%]	unstable [-31.652µs; +47.849µs] or [-9.935%; +15.019%]	unstable [-43.261µs; +60.035µs] or [-12.972%; +18.002%]	unstable [-94.915µs; +134.729µs] or [-9.930%; +14.095%]	same
scenario:basic	same	unsure [+1.264µs; +15.523µs] or [+0.440%; +5.406%]	unsure [+2.846µs; +16.160µs] or [+0.959%; +5.447%]	unstable [-35.671µs; +123.906µs] or [-4.871%; +16.921%]	unstable [-294.093op/s; +30.935op/s] or [-11.176%; +1.176%]
scenario:loop	same	same	unsure [+2.784µs; +11.285µs] or [+0.031%; +0.125%]	same	same

Request duration reports for reports

gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (318.602 µs) : 284, 353
.   : milestone, 319,
basic (287.114 µs) : 280, 294
.   : milestone, 287,
loop (8.958 ms) : 8956, 8961
.   : milestone, 8958,
section candidate
noprobe (326.7 µs) : 286, 367
.   : milestone, 327,
basic (295.507 µs) : 289, 302
.   : milestone, 296,
loop (8.961 ms) : 8957, 8965
.   : milestone, 8961,

baseline results

Scenario	Request median duration [CI 0.99]
noprobe	318.602 µs [283.837 µs, 353.367 µs]
basic	287.114 µs [279.917 µs, 294.31 µs]
loop	8.958 ms [8.956 ms, 8.961 ms]

candidate results

Scenario	Request median duration [CI 0.99]
noprobe	326.7 µs [286.017 µs, 367.384 µs]
basic	295.507 µs [288.761 µs, 302.254 µs]
loop	8.961 ms [8.957 ms, 8.965 ms]

pr-commenter · 2025-10-22T12:53:59Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	jpbempel/fix-tests
git_commit_date	1761128374	1761134482
git_commit_sha	`6837f84`	`0998710`
release_version	1.55.0-SNAPSHOT~6837f840cb	1.55.0-SNAPSHOT~0998710747

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1761137263	1761137263
ci_job_id	1191219390	1191219390
ci_pipeline_id	79949095	79949095
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-fddp6rck 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-fddp6rck 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 60 metrics, 5 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.55.0-SNAPSHOT~0998710747, baseline=1.55.0-SNAPSHOT~6837f840cb

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.018 s) : 0, 1018060
Total [baseline] (8.672 s) : 0, 8672289
Agent [candidate] (1.018 s) : 0, 1018283
Total [candidate] (8.637 s) : 0, 8636508
section iast
Agent [baseline] (1.151 s) : 0, 1151153
Total [baseline] (9.272 s) : 0, 9272278
Agent [candidate] (1.149 s) : 0, 1148989
Total [candidate] (9.313 s) : 0, 9312650

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.018 s	-
Agent	iast	1.151 s	133.094 ms (13.1%)
Total	tracing	8.672 s	-
Total	iast	9.272 s	599.989 ms (6.9%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.018 s	-
Agent	iast	1.149 s	130.706 ms (12.8%)
Total	tracing	8.637 s	-
Total	iast	9.313 s	676.142 ms (7.8%)

gantt
    title insecure-bank - break down per module: candidate=1.55.0-SNAPSHOT~0998710747, baseline=1.55.0-SNAPSHOT~6837f840cb

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.46 ms) : 0, 1460
crashtracking [candidate] (1.452 ms) : 0, 1452
BytebuddyAgent [baseline] (692.358 ms) : 0, 692358
BytebuddyAgent [candidate] (693.335 ms) : 0, 693335
GlobalTracer [baseline] (242.585 ms) : 0, 242585
GlobalTracer [candidate] (243.144 ms) : 0, 243144
AppSec [baseline] (32.414 ms) : 0, 32414
AppSec [candidate] (32.205 ms) : 0, 32205
Debugger [baseline] (6.327 ms) : 0, 6327
Debugger [candidate] (6.251 ms) : 0, 6251
Remote Config [baseline] (686.47 µs) : 0, 686
Remote Config [candidate] (679.38 µs) : 0, 679
Telemetry [baseline] (9.355 ms) : 0, 9355
Telemetry [candidate] (9.363 ms) : 0, 9363
Flare Poller [baseline] (11.761 ms) : 0, 11761
Flare Poller [candidate] (10.75 ms) : 0, 10750
section iast
crashtracking [baseline] (1.486 ms) : 0, 1486
crashtracking [candidate] (1.485 ms) : 0, 1485
BytebuddyAgent [baseline] (815.007 ms) : 0, 815007
BytebuddyAgent [candidate] (813.931 ms) : 0, 813931
GlobalTracer [baseline] (231.452 ms) : 0, 231452
GlobalTracer [candidate] (230.86 ms) : 0, 230860
AppSec [baseline] (34.976 ms) : 0, 34976
AppSec [candidate] (34.967 ms) : 0, 34967
Debugger [baseline] (6.264 ms) : 0, 6264
Debugger [candidate] (6.16 ms) : 0, 6160
Remote Config [baseline] (633.472 µs) : 0, 633
Remote Config [candidate] (602.013 µs) : 0, 602
Telemetry [baseline] (8.831 ms) : 0, 8831
Telemetry [candidate] (8.659 ms) : 0, 8659
Flare Poller [baseline] (4.294 ms) : 0, 4294
Flare Poller [candidate] (4.291 ms) : 0, 4291
IAST [baseline] (26.77 ms) : 0, 26770
IAST [candidate] (26.636 ms) : 0, 26636

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.55.0-SNAPSHOT~0998710747, baseline=1.55.0-SNAPSHOT~6837f840cb

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.017 s) : 0, 1017310
Total [baseline] (10.642 s) : 0, 10642122
Agent [candidate] (1.027 s) : 0, 1026563
Total [candidate] (10.763 s) : 0, 10763120
section appsec
Agent [baseline] (1.21 s) : 0, 1209523
Total [baseline] (10.927 s) : 0, 10926561
Agent [candidate] (1.202 s) : 0, 1202101
Total [candidate] (10.874 s) : 0, 10873643
section iast
Agent [baseline] (1.151 s) : 0, 1151013
Total [baseline] (11.018 s) : 0, 11017739
Agent [candidate] (1.149 s) : 0, 1148915
Total [candidate] (11.084 s) : 0, 11084196
section profiling
Agent [baseline] (1.166 s) : 0, 1165895
Total [baseline] (10.8 s) : 0, 10800323
Agent [candidate] (1.172 s) : 0, 1172232
Total [candidate] (10.85 s) : 0, 10850294

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.017 s	-
Agent	appsec	1.21 s	192.213 ms (18.9%)
Agent	iast	1.151 s	133.703 ms (13.1%)
Agent	profiling	1.166 s	148.585 ms (14.6%)
Total	tracing	10.642 s	-
Total	appsec	10.927 s	284.439 ms (2.7%)
Total	iast	11.018 s	375.617 ms (3.5%)
Total	profiling	10.8 s	158.201 ms (1.5%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.027 s	-
Agent	appsec	1.202 s	175.538 ms (17.1%)
Agent	iast	1.149 s	122.352 ms (11.9%)
Agent	profiling	1.172 s	145.669 ms (14.2%)
Total	tracing	10.763 s	-
Total	appsec	10.874 s	110.524 ms (1.0%)
Total	iast	11.084 s	321.076 ms (3.0%)
Total	profiling	10.85 s	87.174 ms (0.8%)

gantt
    title petclinic - break down per module: candidate=1.55.0-SNAPSHOT~0998710747, baseline=1.55.0-SNAPSHOT~6837f840cb

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.462 ms) : 0, 1462
crashtracking [candidate] (1.471 ms) : 0, 1471
BytebuddyAgent [baseline] (693.922 ms) : 0, 693922
BytebuddyAgent [candidate] (700.678 ms) : 0, 700678
GlobalTracer [baseline] (242.244 ms) : 0, 242244
GlobalTracer [candidate] (244.85 ms) : 0, 244850
AppSec [baseline] (32.156 ms) : 0, 32156
AppSec [candidate] (32.321 ms) : 0, 32321
Debugger [baseline] (6.346 ms) : 0, 6346
Debugger [candidate] (6.301 ms) : 0, 6301
Remote Config [baseline] (684.839 µs) : 0, 685
Remote Config [candidate] (686.167 µs) : 0, 686
Telemetry [baseline] (9.194 ms) : 0, 9194
Telemetry [candidate] (9.265 ms) : 0, 9265
Flare Poller [baseline] (10.148 ms) : 0, 10148
Flare Poller [candidate] (9.661 ms) : 0, 9661
section appsec
crashtracking [baseline] (1.48 ms) : 0, 1480
crashtracking [candidate] (1.461 ms) : 0, 1461
BytebuddyAgent [baseline] (728.238 ms) : 0, 728238
BytebuddyAgent [candidate] (723.153 ms) : 0, 723153
GlobalTracer [baseline] (237.923 ms) : 0, 237923
GlobalTracer [candidate] (236.303 ms) : 0, 236303
IAST [baseline] (25.103 ms) : 0, 25103
IAST [candidate] (25.063 ms) : 0, 25063
AppSec [baseline] (176.003 ms) : 0, 176003
AppSec [candidate] (175.612 ms) : 0, 175612
Debugger [baseline] (6.113 ms) : 0, 6113
Debugger [candidate] (6.131 ms) : 0, 6131
Remote Config [baseline] (647.152 µs) : 0, 647
Remote Config [candidate] (629.566 µs) : 0, 630
Telemetry [baseline] (8.605 ms) : 0, 8605
Telemetry [candidate] (8.52 ms) : 0, 8520
Flare Poller [baseline] (3.963 ms) : 0, 3963
Flare Poller [candidate] (3.91 ms) : 0, 3910
section iast
crashtracking [baseline] (1.452 ms) : 0, 1452
crashtracking [candidate] (1.458 ms) : 0, 1458
BytebuddyAgent [baseline] (814.689 ms) : 0, 814689
BytebuddyAgent [candidate] (813.847 ms) : 0, 813847
GlobalTracer [baseline] (231.592 ms) : 0, 231592
GlobalTracer [candidate] (230.941 ms) : 0, 230941
IAST [baseline] (26.632 ms) : 0, 26632
IAST [candidate] (26.569 ms) : 0, 26569
AppSec [baseline] (35.342 ms) : 0, 35342
AppSec [candidate] (35.025 ms) : 0, 35025
Debugger [baseline] (6.172 ms) : 0, 6172
Debugger [candidate] (6.116 ms) : 0, 6116
Remote Config [baseline] (608.184 µs) : 0, 608
Remote Config [candidate] (602.63 µs) : 0, 603
Telemetry [baseline] (8.822 ms) : 0, 8822
Telemetry [candidate] (8.662 ms) : 0, 8662
Flare Poller [baseline] (4.191 ms) : 0, 4191
Flare Poller [candidate] (4.25 ms) : 0, 4250
section profiling
crashtracking [baseline] (1.474 ms) : 0, 1474
crashtracking [candidate] (1.48 ms) : 0, 1480
BytebuddyAgent [baseline] (720.99 ms) : 0, 720990
BytebuddyAgent [candidate] (726.267 ms) : 0, 726267
GlobalTracer [baseline] (219.179 ms) : 0, 219179
GlobalTracer [candidate] (220.415 ms) : 0, 220415
AppSec [baseline] (32.362 ms) : 0, 32362
AppSec [candidate] (32.572 ms) : 0, 32572
Debugger [baseline] (6.722 ms) : 0, 6722
Debugger [candidate] (8.319 ms) : 0, 8319
Remote Config [baseline] (698.85 µs) : 0, 699
Remote Config [candidate] (686.207 µs) : 0, 686
Telemetry [baseline] (15.896 ms) : 0, 15896
Telemetry [candidate] (14.533 ms) : 0, 14533
Flare Poller [baseline] (4.238 ms) : 0, 4238
Flare Poller [candidate] (4.175 ms) : 0, 4175
ProfilingAgent [baseline] (110.416 ms) : 0, 110416
ProfilingAgent [candidate] (109.563 ms) : 0, 109563
Profiling [baseline] (111.055 ms) : 0, 111055
Profiling [candidate] (110.168 ms) : 0, 110168

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	jpbempel/fix-tests
git_commit_date	1761128374	1761134482
git_commit_sha	`6837f84`	`0998710`
release_version	1.55.0-SNAPSHOT~6837f840cb	1.55.0-SNAPSHOT~0998710747

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1761136939	1761136939
ci_job_id	1191219391	1191219391
ci_pipeline_id	79949095	79949095
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-bszx3mjo 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-bszx3mjo 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 12 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:petclinic:appsec:high_load	better [-2.330ms; -1.422ms] or [-4.811%; -2.936%]	unstable [-0.501op/s; +13.456op/s] or [-0.518%; +13.926%]	46.549ms	103.103op/s	48.425ms	96.625op/s

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.55.0-SNAPSHOT~0998710747, baseline=1.55.0-SNAPSHOT~6837f840cb
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.355 ms) : 4298, 4412
.   : milestone, 4355,
iast (9.401 ms) : 9248, 9554
.   : milestone, 9401,
iast_FULL (14.154 ms) : 13868, 14441
.   : milestone, 14154,
iast_GLOBAL (10.78 ms) : 10580, 10981
.   : milestone, 10780,
profiling (8.911 ms) : 8772, 9049
.   : milestone, 8911,
tracing (7.632 ms) : 7507, 7756
.   : milestone, 7632,
section candidate
no_agent (4.362 ms) : 4314, 4411
.   : milestone, 4362,
iast (9.425 ms) : 9261, 9589
.   : milestone, 9425,
iast_FULL (14.076 ms) : 13797, 14355
.   : milestone, 14076,
iast_GLOBAL (10.903 ms) : 10704, 11102
.   : milestone, 10903,
profiling (8.915 ms) : 8768, 9062
.   : milestone, 8915,
tracing (7.702 ms) : 7592, 7813
.   : milestone, 7702,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.355 ms [4.298 ms, 4.412 ms]	-
iast	9.401 ms [9.248 ms, 9.554 ms]	5.046 ms (115.8%)
iast_FULL	14.154 ms [13.868 ms, 14.441 ms]	9.799 ms (225.0%)
iast_GLOBAL	10.78 ms [10.58 ms, 10.981 ms]	6.425 ms (147.5%)
profiling	8.911 ms [8.772 ms, 9.049 ms]	4.555 ms (104.6%)
tracing	7.632 ms [7.507 ms, 7.756 ms]	3.276 ms (75.2%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.362 ms [4.314 ms, 4.411 ms]	-
iast	9.425 ms [9.261 ms, 9.589 ms]	5.063 ms (116.0%)
iast_FULL	14.076 ms [13.797 ms, 14.355 ms]	9.714 ms (222.7%)
iast_GLOBAL	10.903 ms [10.704 ms, 11.102 ms]	6.54 ms (149.9%)
profiling	8.915 ms [8.768 ms, 9.062 ms]	4.553 ms (104.4%)
tracing	7.702 ms [7.592 ms, 7.813 ms]	3.34 ms (76.6%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.55.0-SNAPSHOT~0998710747, baseline=1.55.0-SNAPSHOT~6837f840cb
    dateFormat X
    axisFormat %s
section baseline
no_agent (36.799 ms) : 36506, 37092
.   : milestone, 36799,
appsec (48.425 ms) : 47986, 48864
.   : milestone, 48425,
code_origins (44.011 ms) : 43639, 44382
.   : milestone, 44011,
iast (46.915 ms) : 46508, 47322
.   : milestone, 46915,
profiling (49.333 ms) : 48839, 49828
.   : milestone, 49333,
tracing (43.763 ms) : 43389, 44137
.   : milestone, 43763,
section candidate
no_agent (37.254 ms) : 36960, 37549
.   : milestone, 37254,
appsec (46.549 ms) : 46145, 46954
.   : milestone, 46549,
code_origins (43.2 ms) : 42826, 43574
.   : milestone, 43200,
iast (46.043 ms) : 45644, 46442
.   : milestone, 46043,
profiling (49.842 ms) : 49378, 50305
.   : milestone, 49842,
tracing (44.574 ms) : 44188, 44960
.   : milestone, 44574,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	36.799 ms [36.506 ms, 37.092 ms]	-
appsec	48.425 ms [47.986 ms, 48.864 ms]	11.626 ms (31.6%)
code_origins	44.011 ms [43.639 ms, 44.382 ms]	7.211 ms (19.6%)
iast	46.915 ms [46.508 ms, 47.322 ms]	10.115 ms (27.5%)
profiling	49.333 ms [48.839 ms, 49.828 ms]	12.534 ms (34.1%)
tracing	43.763 ms [43.389 ms, 44.137 ms]	6.964 ms (18.9%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	37.254 ms [36.96 ms, 37.549 ms]	-
appsec	46.549 ms [46.145 ms, 46.954 ms]	9.295 ms (25.0%)
code_origins	43.2 ms [42.826 ms, 43.574 ms]	5.946 ms (16.0%)
iast	46.043 ms [45.644 ms, 46.442 ms]	8.789 ms (23.6%)
profiling	49.842 ms [49.378 ms, 50.305 ms]	12.587 ms (33.8%)
tracing	44.574 ms [44.188 ms, 44.96 ms]	7.32 ms (19.6%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	jpbempel/fix-tests
git_commit_date	1761128374	1761134482
git_commit_sha	`6837f84`	`0998710`
release_version	1.55.0-SNAPSHOT~6837f840cb	1.55.0-SNAPSHOT~0998710747

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1761137486	1761137486
ci_job_id	1191219392	1191219392
ci_pipeline_id	79949095	79949095
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-2-nt57q1uv 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-2-nt57q1uv 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.55.0-SNAPSHOT~0998710747, baseline=1.55.0-SNAPSHOT~6837f840cb
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.477 ms) : 1465, 1488
.   : milestone, 1477,
appsec (2.455 ms) : 2403, 2506
.   : milestone, 2455,
iast (2.21 ms) : 2146, 2274
.   : milestone, 2210,
iast_GLOBAL (2.252 ms) : 2187, 2316
.   : milestone, 2252,
profiling (2.068 ms) : 2015, 2120
.   : milestone, 2068,
tracing (2.025 ms) : 1975, 2075
.   : milestone, 2025,
section candidate
no_agent (1.469 ms) : 1457, 1480
.   : milestone, 1469,
appsec (2.452 ms) : 2400, 2503
.   : milestone, 2452,
iast (2.213 ms) : 2149, 2278
.   : milestone, 2213,
iast_GLOBAL (2.256 ms) : 2192, 2320
.   : milestone, 2256,
profiling (2.076 ms) : 2022, 2129
.   : milestone, 2076,
tracing (2.019 ms) : 1969, 2068
.   : milestone, 2019,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.477 ms [1.465 ms, 1.488 ms]	-
appsec	2.455 ms [2.403 ms, 2.506 ms]	977.7 µs (66.2%)
iast	2.21 ms [2.146 ms, 2.274 ms]	733.285 µs (49.7%)
iast_GLOBAL	2.252 ms [2.187 ms, 2.316 ms]	774.648 µs (52.5%)
profiling	2.068 ms [2.015 ms, 2.12 ms]	591.046 µs (40.0%)
tracing	2.025 ms [1.975 ms, 2.075 ms]	548.389 µs (37.1%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.469 ms [1.457 ms, 1.48 ms]	-
appsec	2.452 ms [2.4 ms, 2.503 ms]	983.084 µs (66.9%)
iast	2.213 ms [2.149 ms, 2.278 ms]	744.647 µs (50.7%)
iast_GLOBAL	2.256 ms [2.192 ms, 2.32 ms]	787.182 µs (53.6%)
profiling	2.076 ms [2.022 ms, 2.129 ms]	606.684 µs (41.3%)
tracing	2.019 ms [1.969 ms, 2.068 ms]	549.714 µs (37.4%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.55.0-SNAPSHOT~0998710747, baseline=1.55.0-SNAPSHOT~6837f840cb
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.998 s) : 14998000, 14998000
.   : milestone, 14998000,
appsec (15.023 s) : 15023000, 15023000
.   : milestone, 15023000,
iast (18.683 s) : 18683000, 18683000
.   : milestone, 18683000,
iast_GLOBAL (17.745 s) : 17745000, 17745000
.   : milestone, 17745000,
profiling (15.501 s) : 15501000, 15501000
.   : milestone, 15501000,
tracing (15.08 s) : 15080000, 15080000
.   : milestone, 15080000,
section candidate
no_agent (15.511 s) : 15511000, 15511000
.   : milestone, 15511000,
appsec (14.787 s) : 14787000, 14787000
.   : milestone, 14787000,
iast (18.683 s) : 18683000, 18683000
.   : milestone, 18683000,
iast_GLOBAL (17.732 s) : 17732000, 17732000
.   : milestone, 17732000,
profiling (15.554 s) : 15554000, 15554000
.   : milestone, 15554000,
tracing (14.761 s) : 14761000, 14761000
.   : milestone, 14761000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.998 s [14.998 s, 14.998 s]	-
appsec	15.023 s [15.023 s, 15.023 s]	25.0 ms (0.2%)
iast	18.683 s [18.683 s, 18.683 s]	3.685 s (24.6%)
iast_GLOBAL	17.745 s [17.745 s, 17.745 s]	2.747 s (18.3%)
profiling	15.501 s [15.501 s, 15.501 s]	503.0 ms (3.4%)
tracing	15.08 s [15.08 s, 15.08 s]	82.0 ms (0.5%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.511 s [15.511 s, 15.511 s]	-
appsec	14.787 s [14.787 s, 14.787 s]	-724.0 ms (-4.7%)
iast	18.683 s [18.683 s, 18.683 s]	3.172 s (20.5%)
iast_GLOBAL	17.732 s [17.732 s, 17.732 s]	2.221 s (14.3%)
profiling	15.554 s [15.554 s, 15.554 s]	43.0 ms (0.3%)
tracing	14.761 s [14.761 s, 14.761 s]	-750.0 ms (-4.8%)

Fix units tests

0998710

jpbempel added the type: bug Bug report and fix label Oct 22, 2025

jpbempel requested a review from a team as a code owner October 22, 2025 12:02

jpbempel added comp: testing Testing tag: no release notes Changes to exclude from release notes labels Oct 22, 2025

jpbempel requested review from ojung and removed request for a team October 22, 2025 12:02

jpbempel added the comp: debugger Dynamic Instrumentation label Oct 22, 2025

PerfectSlayer removed the comp: testing Testing label Oct 22, 2025

PerfectSlayer approved these changes Oct 22, 2025

View reviewed changes

jpbempel merged commit 2a41c8b into master Oct 22, 2025
703 of 710 checks passed

jpbempel deleted the jpbempel/fix-tests branch October 22, 2025 14:40

github-actions bot added this to the 1.55.0 milestone Oct 22, 2025

amarziali pushed a commit that referenced this pull request Oct 27, 2025

Fix units tests (#9829)

640b8ba

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Fix units tests #9829

Fix units tests #9829

Uh oh!

jpbempel commented Oct 22, 2025

Uh oh!

datadog-official bot commented Oct 22, 2025 •

edited

Loading

Uh oh!

pr-commenter bot commented Oct 22, 2025

Uh oh!

pr-commenter bot commented Oct 22, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Fix units tests #9829

Fix units tests #9829

Uh oh!

Conversation

jpbempel commented Oct 22, 2025

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

datadog-official bot commented Oct 22, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

pr-commenter bot commented Oct 22, 2025

Debugger benchmarks

Parameters

Summary

Uh oh!

pr-commenter bot commented Oct 22, 2025

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

datadog-official bot commented Oct 22, 2025 •

edited

Loading