Give executable permissions to the system-tests script #9820

sarahchen6 · 2025-10-21T17:26:55Z

What Does This Do

Give executable permission to update_system_test_reference.sh

Motivation

TIL that this permission needs to be pushed to CI...

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any useful labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

datadog-official · 2025-10-21T17:57:48Z

🎯 Code Coverage
• Patch Coverage: 100.00%
• Total Coverage: 59.69% (-0.01%)

View detailed report

_{This comment will be updated automatically if new data arrives.

🔗 Commit SHA: a0ffaf2 | Docs | Was this helpful? Give us feedback!}

pr-commenter · 2025-10-21T18:17:51Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	sarahchen6/fix-system-tests-script
git_commit_date	1761066823	1761067475
git_commit_sha	`57e4640`	`a0ffaf2`
release_version	1.55.0-SNAPSHOT~57e4640efd	1.55.0-SNAPSHOT~a0ffaf2277

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1761070404	1761070404
ci_job_id	1189622691	1189622691
ci_pipeline_id	79866082	79866082
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-cm07e6oc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-cm07e6oc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 60 metrics, 5 unstable metrics.

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.55.0-SNAPSHOT~a0ffaf2277, baseline=1.55.0-SNAPSHOT~57e4640efd

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.028 s) : 0, 1028281
Total [baseline] (10.715 s) : 0, 10715176
Agent [candidate] (1.017 s) : 0, 1017256
Total [candidate] (10.595 s) : 0, 10594767
section appsec
Agent [baseline] (1.196 s) : 0, 1196092
Total [baseline] (10.849 s) : 0, 10848757
Agent [candidate] (1.203 s) : 0, 1203205
Total [candidate] (10.832 s) : 0, 10832045
section iast
Agent [baseline] (1.162 s) : 0, 1161802
Total [baseline] (11.002 s) : 0, 11001574
Agent [candidate] (1.151 s) : 0, 1150984
Total [candidate] (10.986 s) : 0, 10986460
section profiling
Agent [baseline] (1.165 s) : 0, 1164866
Total [baseline] (10.887 s) : 0, 10887099
Agent [candidate] (1.163 s) : 0, 1163447
Total [candidate] (10.823 s) : 0, 10822970

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.028 s	-
Agent	appsec	1.196 s	167.811 ms (16.3%)
Agent	iast	1.162 s	133.521 ms (13.0%)
Agent	profiling	1.165 s	136.584 ms (13.3%)
Total	tracing	10.715 s	-
Total	appsec	10.849 s	133.581 ms (1.2%)
Total	iast	11.002 s	286.398 ms (2.7%)
Total	profiling	10.887 s	171.923 ms (1.6%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.017 s	-
Agent	appsec	1.203 s	185.949 ms (18.3%)
Agent	iast	1.151 s	133.728 ms (13.1%)
Agent	profiling	1.163 s	146.191 ms (14.4%)
Total	tracing	10.595 s	-
Total	appsec	10.832 s	237.278 ms (2.2%)
Total	iast	10.986 s	391.693 ms (3.7%)
Total	profiling	10.823 s	228.203 ms (2.2%)

gantt
    title petclinic - break down per module: candidate=1.55.0-SNAPSHOT~a0ffaf2277, baseline=1.55.0-SNAPSHOT~57e4640efd

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.477 ms) : 0, 1477
crashtracking [candidate] (1.436 ms) : 0, 1436
BytebuddyAgent [baseline] (701.374 ms) : 0, 701374
BytebuddyAgent [candidate] (693.131 ms) : 0, 693131
GlobalTracer [baseline] (244.157 ms) : 0, 244157
GlobalTracer [candidate] (242.818 ms) : 0, 242818
AppSec [baseline] (32.403 ms) : 0, 32403
AppSec [candidate] (32.232 ms) : 0, 32232
Debugger [baseline] (6.387 ms) : 0, 6387
Debugger [candidate] (6.261 ms) : 0, 6261
Remote Config [baseline] (674.464 µs) : 0, 674
Remote Config [candidate] (679.831 µs) : 0, 680
Telemetry [baseline] (9.371 ms) : 0, 9371
Telemetry [candidate] (9.206 ms) : 0, 9206
Flare Poller [baseline] (11.078 ms) : 0, 11078
Flare Poller [candidate] (10.349 ms) : 0, 10349
section appsec
crashtracking [baseline] (1.443 ms) : 0, 1443
crashtracking [candidate] (1.46 ms) : 0, 1460
BytebuddyAgent [baseline] (719.39 ms) : 0, 719390
BytebuddyAgent [candidate] (724.496 ms) : 0, 724496
GlobalTracer [baseline] (235.059 ms) : 0, 235059
GlobalTracer [candidate] (236.238 ms) : 0, 236238
IAST [baseline] (24.823 ms) : 0, 24823
IAST [candidate] (25.083 ms) : 0, 25083
AppSec [baseline] (175.11 ms) : 0, 175110
AppSec [candidate] (175.397 ms) : 0, 175397
Debugger [baseline] (6.046 ms) : 0, 6046
Debugger [candidate] (6.085 ms) : 0, 6085
Remote Config [baseline] (622.295 µs) : 0, 622
Remote Config [candidate] (631.14 µs) : 0, 631
Telemetry [baseline] (8.46 ms) : 0, 8460
Telemetry [candidate] (8.642 ms) : 0, 8642
Flare Poller [baseline] (3.973 ms) : 0, 3973
Flare Poller [candidate] (3.934 ms) : 0, 3934
section iast
crashtracking [baseline] (1.47 ms) : 0, 1470
crashtracking [candidate] (1.453 ms) : 0, 1453
BytebuddyAgent [baseline] (822.9 ms) : 0, 822900
BytebuddyAgent [candidate] (815.252 ms) : 0, 815252
GlobalTracer [baseline] (233.569 ms) : 0, 233569
GlobalTracer [candidate] (231.213 ms) : 0, 231213
IAST [baseline] (26.964 ms) : 0, 26964
IAST [candidate] (27.669 ms) : 0, 27669
AppSec [baseline] (35.357 ms) : 0, 35357
AppSec [candidate] (34.328 ms) : 0, 34328
Debugger [baseline] (6.171 ms) : 0, 6171
Debugger [candidate] (6.124 ms) : 0, 6124
Remote Config [baseline] (614.638 µs) : 0, 615
Remote Config [candidate] (593.827 µs) : 0, 594
Telemetry [baseline] (8.862 ms) : 0, 8862
Telemetry [candidate] (8.604 ms) : 0, 8604
Flare Poller [baseline] (4.306 ms) : 0, 4306
Flare Poller [candidate] (4.32 ms) : 0, 4320
section profiling
crashtracking [baseline] (1.452 ms) : 0, 1452
crashtracking [candidate] (1.472 ms) : 0, 1472
BytebuddyAgent [baseline] (720.746 ms) : 0, 720746
BytebuddyAgent [candidate] (720.841 ms) : 0, 720841
GlobalTracer [baseline] (219.277 ms) : 0, 219277
GlobalTracer [candidate] (218.537 ms) : 0, 218537
AppSec [baseline] (32.428 ms) : 0, 32428
AppSec [candidate] (32.217 ms) : 0, 32217
Debugger [baseline] (6.756 ms) : 0, 6756
Debugger [candidate] (6.69 ms) : 0, 6690
Remote Config [baseline] (729.845 µs) : 0, 730
Remote Config [candidate] (684.267 µs) : 0, 684
Telemetry [baseline] (15.646 ms) : 0, 15646
Telemetry [candidate] (15.996 ms) : 0, 15996
Flare Poller [baseline] (4.226 ms) : 0, 4226
Flare Poller [candidate] (4.191 ms) : 0, 4191
ProfilingAgent [baseline] (109.866 ms) : 0, 109866
ProfilingAgent [candidate] (109.057 ms) : 0, 109057
Profiling [baseline] (110.494 ms) : 0, 110494
Profiling [candidate] (109.7 ms) : 0, 109700

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.55.0-SNAPSHOT~a0ffaf2277, baseline=1.55.0-SNAPSHOT~57e4640efd

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.017 s) : 0, 1016914
Total [baseline] (8.669 s) : 0, 8669079
Agent [candidate] (1.019 s) : 0, 1019488
Total [candidate] (8.645 s) : 0, 8645067
section iast
Agent [baseline] (1.15 s) : 0, 1149980
Total [baseline] (9.298 s) : 0, 9298453
Agent [candidate] (1.159 s) : 0, 1158532
Total [candidate] (9.281 s) : 0, 9280545

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.017 s	-
Agent	iast	1.15 s	133.066 ms (13.1%)
Total	tracing	8.669 s	-
Total	iast	9.298 s	629.373 ms (7.3%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.019 s	-
Agent	iast	1.159 s	139.045 ms (13.6%)
Total	tracing	8.645 s	-
Total	iast	9.281 s	635.478 ms (7.4%)

gantt
    title insecure-bank - break down per module: candidate=1.55.0-SNAPSHOT~a0ffaf2277, baseline=1.55.0-SNAPSHOT~57e4640efd

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.472 ms) : 0, 1472
crashtracking [candidate] (1.453 ms) : 0, 1453
BytebuddyAgent [baseline] (693.277 ms) : 0, 693277
BytebuddyAgent [candidate] (694.264 ms) : 0, 694264
GlobalTracer [baseline] (242.496 ms) : 0, 242496
GlobalTracer [candidate] (243.079 ms) : 0, 243079
AppSec [baseline] (32.143 ms) : 0, 32143
AppSec [candidate] (32.371 ms) : 0, 32371
Debugger [baseline] (6.294 ms) : 0, 6294
Debugger [candidate] (6.329 ms) : 0, 6329
Remote Config [baseline] (675.657 µs) : 0, 676
Remote Config [candidate] (675.702 µs) : 0, 676
Telemetry [baseline] (9.28 ms) : 0, 9280
Telemetry [candidate] (9.284 ms) : 0, 9284
Flare Poller [baseline] (10.168 ms) : 0, 10168
Flare Poller [candidate] (10.888 ms) : 0, 10888
section iast
crashtracking [baseline] (1.472 ms) : 0, 1472
crashtracking [candidate] (1.486 ms) : 0, 1486
BytebuddyAgent [baseline] (814.028 ms) : 0, 814028
BytebuddyAgent [candidate] (820.523 ms) : 0, 820523
GlobalTracer [baseline] (231.413 ms) : 0, 231413
GlobalTracer [candidate] (232.875 ms) : 0, 232875
IAST [baseline] (26.748 ms) : 0, 26748
IAST [candidate] (27.015 ms) : 0, 27015
AppSec [baseline] (35.177 ms) : 0, 35177
AppSec [candidate] (35.202 ms) : 0, 35202
Debugger [baseline] (6.148 ms) : 0, 6148
Debugger [candidate] (6.19 ms) : 0, 6190
Remote Config [baseline] (593.924 µs) : 0, 594
Remote Config [candidate] (598.229 µs) : 0, 598
Telemetry [baseline] (8.713 ms) : 0, 8713
Telemetry [candidate] (8.928 ms) : 0, 8928
Flare Poller [baseline] (4.291 ms) : 0, 4291
Flare Poller [candidate] (4.257 ms) : 0, 4257

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	sarahchen6/fix-system-tests-script
git_commit_date	1761066823	1761067475
git_commit_sha	`57e4640`	`a0ffaf2`
release_version	1.55.0-SNAPSHOT~57e4640efd	1.55.0-SNAPSHOT~a0ffaf2277

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1761069996	1761069996
ci_job_id	1189622694	1189622694
ci_pipeline_id	79866082	79866082
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-6219klpt 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-6219klpt 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 2 performance regressions! Performance is the same for 8 metrics, 12 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:insecure-bank:iast_FULL:high_load	worse [+300.817µs; +903.573µs] or [+2.178%; +6.543%]	unstable [-51.132op/s; +23.007op/s] or [-15.150%; +6.817%]	14.412ms	323.438op/s	13.810ms	337.500op/s
scenario:load:petclinic:no_agent:high_load	worse [+1.434ms; +2.098ms] or [+3.899%; +5.703%]	unstable [-14.065op/s; +2.465op/s] or [-11.063%; +1.939%]	38.552ms	121.338op/s	36.786ms	127.138op/s
scenario:load:petclinic:appsec:high_load	better [-2.021ms; -1.099ms] or [-4.062%; -2.210%]	unstable [-3.411op/s; +9.486op/s] or [-3.625%; +10.081%]	48.184ms	97.138op/s	49.744ms	94.100op/s
scenario:load:petclinic:profiling:high_load	better [-2.591ms; -1.625ms] or [-5.280%; -3.312%]	unstable [-2.626op/s; +11.126op/s] or [-2.752%; +11.662%]	46.962ms	99.650op/s	49.070ms	95.400op/s

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.55.0-SNAPSHOT~a0ffaf2277, baseline=1.55.0-SNAPSHOT~57e4640efd
    dateFormat X
    axisFormat %s
section baseline
no_agent (36.786 ms) : 36484, 37089
.   : milestone, 36786,
appsec (49.744 ms) : 49298, 50189
.   : milestone, 49744,
code_origins (42.616 ms) : 42255, 42978
.   : milestone, 42616,
iast (45.574 ms) : 45166, 45981
.   : milestone, 45574,
profiling (49.07 ms) : 48625, 49515
.   : milestone, 49070,
tracing (43.551 ms) : 43182, 43920
.   : milestone, 43551,
section candidate
no_agent (38.552 ms) : 38239, 38866
.   : milestone, 38552,
appsec (48.184 ms) : 47774, 48593
.   : milestone, 48184,
code_origins (43.18 ms) : 42813, 43547
.   : milestone, 43180,
iast (46.367 ms) : 45939, 46795
.   : milestone, 46367,
profiling (46.962 ms) : 46510, 47414
.   : milestone, 46962,
tracing (44.069 ms) : 43674, 44464
.   : milestone, 44069,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	36.786 ms [36.484 ms, 37.089 ms]	-
appsec	49.744 ms [49.298 ms, 50.189 ms]	12.957 ms (35.2%)
code_origins	42.616 ms [42.255 ms, 42.978 ms]	5.83 ms (15.8%)
iast	45.574 ms [45.166 ms, 45.981 ms]	8.787 ms (23.9%)
profiling	49.07 ms [48.625 ms, 49.515 ms]	12.284 ms (33.4%)
tracing	43.551 ms [43.182 ms, 43.92 ms]	6.765 ms (18.4%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	38.552 ms [38.239 ms, 38.866 ms]	-
appsec	48.184 ms [47.774 ms, 48.593 ms]	9.631 ms (25.0%)
code_origins	43.18 ms [42.813 ms, 43.547 ms]	4.628 ms (12.0%)
iast	46.367 ms [45.939 ms, 46.795 ms]	7.815 ms (20.3%)
profiling	46.962 ms [46.51 ms, 47.414 ms]	8.409 ms (21.8%)
tracing	44.069 ms [43.674 ms, 44.464 ms]	5.516 ms (14.3%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.55.0-SNAPSHOT~a0ffaf2277, baseline=1.55.0-SNAPSHOT~57e4640efd
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.42 ms) : 4369, 4470
.   : milestone, 4420,
iast (9.801 ms) : 9637, 9965
.   : milestone, 9801,
iast_FULL (13.81 ms) : 13540, 14080
.   : milestone, 13810,
iast_GLOBAL (10.958 ms) : 10760, 11155
.   : milestone, 10958,
profiling (8.948 ms) : 8809, 9088
.   : milestone, 8948,
tracing (7.839 ms) : 7719, 7959
.   : milestone, 7839,
section candidate
no_agent (4.329 ms) : 4278, 4381
.   : milestone, 4329,
iast (9.487 ms) : 9330, 9644
.   : milestone, 9487,
iast_FULL (14.412 ms) : 14122, 14702
.   : milestone, 14412,
iast_GLOBAL (10.635 ms) : 10446, 10825
.   : milestone, 10635,
profiling (9.009 ms) : 8867, 9151
.   : milestone, 9009,
tracing (7.711 ms) : 7600, 7823
.   : milestone, 7711,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.42 ms [4.369 ms, 4.47 ms]	-
iast	9.801 ms [9.637 ms, 9.965 ms]	5.382 ms (121.8%)
iast_FULL	13.81 ms [13.54 ms, 14.08 ms]	9.39 ms (212.5%)
iast_GLOBAL	10.958 ms [10.76 ms, 11.155 ms]	6.538 ms (147.9%)
profiling	8.948 ms [8.809 ms, 9.088 ms]	4.529 ms (102.5%)
tracing	7.839 ms [7.719 ms, 7.959 ms]	3.419 ms (77.4%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.329 ms [4.278 ms, 4.381 ms]	-
iast	9.487 ms [9.33 ms, 9.644 ms]	5.157 ms (119.1%)
iast_FULL	14.412 ms [14.122 ms, 14.702 ms]	10.083 ms (232.9%)
iast_GLOBAL	10.635 ms [10.446 ms, 10.825 ms]	6.306 ms (145.7%)
profiling	9.009 ms [8.867 ms, 9.151 ms]	4.68 ms (108.1%)
tracing	7.711 ms [7.6 ms, 7.823 ms]	3.382 ms (78.1%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	sarahchen6/fix-system-tests-script
git_commit_date	1761066823	1761067475
git_commit_sha	`57e4640`	`a0ffaf2`
release_version	1.55.0-SNAPSHOT~57e4640efd	1.55.0-SNAPSHOT~a0ffaf2277

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1761070593	1761070593
ci_job_id	1189622696	1189622696
ci_pipeline_id	79866082	79866082
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-mam6a4il 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-mam6a4il 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.55.0-SNAPSHOT~a0ffaf2277, baseline=1.55.0-SNAPSHOT~57e4640efd
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.472 s) : 15472000, 15472000
.   : milestone, 15472000,
appsec (14.874 s) : 14874000, 14874000
.   : milestone, 14874000,
iast (18.555 s) : 18555000, 18555000
.   : milestone, 18555000,
iast_GLOBAL (17.941 s) : 17941000, 17941000
.   : milestone, 17941000,
profiling (15.674 s) : 15674000, 15674000
.   : milestone, 15674000,
tracing (15.075 s) : 15075000, 15075000
.   : milestone, 15075000,
section candidate
no_agent (15.053 s) : 15053000, 15053000
.   : milestone, 15053000,
appsec (14.762 s) : 14762000, 14762000
.   : milestone, 14762000,
iast (18.277 s) : 18277000, 18277000
.   : milestone, 18277000,
iast_GLOBAL (18.289 s) : 18289000, 18289000
.   : milestone, 18289000,
profiling (15.158 s) : 15158000, 15158000
.   : milestone, 15158000,
tracing (14.957 s) : 14957000, 14957000
.   : milestone, 14957000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.472 s [15.472 s, 15.472 s]	-
appsec	14.874 s [14.874 s, 14.874 s]	-598.0 ms (-3.9%)
iast	18.555 s [18.555 s, 18.555 s]	3.083 s (19.9%)
iast_GLOBAL	17.941 s [17.941 s, 17.941 s]	2.469 s (16.0%)
profiling	15.674 s [15.674 s, 15.674 s]	202.0 ms (1.3%)
tracing	15.075 s [15.075 s, 15.075 s]	-397.0 ms (-2.6%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.053 s [15.053 s, 15.053 s]	-
appsec	14.762 s [14.762 s, 14.762 s]	-291.0 ms (-1.9%)
iast	18.277 s [18.277 s, 18.277 s]	3.224 s (21.4%)
iast_GLOBAL	18.289 s [18.289 s, 18.289 s]	3.236 s (21.5%)
profiling	15.158 s [15.158 s, 15.158 s]	105.0 ms (0.7%)
tracing	14.957 s [14.957 s, 14.957 s]	-96.0 ms (-0.6%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.55.0-SNAPSHOT~a0ffaf2277, baseline=1.55.0-SNAPSHOT~57e4640efd
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.478 ms) : 1466, 1489
.   : milestone, 1478,
appsec (3.645 ms) : 3432, 3857
.   : milestone, 3645,
iast (2.206 ms) : 2143, 2270
.   : milestone, 2206,
iast_GLOBAL (2.244 ms) : 2180, 2307
.   : milestone, 2244,
profiling (2.053 ms) : 2002, 2104
.   : milestone, 2053,
tracing (2.021 ms) : 1972, 2071
.   : milestone, 2021,
section candidate
no_agent (1.481 ms) : 1470, 1493
.   : milestone, 1481,
appsec (3.703 ms) : 3485, 3920
.   : milestone, 3703,
iast (2.198 ms) : 2135, 2261
.   : milestone, 2198,
iast_GLOBAL (2.253 ms) : 2190, 2317
.   : milestone, 2253,
profiling (2.047 ms) : 1997, 2098
.   : milestone, 2047,
tracing (2.021 ms) : 1972, 2070
.   : milestone, 2021,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.478 ms [1.466 ms, 1.489 ms]	-
appsec	3.645 ms [3.432 ms, 3.857 ms]	2.167 ms (146.6%)
iast	2.206 ms [2.143 ms, 2.27 ms]	728.54 µs (49.3%)
iast_GLOBAL	2.244 ms [2.18 ms, 2.307 ms]	765.844 µs (51.8%)
profiling	2.053 ms [2.002 ms, 2.104 ms]	575.427 µs (38.9%)
tracing	2.021 ms [1.972 ms, 2.071 ms]	543.46 µs (36.8%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.481 ms [1.47 ms, 1.493 ms]	-
appsec	3.703 ms [3.485 ms, 3.92 ms]	2.222 ms (150.0%)
iast	2.198 ms [2.135 ms, 2.261 ms]	717.217 µs (48.4%)
iast_GLOBAL	2.253 ms [2.19 ms, 2.317 ms]	772.1 µs (52.1%)
profiling	2.047 ms [1.997 ms, 2.098 ms]	565.96 µs (38.2%)
tracing	2.021 ms [1.972 ms, 2.07 ms]	539.909 µs (36.4%)

Give executable permissions

a0ffaf2

sarahchen6 requested a review from a team as a code owner October 21, 2025 17:26

sarahchen6 requested a review from amarziali October 21, 2025 17:26

sarahchen6 added type: bug Bug report and fix tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels Oct 21, 2025

sarahchen6 requested a review from AlexeyKuznetsov-DD October 21, 2025 17:27

AlexeyKuznetsov-DD approved these changes Oct 21, 2025

View reviewed changes

sarahchen6 enabled auto-merge (squash) October 21, 2025 17:45

sarahchen6 merged commit ab3fd93 into master Oct 21, 2025
540 of 542 checks passed

sarahchen6 deleted the sarahchen6/fix-system-tests-script branch October 21, 2025 18:29

github-actions bot added this to the 1.55.0 milestone Oct 21, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Give executable permissions to the system-tests script #9820

Give executable permissions to the system-tests script #9820

Uh oh!

sarahchen6 commented Oct 21, 2025 •

edited

Loading

Uh oh!

datadog-official bot commented Oct 21, 2025 •

edited by datadog-datadog-prod-us1 bot

Loading

Uh oh!

pr-commenter bot commented Oct 21, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Give executable permissions to the system-tests script #9820

Give executable permissions to the system-tests script #9820

Uh oh!

Conversation

sarahchen6 commented Oct 21, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

datadog-official bot commented Oct 21, 2025 • edited by datadog-datadog-prod-us1 bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

pr-commenter bot commented Oct 21, 2025

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

sarahchen6 commented Oct 21, 2025 •

edited

Loading

datadog-official bot commented Oct 21, 2025 •

edited by datadog-datadog-prod-us1 bot

Loading