Skip to content

Revert "Update ddapm-test-agent from v1.11.0 to v1.24.1 (#9043)" #9084

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 3 commits into from
Closed

Revert "Update ddapm-test-agent from v1.11.0 to v1.24.1 (#9043)" #9084

wants to merge 3 commits into from

Conversation

@AlexeyKuznetsov-DD
Copy link
Contributor

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD commented Jul 2, 2025 •
edited by randomanderson
Loading

This reverts commit 0f66a88.

What Does This Do

After upgrade service container not able to come up, so better to revert to working version. The service error was hidden logic flaw in check_agent_results.sh. The script assumes if the test-agent is not running, it was not supposed to run because only certain jobs use the test-agent. A followup PR will correct the logic

Motivation

Additional Notes

We need to investigate why service container can not start after version update and what is the root cause of error:

 Failed: Error: failed to create containerd task: failed to create shim task: ENOENT: No such file or directory

Stack backtrace: 0: <unknown> 1: <unknown> 2: <unknown> 3: <unknown> 4: <unknown> 5: <unknown>

Stack backtrace: 0: <unknown> 1: <unknown> 2: <unknown> 3: <unknown> 4: <unknown> 5: <unknown> 6: <unknown> 7: <unknown> 8: <unknown> 9: <unknown> 10: <unknown> 11: <unknown> 12: <unknown> 13: <unknown>

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD self-assigned this Jul 2, 2025
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD added comp: core Tracer core tag: no release notes Changes to exclude from release notes labels Jul 2, 2025
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD marked this pull request as ready for review July 2, 2025 14:06
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD requested review from a team as code owners July 2, 2025 14:06
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD requested review from PerfectSlayer and erikayasuda and removed request for a team July 2, 2025 14:06
@PerfectSlayer
Copy link
Contributor

Quick question: what was the rational to revert the upgrade?

mcculls
mcculls approved these changes Jul 2, 2025
View reviewed changes
Copy link
Contributor

@mcculls mcculls left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could you add the motivation, for people who might look at upgrading this in the future

@AlexeyKuznetsov-DD
Copy link
Contributor Author

Quick question: what was the rational to revert the upgrade?

Added

@pr-commenter
Copy link

pr-commenter bot commented Jul 2, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/revert-ddapm-test-agent-upgrade
git_commit_date 1751472328 1751474400
git_commit_sha 0c891b7 ec9c09d
release_version 1.51.0-SNAPSHOT~0c891b79c1 1.51.0-SNAPSHOT~ec9c09df34
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1751476183 1751476183
ci_job_id 1010502403 1010502403
ci_pipeline_id 69466948 69466948
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-cw2yl-8y-project-304-concurrent-0-43gj313j 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-cw2yl-8y-project-304-concurrent-0-43gj313j 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 45 metrics, 8 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.51.0-SNAPSHOT~ec9c09df34, baseline=1.51.0-SNAPSHOT~0c891b79c1

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (997.747 ms) : 0, 997747
Total [baseline] (10.703 s) : 0, 10703413
Agent [candidate] (999.973 ms) : 0, 999973
Total [candidate] (10.686 s) : 0, 10686469
section appsec
Agent [baseline] (1.177 s) : 0, 1177374
Total [baseline] (10.821 s) : 0, 10820659
Agent [candidate] (1.18 s) : 0, 1179978
Total [candidate] (10.799 s) : 0, 10799069
section iast
Agent [baseline] (1.142 s) : 0, 1142213
Total [baseline] (10.866 s) : 0, 10865515
Agent [candidate] (1.138 s) : 0, 1138425
Total [candidate] (10.828 s) : 0, 10828357
section profiling
Agent [baseline] (1.257 s) : 0, 1257132
Total [baseline] (11.155 s) : 0, 11154686
Agent [candidate] (1.246 s) : 0, 1246223
Total [candidate] (11.014 s) : 0, 11014167
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 997.747 ms -
Agent appsec 1.177 s 179.627 ms (18.0%)
Agent iast 1.142 s 144.467 ms (14.5%)
Agent profiling 1.257 s 259.385 ms (26.0%)
Total tracing 10.703 s -
Total appsec 10.821 s 117.246 ms (1.1%)
Total iast 10.866 s 162.102 ms (1.5%)
Total profiling 11.155 s 451.273 ms (4.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 999.973 ms -
Agent appsec 1.18 s 180.005 ms (18.0%)
Agent iast 1.138 s 138.452 ms (13.8%)
Agent profiling 1.246 s 246.25 ms (24.6%)
Total tracing 10.686 s -
Total appsec 10.799 s 112.601 ms (1.1%)
Total iast 10.828 s 141.888 ms (1.3%)
Total profiling 11.014 s 327.698 ms (3.1%) 
gantt
    title petclinic - break down per module: candidate=1.51.0-SNAPSHOT~ec9c09df34, baseline=1.51.0-SNAPSHOT~0c891b79c1

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (688.683 ms) : 0, 688683
BytebuddyAgent [candidate] (690.517 ms) : 0, 690517
GlobalTracer [baseline] (243.134 ms) : 0, 243134
GlobalTracer [candidate] (243.322 ms) : 0, 243322
AppSec [baseline] (30.285 ms) : 0, 30285
AppSec [candidate] (30.295 ms) : 0, 30295
Debugger [baseline] (5.987 ms) : 0, 5987
Debugger [candidate] (6.044 ms) : 0, 6044
Remote Config [baseline] (677.78 µs) : 0, 678
Remote Config [candidate] (682.513 µs) : 0, 683
Telemetry [baseline] (8.217 ms) : 0, 8217
Telemetry [candidate] (8.244 ms) : 0, 8244
section appsec
BytebuddyAgent [baseline] (712.066 ms) : 0, 712066
BytebuddyAgent [candidate] (713.542 ms) : 0, 713542
GlobalTracer [baseline] (236.304 ms) : 0, 236304
GlobalTracer [candidate] (236.937 ms) : 0, 236937
AppSec [baseline] (171.456 ms) : 0, 171456
AppSec [candidate] (171.85 ms) : 0, 171850
Debugger [baseline] (5.803 ms) : 0, 5803
Debugger [candidate] (5.801 ms) : 0, 5801
Remote Config [baseline] (603.942 µs) : 0, 604
Remote Config [candidate] (605.962 µs) : 0, 606
Telemetry [baseline] (8.152 ms) : 0, 8152
Telemetry [candidate] (8.117 ms) : 0, 8117
IAST [baseline] (22.182 ms) : 0, 22182
IAST [candidate] (22.274 ms) : 0, 22274
section iast
BytebuddyAgent [baseline] (814.962 ms) : 0, 814962
BytebuddyAgent [candidate] (814.274 ms) : 0, 814274
GlobalTracer [baseline] (235.443 ms) : 0, 235443
GlobalTracer [candidate] (233.767 ms) : 0, 233767
AppSec [baseline] (28.847 ms) : 0, 28847
AppSec [candidate] (27.412 ms) : 0, 27412
Debugger [baseline] (5.876 ms) : 0, 5876
Debugger [candidate] (5.79 ms) : 0, 5790
Remote Config [baseline] (592.874 µs) : 0, 593
Remote Config [candidate] (585.37 µs) : 0, 585
Telemetry [baseline] (8.08 ms) : 0, 8080
Telemetry [candidate] (7.957 ms) : 0, 7957
IAST [baseline] (26.681 ms) : 0, 26681
IAST [candidate] (27.755 ms) : 0, 27755
section profiling
BytebuddyAgent [baseline] (685.193 ms) : 0, 685193
BytebuddyAgent [candidate] (678.381 ms) : 0, 678381
GlobalTracer [baseline] (365.064 ms) : 0, 365064
GlobalTracer [candidate] (362.418 ms) : 0, 362418
AppSec [baseline] (33.115 ms) : 0, 33115
AppSec [candidate] (30.841 ms) : 0, 30841
Debugger [baseline] (9.879 ms) : 0, 9879
Debugger [candidate] (11.538 ms) : 0, 11538
Remote Config [baseline] (1.59 ms) : 0, 1590
Remote Config [candidate] (1.38 ms) : 0, 1380
Telemetry [baseline] (8.869 ms) : 0, 8869
Telemetry [candidate] (9.529 ms) : 0, 9529
ProfilingAgent [baseline] (104.259 ms) : 0, 104259
ProfilingAgent [candidate] (103.559 ms) : 0, 103559
Profiling [baseline] (104.285 ms) : 0, 104285
Profiling [candidate] (103.583 ms) : 0, 103583
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.51.0-SNAPSHOT~ec9c09df34, baseline=1.51.0-SNAPSHOT~0c891b79c1

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (996.415 ms) : 0, 996415
Total [baseline] (8.591 s) : 0, 8590622
Agent [candidate] (1.004 s) : 0, 1004286
Total [candidate] (8.635 s) : 0, 8635270
section iast
Agent [baseline] (1.131 s) : 0, 1131033
Total [baseline] (9.257 s) : 0, 9256896
Agent [candidate] (1.133 s) : 0, 1133429
Total [candidate] (9.282 s) : 0, 9281701
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 996.415 ms -
Agent iast 1.131 s 134.618 ms (13.5%)
Total tracing 8.591 s -
Total iast 9.257 s 666.275 ms (7.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.004 s -
Agent iast 1.133 s 129.143 ms (12.9%)
Total tracing 8.635 s -
Total iast 9.282 s 646.431 ms (7.5%) 
gantt
    title insecure-bank - break down per module: candidate=1.51.0-SNAPSHOT~ec9c09df34, baseline=1.51.0-SNAPSHOT~0c891b79c1

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (687.981 ms) : 0, 687981
BytebuddyAgent [candidate] (692.689 ms) : 0, 692689
GlobalTracer [baseline] (242.274 ms) : 0, 242274
GlobalTracer [candidate] (244.847 ms) : 0, 244847
AppSec [baseline] (30.461 ms) : 0, 30461
AppSec [candidate] (30.727 ms) : 0, 30727
Debugger [baseline] (6.029 ms) : 0, 6029
Debugger [candidate] (6.082 ms) : 0, 6082
Remote Config [baseline] (668.454 µs) : 0, 668
Remote Config [candidate] (681.607 µs) : 0, 682
Telemetry [baseline] (8.192 ms) : 0, 8192
Telemetry [candidate] (8.279 ms) : 0, 8279
section iast
BytebuddyAgent [baseline] (807.586 ms) : 0, 807586
BytebuddyAgent [candidate] (809.074 ms) : 0, 809074
GlobalTracer [baseline] (233.326 ms) : 0, 233326
GlobalTracer [candidate] (233.274 ms) : 0, 233274
AppSec [baseline] (25.77 ms) : 0, 25770
AppSec [candidate] (28.538 ms) : 0, 28538
Debugger [baseline] (5.835 ms) : 0, 5835
Debugger [candidate] (5.884 ms) : 0, 5884
Remote Config [baseline] (581.57 µs) : 0, 582
Remote Config [candidate] (594.413 µs) : 0, 594
Telemetry [baseline] (7.93 ms) : 0, 7930
Telemetry [candidate] (8.084 ms) : 0, 8084
IAST [baseline] (29.241 ms) : 0, 29241
IAST [candidate] (27.159 ms) : 0, 27159
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/revert-ddapm-test-agent-upgrade
git_commit_date 1751472328 1751474400
git_commit_sha 0c891b7 ec9c09d
release_version 1.51.0-SNAPSHOT~0c891b79c1 1.51.0-SNAPSHOT~ec9c09df34
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1751475855 1751475855
ci_job_id 1010502404 1010502404
ci_pipeline_id 69466948 69466948
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-cw2yl-8y-project-304-concurrent-1-8i9cwstp 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-cw2yl-8y-project-304-concurrent-1-8i9cwstp 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 2 performance regressions! Performance is the same for 8 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:petclinic:appsec:high_load worse
[+1.654ms; +2.524ms] or [+3.663%; +5.587%]		 unstable
[-11.975op/s; +2.850op/s] or [-11.564%; +2.752%]		 47.260ms 98.987op/s 45.171ms 103.550op/s
scenario:load:petclinic:iast:high_load better
[-2.079ms; -1.266ms] or [-4.661%; -2.839%]		 unstable
[-3.383op/s; +11.458op/s] or [-3.225%; +10.921%]		 42.919ms 108.963op/s 44.592ms 104.925op/s
scenario:load:petclinic:code_origins:high_load better
[-2.650ms; -1.803ms] or [-5.667%; -3.855%]		 unstable
[-2.077op/s; +12.002op/s] or [-2.076%; +11.993%]		 44.536ms 105.037op/s 46.763ms 100.075op/s
scenario:load:petclinic:profiling:high_load worse
[+2.916ms; +3.883ms] or [+6.302%; +8.391%]		 unstable
[-14.008op/s; +0.433op/s] or [-13.857%; +0.428%]		 49.675ms 94.300op/s 46.276ms 101.088op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.51.0-SNAPSHOT~ec9c09df34, baseline=1.51.0-SNAPSHOT~0c891b79c1
    dateFormat X
    axisFormat %s
section baseline
no_agent (36.351 ms) : 36058, 36644
.   : milestone, 36351,
appsec (45.171 ms) : 44772, 45570
.   : milestone, 45171,
code_origins (46.763 ms) : 46357, 47168
.   : milestone, 46763,
iast (44.592 ms) : 44209, 44975
.   : milestone, 44592,
profiling (46.276 ms) : 45849, 46703
.   : milestone, 46276,
tracing (44.519 ms) : 44154, 44885
.   : milestone, 44519,
section candidate
no_agent (35.524 ms) : 35237, 35811
.   : milestone, 35524,
appsec (47.26 ms) : 46851, 47669
.   : milestone, 47260,
code_origins (44.536 ms) : 44155, 44918
.   : milestone, 44536,
iast (42.919 ms) : 42547, 43291
.   : milestone, 42919,
profiling (49.675 ms) : 49205, 50146
.   : milestone, 49675,
tracing (43.997 ms) : 43617, 44377
.   : milestone, 43997,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 36.351 ms [36.058 ms, 36.644 ms] -
appsec 45.171 ms [44.772 ms, 45.57 ms] 8.82 ms (24.3%)
code_origins 46.763 ms [46.357 ms, 47.168 ms] 10.412 ms (28.6%)
iast 44.592 ms [44.209 ms, 44.975 ms] 8.241 ms (22.7%)
profiling 46.276 ms [45.849 ms, 46.703 ms] 9.925 ms (27.3%)
tracing 44.519 ms [44.154 ms, 44.885 ms] 8.168 ms (22.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 35.524 ms [35.237 ms, 35.811 ms] -
appsec 47.26 ms [46.851 ms, 47.669 ms] 11.736 ms (33.0%)
code_origins 44.536 ms [44.155 ms, 44.918 ms] 9.012 ms (25.4%)
iast 42.919 ms [42.547 ms, 43.291 ms] 7.395 ms (20.8%)
profiling 49.675 ms [49.205 ms, 50.146 ms] 14.151 ms (39.8%)
tracing 43.997 ms [43.617 ms, 44.377 ms] 8.473 ms (23.9%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.51.0-SNAPSHOT~ec9c09df34, baseline=1.51.0-SNAPSHOT~0c891b79c1
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.313 ms) : 4266, 4361
.   : milestone, 4313,
iast (9.11 ms) : 8961, 9260
.   : milestone, 9110,
iast_FULL (14.093 ms) : 13814, 14373
.   : milestone, 14093,
iast_GLOBAL (10.098 ms) : 9912, 10284
.   : milestone, 10098,
profiling (8.638 ms) : 8508, 8769
.   : milestone, 8638,
tracing (7.703 ms) : 7590, 7816
.   : milestone, 7703,
section candidate
no_agent (4.415 ms) : 4365, 4464
.   : milestone, 4415,
iast (9.36 ms) : 9208, 9511
.   : milestone, 9360,
iast_FULL (14.164 ms) : 13888, 14440
.   : milestone, 14164,
iast_GLOBAL (10.185 ms) : 10009, 10361
.   : milestone, 10185,
profiling (8.759 ms) : 8616, 8903
.   : milestone, 8759,
tracing (7.775 ms) : 7662, 7889
.   : milestone, 7775,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.313 ms [4.266 ms, 4.361 ms] -
iast 9.11 ms [8.961 ms, 9.26 ms] 4.797 ms (111.2%)
iast_FULL 14.093 ms [13.814 ms, 14.373 ms] 9.78 ms (226.7%)
iast_GLOBAL 10.098 ms [9.912 ms, 10.284 ms] 5.784 ms (134.1%)
profiling 8.638 ms [8.508 ms, 8.769 ms] 4.325 ms (100.3%)
tracing 7.703 ms [7.59 ms, 7.816 ms] 3.39 ms (78.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.415 ms [4.365 ms, 4.464 ms] -
iast 9.36 ms [9.208 ms, 9.511 ms] 4.945 ms (112.0%)
iast_FULL 14.164 ms [13.888 ms, 14.44 ms] 9.749 ms (220.8%)
iast_GLOBAL 10.185 ms [10.009 ms, 10.361 ms] 5.77 ms (130.7%)
profiling 8.759 ms [8.616 ms, 8.903 ms] 4.344 ms (98.4%)
tracing 7.775 ms [7.662 ms, 7.889 ms] 3.361 ms (76.1%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/revert-ddapm-test-agent-upgrade
git_commit_date 1751472328 1751474400
git_commit_sha 0c891b7 ec9c09d
release_version 1.51.0-SNAPSHOT~0c891b79c1 1.51.0-SNAPSHOT~ec9c09df34
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1751476370 1751476370
ci_job_id 1010502405 1010502405
ci_pipeline_id 69466948 69466948
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zemipyz3-project-304-concurrent-0-5ozl9sqw 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zemipyz3-project-304-concurrent-0-5ozl9sqw 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.51.0-SNAPSHOT~ec9c09df34, baseline=1.51.0-SNAPSHOT~0c891b79c1
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.47 ms) : 1459, 1481
.   : milestone, 1470,
appsec (2.399 ms) : 2350, 2449
.   : milestone, 2399,
iast (2.179 ms) : 2117, 2240
.   : milestone, 2179,
iast_GLOBAL (2.225 ms) : 2163, 2287
.   : milestone, 2225,
profiling (2.035 ms) : 1984, 2086
.   : milestone, 2035,
tracing (2.018 ms) : 1970, 2067
.   : milestone, 2018,
section candidate
no_agent (1.471 ms) : 1460, 1483
.   : milestone, 1471,
appsec (2.398 ms) : 2349, 2448
.   : milestone, 2398,
iast (2.187 ms) : 2124, 2249
.   : milestone, 2187,
iast_GLOBAL (2.232 ms) : 2170, 2294
.   : milestone, 2232,
profiling (2.037 ms) : 1987, 2088
.   : milestone, 2037,
tracing (2.018 ms) : 1969, 2066
.   : milestone, 2018,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.47 ms [1.459 ms, 1.481 ms] -
appsec 2.399 ms [2.35 ms, 2.449 ms] 929.173 µs (63.2%)
iast 2.179 ms [2.117 ms, 2.24 ms] 708.704 µs (48.2%)
iast_GLOBAL 2.225 ms [2.163 ms, 2.287 ms] 755.489 µs (51.4%)
profiling 2.035 ms [1.984 ms, 2.086 ms] 565.379 µs (38.5%)
tracing 2.018 ms [1.97 ms, 2.067 ms] 548.169 µs (37.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.471 ms [1.46 ms, 1.483 ms] -
appsec 2.398 ms [2.349 ms, 2.448 ms] 926.814 µs (63.0%)
iast 2.187 ms [2.124 ms, 2.249 ms] 715.259 µs (48.6%)
iast_GLOBAL 2.232 ms [2.17 ms, 2.294 ms] 760.624 µs (51.7%)
profiling 2.037 ms [1.987 ms, 2.088 ms] 566.096 µs (38.5%)
tracing 2.018 ms [1.969 ms, 2.066 ms] 546.417 µs (37.1%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.51.0-SNAPSHOT~ec9c09df34, baseline=1.51.0-SNAPSHOT~0c891b79c1
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.989 s) : 14989000, 14989000
.   : milestone, 14989000,
appsec (14.795 s) : 14795000, 14795000
.   : milestone, 14795000,
iast (18.466 s) : 18466000, 18466000
.   : milestone, 18466000,
iast_GLOBAL (18.15 s) : 18150000, 18150000
.   : milestone, 18150000,
profiling (15.883 s) : 15883000, 15883000
.   : milestone, 15883000,
tracing (14.815 s) : 14815000, 14815000
.   : milestone, 14815000,
section candidate
no_agent (15.225 s) : 15225000, 15225000
.   : milestone, 15225000,
appsec (14.852 s) : 14852000, 14852000
.   : milestone, 14852000,
iast (18.267 s) : 18267000, 18267000
.   : milestone, 18267000,
iast_GLOBAL (18.192 s) : 18192000, 18192000
.   : milestone, 18192000,
profiling (15.345 s) : 15345000, 15345000
.   : milestone, 15345000,
tracing (14.989 s) : 14989000, 14989000
.   : milestone, 14989000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.989 s [14.989 s, 14.989 s] -
appsec 14.795 s [14.795 s, 14.795 s] -194.0 ms (-1.3%)
iast 18.466 s [18.466 s, 18.466 s] 3.477 s (23.2%)
iast_GLOBAL 18.15 s [18.15 s, 18.15 s] 3.161 s (21.1%)
profiling 15.883 s [15.883 s, 15.883 s] 894.0 ms (6.0%)
tracing 14.815 s [14.815 s, 14.815 s] -174.0 ms (-1.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.225 s [15.225 s, 15.225 s] -
appsec 14.852 s [14.852 s, 14.852 s] -373.0 ms (-2.4%)
iast 18.267 s [18.267 s, 18.267 s] 3.042 s (20.0%)
iast_GLOBAL 18.192 s [18.192 s, 18.192 s] 2.967 s (19.5%)
profiling 15.345 s [15.345 s, 15.345 s] 120.0 ms (0.8%)
tracing 14.989 s [14.989 s, 14.989 s] -236.0 ms (-1.6%)

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD deleted the alexeyk/revert-ddapm-test-agent-upgrade branch July 2, 2025 18:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@mcculls mcculls mcculls approved these changes

@randomanderson randomanderson randomanderson approved these changes

@erikayasuda erikayasuda Awaiting requested review from erikayasuda erikayasuda is a code owner automatically assigned from DataDog/apm-release-platform

@PerfectSlayer PerfectSlayer Awaiting requested review from PerfectSlayer PerfectSlayer is a code owner automatically assigned from DataDog/apm-java

Assignees

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD

Labels

comp: core Tracer core tag: no release notes Changes to exclude from release notes

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

5 participants

@AlexeyKuznetsov-DD @PerfectSlayer @mcculls @randomanderson