Skip to content

Conversation

sezen-datadog
Copy link
Contributor

@sezen-datadog sezen-datadog commented May 16, 2025

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: APPSEC-57259

@sezen-datadog sezen-datadog force-pushed the sezen.leblay/APPSEC-57259 branch 2 times, most recently from 891c835 to a2809f5 Compare May 16, 2025 13:40
@pr-commenter
Copy link

pr-commenter bot commented May 16, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sezen.leblay/APPSEC-57259
git_commit_date 1746789389 1749037898
git_commit_sha ad6d5fe cab7bfe
release_version 1.50.0-SNAPSHOT~ad6d5fef42 1.50.0-SNAPSHOT~cab7bfe297
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1749040343 1749040343
ci_job_id 967307418 967307418
ci_pipeline_id 66920181 66920181
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-ul4n-y4k-project-304-concurrent-1-iay1xjmu 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-ul4n-y4k-project-304-concurrent-1-iay1xjmu 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 2 performance improvements and 2 performance regressions! Performance is the same for 55 metrics, 12 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:AppSec better
[-8.608ms; -5.164ms] or [-15.395%; -9.235%]
49.027ms 55.913ms
scenario:startup:insecure-bank:tracing:AppSec worse
[+1.345ms; +5.151ms] or [+2.477%; +9.489%]
57.536ms 54.288ms
scenario:startup:petclinic:profiling:GlobalTracer better
[-23.730ms; -17.034ms] or [-6.225%; -4.469%]
360.802ms 381.184ms
scenario:startup:petclinic:profiling:AppSec worse
[+5.362ms; +9.052ms] or [+9.891%; +16.696%]
61.419ms 54.213ms
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.50.0-SNAPSHOT~cab7bfe297, baseline=1.50.0-SNAPSHOT~ad6d5fef42

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.021 s) : 0, 1020555
Total [baseline] (11.031 s) : 0, 11030857
Agent [candidate] (1.021 s) : 0, 1021229
Total [candidate] (11.189 s) : 0, 11188907
section appsec
Agent [baseline] (1.157 s) : 0, 1157353
Total [baseline] (11.202 s) : 0, 11202086
Agent [candidate] (1.164 s) : 0, 1164267
Total [candidate] (11.245 s) : 0, 11244894
section iast
Agent [baseline] (1.149 s) : 0, 1149484
Total [baseline] (11.318 s) : 0, 11317532
Agent [candidate] (1.149 s) : 0, 1149204
Total [candidate] (11.39 s) : 0, 11389579
section profiling
Agent [baseline] (1.294 s) : 0, 1293532
Total [baseline] (11.416 s) : 0, 11416222
Agent [candidate] (1.268 s) : 0, 1268059
Total [candidate] (11.452 s) : 0, 11452467
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.021 s -
Agent appsec 1.157 s 136.798 ms (13.4%)
Agent iast 1.149 s 128.929 ms (12.6%)
Agent profiling 1.294 s 272.977 ms (26.7%)
Total tracing 11.031 s -
Total appsec 11.202 s 171.229 ms (1.6%)
Total iast 11.318 s 286.675 ms (2.6%)
Total profiling 11.416 s 385.365 ms (3.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.021 s -
Agent appsec 1.164 s 143.038 ms (14.0%)
Agent iast 1.149 s 127.975 ms (12.5%)
Agent profiling 1.268 s 246.83 ms (24.2%)
Total tracing 11.189 s -
Total appsec 11.245 s 55.987 ms (0.5%)
Total iast 11.39 s 200.672 ms (1.8%)
Total profiling 11.452 s 263.56 ms (2.4%)
gantt
    title petclinic - break down per module: candidate=1.50.0-SNAPSHOT~cab7bfe297, baseline=1.50.0-SNAPSHOT~ad6d5fef42

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (681.292 ms) : 0, 681292
BytebuddyAgent [candidate] (684.075 ms) : 0, 684075
GlobalTracer [baseline] (239.181 ms) : 0, 239181
GlobalTracer [candidate] (240.578 ms) : 0, 240578
AppSec [baseline] (54.562 ms) : 0, 54562
AppSec [candidate] (56.242 ms) : 0, 56242
Debugger [baseline] (11.234 ms) : 0, 11234
Debugger [candidate] (6.197 ms) : 0, 6197
Remote Config [baseline] (697.897 µs) : 0, 698
Remote Config [candidate] (726.523 µs) : 0, 727
Telemetry [baseline] (9.995 ms) : 0, 9995
Telemetry [candidate] (9.879 ms) : 0, 9879
section appsec
BytebuddyAgent [baseline] (698.066 ms) : 0, 698066
BytebuddyAgent [candidate] (701.639 ms) : 0, 701639
GlobalTracer [baseline] (235.849 ms) : 0, 235849
GlobalTracer [candidate] (237.519 ms) : 0, 237519
AppSec [baseline] (175.223 ms) : 0, 175223
AppSec [candidate] (176.676 ms) : 0, 176676
Debugger [baseline] (5.908 ms) : 0, 5908
Debugger [candidate] (5.95 ms) : 0, 5950
Remote Config [baseline] (634.54 µs) : 0, 635
Remote Config [candidate] (634.58 µs) : 0, 635
Telemetry [baseline] (7.354 ms) : 0, 7354
Telemetry [candidate] (7.347 ms) : 0, 7347
IAST [baseline] (21.771 ms) : 0, 21771
IAST [candidate] (21.74 ms) : 0, 21740
section iast
BytebuddyAgent [baseline] (802.466 ms) : 0, 802466
BytebuddyAgent [candidate] (801.275 ms) : 0, 801275
GlobalTracer [baseline] (230.227 ms) : 0, 230227
GlobalTracer [candidate] (230.515 ms) : 0, 230515
AppSec [baseline] (50.285 ms) : 0, 50285
AppSec [candidate] (53.201 ms) : 0, 53201
Debugger [baseline] (5.944 ms) : 0, 5944
Debugger [candidate] (5.985 ms) : 0, 5985
Remote Config [baseline] (617.188 µs) : 0, 617
Remote Config [candidate] (584.407 µs) : 0, 584
Telemetry [baseline] (7.971 ms) : 0, 7971
Telemetry [candidate] (7.873 ms) : 0, 7873
IAST [baseline] (27.77 ms) : 0, 27770
IAST [candidate] (26.235 ms) : 0, 26235
section profiling
ProfilingAgent [baseline] (109.084 ms) : 0, 109084
ProfilingAgent [candidate] (105.117 ms) : 0, 105117
BytebuddyAgent [baseline] (683.156 ms) : 0, 683156
BytebuddyAgent [candidate] (675.119 ms) : 0, 675119
GlobalTracer [baseline] (381.184 ms) : 0, 381184
GlobalTracer [candidate] (360.802 ms) : 0, 360802
AppSec [baseline] (54.213 ms) : 0, 54213
AppSec [candidate] (61.419 ms) : 0, 61419
Debugger [baseline] (6.113 ms) : 0, 6113
Debugger [candidate] (6.093 ms) : 0, 6093
Remote Config [baseline] (661.527 µs) : 0, 662
Remote Config [candidate] (646.915 µs) : 0, 647
Telemetry [baseline] (8.096 ms) : 0, 8096
Telemetry [candidate] (8.125 ms) : 0, 8125
Profiling [baseline] (109.108 ms) : 0, 109108
Profiling [candidate] (105.142 ms) : 0, 105142
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.50.0-SNAPSHOT~cab7bfe297, baseline=1.50.0-SNAPSHOT~ad6d5fef42

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.019 s) : 0, 1018797
Total [baseline] (8.475 s) : 0, 8475132
Agent [candidate] (1.023 s) : 0, 1023303
Total [candidate] (8.488 s) : 0, 8488326
section iast
Agent [baseline] (1.148 s) : 0, 1147507
Total [baseline] (9.15 s) : 0, 9150467
Agent [candidate] (1.164 s) : 0, 1163615
Total [candidate] (9.165 s) : 0, 9165448
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.149 s) : 0, 1148637
Total [baseline] (9.086 s) : 0, 9085529
Agent [candidate] (1.156 s) : 0, 1156434
Total [candidate] (9.128 s) : 0, 9127924
section iast_TELEMETRY_OFF
Agent [baseline] (1.144 s) : 0, 1143633
Total [baseline] (9.25 s) : 0, 9249936
Agent [candidate] (1.146 s) : 0, 1146139
Total [candidate] (9.192 s) : 0, 9192449
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.019 s -
Agent iast 1.148 s 128.71 ms (12.6%)
Agent iast_HARDCODED_SECRET_DISABLED 1.149 s 129.84 ms (12.7%)
Agent iast_TELEMETRY_OFF 1.144 s 124.837 ms (12.3%)
Total tracing 8.475 s -
Total iast 9.15 s 675.334 ms (8.0%)
Total iast_HARDCODED_SECRET_DISABLED 9.086 s 610.396 ms (7.2%)
Total iast_TELEMETRY_OFF 9.25 s 774.803 ms (9.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.023 s -
Agent iast 1.164 s 140.312 ms (13.7%)
Agent iast_HARDCODED_SECRET_DISABLED 1.156 s 133.131 ms (13.0%)
Agent iast_TELEMETRY_OFF 1.146 s 122.836 ms (12.0%)
Total tracing 8.488 s -
Total iast 9.165 s 677.122 ms (8.0%)
Total iast_HARDCODED_SECRET_DISABLED 9.128 s 639.598 ms (7.5%)
Total iast_TELEMETRY_OFF 9.192 s 704.123 ms (8.3%)
gantt
    title insecure-bank - break down per module: candidate=1.50.0-SNAPSHOT~cab7bfe297, baseline=1.50.0-SNAPSHOT~ad6d5fef42

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (681.425 ms) : 0, 681425
BytebuddyAgent [candidate] (684.403 ms) : 0, 684403
GlobalTracer [baseline] (239.046 ms) : 0, 239046
GlobalTracer [candidate] (240.278 ms) : 0, 240278
AppSec [baseline] (54.288 ms) : 0, 54288
AppSec [candidate] (57.536 ms) : 0, 57536
Debugger [baseline] (9.146 ms) : 0, 9146
Debugger [candidate] (6.152 ms) : 0, 6152
Remote Config [baseline] (700.673 µs) : 0, 701
Remote Config [candidate] (732.16 µs) : 0, 732
Telemetry [baseline] (10.68 ms) : 0, 10680
Telemetry [candidate] (10.607 ms) : 0, 10607
section iast
BytebuddyAgent [baseline] (801.535 ms) : 0, 801535
BytebuddyAgent [candidate] (813.514 ms) : 0, 813514
GlobalTracer [baseline] (229.896 ms) : 0, 229896
GlobalTracer [candidate] (231.625 ms) : 0, 231625
IAST [baseline] (30.027 ms) : 0, 30027
IAST [candidate] (27.17 ms) : 0, 27170
AppSec [baseline] (47.584 ms) : 0, 47584
AppSec [candidate] (52.974 ms) : 0, 52974
Debugger [baseline] (5.913 ms) : 0, 5913
Debugger [candidate] (6.001 ms) : 0, 6001
Remote Config [baseline] (585.865 µs) : 0, 586
Remote Config [candidate] (599.884 µs) : 0, 600
Telemetry [baseline] (7.801 ms) : 0, 7801
Telemetry [candidate] (8.026 ms) : 0, 8026
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (802.111 ms) : 0, 802111
BytebuddyAgent [candidate] (807.606 ms) : 0, 807606
GlobalTracer [baseline] (229.972 ms) : 0, 229972
GlobalTracer [candidate] (231.205 ms) : 0, 231205
IAST [baseline] (30.298 ms) : 0, 30298
IAST [candidate] (26.352 ms) : 0, 26352
AppSec [baseline] (47.666 ms) : 0, 47666
AppSec [candidate] (53.12 ms) : 0, 53120
Debugger [baseline] (5.927 ms) : 0, 5927
Debugger [candidate] (5.982 ms) : 0, 5982
Remote Config [baseline] (595.168 µs) : 0, 595
Remote Config [candidate] (603.645 µs) : 0, 604
Telemetry [baseline] (7.879 ms) : 0, 7879
Telemetry [candidate] (7.898 ms) : 0, 7898
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (797.618 ms) : 0, 797618
BytebuddyAgent [candidate] (799.324 ms) : 0, 799324
GlobalTracer [baseline] (229.876 ms) : 0, 229876
GlobalTracer [candidate] (230.625 ms) : 0, 230625
IAST [baseline] (22.441 ms) : 0, 22441
IAST [candidate] (29.462 ms) : 0, 29462
AppSec [baseline] (55.913 ms) : 0, 55913
AppSec [candidate] (49.027 ms) : 0, 49027
Debugger [baseline] (5.982 ms) : 0, 5982
Debugger [candidate] (5.889 ms) : 0, 5889
Remote Config [baseline] (604.336 µs) : 0, 604
Remote Config [candidate] (645.255 µs) : 0, 645
Telemetry [baseline] (7.754 ms) : 0, 7754
Telemetry [candidate] (7.788 ms) : 0, 7788
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-06-04T12:11:40 2025-06-04T12:16:50
git_branch master sezen.leblay/APPSEC-57259
git_commit_date 1746789389 1749037898
git_commit_sha ad6d5fe cab7bfe
release_version 1.50.0-SNAPSHOT~ad6d5fef42 1.50.0-SNAPSHOT~cab7bfe297
start_time 2025-06-04T12:11:19 2025-06-04T12:16:01
See matching parameters
Baseline Candidate
application petclinic petclinic
ci_job_date 1749039410 1749039410
ci_job_id 967307420 967307420
ci_pipeline_id 66920181 66920181
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-ul4n-y4k-project-304-concurrent-2-odoswnxm 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-ul4n-y4k-project-304-concurrent-2-odoswnxm 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
thresholds_or_results results results
variant appsec appsec

Summary

Found 0 performance improvements and 4 performance regressions! Performance is the same for 0 metrics, 10 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:petclinic:iast unstable
[+69.492ms; +73.962ms] or [+639.133%; +680.239%]
worse
[-414.208op/s; -380.708op/s] or [-90.903%; -83.551%]
82.600ms 58.200op/s 10.873ms 455.658op/s
scenario:load:petclinic:no_agent unstable
[+39.608ms; +41.032ms] or [+507.004%; +525.231%]
worse
[-548.389op/s; -518.548op/s] or [-86.371%; -81.671%]
48.132ms 101.452op/s 7.812ms 634.921op/s
scenario:load:petclinic:profiling unstable
[+51.557ms; +53.628ms] or [+532.382%; +553.775%]
worse
[-452.599op/s; -410.033op/s] or [-88.822%; -80.469%]
62.277ms 78.238op/s 9.684ms 509.554op/s
scenario:load:petclinic:tracing unstable
[+45.546ms; +47.228ms] or [+544.618%; +564.734%]
worse
[-514.586op/s; -482.765op/s] or [-87.480%; -82.070%]
54.750ms 89.560op/s 8.363ms 588.235op/s
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~cab7bfe297, baseline=1.50.0-SNAPSHOT~ad6d5fef42
    dateFormat X
    axisFormat %s
section baseline
no_agent (7.812 ms) : 7789, 7836
.   : milestone, 7812,
appsec (1.14 ms) : 1091, 1188
.   : milestone, 1140,
appsec_no_iast (436.915 µs) : 402, 471
.   : milestone, 437,
code_origins (29.742 ms) : 29641, 29842
.   : milestone, 29742,
iast (10.873 ms) : 10827, 10919
.   : milestone, 10873,
profiling (9.684 ms) : 9641, 9727
.   : milestone, 9684,
tracing (8.363 ms) : 8336, 8390
.   : milestone, 8363,
section candidate
no_agent (48.132 ms) : 47197, 49068
.   : milestone, 48132,
appsec (69.991 ms) : 68292, 71690
.   : milestone, 69991,
appsec_no_iast (77.31 ms) : 75133, 79487
.   : milestone, 77310,
code_origins (88.658 ms) : 83648, 93668
.   : milestone, 88658,
iast (82.6 ms) : 79663, 85536
.   : milestone, 82600,
profiling (62.277 ms) : 60916, 63637
.   : milestone, 62277,
tracing (54.75 ms) : 53644, 55855
.   : milestone, 54750,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 7.812 ms [7.789 ms, 7.836 ms] -
appsec 1.14 ms [1.091 ms, 1.188 ms] -6.673 ms (-85.4%)
appsec_no_iast 436.915 µs [402.456 µs, 471.375 µs] -7.375 ms (-94.4%)
code_origins 29.742 ms [29.641 ms, 29.842 ms] 21.929 ms (280.7%)
iast 10.873 ms [10.827 ms, 10.919 ms] 3.061 ms (39.2%)
profiling 9.684 ms [9.641 ms, 9.727 ms] 1.872 ms (24.0%)
tracing 8.363 ms [8.336 ms, 8.39 ms] 550.638 µs (7.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 48.132 ms [47.197 ms, 49.068 ms] -
appsec 69.991 ms [68.292 ms, 71.69 ms] 21.858 ms (45.4%)
appsec_no_iast 77.31 ms [75.133 ms, 79.487 ms] 29.178 ms (60.6%)
code_origins 88.658 ms [83.648 ms, 93.668 ms] 40.526 ms (84.2%)
iast 82.6 ms [79.663 ms, 85.536 ms] 34.467 ms (71.6%)
profiling 62.277 ms [60.916 ms, 63.637 ms] 14.144 ms (29.4%)
tracing 54.75 ms [53.644 ms, 55.855 ms] 6.617 ms (13.7%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sezen.leblay/APPSEC-57259
git_commit_date 1746789389 1749037898
git_commit_sha ad6d5fe cab7bfe
release_version 1.50.0-SNAPSHOT~ad6d5fef42 1.50.0-SNAPSHOT~cab7bfe297
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1749039981 1749039981
ci_job_id 967307422 967307422
ci_pipeline_id 66920181 66920181
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-o6ycphvs-project-304-concurrent-0-9gm8qes8 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-o6ycphvs-project-304-concurrent-0-9gm8qes8 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~cab7bfe297, baseline=1.50.0-SNAPSHOT~ad6d5fef42
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.044 s) : 15044000, 15044000
.   : milestone, 15044000,
appsec (14.742 s) : 14742000, 14742000
.   : milestone, 14742000,
iast (18.982 s) : 18982000, 18982000
.   : milestone, 18982000,
iast_GLOBAL (18.182 s) : 18182000, 18182000
.   : milestone, 18182000,
profiling (15.927 s) : 15927000, 15927000
.   : milestone, 15927000,
tracing (14.88 s) : 14880000, 14880000
.   : milestone, 14880000,
section candidate
no_agent (15.669 s) : 15669000, 15669000
.   : milestone, 15669000,
appsec (15.023 s) : 15023000, 15023000
.   : milestone, 15023000,
iast (18.884 s) : 18884000, 18884000
.   : milestone, 18884000,
iast_GLOBAL (17.984 s) : 17984000, 17984000
.   : milestone, 17984000,
profiling (15.822 s) : 15822000, 15822000
.   : milestone, 15822000,
tracing (14.91 s) : 14910000, 14910000
.   : milestone, 14910000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.044 s [15.044 s, 15.044 s] -
appsec 14.742 s [14.742 s, 14.742 s] -302.0 ms (-2.0%)
iast 18.982 s [18.982 s, 18.982 s] 3.938 s (26.2%)
iast_GLOBAL 18.182 s [18.182 s, 18.182 s] 3.138 s (20.9%)
profiling 15.927 s [15.927 s, 15.927 s] 883.0 ms (5.9%)
tracing 14.88 s [14.88 s, 14.88 s] -164.0 ms (-1.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.669 s [15.669 s, 15.669 s] -
appsec 15.023 s [15.023 s, 15.023 s] -646.0 ms (-4.1%)
iast 18.884 s [18.884 s, 18.884 s] 3.215 s (20.5%)
iast_GLOBAL 17.984 s [17.984 s, 17.984 s] 2.315 s (14.8%)
profiling 15.822 s [15.822 s, 15.822 s] 153.0 ms (1.0%)
tracing 14.91 s [14.91 s, 14.91 s] -759.0 ms (-4.8%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~cab7bfe297, baseline=1.50.0-SNAPSHOT~ad6d5fef42
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.474 ms) : 1463, 1486
.   : milestone, 1474,
appsec (2.41 ms) : 2361, 2459
.   : milestone, 2410,
iast (2.179 ms) : 2118, 2239
.   : milestone, 2179,
iast_GLOBAL (2.223 ms) : 2162, 2285
.   : milestone, 2223,
profiling (2.013 ms) : 1965, 2061
.   : milestone, 2013,
tracing (2.001 ms) : 1954, 2048
.   : milestone, 2001,
section candidate
no_agent (1.476 ms) : 1465, 1488
.   : milestone, 1476,
appsec (2.4 ms) : 2351, 2448
.   : milestone, 2400,
iast (2.19 ms) : 2129, 2251
.   : milestone, 2190,
iast_GLOBAL (2.234 ms) : 2173, 2295
.   : milestone, 2234,
profiling (2.053 ms) : 2002, 2104
.   : milestone, 2053,
tracing (2.01 ms) : 1962, 2058
.   : milestone, 2010,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.463 ms, 1.486 ms] -
appsec 2.41 ms [2.361 ms, 2.459 ms] 935.335 µs (63.4%)
iast 2.179 ms [2.118 ms, 2.239 ms] 704.155 µs (47.8%)
iast_GLOBAL 2.223 ms [2.162 ms, 2.285 ms] 748.99 µs (50.8%)
profiling 2.013 ms [1.965 ms, 2.061 ms] 538.909 µs (36.6%)
tracing 2.001 ms [1.954 ms, 2.048 ms] 526.575 µs (35.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.465 ms, 1.488 ms] -
appsec 2.4 ms [2.351 ms, 2.448 ms] 923.494 µs (62.6%)
iast 2.19 ms [2.129 ms, 2.251 ms] 713.895 µs (48.4%)
iast_GLOBAL 2.234 ms [2.173 ms, 2.295 ms] 758.071 µs (51.4%)
profiling 2.053 ms [2.002 ms, 2.104 ms] 577.071 µs (39.1%)
tracing 2.01 ms [1.962 ms, 2.058 ms] 533.887 µs (36.2%)

@sezen-datadog sezen-datadog force-pushed the sezen.leblay/APPSEC-57259 branch 2 times, most recently from ff2d34f to 4d7fed2 Compare May 16, 2025 14:19
@smola smola added type: enhancement Enhancements and improvements comp: asm waf Application Security Management (WAF) labels May 19, 2025
@sezen-datadog sezen-datadog force-pushed the sezen.leblay/APPSEC-57259 branch 7 times, most recently from f686487 to c4de9a0 Compare May 26, 2025 10:05
@sezen-datadog sezen-datadog force-pushed the sezen.leblay/APPSEC-57259 branch 2 times, most recently from 5bee816 to 6e49d48 Compare May 28, 2025 13:34
@sezen-datadog sezen-datadog force-pushed the sezen.leblay/APPSEC-57259 branch 5 times, most recently from 7f3daca to 462a5a5 Compare June 4, 2025 10:54
@sezen-datadog sezen-datadog force-pushed the sezen.leblay/APPSEC-57259 branch from 462a5a5 to f8b5c97 Compare June 4, 2025 11:18
Signed-off-by: sezen.leblay <[email protected]>
@sezen-datadog sezen-datadog deleted the sezen.leblay/APPSEC-57259 branch June 5, 2025 10:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: asm waf Application Security Management (WAF) type: enhancement Enhancements and improvements

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants