Skip to content

Update Gradle Daemon smoke tests to use Maven repository proxy when available #8976

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 3 commits into from
Jun 13, 2025
Merged

Update Gradle Daemon smoke tests to use Maven repository proxy when available #8976

merged 3 commits into from
Jun 13, 2025

Conversation

@nikita-tkachenko-datadog
Copy link
Contributor

@nikita-tkachenko-datadog nikita-tkachenko-datadog commented Jun 12, 2025

What Does This Do

Updates Gradle Daemon smoke tests to use Maven repository proxy when available.

The proxy URL is retrieved from a Gradle project property, then propagated to the tests as an environment variable, and then propagated to the "nested" Gradle builds started by the tests, again as an environment variable.

The reason it is not propagated as a project property is that project property is a part of Gradle command, and Gradle command is reported as a span tag by the Test Optimization, which makes it a part of the test fixtures.
The proxy not always being present would make the test command (and the test fixtures) unstable.

Motivation

Gradle Daemon smoke tests need to use caching Maven proxy, otherwise the nested Gradle builds downloading their artifacts (e.g. JUnit) can be rate-limited by Maven Central (which makes the tests flaky).

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@nikita-tkachenko-datadog nikita-tkachenko-datadog added comp: testing Testing tag: no release notes Changes to exclude from release notes comp: ci visibility Continuous Integration Visibility labels Jun 12, 2025
@nikita-tkachenko-datadog nikita-tkachenko-datadog marked this pull request as ready for review June 12, 2025 19:28
@nikita-tkachenko-datadog nikita-tkachenko-datadog requested a review from a team as a code owner June 12, 2025 19:28
@pr-commenter
Copy link

pr-commenter bot commented Jun 12, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/gradle-smoke-tests-maven-proxy
git_commit_date 1749754796 1749805615
git_commit_sha d2d38c9 b7e31c0
release_version 1.50.0-SNAPSHOT~d2d38c9d44 1.50.0-SNAPSHOT~b7e31c024c
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1749807848 1749807848
ci_job_id 980408863 980408863
ci_pipeline_id 67645810 67645810
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-63wmvl1-project-304-concurrent-0-u2u41e2a 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-63wmvl1-project-304-concurrent-0-u2u41e2a 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 59 metrics, 12 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.50.0-SNAPSHOT~b7e31c024c, baseline=1.50.0-SNAPSHOT~d2d38c9d44

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.024 s) : 0, 1024338
Total [baseline] (10.429 s) : 0, 10428810
Agent [candidate] (1.025 s) : 0, 1024778
Total [candidate] (10.439 s) : 0, 10438873
section appsec
Agent [baseline] (1.177 s) : 0, 1177091
Total [baseline] (10.693 s) : 0, 10693450
Agent [candidate] (1.179 s) : 0, 1179454
Total [candidate] (10.632 s) : 0, 10632130
section iast
Agent [baseline] (1.151 s) : 0, 1150982
Total [baseline] (10.79 s) : 0, 10789791
Agent [candidate] (1.153 s) : 0, 1153013
Total [candidate] (10.894 s) : 0, 10893615
section profiling
Agent [baseline] (1.266 s) : 0, 1265713
Total [baseline] (10.875 s) : 0, 10875200
Agent [candidate] (1.273 s) : 0, 1273445
Total [candidate] (10.823 s) : 0, 10822593
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.024 s -
Agent appsec 1.177 s 152.753 ms (14.9%)
Agent iast 1.151 s 126.644 ms (12.4%)
Agent profiling 1.266 s 241.375 ms (23.6%)
Total tracing 10.429 s -
Total appsec 10.693 s 264.64 ms (2.5%)
Total iast 10.79 s 360.981 ms (3.5%)
Total profiling 10.875 s 446.39 ms (4.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.025 s -
Agent appsec 1.179 s 154.676 ms (15.1%)
Agent iast 1.153 s 128.235 ms (12.5%)
Agent profiling 1.273 s 248.667 ms (24.3%)
Total tracing 10.439 s -
Total appsec 10.632 s 193.257 ms (1.9%)
Total iast 10.894 s 454.742 ms (4.4%)
Total profiling 10.823 s 383.72 ms (3.7%) 
gantt
    title petclinic - break down per module: candidate=1.50.0-SNAPSHOT~b7e31c024c, baseline=1.50.0-SNAPSHOT~d2d38c9d44

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (684.129 ms) : 0, 684129
BytebuddyAgent [candidate] (683.843 ms) : 0, 683843
GlobalTracer [baseline] (241.21 ms) : 0, 241210
GlobalTracer [candidate] (240.872 ms) : 0, 240872
AppSec [baseline] (56.456 ms) : 0, 56456
AppSec [candidate] (55.355 ms) : 0, 55355
Debugger [baseline] (6.163 ms) : 0, 6163
Debugger [candidate] (6.162 ms) : 0, 6162
Remote Config [baseline] (726.277 µs) : 0, 726
Remote Config [candidate] (732.964 µs) : 0, 733
Telemetry [baseline] (12.006 ms) : 0, 12006
Telemetry [candidate] (14.304 ms) : 0, 14304
section appsec
BytebuddyAgent [baseline] (706.387 ms) : 0, 706387
BytebuddyAgent [candidate] (708.271 ms) : 0, 708271
GlobalTracer [baseline] (235.555 ms) : 0, 235555
GlobalTracer [candidate] (235.82 ms) : 0, 235820
AppSec [baseline] (175.751 ms) : 0, 175751
AppSec [candidate] (175.758 ms) : 0, 175758
Debugger [baseline] (5.939 ms) : 0, 5939
Debugger [candidate] (5.961 ms) : 0, 5961
Remote Config [baseline] (615.147 µs) : 0, 615
Remote Config [candidate] (623.005 µs) : 0, 623
Telemetry [baseline] (7.342 ms) : 0, 7342
Telemetry [candidate] (7.375 ms) : 0, 7375
IAST [baseline] (21.963 ms) : 0, 21963
IAST [candidate] (22.063 ms) : 0, 22063
section iast
BytebuddyAgent [baseline] (802.393 ms) : 0, 802393
BytebuddyAgent [candidate] (803.553 ms) : 0, 803553
GlobalTracer [baseline] (230.97 ms) : 0, 230970
GlobalTracer [candidate] (231.214 ms) : 0, 231214
AppSec [baseline] (51.027 ms) : 0, 51027
AppSec [candidate] (53.242 ms) : 0, 53242
Debugger [baseline] (5.989 ms) : 0, 5989
Debugger [candidate] (5.996 ms) : 0, 5996
Remote Config [baseline] (599.427 µs) : 0, 599
Remote Config [candidate] (585.083 µs) : 0, 585
Telemetry [baseline] (8.015 ms) : 0, 8015
Telemetry [candidate] (7.988 ms) : 0, 7988
IAST [baseline] (28.434 ms) : 0, 28434
IAST [candidate] (26.875 ms) : 0, 26875
section profiling
BytebuddyAgent [baseline] (675.563 ms) : 0, 675563
BytebuddyAgent [candidate] (680.696 ms) : 0, 680696
GlobalTracer [baseline] (360.173 ms) : 0, 360173
GlobalTracer [candidate] (361.977 ms) : 0, 361977
AppSec [baseline] (61.778 ms) : 0, 61778
AppSec [candidate] (61.858 ms) : 0, 61858
Debugger [baseline] (6.143 ms) : 0, 6143
Debugger [candidate] (6.067 ms) : 0, 6067
Remote Config [baseline] (645.722 µs) : 0, 646
Remote Config [candidate] (650.731 µs) : 0, 651
Telemetry [baseline] (8.162 ms) : 0, 8162
Telemetry [candidate] (8.103 ms) : 0, 8103
ProfilingAgent [baseline] (102.488 ms) : 0, 102488
ProfilingAgent [candidate] (102.887 ms) : 0, 102887
Profiling [baseline] (102.511 ms) : 0, 102511
Profiling [candidate] (102.911 ms) : 0, 102911
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.50.0-SNAPSHOT~b7e31c024c, baseline=1.50.0-SNAPSHOT~d2d38c9d44

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.037 s) : 0, 1037360
Total [baseline] (8.614 s) : 0, 8614153
Agent [candidate] (1.023 s) : 0, 1023136
Total [candidate] (8.52 s) : 0, 8519585
section iast
Agent [baseline] (1.163 s) : 0, 1162894
Total [baseline] (9.221 s) : 0, 9221166
Agent [candidate] (1.149 s) : 0, 1148588
Total [candidate] (9.161 s) : 0, 9160594
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.151 s) : 0, 1150504
Total [baseline] (9.15 s) : 0, 9150090
Agent [candidate] (1.159 s) : 0, 1159400
Total [candidate] (9.175 s) : 0, 9175105
section iast_TELEMETRY_OFF
Agent [baseline] (1.155 s) : 0, 1155202
Total [baseline] (9.211 s) : 0, 9210834
Agent [candidate] (1.148 s) : 0, 1147964
Total [candidate] (9.22 s) : 0, 9219656
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.037 s -
Agent iast 1.163 s 125.534 ms (12.1%)
Agent iast_HARDCODED_SECRET_DISABLED 1.151 s 113.144 ms (10.9%)
Agent iast_TELEMETRY_OFF 1.155 s 117.842 ms (11.4%)
Total tracing 8.614 s -
Total iast 9.221 s 607.013 ms (7.0%)
Total iast_HARDCODED_SECRET_DISABLED 9.15 s 535.937 ms (6.2%)
Total iast_TELEMETRY_OFF 9.211 s 596.681 ms (6.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.023 s -
Agent iast 1.149 s 125.452 ms (12.3%)
Agent iast_HARDCODED_SECRET_DISABLED 1.159 s 136.264 ms (13.3%)
Agent iast_TELEMETRY_OFF 1.148 s 124.828 ms (12.2%)
Total tracing 8.52 s -
Total iast 9.161 s 641.009 ms (7.5%)
Total iast_HARDCODED_SECRET_DISABLED 9.175 s 655.52 ms (7.7%)
Total iast_TELEMETRY_OFF 9.22 s 700.071 ms (8.2%) 
gantt
    title insecure-bank - break down per module: candidate=1.50.0-SNAPSHOT~b7e31c024c, baseline=1.50.0-SNAPSHOT~d2d38c9d44

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (693.603 ms) : 0, 693603
BytebuddyAgent [candidate] (682.64 ms) : 0, 682640
GlobalTracer [baseline] (243.278 ms) : 0, 243278
GlobalTracer [candidate] (240.589 ms) : 0, 240589
AppSec [baseline] (58.987 ms) : 0, 58987
AppSec [candidate] (56.679 ms) : 0, 56679
Debugger [baseline] (6.188 ms) : 0, 6188
Debugger [candidate] (6.133 ms) : 0, 6133
Remote Config [baseline] (725.874 µs) : 0, 726
Remote Config [candidate] (722.311 µs) : 0, 722
Telemetry [baseline] (10.788 ms) : 0, 10788
Telemetry [candidate] (12.889 ms) : 0, 12889
section iast
BytebuddyAgent [baseline] (810.054 ms) : 0, 810054
BytebuddyAgent [candidate] (801.187 ms) : 0, 801187
GlobalTracer [baseline] (233.377 ms) : 0, 233377
GlobalTracer [candidate] (230.269 ms) : 0, 230269
AppSec [baseline] (53.206 ms) : 0, 53206
AppSec [candidate] (53.161 ms) : 0, 53161
Debugger [baseline] (6.074 ms) : 0, 6074
Debugger [candidate] (5.981 ms) : 0, 5981
Remote Config [baseline] (620.291 µs) : 0, 620
Remote Config [candidate] (595.905 µs) : 0, 596
Telemetry [baseline] (8.147 ms) : 0, 8147
Telemetry [candidate] (7.831 ms) : 0, 7831
IAST [baseline] (27.671 ms) : 0, 27671
IAST [candidate] (26.124 ms) : 0, 26124
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (802.303 ms) : 0, 802303
BytebuddyAgent [candidate] (808.07 ms) : 0, 808070
GlobalTracer [baseline] (230.772 ms) : 0, 230772
GlobalTracer [candidate] (232.098 ms) : 0, 232098
AppSec [baseline] (51.52 ms) : 0, 51520
AppSec [candidate] (55.843 ms) : 0, 55843
Debugger [baseline] (5.984 ms) : 0, 5984
Debugger [candidate] (6.092 ms) : 0, 6092
Remote Config [baseline] (595.206 µs) : 0, 595
Remote Config [candidate] (602.868 µs) : 0, 603
Telemetry [baseline] (7.921 ms) : 0, 7921
Telemetry [candidate] (8.109 ms) : 0, 8109
IAST [baseline] (27.808 ms) : 0, 27808
IAST [candidate] (24.829 ms) : 0, 24829
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (805.497 ms) : 0, 805497
BytebuddyAgent [candidate] (799.306 ms) : 0, 799306
GlobalTracer [baseline] (232.213 ms) : 0, 232213
GlobalTracer [candidate] (231.251 ms) : 0, 231251
AppSec [baseline] (48.794 ms) : 0, 48794
AppSec [candidate] (49.469 ms) : 0, 49469
Debugger [baseline] (6.027 ms) : 0, 6027
Debugger [candidate] (6.022 ms) : 0, 6022
Remote Config [baseline] (615.264 µs) : 0, 615
Remote Config [candidate] (606.765 µs) : 0, 607
Telemetry [baseline] (7.968 ms) : 0, 7968
Telemetry [candidate] (7.977 ms) : 0, 7977
IAST [baseline] (30.474 ms) : 0, 30474
IAST [candidate] (29.868 ms) : 0, 29868
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-06-13T09:18:13 2025-06-13T09:24:58
git_branch master nikita-tkachenko/gradle-smoke-tests-maven-proxy
git_commit_date 1749754796 1749805615
git_commit_sha d2d38c9 b7e31c0
release_version 1.50.0-SNAPSHOT~d2d38c9d44 1.50.0-SNAPSHOT~b7e31c024c
start_time 2025-06-13T09:17:58 2025-06-13T09:24:44
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1749807034 1749807034
ci_job_id 980408864 980408864
ci_pipeline_id 67645810 67645810
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-63wmvl1-project-304-concurrent-1-ay8kl9bb 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-63wmvl1-project-304-concurrent-1-ay8kl9bb 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
thresholds_or_results results results
variant iast iast

Summary

Found 0 performance improvements and 1 performance regressions! Performance is the same for 5 metrics, 22 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:petclinic:no_agent worse
[+354.925µs; +577.808µs] or [+3.036%; +4.943%]		 unstable
[-55.851op/s; +21.473op/s] or [-13.195%; +5.073%]		 12.157ms 406.091op/s 11.690ms 423.280op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~b7e31c024c, baseline=1.50.0-SNAPSHOT~d2d38c9d44
    dateFormat X
    axisFormat %s
section baseline
no_agent (11.69 ms) : 11593, 11788
.   : milestone, 11690,
appsec (1.534 ms) : 1440, 1629
.   : milestone, 1534,
code_origins (246.708 µs) : 200, 294
.   : milestone, 247,
iast (874.365 µs) : 799, 950
.   : milestone, 874,
profiling (2.206 ms) : 2099, 2312
.   : milestone, 2206,
tracing (2.852 ms) : 2738, 2965
.   : milestone, 2852,
section candidate
no_agent (12.157 ms) : 12047, 12266
.   : milestone, 12157,
appsec (11.687 ms) : 11083, 12291
.   : milestone, 11687,
code_origins (2.661 ms) : 2386, 2937
.   : milestone, 2661,
iast (5.822 ms) : 5420, 6223
.   : milestone, 5822,
profiling (10.867 ms) : 10407, 11327
.   : milestone, 10867,
tracing (12.408 ms) : 11975, 12842
.   : milestone, 12408,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 11.69 ms [11.593 ms, 11.788 ms] -
appsec 1.534 ms [1.44 ms, 1.629 ms] -10.156 ms (-86.9%)
code_origins 246.708 µs [199.703 µs, 293.714 µs] -11.443 ms (-97.9%)
iast 874.365 µs [798.582 µs, 950.147 µs] -10.816 ms (-92.5%)
profiling 2.206 ms [2.099 ms, 2.312 ms] -9.485 ms (-81.1%)
tracing 2.852 ms [2.738 ms, 2.965 ms] -8.839 ms (-75.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 12.157 ms [12.047 ms, 12.266 ms] -
appsec 11.687 ms [11.083 ms, 12.291 ms] -469.281 µs (-3.9%)
code_origins 2.661 ms [2.386 ms, 2.937 ms] -9.495 ms (-78.1%)
iast 5.822 ms [5.42 ms, 6.223 ms] -6.335 ms (-52.1%)
profiling 10.867 ms [10.407 ms, 11.327 ms] -1.29 ms (-10.6%)
tracing 12.408 ms [11.975 ms, 12.842 ms] 251.861 µs (2.1%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~b7e31c024c, baseline=1.50.0-SNAPSHOT~d2d38c9d44
    dateFormat X
    axisFormat %s
section baseline
no_agent (385.832 µs) : 366, 406
.   : milestone, 386,
iast (531.153 µs) : 509, 553
.   : milestone, 531,
iast_FULL (753.9 µs) : 730, 778
.   : milestone, 754,
iast_GLOBAL (574.62 µs) : 551, 598
.   : milestone, 575,
iast_HARDCODED_SECRET_DISABLED (541.137 µs) : 519, 563
.   : milestone, 541,
iast_INACTIVE (472.849 µs) : 450, 495
.   : milestone, 473,
iast_TELEMETRY_OFF (525.533 µs) : 502, 549
.   : milestone, 526,
tracing (471.015 µs) : 448, 494
.   : milestone, 471,
section candidate
no_agent (392.26 µs) : 371, 414
.   : milestone, 392,
iast (529.166 µs) : 506, 553
.   : milestone, 529,
iast_FULL (744.506 µs) : 722, 767
.   : milestone, 745,
iast_GLOBAL (594.124 µs) : 570, 619
.   : milestone, 594,
iast_HARDCODED_SECRET_DISABLED (526.759 µs) : 505, 548
.   : milestone, 527,
iast_INACTIVE (483.595 µs) : 461, 507
.   : milestone, 484,
iast_TELEMETRY_OFF (526.495 µs) : 503, 550
.   : milestone, 526,
tracing (477.432 µs) : 454, 501
.   : milestone, 477,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 385.832 µs [366.12 µs, 405.545 µs] -
iast 531.153 µs [509.13 µs, 553.176 µs] 145.321 µs (37.7%)
iast_FULL 753.9 µs [730.161 µs, 777.638 µs] 368.068 µs (95.4%)
iast_GLOBAL 574.62 µs [550.874 µs, 598.367 µs] 188.788 µs (48.9%)
iast_HARDCODED_SECRET_DISABLED 541.137 µs [519.24 µs, 563.033 µs] 155.304 µs (40.3%)
iast_INACTIVE 472.849 µs [450.31 µs, 495.388 µs] 87.017 µs (22.6%)
iast_TELEMETRY_OFF 525.533 µs [502.132 µs, 548.935 µs] 139.701 µs (36.2%)
tracing 471.015 µs [448.464 µs, 493.565 µs] 85.182 µs (22.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 392.26 µs [370.996 µs, 413.524 µs] -
iast 529.166 µs [505.537 µs, 552.796 µs] 136.906 µs (34.9%)
iast_FULL 744.506 µs [722.399 µs, 766.613 µs] 352.246 µs (89.8%)
iast_GLOBAL 594.124 µs [569.689 µs, 618.56 µs] 201.864 µs (51.5%)
iast_HARDCODED_SECRET_DISABLED 526.759 µs [505.128 µs, 548.391 µs] 134.499 µs (34.3%)
iast_INACTIVE 483.595 µs [460.686 µs, 506.504 µs] 91.335 µs (23.3%)
iast_TELEMETRY_OFF 526.495 µs [503.292 µs, 549.698 µs] 134.235 µs (34.2%)
tracing 477.432 µs [454.149 µs, 500.715 µs] 85.172 µs (21.7%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/gradle-smoke-tests-maven-proxy
git_commit_date 1749754796 1749805615
git_commit_sha d2d38c9 b7e31c0
release_version 1.50.0-SNAPSHOT~d2d38c9d44 1.50.0-SNAPSHOT~b7e31c024c
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1749807668 1749807668
ci_job_id 980408865 980408865
ci_pipeline_id 67645810 67645810
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-63wmvl1-project-304-concurrent-2-eiex44o0 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-63wmvl1-project-304-concurrent-2-eiex44o0 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~b7e31c024c, baseline=1.50.0-SNAPSHOT~d2d38c9d44
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.482 ms) : 1471, 1494
.   : milestone, 1482,
appsec (2.414 ms) : 2366, 2462
.   : milestone, 2414,
iast (2.202 ms) : 2141, 2263
.   : milestone, 2202,
iast_GLOBAL (2.244 ms) : 2183, 2305
.   : milestone, 2244,
profiling (2.06 ms) : 2010, 2109
.   : milestone, 2060,
tracing (2.023 ms) : 1975, 2070
.   : milestone, 2023,
section candidate
no_agent (1.486 ms) : 1475, 1498
.   : milestone, 1486,
appsec (2.417 ms) : 2368, 2465
.   : milestone, 2417,
iast (2.2 ms) : 2139, 2261
.   : milestone, 2200,
iast_GLOBAL (2.235 ms) : 2174, 2297
.   : milestone, 2235,
profiling (2.04 ms) : 1991, 2089
.   : milestone, 2040,
tracing (2.011 ms) : 1964, 2058
.   : milestone, 2011,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.482 ms [1.471 ms, 1.494 ms] -
appsec 2.414 ms [2.366 ms, 2.462 ms] 931.739 µs (62.9%)
iast 2.202 ms [2.141 ms, 2.263 ms] 719.763 µs (48.6%)
iast_GLOBAL 2.244 ms [2.183 ms, 2.305 ms] 761.351 µs (51.4%)
profiling 2.06 ms [2.01 ms, 2.109 ms] 577.477 µs (39.0%)
tracing 2.023 ms [1.975 ms, 2.07 ms] 540.451 µs (36.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.486 ms [1.475 ms, 1.498 ms] -
appsec 2.417 ms [2.368 ms, 2.465 ms] 930.406 µs (62.6%)
iast 2.2 ms [2.139 ms, 2.261 ms] 713.556 µs (48.0%)
iast_GLOBAL 2.235 ms [2.174 ms, 2.297 ms] 748.916 µs (50.4%)
profiling 2.04 ms [1.991 ms, 2.089 ms] 553.498 µs (37.2%)
tracing 2.011 ms [1.964 ms, 2.058 ms] 524.182 µs (35.3%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~b7e31c024c, baseline=1.50.0-SNAPSHOT~d2d38c9d44
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.058 s) : 15058000, 15058000
.   : milestone, 15058000,
appsec (14.614 s) : 14614000, 14614000
.   : milestone, 14614000,
iast (18.959 s) : 18959000, 18959000
.   : milestone, 18959000,
iast_GLOBAL (18.48 s) : 18480000, 18480000
.   : milestone, 18480000,
profiling (15.016 s) : 15016000, 15016000
.   : milestone, 15016000,
tracing (14.987 s) : 14987000, 14987000
.   : milestone, 14987000,
section candidate
no_agent (14.907 s) : 14907000, 14907000
.   : milestone, 14907000,
appsec (14.835 s) : 14835000, 14835000
.   : milestone, 14835000,
iast (19.097 s) : 19097000, 19097000
.   : milestone, 19097000,
iast_GLOBAL (18.262 s) : 18262000, 18262000
.   : milestone, 18262000,
profiling (15.11 s) : 15110000, 15110000
.   : milestone, 15110000,
tracing (15.197 s) : 15197000, 15197000
.   : milestone, 15197000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.058 s [15.058 s, 15.058 s] -
appsec 14.614 s [14.614 s, 14.614 s] -444.0 ms (-2.9%)
iast 18.959 s [18.959 s, 18.959 s] 3.901 s (25.9%)
iast_GLOBAL 18.48 s [18.48 s, 18.48 s] 3.422 s (22.7%)
profiling 15.016 s [15.016 s, 15.016 s] -42.0 ms (-0.3%)
tracing 14.987 s [14.987 s, 14.987 s] -71.0 ms (-0.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.907 s [14.907 s, 14.907 s] -
appsec 14.835 s [14.835 s, 14.835 s] -72.0 ms (-0.5%)
iast 19.097 s [19.097 s, 19.097 s] 4.19 s (28.1%)
iast_GLOBAL 18.262 s [18.262 s, 18.262 s] 3.355 s (22.5%)
profiling 15.11 s [15.11 s, 15.11 s] 203.0 ms (1.4%)
tracing 15.197 s [15.197 s, 15.197 s] 290.0 ms (1.9%)

@mcculls mcculls merged commit 0b95f68 into master Jun 13, 2025
364 of 373 checks passed
@mcculls mcculls deleted the nikita-tkachenko/gradle-smoke-tests-maven-proxy branch June 13, 2025 09:50
@github-actions github-actions bot added this to the 1.50.0 milestone Jun 13, 2025
@randomanderson randomanderson mentioned this pull request Jul 28, 2025
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@bric3 bric3 bric3 approved these changes

@Mariovido Mariovido Awaiting requested review from Mariovido Mariovido is a code owner automatically assigned from DataDog/ci-app-libraries-java

Assignees

No one assigned

Labels

comp: ci visibility Continuous Integration Visibility comp: testing Testing tag: no release notes Changes to exclude from release notes

Projects

None yet

Milestone

1.50.0

Development

Successfully merging this pull request may close these issues.

4 participants

@nikita-tkachenko-datadog @bric3 @mcculls