Skip to content

Update Maven smoke tests to use repository proxy #8979

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Jun 13, 2025
Merged

Update Maven smoke tests to use repository proxy #8979

merged 1 commit into from
Jun 13, 2025

Conversation

@nikita-tkachenko-datadog
Copy link
Contributor

@nikita-tkachenko-datadog nikita-tkachenko-datadog commented Jun 13, 2025

What Does This Do

Updates Maven smoke tests to use caching Maven repository proxy in CI.

Motivation

The tests need to download Maven artifacts for the tested projects.
When downloading directly from Maven Central, the tests fail because of download query rate limits.

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@nikita-tkachenko-datadog nikita-tkachenko-datadog added comp: testing Testing tag: no release notes Changes to exclude from release notes comp: ci visibility Continuous Integration Visibility labels Jun 13, 2025
@nikita-tkachenko-datadog nikita-tkachenko-datadog marked this pull request as ready for review June 13, 2025 10:52
@nikita-tkachenko-datadog nikita-tkachenko-datadog requested a review from a team as a code owner June 13, 2025 10:52
@pr-commenter
Copy link

pr-commenter bot commented Jun 13, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/maven-smoke-tests-repo-proxy
git_commit_date 1749808206 1749816503
git_commit_sha 0b95f68 11a70b2
release_version 1.50.0-SNAPSHOT~0b95f68fa0 1.50.0-SNAPSHOT~11a70b2c8e
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1749818797 1749818797
ci_job_id 980760047 980760047
ci_pipeline_id 67662669 67662669
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zvqazpau-project-304-concurrent-0-ch0jf00r 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zvqazpau-project-304-concurrent-0-ch0jf00r 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
startup:insecure-bank:iast startup:insecure-bank:iast startup:insecure-bank:iast
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 56 metrics, 15 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.50.0-SNAPSHOT~11a70b2c8e, baseline=1.50.0-SNAPSHOT~0b95f68fa0

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.023 s) : 0, 1022714
Total [baseline] (8.532 s) : 0, 8531849
Agent [candidate] (1.024 s) : 0, 1023714
Total [candidate] (8.526 s) : 0, 8526288
section iast
Agent [baseline] (1.149 s) : 0, 1148741
Total [baseline] (9.175 s) : 0, 9174641
Agent [candidate] (1.149 s) : 0, 1148850
Total [candidate] (9.204 s) : 0, 9203599
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.158 s) : 0, 1158281
Total [baseline] (9.164 s) : 0, 9164472
Agent [candidate] (1.157 s) : 0, 1156702
Total [candidate] (9.17 s) : 0, 9170107
section iast_TELEMETRY_OFF
Agent [baseline] (1.145 s) : 0, 1144770
Total [baseline] (9.234 s) : 0, 9234361
Agent [candidate] (1.148 s) : 0, 1148487
Total [candidate] (9.227 s) : 0, 9226905
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.023 s -
Agent iast 1.149 s 126.028 ms (12.3%)
Agent iast_HARDCODED_SECRET_DISABLED 1.158 s 135.567 ms (13.3%)
Agent iast_TELEMETRY_OFF 1.145 s 122.056 ms (11.9%)
Total tracing 8.532 s -
Total iast 9.175 s 642.791 ms (7.5%)
Total iast_HARDCODED_SECRET_DISABLED 9.164 s 632.623 ms (7.4%)
Total iast_TELEMETRY_OFF 9.234 s 702.512 ms (8.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.024 s -
Agent iast 1.149 s 125.136 ms (12.2%)
Agent iast_HARDCODED_SECRET_DISABLED 1.157 s 132.988 ms (13.0%)
Agent iast_TELEMETRY_OFF 1.148 s 124.773 ms (12.2%)
Total tracing 8.526 s -
Total iast 9.204 s 677.312 ms (7.9%)
Total iast_HARDCODED_SECRET_DISABLED 9.17 s 643.819 ms (7.6%)
Total iast_TELEMETRY_OFF 9.227 s 700.618 ms (8.2%) 
gantt
    title insecure-bank - break down per module: candidate=1.50.0-SNAPSHOT~11a70b2c8e, baseline=1.50.0-SNAPSHOT~0b95f68fa0

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (683.352 ms) : 0, 683352
BytebuddyAgent [candidate] (682.863 ms) : 0, 682863
GlobalTracer [baseline] (239.972 ms) : 0, 239972
GlobalTracer [candidate] (240.521 ms) : 0, 240521
AppSec [baseline] (56.199 ms) : 0, 56199
AppSec [candidate] (57.809 ms) : 0, 57809
Debugger [baseline] (6.135 ms) : 0, 6135
Debugger [candidate] (6.181 ms) : 0, 6181
Remote Config [baseline] (734.382 µs) : 0, 734
Remote Config [candidate] (727.682 µs) : 0, 728
Telemetry [baseline] (12.788 ms) : 0, 12788
Telemetry [candidate] (12.094 ms) : 0, 12094
section iast
BytebuddyAgent [baseline] (801.229 ms) : 0, 801229
BytebuddyAgent [candidate] (801.833 ms) : 0, 801833
GlobalTracer [baseline] (230.354 ms) : 0, 230354
GlobalTracer [candidate] (230.656 ms) : 0, 230656
AppSec [baseline] (54.715 ms) : 0, 54715
AppSec [candidate] (50.903 ms) : 0, 50903
Debugger [baseline] (5.927 ms) : 0, 5927
Debugger [candidate] (5.92 ms) : 0, 5920
Remote Config [baseline] (594.728 µs) : 0, 595
Remote Config [candidate] (585.856 µs) : 0, 586
Telemetry [baseline] (7.872 ms) : 0, 7872
Telemetry [candidate] (7.857 ms) : 0, 7857
IAST [baseline] (24.621 ms) : 0, 24621
IAST [candidate] (27.61 ms) : 0, 27610
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (807.616 ms) : 0, 807616
BytebuddyAgent [candidate] (806.685 ms) : 0, 806685
GlobalTracer [baseline] (232.123 ms) : 0, 232123
GlobalTracer [candidate] (231.402 ms) : 0, 231402
AppSec [baseline] (52.194 ms) : 0, 52194
AppSec [candidate] (53.699 ms) : 0, 53699
Debugger [baseline] (6.083 ms) : 0, 6083
Debugger [candidate] (5.997 ms) : 0, 5997
Remote Config [baseline] (600.072 µs) : 0, 600
Remote Config [candidate] (601.565 µs) : 0, 602
Telemetry [baseline] (8.06 ms) : 0, 8060
Telemetry [candidate] (7.987 ms) : 0, 7987
IAST [baseline] (27.944 ms) : 0, 27944
IAST [candidate] (26.709 ms) : 0, 26709
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (797.6 ms) : 0, 797600
BytebuddyAgent [candidate] (800.224 ms) : 0, 800224
GlobalTracer [baseline] (230.337 ms) : 0, 230337
GlobalTracer [candidate] (231.034 ms) : 0, 231034
AppSec [baseline] (51.003 ms) : 0, 51003
AppSec [candidate] (48.689 ms) : 0, 48689
Debugger [baseline] (5.944 ms) : 0, 5944
Debugger [candidate] (5.929 ms) : 0, 5929
Remote Config [baseline] (600.676 µs) : 0, 601
Remote Config [candidate] (585.813 µs) : 0, 586
Telemetry [baseline] (7.808 ms) : 0, 7808
Telemetry [candidate] (7.953 ms) : 0, 7953
IAST [baseline] (26.477 ms) : 0, 26477
IAST [candidate] (30.576 ms) : 0, 30576
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.50.0-SNAPSHOT~11a70b2c8e, baseline=1.50.0-SNAPSHOT~0b95f68fa0

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.023 s) : 0, 1023397
Total [baseline] (10.459 s) : 0, 10458871
Agent [candidate] (1.023 s) : 0, 1022883
Total [candidate] (10.495 s) : 0, 10495401
section appsec
Agent [baseline] (1.169 s) : 0, 1168887
Total [baseline] (10.672 s) : 0, 10671717
Agent [candidate] (1.177 s) : 0, 1176957
Total [candidate] (10.651 s) : 0, 10651067
section iast
Agent [baseline] (1.152 s) : 0, 1152264
Total [baseline] (10.913 s) : 0, 10913056
Agent [candidate] (1.148 s) : 0, 1147721
Total [candidate] (10.841 s) : 0, 10840551
section profiling
Agent [baseline] (1.268 s) : 0, 1267795
Total [baseline] (10.783 s) : 0, 10782691
Agent [candidate] (1.263 s) : 0, 1263388
Total [candidate] (10.784 s) : 0, 10783851
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.023 s -
Agent appsec 1.169 s 145.49 ms (14.2%)
Agent iast 1.152 s 128.867 ms (12.6%)
Agent profiling 1.268 s 244.398 ms (23.9%)
Total tracing 10.459 s -
Total appsec 10.672 s 212.846 ms (2.0%)
Total iast 10.913 s 454.184 ms (4.3%)
Total profiling 10.783 s 323.819 ms (3.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.023 s -
Agent appsec 1.177 s 154.074 ms (15.1%)
Agent iast 1.148 s 124.838 ms (12.2%)
Agent profiling 1.263 s 240.505 ms (23.5%)
Total tracing 10.495 s -
Total appsec 10.651 s 155.666 ms (1.5%)
Total iast 10.841 s 345.15 ms (3.3%)
Total profiling 10.784 s 288.45 ms (2.7%) 
gantt
    title petclinic - break down per module: candidate=1.50.0-SNAPSHOT~11a70b2c8e, baseline=1.50.0-SNAPSHOT~0b95f68fa0

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (682.577 ms) : 0, 682577
BytebuddyAgent [candidate] (682.733 ms) : 0, 682733
GlobalTracer [baseline] (240.105 ms) : 0, 240105
GlobalTracer [candidate] (240.592 ms) : 0, 240592
AppSec [baseline] (58.294 ms) : 0, 58294
AppSec [candidate] (57.236 ms) : 0, 57236
Debugger [baseline] (6.128 ms) : 0, 6128
Debugger [candidate] (6.167 ms) : 0, 6167
Remote Config [baseline] (717.691 µs) : 0, 718
Remote Config [candidate] (718.901 µs) : 0, 719
Telemetry [baseline] (12.075 ms) : 0, 12075
Telemetry [candidate] (11.99 ms) : 0, 11990
section appsec
BytebuddyAgent [baseline] (701.366 ms) : 0, 701366
BytebuddyAgent [candidate] (708.534 ms) : 0, 708534
GlobalTracer [baseline] (233.554 ms) : 0, 233554
GlobalTracer [candidate] (234.5 ms) : 0, 234500
AppSec [baseline] (174.981 ms) : 0, 174981
AppSec [candidate] (174.742 ms) : 0, 174742
Debugger [baseline] (5.936 ms) : 0, 5936
Debugger [candidate] (5.909 ms) : 0, 5909
Remote Config [baseline] (614.024 µs) : 0, 614
Remote Config [candidate] (664.907 µs) : 0, 665
Telemetry [baseline] (7.258 ms) : 0, 7258
Telemetry [candidate] (7.266 ms) : 0, 7266
IAST [baseline] (21.713 ms) : 0, 21713
IAST [candidate] (21.733 ms) : 0, 21733
section iast
BytebuddyAgent [baseline] (802.553 ms) : 0, 802553
BytebuddyAgent [candidate] (800.108 ms) : 0, 800108
GlobalTracer [baseline] (231.654 ms) : 0, 231654
GlobalTracer [candidate] (230.613 ms) : 0, 230613
AppSec [baseline] (51.292 ms) : 0, 51292
AppSec [candidate] (50.991 ms) : 0, 50991
Debugger [baseline] (6.001 ms) : 0, 6001
Debugger [candidate] (5.91 ms) : 0, 5910
Remote Config [baseline] (597.588 µs) : 0, 598
Remote Config [candidate] (587.627 µs) : 0, 588
Telemetry [baseline] (8.011 ms) : 0, 8011
Telemetry [candidate] (7.889 ms) : 0, 7889
IAST [baseline] (28.647 ms) : 0, 28647
IAST [candidate] (28.169 ms) : 0, 28169
section profiling
BytebuddyAgent [baseline] (677.327 ms) : 0, 677327
BytebuddyAgent [candidate] (674.43 ms) : 0, 674430
GlobalTracer [baseline] (360.591 ms) : 0, 360591
GlobalTracer [candidate] (359.529 ms) : 0, 359529
AppSec [baseline] (61.572 ms) : 0, 61572
AppSec [candidate] (61.629 ms) : 0, 61629
Debugger [baseline] (6.084 ms) : 0, 6084
Debugger [candidate] (6.061 ms) : 0, 6061
Remote Config [baseline] (632.158 µs) : 0, 632
Remote Config [candidate] (653.75 µs) : 0, 654
Telemetry [baseline] (8.115 ms) : 0, 8115
Telemetry [candidate] (8.089 ms) : 0, 8089
ProfilingAgent [baseline] (102.646 ms) : 0, 102646
ProfilingAgent [candidate] (102.292 ms) : 0, 102292
Profiling [baseline] (102.671 ms) : 0, 102671
Profiling [candidate] (102.318 ms) : 0, 102318
Loading

Load

Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~11a70b2c8e, baseline=1.50.0-SNAPSHOT~0b95f68fa0
    dateFormat X
    axisFormat %s
section baseline
no_agent (7.785 ms) : 7762, 7808
.   : milestone, 7785,
appsec (1.439 ms) : 1358, 1519
.   : milestone, 1439,
code_origins (117.984 µs) : 91, 145
.   : milestone, 118,
iast (781.047 µs) : 717, 845
.   : milestone, 781,
profiling (2.111 ms) : 2021, 2200
.   : milestone, 2111,
tracing (10.74 ms) : 10663, 10817
.   : milestone, 10740,
section candidate
no_agent (8.92 ms) : 8895, 8944
.   : milestone, 8920,
appsec (3.306 ms) : 3031, 3581
.   : milestone, 3306,
code_origins (1.029 ms) : 790, 1269
.   : milestone, 1029,
iast (2.091 ms) : 1837, 2345
.   : milestone, 2091,
profiling (10.285 ms) : 10220, 10350
.   : milestone, 10285,
tracing (79.588 µs) : 66, 93
.   : milestone, 80,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 7.785 ms [7.762 ms, 7.808 ms] -
appsec 1.439 ms [1.358 ms, 1.519 ms] -6.346 ms (-81.5%)
code_origins 117.984 µs [91.166 µs, 144.801 µs] -7.667 ms (-98.5%)
iast 781.047 µs [717.255 µs, 844.839 µs] -7.004 ms (-90.0%)
profiling 2.111 ms [2.021 ms, 2.2 ms] -5.674 ms (-72.9%)
tracing 10.74 ms [10.663 ms, 10.817 ms] 2.955 ms (38.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 8.92 ms [8.895 ms, 8.944 ms] -
appsec 3.306 ms [3.031 ms, 3.581 ms] -5.614 ms (-62.9%)
code_origins 1.029 ms [789.945 µs, 1.269 ms] -7.89 ms (-88.5%)
iast 2.091 ms [1.837 ms, 2.345 ms] -6.828 ms (-76.6%)
profiling 10.285 ms [10.22 ms, 10.35 ms] 1.365 ms (15.3%)
tracing 79.588 µs [66.434 µs, 92.743 µs] -8.84 ms (-99.1%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~11a70b2c8e, baseline=1.50.0-SNAPSHOT~0b95f68fa0
    dateFormat X
    axisFormat %s
section baseline
no_agent (379.147 µs) : 359, 399
.   : milestone, 379,
iast (526.443 µs) : 504, 548
.   : milestone, 526,
iast_FULL (740.305 µs) : 718, 762
.   : milestone, 740,
iast_GLOBAL (571.188 µs) : 547, 596
.   : milestone, 571,
iast_HARDCODED_SECRET_DISABLED (518.688 µs) : 497, 540
.   : milestone, 519,
iast_INACTIVE (472.721 µs) : 450, 496
.   : milestone, 473,
iast_TELEMETRY_OFF (520.187 µs) : 497, 544
.   : milestone, 520,
tracing (462.107 µs) : 440, 485
.   : milestone, 462,
section candidate
no_agent (382.936 µs) : 362, 404
.   : milestone, 383,
iast (516.155 µs) : 493, 539
.   : milestone, 516,
iast_FULL (739.508 µs) : 715, 764
.   : milestone, 740,
iast_GLOBAL (577.745 µs) : 554, 602
.   : milestone, 578,
iast_HARDCODED_SECRET_DISABLED (519.092 µs) : 497, 541
.   : milestone, 519,
iast_INACTIVE (484.328 µs) : 462, 507
.   : milestone, 484,
iast_TELEMETRY_OFF (518.26 µs) : 495, 542
.   : milestone, 518,
tracing (462.412 µs) : 440, 485
.   : milestone, 462,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 379.147 µs [358.932 µs, 399.361 µs] -
iast 526.443 µs [504.408 µs, 548.479 µs] 147.297 µs (38.8%)
iast_FULL 740.305 µs [718.139 µs, 762.471 µs] 361.158 µs (95.3%)
iast_GLOBAL 571.188 µs [546.762 µs, 595.613 µs] 192.041 µs (50.7%)
iast_HARDCODED_SECRET_DISABLED 518.688 µs [496.912 µs, 540.464 µs] 139.541 µs (36.8%)
iast_INACTIVE 472.721 µs [449.692 µs, 495.751 µs] 93.575 µs (24.7%)
iast_TELEMETRY_OFF 520.187 µs [496.693 µs, 543.681 µs] 141.04 µs (37.2%)
tracing 462.107 µs [439.588 µs, 484.626 µs] 82.961 µs (21.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 382.936 µs [362.144 µs, 403.728 µs] -
iast 516.155 µs [492.991 µs, 539.318 µs] 133.219 µs (34.8%)
iast_FULL 739.508 µs [715.448 µs, 763.567 µs] 356.572 µs (93.1%)
iast_GLOBAL 577.745 µs [553.896 µs, 601.593 µs] 194.809 µs (50.9%)
iast_HARDCODED_SECRET_DISABLED 519.092 µs [496.822 µs, 541.362 µs] 136.156 µs (35.6%)
iast_INACTIVE 484.328 µs [461.616 µs, 507.039 µs] 101.392 µs (26.5%)
iast_TELEMETRY_OFF 518.26 µs [494.865 µs, 541.655 µs] 135.324 µs (35.3%)
tracing 462.412 µs [440.07 µs, 484.754 µs] 79.476 µs (20.8%)

Dacapo

@nikita-tkachenko-datadog nikita-tkachenko-datadog force-pushed the nikita-tkachenko/maven-smoke-tests-repo-proxy branch from 4d8bfe0 to b5b0ad6 Compare June 13, 2025 12:07
@nikita-tkachenko-datadog nikita-tkachenko-datadog force-pushed the nikita-tkachenko/maven-smoke-tests-repo-proxy branch from b5b0ad6 to 11a70b2 Compare June 13, 2025 12:09
@mcculls mcculls merged commit ff2b2e9 into master Jun 13, 2025
464 of 470 checks passed
@mcculls mcculls deleted the nikita-tkachenko/maven-smoke-tests-repo-proxy branch June 13, 2025 13:36
@github-actions github-actions bot added this to the 1.50.0 milestone Jun 13, 2025
@randomanderson randomanderson mentioned this pull request Jul 28, 2025
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@mcculls mcculls mcculls approved these changes

@bric3 bric3 bric3 approved these changes

@daniel-mohedano daniel-mohedano Awaiting requested review from daniel-mohedano daniel-mohedano is a code owner automatically assigned from DataDog/ci-app-libraries-java

Assignees

No one assigned

Labels

comp: ci visibility Continuous Integration Visibility comp: testing Testing tag: no release notes Changes to exclude from release notes

Projects

None yet

Milestone

1.50.0

Development

Successfully merging this pull request may close these issues.

4 participants

@nikita-tkachenko-datadog @mcculls @bric3