Skip to content

Re-Update test source file reporting to match codeowners file #9002

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 1 commit into from
Closed

Re-Update test source file reporting to match codeowners file #9002

wants to merge 1 commit into from

Conversation

@sarahchen6
Copy link
Contributor

What Does This Do

Fix our test source file retrieval script

Motivation

Adjust change in #8936 that did not actually resolve missing codeowners

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@sarahchen6 sarahchen6 added type: enhancement Enhancements and improvements tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels Jun 17, 2025
@pr-commenter
Copy link

pr-commenter bot commented Jun 17, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/fix-codeowner-retrieval-again
git_commit_date 1750176286 1750195705
git_commit_sha 72f45a8 326d5bc
release_version 1.50.0-SNAPSHOT~72f45a8563 1.50.0-SNAPSHOT~326d5bc135
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1750197825 1750197825
ci_job_id 987103261 987103261
ci_pipeline_id 68052311 68052311
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-clrnfvyp-project-304-concurrent-0-vvu9rsow 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-clrnfvyp-project-304-concurrent-0-vvu9rsow 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 45 metrics, 8 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.50.0-SNAPSHOT~326d5bc135, baseline=1.50.0-SNAPSHOT~72f45a8563

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.023 s) : 0, 1022953
Total [baseline] (8.497 s) : 0, 8497428
Agent [candidate] (1.032 s) : 0, 1032380
Total [candidate] (8.577 s) : 0, 8577366
section iast
Agent [baseline] (1.151 s) : 0, 1150646
Total [baseline] (9.175 s) : 0, 9175076
Agent [candidate] (1.152 s) : 0, 1152133
Total [candidate] (9.203 s) : 0, 9203021
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.023 s -
Agent iast 1.151 s 127.693 ms (12.5%)
Total tracing 8.497 s -
Total iast 9.175 s 677.649 ms (8.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.032 s -
Agent iast 1.152 s 119.752 ms (11.6%)
Total tracing 8.577 s -
Total iast 9.203 s 625.655 ms (7.3%) 
gantt
    title insecure-bank - break down per module: candidate=1.50.0-SNAPSHOT~326d5bc135, baseline=1.50.0-SNAPSHOT~72f45a8563

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (682.805 ms) : 0, 682805
BytebuddyAgent [candidate] (688.615 ms) : 0, 688615
GlobalTracer [baseline] (239.462 ms) : 0, 239462
GlobalTracer [candidate] (241.916 ms) : 0, 241916
AppSec [baseline] (59.09 ms) : 0, 59090
AppSec [candidate] (60.822 ms) : 0, 60822
Debugger [baseline] (6.104 ms) : 0, 6104
Debugger [candidate] (6.184 ms) : 0, 6184
Remote Config [baseline] (726.185 µs) : 0, 726
Remote Config [candidate] (741.998 µs) : 0, 742
Telemetry [baseline] (11.427 ms) : 0, 11427
Telemetry [candidate] (10.541 ms) : 0, 10541
section iast
BytebuddyAgent [baseline] (801.421 ms) : 0, 801421
BytebuddyAgent [candidate] (802.271 ms) : 0, 802271
GlobalTracer [baseline] (229.89 ms) : 0, 229890
GlobalTracer [candidate] (230.376 ms) : 0, 230376
AppSec [baseline] (55.569 ms) : 0, 55569
AppSec [candidate] (55.431 ms) : 0, 55431
Debugger [baseline] (5.972 ms) : 0, 5972
Debugger [candidate] (6.004 ms) : 0, 6004
Remote Config [baseline] (593.802 µs) : 0, 594
Remote Config [candidate] (590.421 µs) : 0, 590
Telemetry [baseline] (7.885 ms) : 0, 7885
Telemetry [candidate] (7.932 ms) : 0, 7932
IAST [baseline] (25.972 ms) : 0, 25972
IAST [candidate] (26.15 ms) : 0, 26150
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.50.0-SNAPSHOT~326d5bc135, baseline=1.50.0-SNAPSHOT~72f45a8563

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.026 s) : 0, 1025996
Total [baseline] (10.457 s) : 0, 10456860
Agent [candidate] (1.025 s) : 0, 1024787
Total [candidate] (10.594 s) : 0, 10594014
section appsec
Agent [baseline] (1.175 s) : 0, 1175158
Total [baseline] (10.668 s) : 0, 10667894
Agent [candidate] (1.175 s) : 0, 1175169
Total [candidate] (10.68 s) : 0, 10679515
section iast
Agent [baseline] (1.153 s) : 0, 1152680
Total [baseline] (10.812 s) : 0, 10812041
Agent [candidate] (1.153 s) : 0, 1153379
Total [candidate] (10.885 s) : 0, 10885243
section profiling
Agent [baseline] (1.276 s) : 0, 1275998
Total [baseline] (10.924 s) : 0, 10923748
Agent [candidate] (1.271 s) : 0, 1271362
Total [candidate] (10.949 s) : 0, 10948746
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.026 s -
Agent appsec 1.175 s 149.162 ms (14.5%)
Agent iast 1.153 s 126.684 ms (12.3%)
Agent profiling 1.276 s 250.002 ms (24.4%)
Total tracing 10.457 s -
Total appsec 10.668 s 211.034 ms (2.0%)
Total iast 10.812 s 355.181 ms (3.4%)
Total profiling 10.924 s 466.888 ms (4.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.025 s -
Agent appsec 1.175 s 150.382 ms (14.7%)
Agent iast 1.153 s 128.592 ms (12.5%)
Agent profiling 1.271 s 246.576 ms (24.1%)
Total tracing 10.594 s -
Total appsec 10.68 s 85.501 ms (0.8%)
Total iast 10.885 s 291.229 ms (2.7%)
Total profiling 10.949 s 354.731 ms (3.3%) 
gantt
    title petclinic - break down per module: candidate=1.50.0-SNAPSHOT~326d5bc135, baseline=1.50.0-SNAPSHOT~72f45a8563

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (682.404 ms) : 0, 682404
BytebuddyAgent [candidate] (682.673 ms) : 0, 682673
GlobalTracer [baseline] (240.273 ms) : 0, 240273
GlobalTracer [candidate] (240.945 ms) : 0, 240945
AppSec [baseline] (61.247 ms) : 0, 61247
AppSec [candidate] (59.006 ms) : 0, 59006
Debugger [baseline] (7.512 ms) : 0, 7512
Debugger [candidate] (6.837 ms) : 0, 6837
Remote Config [baseline] (728.91 µs) : 0, 729
Remote Config [candidate] (732.099 µs) : 0, 732
Telemetry [baseline] (10.34 ms) : 0, 10340
Telemetry [candidate] (11.275 ms) : 0, 11275
section appsec
BytebuddyAgent [baseline] (703.838 ms) : 0, 703838
BytebuddyAgent [candidate] (704.092 ms) : 0, 704092
GlobalTracer [baseline] (233.908 ms) : 0, 233908
GlobalTracer [candidate] (233.951 ms) : 0, 233951
IAST [baseline] (21.803 ms) : 0, 21803
IAST [candidate] (21.748 ms) : 0, 21748
AppSec [baseline] (178.505 ms) : 0, 178505
AppSec [candidate] (178.351 ms) : 0, 178351
Debugger [baseline] (5.844 ms) : 0, 5844
Debugger [candidate] (5.838 ms) : 0, 5838
Remote Config [baseline] (602.025 µs) : 0, 602
Remote Config [candidate] (602.331 µs) : 0, 602
Telemetry [baseline] (7.241 ms) : 0, 7241
Telemetry [candidate] (7.239 ms) : 0, 7239
section iast
BytebuddyAgent [baseline] (802.476 ms) : 0, 802476
BytebuddyAgent [candidate] (803.285 ms) : 0, 803285
GlobalTracer [baseline] (230.41 ms) : 0, 230410
GlobalTracer [candidate] (230.641 ms) : 0, 230641
IAST [baseline] (27.625 ms) : 0, 27625
IAST [candidate] (27.515 ms) : 0, 27515
AppSec [baseline] (54.227 ms) : 0, 54227
AppSec [candidate] (53.995 ms) : 0, 53995
Debugger [baseline] (6.041 ms) : 0, 6041
Debugger [candidate] (5.986 ms) : 0, 5986
Remote Config [baseline] (583.17 µs) : 0, 583
Remote Config [candidate] (586.292 µs) : 0, 586
Telemetry [baseline] (7.877 ms) : 0, 7877
Telemetry [candidate] (7.879 ms) : 0, 7879
section profiling
BytebuddyAgent [baseline] (677.688 ms) : 0, 677688
BytebuddyAgent [candidate] (673.436 ms) : 0, 673436
GlobalTracer [baseline] (361.21 ms) : 0, 361210
GlobalTracer [candidate] (360.51 ms) : 0, 360510
AppSec [baseline] (64.683 ms) : 0, 64683
AppSec [candidate] (64.827 ms) : 0, 64827
Debugger [baseline] (6.149 ms) : 0, 6149
Debugger [candidate] (6.185 ms) : 0, 6185
Remote Config [baseline] (665.982 µs) : 0, 666
Remote Config [candidate] (642.992 µs) : 0, 643
Telemetry [baseline] (8.137 ms) : 0, 8137
Telemetry [candidate] (8.205 ms) : 0, 8205
ProfilingAgent [baseline] (106.626 ms) : 0, 106626
ProfilingAgent [candidate] (107.033 ms) : 0, 107033
Profiling [baseline] (106.652 ms) : 0, 106652
Profiling [candidate] (107.059 ms) : 0, 107059
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-06-17T21:48:06 2025-06-17T21:51:29
git_branch master sarahchen6/fix-codeowner-retrieval-again
git_commit_date 1750176286 1750195705
git_commit_sha 72f45a8 326d5bc
release_version 1.50.0-SNAPSHOT~72f45a8563 1.50.0-SNAPSHOT~326d5bc135
start_time 2025-06-17T21:47:33 2025-06-17T21:49:19
See matching parameters
Baseline Candidate
application petclinic petclinic
ci_job_date 1750197251 1750197251
ci_job_id 987103262 987103262
ci_pipeline_id 68052311 68052311
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-2oizdj4a-project-304-concurrent-0-clxyf83w 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-2oizdj4a-project-304-concurrent-0-clxyf83w 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
thresholds_or_results results results
variant appsec appsec

Summary

Found 5 performance improvements and 0 performance regressions! Performance is the same for 0 metrics, 5 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:petclinic:appsec better
[-61.555ms; -60.118ms] or [-89.392%; -87.306%]		 unstable
[+525.629op/s; +556.334op/s] or [+754.066%; +798.116%]		 8.023ms 610.687op/s 68.859ms 69.706op/s
scenario:load:petclinic:code_origins better
[-62.340ms; -59.682ms] or [-72.409%; -69.322%]		 unstable
[+115.353op/s; +159.981op/s] or [+214.943%; +298.101%]		 25.083ms 191.333op/s 86.094ms 53.667op/s
scenario:load:petclinic:iast better
[-67.762ms; -66.010ms] or [-88.036%; -85.760%]		 unstable
[+404.110op/s; +445.325op/s] or [+647.251%; +713.265%]		 10.084ms 487.152op/s 76.971ms 62.435op/s
scenario:load:petclinic:no_agent better
[-12.215ms; -12.017ms] or [-96.566%; -95.002%]		 unstable
[+2019.415op/s; +6607.162op/s] or [+514.378%; +1682.951%]		 0.533ms 4705.882op/s 12.649ms 392.594op/s
scenario:load:petclinic:tracing better
[-50.710ms; -49.575ms] or [-100.991%; -98.730%]		 unstable
[+5728.358op/s; +10076.806op/s] or [+5880.173%; +10343.866%]		 0.070ms 8000.000op/s 50.212ms 97.418op/s

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/fix-codeowner-retrieval-again
git_commit_date 1750176286 1750195705
git_commit_sha 72f45a8 326d5bc
release_version 1.50.0-SNAPSHOT~72f45a8563 1.50.0-SNAPSHOT~326d5bc135
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1750198049 1750198049
ci_job_id 987103263 987103263
ci_pipeline_id 68052311 68052311
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-clrnfvyp-project-304-concurrent-1-ua3xe6kl 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-clrnfvyp-project-304-concurrent-1-ua3xe6kl 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~326d5bc135, baseline=1.50.0-SNAPSHOT~72f45a8563
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.575 s) : 15575000, 15575000
.   : milestone, 15575000,
appsec (14.892 s) : 14892000, 14892000
.   : milestone, 14892000,
iast (18.691 s) : 18691000, 18691000
.   : milestone, 18691000,
iast_GLOBAL (17.938 s) : 17938000, 17938000
.   : milestone, 17938000,
profiling (15.576 s) : 15576000, 15576000
.   : milestone, 15576000,
tracing (14.931 s) : 14931000, 14931000
.   : milestone, 14931000,
section candidate
no_agent (15.515 s) : 15515000, 15515000
.   : milestone, 15515000,
appsec (19.197 s) : 19197000, 19197000
.   : milestone, 19197000,
iast (19.193 s) : 19193000, 19193000
.   : milestone, 19193000,
iast_GLOBAL (17.916 s) : 17916000, 17916000
.   : milestone, 17916000,
profiling (15.16 s) : 15160000, 15160000
.   : milestone, 15160000,
tracing (15.002 s) : 15002000, 15002000
.   : milestone, 15002000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.575 s [15.575 s, 15.575 s] -
appsec 14.892 s [14.892 s, 14.892 s] -683.0 ms (-4.4%)
iast 18.691 s [18.691 s, 18.691 s] 3.116 s (20.0%)
iast_GLOBAL 17.938 s [17.938 s, 17.938 s] 2.363 s (15.2%)
profiling 15.576 s [15.576 s, 15.576 s] 1.0 ms (0.0%)
tracing 14.931 s [14.931 s, 14.931 s] -644.0 ms (-4.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.515 s [15.515 s, 15.515 s] -
appsec 19.197 s [19.197 s, 19.197 s] 3.682 s (23.7%)
iast 19.193 s [19.193 s, 19.193 s] 3.678 s (23.7%)
iast_GLOBAL 17.916 s [17.916 s, 17.916 s] 2.401 s (15.5%)
profiling 15.16 s [15.16 s, 15.16 s] -355.0 ms (-2.3%)
tracing 15.002 s [15.002 s, 15.002 s] -513.0 ms (-3.3%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~326d5bc135, baseline=1.50.0-SNAPSHOT~72f45a8563
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.48 ms) : 1469, 1492
.   : milestone, 1480,
appsec (2.416 ms) : 2368, 2465
.   : milestone, 2416,
iast (2.204 ms) : 2142, 2266
.   : milestone, 2204,
iast_GLOBAL (2.248 ms) : 2186, 2311
.   : milestone, 2248,
profiling (2.077 ms) : 2026, 2129
.   : milestone, 2077,
tracing (2.018 ms) : 1970, 2066
.   : milestone, 2018,
section candidate
no_agent (1.48 ms) : 1469, 1492
.   : milestone, 1480,
appsec (2.433 ms) : 2384, 2483
.   : milestone, 2433,
iast (2.203 ms) : 2141, 2265
.   : milestone, 2203,
iast_GLOBAL (2.251 ms) : 2189, 2313
.   : milestone, 2251,
profiling (2.048 ms) : 1998, 2098
.   : milestone, 2048,
tracing (2.022 ms) : 1975, 2070
.   : milestone, 2022,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.48 ms [1.469 ms, 1.492 ms] -
appsec 2.416 ms [2.368 ms, 2.465 ms] 936.084 µs (63.2%)
iast 2.204 ms [2.142 ms, 2.266 ms] 723.333 µs (48.9%)
iast_GLOBAL 2.248 ms [2.186 ms, 2.311 ms] 767.879 µs (51.9%)
profiling 2.077 ms [2.026 ms, 2.129 ms] 596.914 µs (40.3%)
tracing 2.018 ms [1.97 ms, 2.066 ms] 537.661 µs (36.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.48 ms [1.469 ms, 1.492 ms] -
appsec 2.433 ms [2.384 ms, 2.483 ms] 953.304 µs (64.4%)
iast 2.203 ms [2.141 ms, 2.265 ms] 723.022 µs (48.8%)
iast_GLOBAL 2.251 ms [2.189 ms, 2.313 ms] 770.681 µs (52.1%)
profiling 2.048 ms [1.998 ms, 2.098 ms] 567.97 µs (38.4%)
tracing 2.022 ms [1.975 ms, 2.07 ms] 542.187 µs (36.6%)

@sarahchen6
Copy link
Contributor Author

Fixed by #9008 :)

@sarahchen6 sarahchen6 closed this Jun 20, 2025
@sarahchen6 sarahchen6 deleted the sarahchen6/fix-codeowner-retrieval-again branch October 16, 2025 18:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes type: enhancement Enhancements and improvements

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@sarahchen6