Skip to content

Code Changes from Chat Message bc5066f5-cc93-4018-b432-6fdaca377d55 #9123

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 1 commit into from
Closed

Code Changes from Chat Message bc5066f5-cc93-4018-b432-6fdaca377d55 #9123

wants to merge 1 commit into from

Conversation

@datadog-datadog-prod-us1
Copy link
Contributor

PR by Bits for chat 68b9d59a-f0f9-4167-be10-38efc8ed6f27.

You can ask for changes by mentioning @DataDog in a comment.

Feedback (especially what can be better) welcome in #code-gen-feedback!

@pr-commenter
Copy link

pr-commenter bot commented Jul 8, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master dd-lAf7IE4B56F8
git_commit_date 1751965004 1751968169
git_commit_sha 0f0b07e b527c5b
release_version 1.51.0-SNAPSHOT~0f0b07e5b7 1.51.0-SNAPSHOT~b527c5b204
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1751969992 1751969992
ci_job_id 1017787129 1017787129
ci_pipeline_id 69881385 69881385
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-3-13lbsts2 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-3-13lbsts2 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 43 metrics, 10 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.51.0-SNAPSHOT~b527c5b204, baseline=1.51.0-SNAPSHOT~0f0b07e5b7

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (995.46 ms) : 0, 995460
Total [baseline] (8.583 s) : 0, 8583180
Agent [candidate] (995.028 ms) : 0, 995028
Total [candidate] (8.556 s) : 0, 8556286
section iast
Agent [baseline] (1.134 s) : 0, 1134188
Total [baseline] (9.264 s) : 0, 9263959
Agent [candidate] (1.137 s) : 0, 1137473
Total [candidate] (9.273 s) : 0, 9272765
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 995.46 ms -
Agent iast 1.134 s 138.728 ms (13.9%)
Total tracing 8.583 s -
Total iast 9.264 s 680.779 ms (7.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 995.028 ms -
Agent iast 1.137 s 142.445 ms (14.3%)
Total tracing 8.556 s -
Total iast 9.273 s 716.48 ms (8.4%) 
gantt
    title insecure-bank - break down per module: candidate=1.51.0-SNAPSHOT~b527c5b204, baseline=1.51.0-SNAPSHOT~0f0b07e5b7

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (687.649 ms) : 0, 687649
BytebuddyAgent [candidate] (687.484 ms) : 0, 687484
GlobalTracer [baseline] (241.649 ms) : 0, 241649
GlobalTracer [candidate] (241.525 ms) : 0, 241525
AppSec [baseline] (30.405 ms) : 0, 30405
AppSec [candidate] (30.317 ms) : 0, 30317
Debugger [baseline] (6.05 ms) : 0, 6050
Debugger [candidate] (6.028 ms) : 0, 6028
Remote Config [baseline] (681.924 µs) : 0, 682
Remote Config [candidate] (671.963 µs) : 0, 672
Telemetry [baseline] (8.195 ms) : 0, 8195
Telemetry [candidate] (8.25 ms) : 0, 8250
section iast
BytebuddyAgent [baseline] (810.014 ms) : 0, 810014
BytebuddyAgent [candidate] (811.545 ms) : 0, 811545
GlobalTracer [baseline] (231.477 ms) : 0, 231477
GlobalTracer [candidate] (232.516 ms) : 0, 232516
AppSec [baseline] (29.545 ms) : 0, 29545
AppSec [candidate] (28.395 ms) : 0, 28395
Debugger [baseline] (6.619 ms) : 0, 6619
Debugger [candidate] (6.738 ms) : 0, 6738
Remote Config [baseline] (586.702 µs) : 0, 587
Remote Config [candidate] (578.836 µs) : 0, 579
Telemetry [baseline] (7.927 ms) : 0, 7927
Telemetry [candidate] (7.968 ms) : 0, 7968
IAST [baseline] (27.205 ms) : 0, 27205
IAST [candidate] (28.986 ms) : 0, 28986
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.51.0-SNAPSHOT~b527c5b204, baseline=1.51.0-SNAPSHOT~0f0b07e5b7

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (994.809 ms) : 0, 994809
Total [baseline] (10.6 s) : 0, 10599691
Agent [candidate] (993.711 ms) : 0, 993711
Total [candidate] (10.615 s) : 0, 10614850
section appsec
Agent [baseline] (1.174 s) : 0, 1173511
Total [baseline] (10.669 s) : 0, 10669116
Agent [candidate] (1.174 s) : 0, 1174082
Total [candidate] (10.755 s) : 0, 10754862
section iast
Agent [baseline] (1.131 s) : 0, 1131092
Total [baseline] (10.764 s) : 0, 10763575
Agent [candidate] (1.139 s) : 0, 1138822
Total [candidate] (10.796 s) : 0, 10796140
section profiling
Agent [baseline] (1.251 s) : 0, 1251368
Total [baseline] (10.952 s) : 0, 10952035
Agent [candidate] (1.245 s) : 0, 1245419
Total [candidate] (10.941 s) : 0, 10940976
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 994.809 ms -
Agent appsec 1.174 s 178.702 ms (18.0%)
Agent iast 1.131 s 136.283 ms (13.7%)
Agent profiling 1.251 s 256.558 ms (25.8%)
Total tracing 10.6 s -
Total appsec 10.669 s 69.425 ms (0.7%)
Total iast 10.764 s 163.884 ms (1.5%)
Total profiling 10.952 s 352.344 ms (3.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 993.711 ms -
Agent appsec 1.174 s 180.371 ms (18.2%)
Agent iast 1.139 s 145.111 ms (14.6%)
Agent profiling 1.245 s 251.707 ms (25.3%)
Total tracing 10.615 s -
Total appsec 10.755 s 140.012 ms (1.3%)
Total iast 10.796 s 181.29 ms (1.7%)
Total profiling 10.941 s 326.126 ms (3.1%) 
gantt
    title petclinic - break down per module: candidate=1.51.0-SNAPSHOT~b527c5b204, baseline=1.51.0-SNAPSHOT~0f0b07e5b7

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (686.432 ms) : 0, 686432
BytebuddyAgent [candidate] (685.998 ms) : 0, 685998
GlobalTracer [baseline] (242.273 ms) : 0, 242273
GlobalTracer [candidate] (241.712 ms) : 0, 241712
AppSec [baseline] (30.453 ms) : 0, 30453
AppSec [candidate] (30.273 ms) : 0, 30273
Debugger [baseline] (6.047 ms) : 0, 6047
Debugger [candidate] (6.035 ms) : 0, 6035
Remote Config [baseline] (667.966 µs) : 0, 668
Remote Config [candidate] (680.58 µs) : 0, 681
Telemetry [baseline] (8.218 ms) : 0, 8218
Telemetry [candidate] (8.219 ms) : 0, 8219
section appsec
BytebuddyAgent [baseline] (709.858 ms) : 0, 709858
BytebuddyAgent [candidate] (709.954 ms) : 0, 709954
GlobalTracer [baseline] (234.521 ms) : 0, 234521
GlobalTracer [candidate] (235.01 ms) : 0, 235010
AppSec [baseline] (170.824 ms) : 0, 170824
AppSec [candidate] (170.544 ms) : 0, 170544
Debugger [baseline] (5.727 ms) : 0, 5727
Debugger [candidate] (5.782 ms) : 0, 5782
Remote Config [baseline] (610.475 µs) : 0, 610
Remote Config [candidate] (615.179 µs) : 0, 615
Telemetry [baseline] (8.043 ms) : 0, 8043
Telemetry [candidate] (8.169 ms) : 0, 8169
IAST [baseline] (23.126 ms) : 0, 23126
IAST [candidate] (23.189 ms) : 0, 23189
section iast
BytebuddyAgent [baseline] (806.484 ms) : 0, 806484
BytebuddyAgent [candidate] (812.64 ms) : 0, 812640
GlobalTracer [baseline] (232.131 ms) : 0, 232131
GlobalTracer [candidate] (233.208 ms) : 0, 233208
AppSec [baseline] (31.532 ms) : 0, 31532
AppSec [candidate] (30.753 ms) : 0, 30753
Debugger [baseline] (6.618 ms) : 0, 6618
Debugger [candidate] (5.778 ms) : 0, 5778
Remote Config [baseline] (568.333 µs) : 0, 568
Remote Config [candidate] (573.678 µs) : 0, 574
Telemetry [baseline] (7.828 ms) : 0, 7828
Telemetry [candidate] (7.917 ms) : 0, 7917
IAST [baseline] (25.202 ms) : 0, 25202
IAST [candidate] (27.097 ms) : 0, 27097
section profiling
BytebuddyAgent [baseline] (681.74 ms) : 0, 681740
BytebuddyAgent [candidate] (677.649 ms) : 0, 677649
GlobalTracer [baseline] (362.793 ms) : 0, 362793
GlobalTracer [candidate] (361.029 ms) : 0, 361029
AppSec [baseline] (34.055 ms) : 0, 34055
AppSec [candidate] (35.415 ms) : 0, 35415
Debugger [baseline] (9.866 ms) : 0, 9866
Debugger [candidate] (9.191 ms) : 0, 9191
Remote Config [baseline] (681.709 µs) : 0, 682
Remote Config [candidate] (659.568 µs) : 0, 660
Telemetry [baseline] (8.766 ms) : 0, 8766
Telemetry [candidate] (8.038 ms) : 0, 8038
ProfilingAgent [baseline] (104.702 ms) : 0, 104702
ProfilingAgent [candidate] (104.897 ms) : 0, 104897
Profiling [baseline] (104.726 ms) : 0, 104726
Profiling [candidate] (104.92 ms) : 0, 104920
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master dd-lAf7IE4B56F8
git_commit_date 1751965004 1751968169
git_commit_sha 0f0b07e b527c5b
release_version 1.51.0-SNAPSHOT~0f0b07e5b7 1.51.0-SNAPSHOT~b527c5b204
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1751969676 1751969676
ci_job_id 1017787130 1017787130
ci_pipeline_id 69881385 69881385
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-4-vq5cwa60 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-4-vq5cwa60 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:profiling:high_load better
[-591.921µs; -302.806µs] or [-6.582%; -3.367%]		 unstable
[-40.070op/s; +93.695op/s] or [-7.767%; +18.161%]		 8.546ms 542.719op/s 8.993ms 515.906op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.51.0-SNAPSHOT~b527c5b204, baseline=1.51.0-SNAPSHOT~0f0b07e5b7
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.323 ms) : 4275, 4372
.   : milestone, 4323,
iast (9.341 ms) : 9190, 9492
.   : milestone, 9341,
iast_FULL (13.82 ms) : 13545, 14095
.   : milestone, 13820,
iast_GLOBAL (10.137 ms) : 9962, 10312
.   : milestone, 10137,
profiling (8.993 ms) : 8855, 9131
.   : milestone, 8993,
tracing (7.996 ms) : 7873, 8119
.   : milestone, 7996,
section candidate
no_agent (4.4 ms) : 4344, 4457
.   : milestone, 4400,
iast (9.162 ms) : 9013, 9311
.   : milestone, 9162,
iast_FULL (14.371 ms) : 14081, 14660
.   : milestone, 14371,
iast_GLOBAL (10.502 ms) : 10321, 10683
.   : milestone, 10502,
profiling (8.546 ms) : 8415, 8677
.   : milestone, 8546,
tracing (7.907 ms) : 7792, 8022
.   : milestone, 7907,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.323 ms [4.275 ms, 4.372 ms] -
iast 9.341 ms [9.19 ms, 9.492 ms] 5.018 ms (116.1%)
iast_FULL 13.82 ms [13.545 ms, 14.095 ms] 9.497 ms (219.7%)
iast_GLOBAL 10.137 ms [9.962 ms, 10.312 ms] 5.814 ms (134.5%)
profiling 8.993 ms [8.855 ms, 9.131 ms] 4.67 ms (108.0%)
tracing 7.996 ms [7.873 ms, 8.119 ms] 3.673 ms (85.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.4 ms [4.344 ms, 4.457 ms] -
iast 9.162 ms [9.013 ms, 9.311 ms] 4.762 ms (108.2%)
iast_FULL 14.371 ms [14.081 ms, 14.66 ms] 9.97 ms (226.6%)
iast_GLOBAL 10.502 ms [10.321 ms, 10.683 ms] 6.102 ms (138.7%)
profiling 8.546 ms [8.415 ms, 8.677 ms] 4.145 ms (94.2%)
tracing 7.907 ms [7.792 ms, 8.022 ms] 3.507 ms (79.7%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.51.0-SNAPSHOT~b527c5b204, baseline=1.51.0-SNAPSHOT~0f0b07e5b7
    dateFormat X
    axisFormat %s
section baseline
no_agent (37.183 ms) : 36887, 37478
.   : milestone, 37183,
appsec (48.262 ms) : 47837, 48687
.   : milestone, 48262,
code_origins (46.416 ms) : 46018, 46814
.   : milestone, 46416,
iast (43.356 ms) : 42970, 43742
.   : milestone, 43356,
profiling (49.82 ms) : 49344, 50296
.   : milestone, 49820,
tracing (44.227 ms) : 43851, 44602
.   : milestone, 44227,
section candidate
no_agent (36.683 ms) : 36394, 36973
.   : milestone, 36683,
appsec (48.069 ms) : 47632, 48507
.   : milestone, 48069,
code_origins (46.115 ms) : 45728, 46502
.   : milestone, 46115,
iast (43.359 ms) : 42983, 43734
.   : milestone, 43359,
profiling (49.489 ms) : 49001, 49976
.   : milestone, 49489,
tracing (43.755 ms) : 43396, 44114
.   : milestone, 43755,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 37.183 ms [36.887 ms, 37.478 ms] -
appsec 48.262 ms [47.837 ms, 48.687 ms] 11.08 ms (29.8%)
code_origins 46.416 ms [46.018 ms, 46.814 ms] 9.233 ms (24.8%)
iast 43.356 ms [42.97 ms, 43.742 ms] 6.174 ms (16.6%)
profiling 49.82 ms [49.344 ms, 50.296 ms] 12.637 ms (34.0%)
tracing 44.227 ms [43.851 ms, 44.602 ms] 7.044 ms (18.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 36.683 ms [36.394 ms, 36.973 ms] -
appsec 48.069 ms [47.632 ms, 48.507 ms] 11.386 ms (31.0%)
code_origins 46.115 ms [45.728 ms, 46.502 ms] 9.432 ms (25.7%)
iast 43.359 ms [42.983 ms, 43.734 ms] 6.675 ms (18.2%)
profiling 49.489 ms [49.001 ms, 49.976 ms] 12.805 ms (34.9%)
tracing 43.755 ms [43.396 ms, 44.114 ms] 7.071 ms (19.3%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master dd-lAf7IE4B56F8
git_commit_date 1751965004 1751968169
git_commit_sha 0f0b07e b527c5b
release_version 1.51.0-SNAPSHOT~0f0b07e5b7 1.51.0-SNAPSHOT~b527c5b204
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1751970224 1751970224
ci_job_id 1017787131 1017787131
ci_pipeline_id 69881385 69881385
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-5-3adbqlur 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-5-3adbqlur 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.51.0-SNAPSHOT~b527c5b204, baseline=1.51.0-SNAPSHOT~0f0b07e5b7
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.476 ms) : 1464, 1488
.   : milestone, 1476,
appsec (2.406 ms) : 2357, 2454
.   : milestone, 2406,
iast (2.184 ms) : 2122, 2245
.   : milestone, 2184,
iast_GLOBAL (2.232 ms) : 2170, 2295
.   : milestone, 2232,
profiling (2.043 ms) : 1993, 2094
.   : milestone, 2043,
tracing (2.004 ms) : 1956, 2051
.   : milestone, 2004,
section candidate
no_agent (1.476 ms) : 1465, 1488
.   : milestone, 1476,
appsec (2.397 ms) : 2347, 2446
.   : milestone, 2397,
iast (2.201 ms) : 2139, 2262
.   : milestone, 2201,
iast_GLOBAL (2.243 ms) : 2180, 2305
.   : milestone, 2243,
profiling (2.038 ms) : 1988, 2088
.   : milestone, 2038,
tracing (2.007 ms) : 1959, 2055
.   : milestone, 2007,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.464 ms, 1.488 ms] -
appsec 2.406 ms [2.357 ms, 2.454 ms] 929.71 µs (63.0%)
iast 2.184 ms [2.122 ms, 2.245 ms] 707.812 µs (48.0%)
iast_GLOBAL 2.232 ms [2.17 ms, 2.295 ms] 756.495 µs (51.3%)
profiling 2.043 ms [1.993 ms, 2.094 ms] 567.424 µs (38.4%)
tracing 2.004 ms [1.956 ms, 2.051 ms] 527.825 µs (35.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.465 ms, 1.488 ms] -
appsec 2.397 ms [2.347 ms, 2.446 ms] 920.245 µs (62.3%)
iast 2.201 ms [2.139 ms, 2.262 ms] 724.215 µs (49.1%)
iast_GLOBAL 2.243 ms [2.18 ms, 2.305 ms] 766.603 µs (51.9%)
profiling 2.038 ms [1.988 ms, 2.088 ms] 561.764 µs (38.1%)
tracing 2.007 ms [1.959 ms, 2.055 ms] 530.703 µs (35.9%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.51.0-SNAPSHOT~b527c5b204, baseline=1.51.0-SNAPSHOT~0f0b07e5b7
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.631 s) : 15631000, 15631000
.   : milestone, 15631000,
appsec (14.786 s) : 14786000, 14786000
.   : milestone, 14786000,
iast (18.522 s) : 18522000, 18522000
.   : milestone, 18522000,
iast_GLOBAL (17.886 s) : 17886000, 17886000
.   : milestone, 17886000,
profiling (15.145 s) : 15145000, 15145000
.   : milestone, 15145000,
tracing (14.857 s) : 14857000, 14857000
.   : milestone, 14857000,
section candidate
no_agent (14.92 s) : 14920000, 14920000
.   : milestone, 14920000,
appsec (14.965 s) : 14965000, 14965000
.   : milestone, 14965000,
iast (18.496 s) : 18496000, 18496000
.   : milestone, 18496000,
iast_GLOBAL (18.175 s) : 18175000, 18175000
.   : milestone, 18175000,
profiling (15.194 s) : 15194000, 15194000
.   : milestone, 15194000,
tracing (14.886 s) : 14886000, 14886000
.   : milestone, 14886000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.631 s [15.631 s, 15.631 s] -
appsec 14.786 s [14.786 s, 14.786 s] -845.0 ms (-5.4%)
iast 18.522 s [18.522 s, 18.522 s] 2.891 s (18.5%)
iast_GLOBAL 17.886 s [17.886 s, 17.886 s] 2.255 s (14.4%)
profiling 15.145 s [15.145 s, 15.145 s] -486.0 ms (-3.1%)
tracing 14.857 s [14.857 s, 14.857 s] -774.0 ms (-5.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.92 s [14.92 s, 14.92 s] -
appsec 14.965 s [14.965 s, 14.965 s] 45.0 ms (0.3%)
iast 18.496 s [18.496 s, 18.496 s] 3.576 s (24.0%)
iast_GLOBAL 18.175 s [18.175 s, 18.175 s] 3.255 s (21.8%)
profiling 15.194 s [15.194 s, 15.194 s] 274.0 ms (1.8%)
tracing 14.886 s [14.886 s, 14.886 s] -34.0 ms (-0.2%)

@pr-commenter
Copy link

pr-commenter bot commented Jul 8, 2025

Kafka / producer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master dd-lAf7IE4B56F8
git_commit_date 1751965028 1751968169
git_commit_sha 2952bda b527c5b
See matching parameters
Baseline Candidate
ci_job_date 1751969246 1751969246
ci_job_id 1017787134 1017787134
ci_pipeline_id 69881385 69881385
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce unsure
[+594.294op/s; +6156.377op/s] or [+0.352%; +3.647%]
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce same

@pr-commenter
Copy link

pr-commenter bot commented Jul 8, 2025

Kafka / consumer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master dd-lAf7IE4B56F8
git_commit_date 1751965028 1751968169
git_commit_sha 2952bda b527c5b
See matching parameters
Baseline Candidate
ci_job_date 1751969281 1751969281
ci_job_id 1017787135 1017787135
ci_pipeline_id 69881385 69881385
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume same

@PerfectSlayer PerfectSlayer added tag: ai generated Largely based on code generated by an AI or LLM and removed Bits AI labels Jul 8, 2025
@PerfectSlayer PerfectSlayer deleted the dd-lAf7IE4B56F8 branch July 8, 2025 14:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

tag: ai generated Largely based on code generated by an AI or LLM

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@PerfectSlayer @bm1549