-
Notifications
You must be signed in to change notification settings - Fork 314
Bump build-inst resource class on circle ci #8833
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
Hi! 👋 Thanks for your pull request! 🎉 To help us review it, please make sure to:
If you need help, please check our contributing guidelines. |
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 60 metrics, 11 unstable metrics. Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.50.0-SNAPSHOT~681b6fd095, baseline=1.50.0-SNAPSHOT~50e8b5aefc
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.028 s) : 0, 1027680
Total [baseline] (8.684 s) : 0, 8683732
Agent [candidate] (1.034 s) : 0, 1033896
Total [candidate] (8.682 s) : 0, 8682477
section iast
Agent [baseline] (1.146 s) : 0, 1146072
Total [baseline] (9.22 s) : 0, 9219862
Agent [candidate] (1.147 s) : 0, 1147323
Total [candidate] (9.222 s) : 0, 9222086
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.144 s) : 0, 1143974
Total [baseline] (9.174 s) : 0, 9173679
Agent [candidate] (1.147 s) : 0, 1146588
Total [candidate] (9.168 s) : 0, 9168243
section iast_TELEMETRY_OFF
Agent [baseline] (1.153 s) : 0, 1152597
Total [baseline] (9.205 s) : 0, 9205084
Agent [candidate] (1.142 s) : 0, 1142274
Total [candidate] (9.209 s) : 0, 9208645
gantt
title insecure-bank - break down per module: candidate=1.50.0-SNAPSHOT~681b6fd095, baseline=1.50.0-SNAPSHOT~50e8b5aefc
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (687.601 ms) : 0, 687601
BytebuddyAgent [candidate] (690.178 ms) : 0, 690178
GlobalTracer [baseline] (241.606 ms) : 0, 241606
GlobalTracer [candidate] (242.253 ms) : 0, 242253
AppSec [baseline] (55.109 ms) : 0, 55109
AppSec [candidate] (55.829 ms) : 0, 55829
Debugger [baseline] (7.588 ms) : 0, 7588
Debugger [candidate] (10.551 ms) : 0, 10551
Remote Config [baseline] (706.786 µs) : 0, 707
Remote Config [candidate] (705.149 µs) : 0, 705
Telemetry [baseline] (11.408 ms) : 0, 11408
Telemetry [candidate] (10.528 ms) : 0, 10528
section iast
BytebuddyAgent [baseline] (800.016 ms) : 0, 800016
BytebuddyAgent [candidate] (801.298 ms) : 0, 801298
GlobalTracer [baseline] (229.647 ms) : 0, 229647
GlobalTracer [candidate] (230.112 ms) : 0, 230112
IAST [baseline] (27.404 ms) : 0, 27404
IAST [candidate] (29.063 ms) : 0, 29063
AppSec [baseline] (51.168 ms) : 0, 51168
AppSec [candidate] (48.431 ms) : 0, 48431
Debugger [baseline] (5.882 ms) : 0, 5882
Debugger [candidate] (5.828 ms) : 0, 5828
Remote Config [baseline] (598.237 µs) : 0, 598
Remote Config [candidate] (589.62 µs) : 0, 590
Telemetry [baseline] (7.84 ms) : 0, 7840
Telemetry [candidate] (7.812 ms) : 0, 7812
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (798.261 ms) : 0, 798261
BytebuddyAgent [candidate] (800.085 ms) : 0, 800085
GlobalTracer [baseline] (229.665 ms) : 0, 229665
GlobalTracer [candidate] (230.459 ms) : 0, 230459
IAST [baseline] (27.418 ms) : 0, 27418
IAST [candidate] (26.53 ms) : 0, 26530
AppSec [baseline] (50.922 ms) : 0, 50922
AppSec [candidate] (51.8 ms) : 0, 51800
Debugger [baseline] (5.828 ms) : 0, 5828
Debugger [candidate] (5.846 ms) : 0, 5846
Remote Config [baseline] (587.659 µs) : 0, 588
Remote Config [candidate] (588.211 µs) : 0, 588
Telemetry [baseline] (7.861 ms) : 0, 7861
Telemetry [candidate] (7.853 ms) : 0, 7853
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (804.556 ms) : 0, 804556
BytebuddyAgent [candidate] (796.697 ms) : 0, 796697
GlobalTracer [baseline] (231.082 ms) : 0, 231082
GlobalTracer [candidate] (229.84 ms) : 0, 229840
IAST [baseline] (22.547 ms) : 0, 22547
IAST [candidate] (22.219 ms) : 0, 22219
AppSec [baseline] (56.199 ms) : 0, 56199
AppSec [candidate] (55.022 ms) : 0, 55022
Debugger [baseline] (5.976 ms) : 0, 5976
Debugger [candidate] (5.906 ms) : 0, 5906
Remote Config [baseline] (605.362 µs) : 0, 605
Remote Config [candidate] (593.592 µs) : 0, 594
Telemetry [baseline] (7.864 ms) : 0, 7864
Telemetry [candidate] (7.724 ms) : 0, 7724
Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.50.0-SNAPSHOT~681b6fd095, baseline=1.50.0-SNAPSHOT~50e8b5aefc
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.03 s) : 0, 1029693
Total [baseline] (10.571 s) : 0, 10570864
Agent [candidate] (1.019 s) : 0, 1018538
Total [candidate] (10.437 s) : 0, 10437178
section appsec
Agent [baseline] (1.163 s) : 0, 1163135
Total [baseline] (10.667 s) : 0, 10666600
Agent [candidate] (1.166 s) : 0, 1165554
Total [candidate] (10.765 s) : 0, 10764778
section iast
Agent [baseline] (1.164 s) : 0, 1164035
Total [baseline] (10.849 s) : 0, 10849247
Agent [candidate] (1.156 s) : 0, 1155736
Total [candidate] (10.869 s) : 0, 10869418
section profiling
Agent [baseline] (1.287 s) : 0, 1286524
Total [baseline] (10.888 s) : 0, 10888101
Agent [candidate] (1.284 s) : 0, 1283857
Total [candidate] (10.797 s) : 0, 10796849
gantt
title petclinic - break down per module: candidate=1.50.0-SNAPSHOT~681b6fd095, baseline=1.50.0-SNAPSHOT~50e8b5aefc
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (690.3 ms) : 0, 690300
BytebuddyAgent [candidate] (680.452 ms) : 0, 680452
GlobalTracer [baseline] (242.315 ms) : 0, 242315
GlobalTracer [candidate] (239.902 ms) : 0, 239902
AppSec [baseline] (54.969 ms) : 0, 54969
AppSec [candidate] (54.45 ms) : 0, 54450
Debugger [baseline] (6.185 ms) : 0, 6185
Debugger [candidate] (8.444 ms) : 0, 8444
Remote Config [baseline] (704.275 µs) : 0, 704
Remote Config [candidate] (696.966 µs) : 0, 697
Telemetry [baseline] (11.446 ms) : 0, 11446
Telemetry [candidate] (11.205 ms) : 0, 11205
section appsec
BytebuddyAgent [baseline] (701.775 ms) : 0, 701775
BytebuddyAgent [candidate] (703.39 ms) : 0, 703390
GlobalTracer [baseline] (236.897 ms) : 0, 236897
GlobalTracer [candidate] (237.354 ms) : 0, 237354
AppSec [baseline] (175.789 ms) : 0, 175789
AppSec [candidate] (176.075 ms) : 0, 176075
Debugger [baseline] (5.955 ms) : 0, 5955
Debugger [candidate] (5.97 ms) : 0, 5970
Remote Config [baseline] (624.841 µs) : 0, 625
Remote Config [candidate] (632.972 µs) : 0, 633
Telemetry [baseline] (7.704 ms) : 0, 7704
Telemetry [candidate] (7.456 ms) : 0, 7456
IAST [baseline] (21.585 ms) : 0, 21585
IAST [candidate] (21.951 ms) : 0, 21951
section iast
BytebuddyAgent [baseline] (814.317 ms) : 0, 814317
BytebuddyAgent [candidate] (807.023 ms) : 0, 807023
GlobalTracer [baseline] (232.838 ms) : 0, 232838
GlobalTracer [candidate] (231.64 ms) : 0, 231640
AppSec [baseline] (47.792 ms) : 0, 47792
AppSec [candidate] (48.889 ms) : 0, 48889
Debugger [baseline] (5.887 ms) : 0, 5887
Debugger [candidate] (5.936 ms) : 0, 5936
Remote Config [baseline] (583.279 µs) : 0, 583
Remote Config [candidate] (597.338 µs) : 0, 597
Telemetry [baseline] (7.924 ms) : 0, 7924
Telemetry [candidate] (7.942 ms) : 0, 7942
IAST [baseline] (30.998 ms) : 0, 30998
IAST [candidate] (30.077 ms) : 0, 30077
section profiling
BytebuddyAgent [baseline] (677.684 ms) : 0, 677684
BytebuddyAgent [candidate] (676.834 ms) : 0, 676834
GlobalTracer [baseline] (376.095 ms) : 0, 376095
GlobalTracer [candidate] (375.286 ms) : 0, 375286
AppSec [baseline] (62.351 ms) : 0, 62351
AppSec [candidate] (61.695 ms) : 0, 61695
Debugger [baseline] (6.342 ms) : 0, 6342
Debugger [candidate] (6.334 ms) : 0, 6334
Remote Config [baseline] (671.723 µs) : 0, 672
Remote Config [candidate] (670.415 µs) : 0, 670
Telemetry [baseline] (8.245 ms) : 0, 8245
Telemetry [candidate] (8.257 ms) : 0, 8257
ProfilingAgent [baseline] (103.925 ms) : 0, 103925
ProfilingAgent [candidate] (103.702 ms) : 0, 103702
Profiling [baseline] (103.95 ms) : 0, 103950
Profiling [candidate] (103.725 ms) : 0, 103725
LoadParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 18 unstable metrics. Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~681b6fd095, baseline=1.50.0-SNAPSHOT~50e8b5aefc
dateFormat X
axisFormat %s
section baseline
no_agent (1.361 ms) : 1342, 1381
. : milestone, 1361,
appsec (1.737 ms) : 1713, 1761
. : milestone, 1737,
appsec_no_iast (1.718 ms) : 1695, 1742
. : milestone, 1718,
code_origins (1.67 ms) : 1643, 1698
. : milestone, 1670,
iast (1.514 ms) : 1490, 1539
. : milestone, 1514,
profiling (1.538 ms) : 1514, 1563
. : milestone, 1538,
tracing (1.503 ms) : 1478, 1528
. : milestone, 1503,
section candidate
no_agent (1.352 ms) : 1333, 1372
. : milestone, 1352,
appsec (1.722 ms) : 1698, 1746
. : milestone, 1722,
appsec_no_iast (1.731 ms) : 1708, 1754
. : milestone, 1731,
code_origins (1.659 ms) : 1631, 1686
. : milestone, 1659,
iast (1.526 ms) : 1502, 1550
. : milestone, 1526,
profiling (1.538 ms) : 1513, 1563
. : milestone, 1538,
tracing (1.502 ms) : 1477, 1526
. : milestone, 1502,
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~681b6fd095, baseline=1.50.0-SNAPSHOT~50e8b5aefc
dateFormat X
axisFormat %s
section baseline
no_agent (384.946 µs) : 365, 405
. : milestone, 385,
iast (529.622 µs) : 506, 553
. : milestone, 530,
iast_FULL (728.1 µs) : 706, 750
. : milestone, 728,
iast_GLOBAL (567.818 µs) : 545, 591
. : milestone, 568,
iast_HARDCODED_SECRET_DISABLED (523.256 µs) : 501, 546
. : milestone, 523,
iast_INACTIVE (466.74 µs) : 445, 489
. : milestone, 467,
iast_TELEMETRY_OFF (504.091 µs) : 481, 527
. : milestone, 504,
tracing (457.397 µs) : 435, 480
. : milestone, 457,
section candidate
no_agent (376.97 µs) : 357, 397
. : milestone, 377,
iast (521.936 µs) : 500, 544
. : milestone, 522,
iast_FULL (732.727 µs) : 711, 755
. : milestone, 733,
iast_GLOBAL (563.915 µs) : 541, 587
. : milestone, 564,
iast_HARDCODED_SECRET_DISABLED (526.856 µs) : 503, 550
. : milestone, 527,
iast_INACTIVE (465.699 µs) : 444, 487
. : milestone, 466,
iast_TELEMETRY_OFF (498.345 µs) : 475, 521
. : milestone, 498,
tracing (462.179 µs) : 439, 485
. : milestone, 462,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics. Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~681b6fd095, baseline=1.50.0-SNAPSHOT~50e8b5aefc
dateFormat X
axisFormat %s
section baseline
no_agent (1.477 ms) : 1465, 1488
. : milestone, 1477,
appsec (2.412 ms) : 2363, 2462
. : milestone, 2412,
iast (2.2 ms) : 2138, 2263
. : milestone, 2200,
iast_GLOBAL (2.247 ms) : 2184, 2310
. : milestone, 2247,
profiling (2.065 ms) : 2014, 2116
. : milestone, 2065,
tracing (2.026 ms) : 1977, 2074
. : milestone, 2026,
section candidate
no_agent (1.48 ms) : 1468, 1491
. : milestone, 1480,
appsec (2.416 ms) : 2366, 2465
. : milestone, 2416,
iast (2.193 ms) : 2131, 2255
. : milestone, 2193,
iast_GLOBAL (2.234 ms) : 2171, 2296
. : milestone, 2234,
profiling (2.033 ms) : 1983, 2083
. : milestone, 2033,
tracing (2.016 ms) : 1968, 2064
. : milestone, 2016,
Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~681b6fd095, baseline=1.50.0-SNAPSHOT~50e8b5aefc
dateFormat X
axisFormat %s
section baseline
no_agent (14.802 s) : 14802000, 14802000
. : milestone, 14802000,
appsec (14.771 s) : 14771000, 14771000
. : milestone, 14771000,
iast (18.831 s) : 18831000, 18831000
. : milestone, 18831000,
iast_GLOBAL (17.962 s) : 17962000, 17962000
. : milestone, 17962000,
profiling (14.778 s) : 14778000, 14778000
. : milestone, 14778000,
tracing (14.881 s) : 14881000, 14881000
. : milestone, 14881000,
section candidate
no_agent (15.634 s) : 15634000, 15634000
. : milestone, 15634000,
appsec (14.989 s) : 14989000, 14989000
. : milestone, 14989000,
iast (18.476 s) : 18476000, 18476000
. : milestone, 18476000,
iast_GLOBAL (17.971 s) : 17971000, 17971000
. : milestone, 17971000,
profiling (14.921 s) : 14921000, 14921000
. : milestone, 14921000,
tracing (15.194 s) : 15194000, 15194000
. : milestone, 15194000,
|
Z Test jobs 1. z_test_21_inst 2. z_test_17_inst 3. z_test_8_smoke Checks 1. check_smoke 2. check_base 3. check_inst Test instrumentation latest 1. test_8_inst_latest 2. test_17_inst_latest
What Does This Do
The build_inst job (
./gradlew clean :instrumentationTest ...
) memory usage is close to 16GiB, this is very likely cause to builds failing a daemon disappearing (org.gradle.launcher.daemon.client.DaemonDisappearedException: Gradle build daemon disappeared unexpectedly (it may have been killed or may have crashed)
)https://circleci.com/docs/configuration-reference/#resourceclass
Motivation
Additional Notes
Contributor Checklist
type:
and (comp:
orinst:
) labels in addition to any usefull labelsclose
,fix
or any linking keywords when referencing an issue.Use
solves
instead, and assign the PR milestone to the issueJira ticket: [PROJ-IDENT]