[TEST] Test CI diff changes

[smola]

What Does This Do

Motivation

Additional Notes

Jira ticket: [PROJ-IDENT]

[pr-commenter]

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	smola/affected-modules-test
git_commit_date	1707212724	1707233178
git_commit_sha	04b123e	bb68f5d
release_version	1.30.0-SNAPSHOT~04b123e6fa	1.30.0-SNAPSHOT~bb68f5dd1c

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1707236149	1707236149
ci_job_id	427285656	427285656
ci_pipeline_id	27794077	27794077
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module	Agent	Agent
parent	None	None
variant	iast	iast

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 43 metrics, 10 unstable metrics.

scenario	Δ mean execution_time	candidate mean execution_time	baseline mean execution_time
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:Remote Config	better [-50.010µs; -13.801µs] or [-8.079%; -2.230%]	587.115µs	619.020µs

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
end_time	2024-02-06T15:51:49	2024-02-06T16:10:46
git_branch	master	smola/affected-modules-test
git_commit_date	1707212724	1707233178
git_commit_sha	04b123e	bb68f5d
release_version	1.30.0-SNAPSHOT~04b123e6fa	1.30.0-SNAPSHOT~bb68f5dd1c
start_time	2024-02-06T15:51:36	2024-02-06T16:10:33

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1707236149	1707236149
ci_job_id	427285656	427285656
ci_pipeline_id	27794077	27794077
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 15 unstable metrics.

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.30.0-SNAPSHOT~bb68f5dd1c, baseline=1.30.0-SNAPSHOT~04b123e6fa
    dateFormat X
    axisFormat %s
section baseline
no_agent (368.558 µs) : 348, 389
.   : milestone, 369,
iast (473.618 µs) : 453, 494
.   : milestone, 474,
iast_FULL (539.818 µs) : 519, 560
.   : milestone, 540,
iast_GLOBAL (502.038 µs) : 480, 524
.   : milestone, 502,
iast_HARDCODED_SECRET_DISABLED (469.818 µs) : 449, 491
.   : milestone, 470,
iast_INACTIVE (445.458 µs) : 424, 466
.   : milestone, 445,
iast_TELEMETRY_OFF (473.516 µs) : 452, 495
.   : milestone, 474,
tracing (436.784 µs) : 416, 457
.   : milestone, 437,
section candidate
no_agent (362.689 µs) : 343, 383
.   : milestone, 363,
iast (477.218 µs) : 455, 499
.   : milestone, 477,
iast_FULL (532.082 µs) : 512, 553
.   : milestone, 532,
iast_GLOBAL (496.909 µs) : 475, 519
.   : milestone, 497,
iast_HARDCODED_SECRET_DISABLED (477.158 µs) : 456, 498
.   : milestone, 477,
iast_INACTIVE (446.246 µs) : 425, 468
.   : milestone, 446,
iast_TELEMETRY_OFF (472.714 µs) : 451, 494
.   : milestone, 473,
tracing (433.531 µs) : 413, 454
.   : milestone, 434,

Loading

• baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	368.558 µs [347.826 µs, 389.29 µs]	-
iast	473.618 µs [452.859 µs, 494.377 µs]	105.06 µs (28.5%)
iast_FULL	539.818 µs [519.233 µs, 560.402 µs]	171.26 µs (46.5%)
iast_GLOBAL	502.038 µs [480.004 µs, 524.072 µs]	133.48 µs (36.2%)
iast_HARDCODED_SECRET_DISABLED	469.818 µs [448.729 µs, 490.907 µs]	101.261 µs (27.5%)
iast_INACTIVE	445.458 µs [424.497 µs, 466.418 µs]	76.9 µs (20.9%)
iast_TELEMETRY_OFF	473.516 µs [452.27 µs, 494.762 µs]	104.958 µs (28.5%)
tracing	436.784 µs [416.375 µs, 457.192 µs]	68.226 µs (18.5%)

• candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	362.689 µs [342.873 µs, 382.505 µs]	-
iast	477.218 µs [455.366 µs, 499.07 µs]	114.529 µs (31.6%)
iast_FULL	532.082 µs [511.526 µs, 552.638 µs]	169.393 µs (46.7%)
iast_GLOBAL	496.909 µs [475.193 µs, 518.625 µs]	134.22 µs (37.0%)
iast_HARDCODED_SECRET_DISABLED	477.158 µs [456.394 µs, 497.921 µs]	114.468 µs (31.6%)
iast_INACTIVE	446.246 µs [424.836 µs, 467.655 µs]	83.556 µs (23.0%)
iast_TELEMETRY_OFF	472.714 µs [451.33 µs, 494.099 µs]	110.025 µs (30.3%)
tracing	433.531 µs [413.47 µs, 453.592 µs]	70.842 µs (19.5%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.30.0-SNAPSHOT~bb68f5dd1c, baseline=1.30.0-SNAPSHOT~04b123e6fa
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.354 ms) : 1335, 1373
.   : milestone, 1354,
appsec (1.776 ms) : 1750, 1802
.   : milestone, 1776,
iast (1.53 ms) : 1506, 1554
.   : milestone, 1530,
profiling (1.55 ms) : 1524, 1576
.   : milestone, 1550,
tracing (1.531 ms) : 1506, 1555
.   : milestone, 1531,
section candidate
no_agent (1.348 ms) : 1329, 1367
.   : milestone, 1348,
appsec (1.793 ms) : 1769, 1818
.   : milestone, 1793,
iast (1.542 ms) : 1517, 1566
.   : milestone, 1542,
profiling (1.542 ms) : 1515, 1569
.   : milestone, 1542,
tracing (1.506 ms) : 1482, 1531
.   : milestone, 1506,

Loading

• baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.354 ms [1.335 ms, 1.373 ms]	-
appsec	1.776 ms [1.75 ms, 1.802 ms]	421.843 µs (31.2%)
iast	1.53 ms [1.506 ms, 1.554 ms]	175.9 µs (13.0%)
profiling	1.55 ms [1.524 ms, 1.576 ms]	196.114 µs (14.5%)
tracing	1.531 ms [1.506 ms, 1.555 ms]	176.422 µs (13.0%)

• candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.348 ms [1.329 ms, 1.367 ms]	-
appsec	1.793 ms [1.769 ms, 1.818 ms]	445.609 µs (33.1%)
iast	1.542 ms [1.517 ms, 1.566 ms]	193.831 µs (14.4%)
profiling	1.542 ms [1.515 ms, 1.569 ms]	194.202 µs (14.4%)
tracing	1.506 ms [1.482 ms, 1.531 ms]	158.568 µs (11.8%)