Using stable config when a security manager is enabled should not prevent tracer startup by amarziali · Pull Request #10006

Using stable config when a security manager is enabled should not prevent tracer startup by amarziali · Pull Request #10006 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	andrea.marziali/stableconfig
git_commit_date	1763637994	1763656721
git_commit_sha	`c05874d`	`acbee29`
release_version	1.56.0~c05874d84e	1.57.0-SNAPSHOT~acbee29b06

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1763658727	1763658727
ci_job_id	1248211767	1248211767
ci_pipeline_id	83402984	83402984
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-aqtrd349 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-aqtrd349 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 59 metrics, 6 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.57.0-SNAPSHOT~acbee29b06, baseline=1.56.0~c05874d84e

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.103 s) : 0, 1102916
Total [baseline] (8.879 s) : 0, 8878974
Agent [candidate] (1.101 s) : 0, 1100720
Total [candidate] (8.835 s) : 0, 8835481
section iast
Agent [baseline] (1.242 s) : 0, 1242030
Total [baseline] (9.567 s) : 0, 9567434
Agent [candidate] (1.24 s) : 0, 1240075
Total [candidate] (9.555 s) : 0, 9554717

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.103 s	-
Agent	iast	1.242 s	139.114 ms (12.6%)
Total	tracing	8.879 s	-
Total	iast	9.567 s	688.46 ms (7.8%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.101 s	-
Agent	iast	1.24 s	139.355 ms (12.7%)
Total	tracing	8.835 s	-
Total	iast	9.555 s	719.236 ms (8.1%)

gantt
    title insecure-bank - break down per module: candidate=1.57.0-SNAPSHOT~acbee29b06, baseline=1.56.0~c05874d84e

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.457 ms) : 0, 1457
crashtracking [candidate] (1.477 ms) : 0, 1477
BytebuddyAgent [baseline] (709.471 ms) : 0, 709471
BytebuddyAgent [candidate] (707.768 ms) : 0, 707768
GlobalTracer [baseline] (249.317 ms) : 0, 249317
GlobalTracer [candidate] (249.131 ms) : 0, 249131
AppSec [baseline] (32.163 ms) : 0, 32163
AppSec [candidate] (32.132 ms) : 0, 32132
Debugger [baseline] (63.0 ms) : 0, 63000
Debugger [candidate] (62.829 ms) : 0, 62829
Remote Config [baseline] (617.424 µs) : 0, 617
Remote Config [candidate] (630.137 µs) : 0, 630
Telemetry [baseline] (8.304 ms) : 0, 8304
Telemetry [candidate] (8.226 ms) : 0, 8226
Flare Poller [baseline] (3.747 ms) : 0, 3747
Flare Poller [candidate] (3.633 ms) : 0, 3633
section iast
crashtracking [baseline] (1.458 ms) : 0, 1458
crashtracking [candidate] (1.502 ms) : 0, 1502
BytebuddyAgent [baseline] (833.55 ms) : 0, 833550
BytebuddyAgent [candidate] (831.665 ms) : 0, 831665
GlobalTracer [baseline] (238.611 ms) : 0, 238611
GlobalTracer [candidate] (237.972 ms) : 0, 237972
AppSec [baseline] (33.307 ms) : 0, 33307
AppSec [candidate] (33.209 ms) : 0, 33209
Debugger [baseline] (60.161 ms) : 0, 60161
Debugger [candidate] (60.71 ms) : 0, 60710
Remote Config [baseline] (538.801 µs) : 0, 539
Remote Config [candidate] (539.127 µs) : 0, 539
Telemetry [baseline] (7.54 ms) : 0, 7540
Telemetry [candidate] (7.662 ms) : 0, 7662
Flare Poller [baseline] (3.491 ms) : 0, 3491
Flare Poller [candidate] (3.49 ms) : 0, 3490
IAST [baseline] (28.417 ms) : 0, 28417
IAST [candidate] (28.453 ms) : 0, 28453

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.57.0-SNAPSHOT~acbee29b06, baseline=1.56.0~c05874d84e

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.113 s) : 0, 1112894
Total [baseline] (10.811 s) : 0, 10811430
Agent [candidate] (1.11 s) : 0, 1109669
Total [candidate] (10.957 s) : 0, 10956808
section appsec
Agent [baseline] (1.296 s) : 0, 1296367
Total [baseline] (11.263 s) : 0, 11262579
Agent [candidate] (1.284 s) : 0, 1283789
Total [candidate] (11.278 s) : 0, 11278130
section iast
Agent [baseline] (1.243 s) : 0, 1242835
Total [baseline] (11.311 s) : 0, 11311028
Agent [candidate] (1.242 s) : 0, 1242204
Total [candidate] (11.343 s) : 0, 11342659
section profiling
Agent [baseline] (1.239 s) : 0, 1238571
Total [baseline] (11.322 s) : 0, 11322492
Agent [candidate] (1.236 s) : 0, 1235670
Total [candidate] (11.135 s) : 0, 11134655

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.113 s	-
Agent	appsec	1.296 s	183.473 ms (16.5%)
Agent	iast	1.243 s	129.941 ms (11.7%)
Agent	profiling	1.239 s	125.678 ms (11.3%)
Total	tracing	10.811 s	-
Total	appsec	11.263 s	451.15 ms (4.2%)
Total	iast	11.311 s	499.598 ms (4.6%)
Total	profiling	11.322 s	511.063 ms (4.7%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.11 s	-
Agent	appsec	1.284 s	174.12 ms (15.7%)
Agent	iast	1.242 s	132.535 ms (11.9%)
Agent	profiling	1.236 s	126.002 ms (11.4%)
Total	tracing	10.957 s	-
Total	appsec	11.278 s	321.322 ms (2.9%)
Total	iast	11.343 s	385.852 ms (3.5%)
Total	profiling	11.135 s	177.847 ms (1.6%)

gantt
    title petclinic - break down per module: candidate=1.57.0-SNAPSHOT~acbee29b06, baseline=1.56.0~c05874d84e

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.478 ms) : 0, 1478
crashtracking [candidate] (1.497 ms) : 0, 1497
BytebuddyAgent [baseline] (714.642 ms) : 0, 714642
BytebuddyAgent [candidate] (713.116 ms) : 0, 713116
GlobalTracer [baseline] (251.433 ms) : 0, 251433
GlobalTracer [candidate] (250.903 ms) : 0, 250903
AppSec [baseline] (32.393 ms) : 0, 32393
AppSec [candidate] (32.205 ms) : 0, 32205
Debugger [baseline] (65.143 ms) : 0, 65143
Debugger [candidate] (64.353 ms) : 0, 64353
Remote Config [baseline] (629.317 µs) : 0, 629
Remote Config [candidate] (628.923 µs) : 0, 629
Telemetry [baseline] (8.353 ms) : 0, 8353
Telemetry [candidate] (8.305 ms) : 0, 8305
Flare Poller [baseline] (3.792 ms) : 0, 3792
Flare Poller [candidate] (3.75 ms) : 0, 3750
section appsec
crashtracking [baseline] (1.474 ms) : 0, 1474
crashtracking [candidate] (1.488 ms) : 0, 1488
BytebuddyAgent [baseline] (743.127 ms) : 0, 743127
BytebuddyAgent [candidate] (733.208 ms) : 0, 733208
GlobalTracer [baseline] (242.49 ms) : 0, 242490
GlobalTracer [candidate] (241.352 ms) : 0, 241352
AppSec [baseline] (174.203 ms) : 0, 174203
AppSec [candidate] (173.792 ms) : 0, 173792
Debugger [baseline] (62.006 ms) : 0, 62006
Debugger [candidate] (61.568 ms) : 0, 61568
Remote Config [baseline] (693.478 µs) : 0, 693
Remote Config [candidate] (660.968 µs) : 0, 661
Telemetry [baseline] (8.26 ms) : 0, 8260
Telemetry [candidate] (8.152 ms) : 0, 8152
Flare Poller [baseline] (3.908 ms) : 0, 3908
Flare Poller [candidate] (3.891 ms) : 0, 3891
IAST [baseline] (24.884 ms) : 0, 24884
IAST [candidate] (24.767 ms) : 0, 24767
section iast
crashtracking [baseline] (1.449 ms) : 0, 1449
crashtracking [candidate] (1.487 ms) : 0, 1487
BytebuddyAgent [baseline] (834.425 ms) : 0, 834425
BytebuddyAgent [candidate] (833.057 ms) : 0, 833057
GlobalTracer [baseline] (238.491 ms) : 0, 238491
GlobalTracer [candidate] (238.71 ms) : 0, 238710
AppSec [baseline] (33.713 ms) : 0, 33713
AppSec [candidate] (34.069 ms) : 0, 34069
Debugger [baseline] (60.762 ms) : 0, 60762
Debugger [candidate] (60.934 ms) : 0, 60934
Remote Config [baseline] (539.042 µs) : 0, 539
Remote Config [candidate] (534.724 µs) : 0, 535
Telemetry [baseline] (7.581 ms) : 0, 7581
Telemetry [candidate] (7.588 ms) : 0, 7588
Flare Poller [baseline] (3.489 ms) : 0, 3489
Flare Poller [candidate] (3.535 ms) : 0, 3535
IAST [baseline] (27.42 ms) : 0, 27420
IAST [candidate] (27.5 ms) : 0, 27500
section profiling
ProfilingAgent [baseline] (97.894 ms) : 0, 97894
ProfilingAgent [candidate] (97.08 ms) : 0, 97080
crashtracking [baseline] (1.438 ms) : 0, 1438
crashtracking [candidate] (1.425 ms) : 0, 1425
BytebuddyAgent [baseline] (737.101 ms) : 0, 737101
BytebuddyAgent [candidate] (736.695 ms) : 0, 736695
GlobalTracer [baseline] (223.721 ms) : 0, 223721
GlobalTracer [candidate] (223.065 ms) : 0, 223065
AppSec [baseline] (32.352 ms) : 0, 32352
AppSec [candidate] (32.343 ms) : 0, 32343
Debugger [baseline] (63.633 ms) : 0, 63633
Debugger [candidate] (63.451 ms) : 0, 63451
Remote Config [baseline] (661.199 µs) : 0, 661
Remote Config [candidate] (645.136 µs) : 0, 645
Telemetry [baseline] (8.175 ms) : 0, 8175
Telemetry [candidate] (8.008 ms) : 0, 8008
Flare Poller [baseline] (3.776 ms) : 0, 3776
Flare Poller [candidate] (3.79 ms) : 0, 3790
Profiling [baseline] (98.486 ms) : 0, 98486
Profiling [candidate] (97.685 ms) : 0, 97685

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	andrea.marziali/stableconfig
git_commit_date	1763637994	1763656721
git_commit_sha	`c05874d`	`acbee29`
release_version	1.56.0~c05874d84e	1.57.0-SNAPSHOT~acbee29b06

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1763659352	1763659352
ci_job_id	1248211769	1248211769
ci_pipeline_id	83402984	83402984
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-7k9dhua0 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-7k9dhua0 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 18 metrics, 17 unstable metrics.

scenario	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p95	Δ mean throughput	candidate mean agg_http_req_duration_p50	candidate mean agg_http_req_duration_p95	candidate mean throughput	baseline mean agg_http_req_duration_p50	baseline mean agg_http_req_duration_p95	baseline mean throughput
scenario:load:petclinic:appsec:high_load	better [-1.821ms; -0.557ms] or [-9.478%; -2.901%]	same [-2.423ms; +0.397ms] or [-7.922%; +1.298%]	unstable [-19.656op/s; +33.968op/s] or [-8.147%; +14.078%]	18.026ms	29.570ms	248.438op/s	19.215ms	30.583ms	241.281op/s

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~acbee29b06, baseline=1.56.0~c05874d84e
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.214 ms) : 1202, 1226
.   : milestone, 1214,
iast (3.334 ms) : 3285, 3383
.   : milestone, 3334,
iast_FULL (5.932 ms) : 5874, 5991
.   : milestone, 5932,
iast_GLOBAL (3.741 ms) : 3673, 3809
.   : milestone, 3741,
profiling (2.159 ms) : 2140, 2178
.   : milestone, 2159,
tracing (1.812 ms) : 1798, 1827
.   : milestone, 1812,
section candidate
no_agent (1.183 ms) : 1172, 1194
.   : milestone, 1183,
iast (3.269 ms) : 3227, 3312
.   : milestone, 3269,
iast_FULL (5.924 ms) : 5863, 5984
.   : milestone, 5924,
iast_GLOBAL (3.82 ms) : 3759, 3881
.   : milestone, 3820,
profiling (2.212 ms) : 2191, 2232
.   : milestone, 2212,
tracing (1.861 ms) : 1846, 1877
.   : milestone, 1861,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.214 ms [1.202 ms, 1.226 ms]	-
iast	3.334 ms [3.285 ms, 3.383 ms]	2.12 ms (174.7%)
iast_FULL	5.932 ms [5.874 ms, 5.991 ms]	4.718 ms (388.7%)
iast_GLOBAL	3.741 ms [3.673 ms, 3.809 ms]	2.527 ms (208.2%)
profiling	2.159 ms [2.14 ms, 2.178 ms]	944.916 µs (77.8%)
tracing	1.812 ms [1.798 ms, 1.827 ms]	598.282 µs (49.3%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.183 ms [1.172 ms, 1.194 ms]	-
iast	3.269 ms [3.227 ms, 3.312 ms]	2.086 ms (176.3%)
iast_FULL	5.924 ms [5.863 ms, 5.984 ms]	4.741 ms (400.7%)
iast_GLOBAL	3.82 ms [3.759 ms, 3.881 ms]	2.637 ms (222.9%)
profiling	2.212 ms [2.191 ms, 2.232 ms]	1.028 ms (86.9%)
tracing	1.861 ms [1.846 ms, 1.877 ms]	677.869 µs (57.3%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~acbee29b06, baseline=1.56.0~c05874d84e
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.106 ms) : 16937, 17274
.   : milestone, 17106,
appsec (19.345 ms) : 19146, 19544
.   : milestone, 19345,
code_origins (17.549 ms) : 17377, 17720
.   : milestone, 17549,
iast (17.689 ms) : 17513, 17866
.   : milestone, 17689,
profiling (18.507 ms) : 18322, 18693
.   : milestone, 18507,
tracing (17.823 ms) : 17646, 17999
.   : milestone, 17823,
section candidate
no_agent (17.951 ms) : 17767, 18136
.   : milestone, 17951,
appsec (18.787 ms) : 18595, 18979
.   : milestone, 18787,
code_origins (17.838 ms) : 17663, 18013
.   : milestone, 17838,
iast (17.748 ms) : 17573, 17922
.   : milestone, 17748,
profiling (18.8 ms) : 18612, 18987
.   : milestone, 18800,
tracing (17.757 ms) : 17580, 17934
.   : milestone, 17757,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	17.106 ms [16.937 ms, 17.274 ms]	-
appsec	19.345 ms [19.146 ms, 19.544 ms]	2.239 ms (13.1%)
code_origins	17.549 ms [17.377 ms, 17.72 ms]	443.109 µs (2.6%)
iast	17.689 ms [17.513 ms, 17.866 ms]	583.708 µs (3.4%)
profiling	18.507 ms [18.322 ms, 18.693 ms]	1.402 ms (8.2%)
tracing	17.823 ms [17.646 ms, 17.999 ms]	717.355 µs (4.2%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	17.951 ms [17.767 ms, 18.136 ms]	-
appsec	18.787 ms [18.595 ms, 18.979 ms]	835.688 µs (4.7%)
code_origins	17.838 ms [17.663 ms, 18.013 ms]	-113.3 µs (-0.6%)
iast	17.748 ms [17.573 ms, 17.922 ms]	-203.701 µs (-1.1%)
profiling	18.8 ms [18.612 ms, 18.987 ms]	848.276 µs (4.7%)
tracing	17.757 ms [17.58 ms, 17.934 ms]	-194.483 µs (-1.1%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	andrea.marziali/stableconfig
git_commit_date	1763637994	1763656721
git_commit_sha	`c05874d`	`acbee29`
release_version	1.56.0~c05874d84e	1.57.0-SNAPSHOT~acbee29b06

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1763659107	1763659107
ci_job_id	1248211770	1248211770
ci_pipeline_id	83402984	83402984
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-w0s38d73 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-w0s38d73 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~acbee29b06, baseline=1.56.0~c05874d84e
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.472 ms) : 1461, 1484
.   : milestone, 1472,
appsec (3.635 ms) : 3421, 3850
.   : milestone, 3635,
iast (2.207 ms) : 2142, 2271
.   : milestone, 2207,
iast_GLOBAL (2.264 ms) : 2199, 2329
.   : milestone, 2264,
profiling (2.075 ms) : 2023, 2128
.   : milestone, 2075,
tracing (2.048 ms) : 1997, 2099
.   : milestone, 2048,
section candidate
no_agent (1.48 ms) : 1468, 1491
.   : milestone, 1480,
appsec (3.699 ms) : 3482, 3916
.   : milestone, 3699,
iast (2.211 ms) : 2147, 2276
.   : milestone, 2211,
iast_GLOBAL (2.247 ms) : 2182, 2311
.   : milestone, 2247,
profiling (2.076 ms) : 2024, 2129
.   : milestone, 2076,
tracing (2.051 ms) : 2000, 2102
.   : milestone, 2051,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.472 ms [1.461 ms, 1.484 ms]	-
appsec	3.635 ms [3.421 ms, 3.85 ms]	2.163 ms (146.9%)
iast	2.207 ms [2.142 ms, 2.271 ms]	734.446 µs (49.9%)
iast_GLOBAL	2.264 ms [2.199 ms, 2.329 ms]	791.85 µs (53.8%)
profiling	2.075 ms [2.023 ms, 2.128 ms]	603.096 µs (41.0%)
tracing	2.048 ms [1.997 ms, 2.099 ms]	575.638 µs (39.1%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.48 ms [1.468 ms, 1.491 ms]	-
appsec	3.699 ms [3.482 ms, 3.916 ms]	2.219 ms (150.0%)
iast	2.211 ms [2.147 ms, 2.276 ms]	731.674 µs (49.4%)
iast_GLOBAL	2.247 ms [2.182 ms, 2.311 ms]	766.974 µs (51.8%)
profiling	2.076 ms [2.024 ms, 2.129 ms]	596.788 µs (40.3%)
tracing	2.051 ms [2.0 ms, 2.102 ms]	571.298 µs (38.6%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~acbee29b06, baseline=1.56.0~c05874d84e
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.943 s) : 14943000, 14943000
.   : milestone, 14943000,
appsec (15.042 s) : 15042000, 15042000
.   : milestone, 15042000,
iast (18.07 s) : 18070000, 18070000
.   : milestone, 18070000,
iast_GLOBAL (17.938 s) : 17938000, 17938000
.   : milestone, 17938000,
profiling (15.381 s) : 15381000, 15381000
.   : milestone, 15381000,
tracing (14.627 s) : 14627000, 14627000
.   : milestone, 14627000,
section candidate
no_agent (14.789 s) : 14789000, 14789000
.   : milestone, 14789000,
appsec (15.164 s) : 15164000, 15164000
.   : milestone, 15164000,
iast (18.251 s) : 18251000, 18251000
.   : milestone, 18251000,
iast_GLOBAL (17.828 s) : 17828000, 17828000
.   : milestone, 17828000,
profiling (14.983 s) : 14983000, 14983000
.   : milestone, 14983000,
tracing (14.707 s) : 14707000, 14707000
.   : milestone, 14707000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.943 s [14.943 s, 14.943 s]	-
appsec	15.042 s [15.042 s, 15.042 s]	99.0 ms (0.7%)
iast	18.07 s [18.07 s, 18.07 s]	3.127 s (20.9%)
iast_GLOBAL	17.938 s [17.938 s, 17.938 s]	2.995 s (20.0%)
profiling	15.381 s [15.381 s, 15.381 s]	438.0 ms (2.9%)
tracing	14.627 s [14.627 s, 14.627 s]	-316.0 ms (-2.1%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.789 s [14.789 s, 14.789 s]	-
appsec	15.164 s [15.164 s, 15.164 s]	375.0 ms (2.5%)
iast	18.251 s [18.251 s, 18.251 s]	3.462 s (23.4%)
iast_GLOBAL	17.828 s [17.828 s, 17.828 s]	3.039 s (20.5%)
profiling	14.983 s [14.983 s, 14.983 s]	194.0 ms (1.3%)
tracing	14.707 s [14.707 s, 14.707 s]	-82.0 ms (-0.6%)