Home Original page

Fix ArrayOutOfBoundsException in ER sanity checks by jpbempel · Pull Request #10314 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/fix-aoobe-er
git_commit_date 1767821642 1767868814
git_commit_sha 419da21 7ed97d5
release_version 1.59.0-SNAPSHOT~419da213f7 1.59.0-SNAPSHOT~7ed97d5f68
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1767870654 1767870654
ci_job_id 1335480410 1335480410
ci_pipeline_id 89634637 89634637
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-1cfvs07j 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-1cfvs07j 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 57 metrics, 8 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.59.0-SNAPSHOT~7ed97d5f68, baseline=1.59.0-SNAPSHOT~419da213f7

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.083 s) : 0, 1083325
Total [baseline] (8.741 s) : 0, 8740908
Agent [candidate] (1.083 s) : 0, 1083050
Total [candidate] (8.729 s) : 0, 8729236
section iast
Agent [baseline] (1.222 s) : 0, 1221890
Total [baseline] (9.274 s) : 0, 9274290
Agent [candidate] (1.227 s) : 0, 1227104
Total [candidate] (9.29 s) : 0, 9290324
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.083 s -
Agent iast 1.222 s 138.565 ms (12.8%)
Total tracing 8.741 s -
Total iast 9.274 s 533.382 ms (6.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.083 s -
Agent iast 1.227 s 144.054 ms (13.3%)
Total tracing 8.729 s -
Total iast 9.29 s 561.088 ms (6.4%) 
gantt
    title insecure-bank - break down per module: candidate=1.59.0-SNAPSHOT~7ed97d5f68, baseline=1.59.0-SNAPSHOT~419da213f7

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.185 ms) : 0, 1185
crashtracking [candidate] (1.177 ms) : 0, 1177
BytebuddyAgent [baseline] (651.393 ms) : 0, 651393
BytebuddyAgent [candidate] (650.826 ms) : 0, 650826
GlobalTracer [baseline] (282.215 ms) : 0, 282215
GlobalTracer [candidate] (282.259 ms) : 0, 282259
AppSec [baseline] (32.723 ms) : 0, 32723
AppSec [candidate] (32.413 ms) : 0, 32413
Debugger [baseline] (67.049 ms) : 0, 67049
Debugger [candidate] (67.55 ms) : 0, 67550
Remote Config [baseline] (622.655 µs) : 0, 623
Remote Config [candidate] (622.668 µs) : 0, 623
Telemetry [baseline] (8.865 ms) : 0, 8865
Telemetry [candidate] (9.011 ms) : 0, 9011
Flare Poller [baseline] (3.741 ms) : 0, 3741
Flare Poller [candidate] (3.7 ms) : 0, 3700
section iast
crashtracking [baseline] (1.189 ms) : 0, 1189
crashtracking [candidate] (1.185 ms) : 0, 1185
BytebuddyAgent [baseline] (790.942 ms) : 0, 790942
BytebuddyAgent [candidate] (794.054 ms) : 0, 794054
GlobalTracer [baseline] (255.206 ms) : 0, 255206
GlobalTracer [candidate] (257.039 ms) : 0, 257039
AppSec [baseline] (35.442 ms) : 0, 35442
AppSec [candidate] (35.537 ms) : 0, 35537
Debugger [baseline] (64.183 ms) : 0, 64183
Debugger [candidate] (63.74 ms) : 0, 63740
Remote Config [baseline] (576.284 µs) : 0, 576
Remote Config [candidate] (585.086 µs) : 0, 585
Telemetry [baseline] (8.498 ms) : 0, 8498
Telemetry [candidate] (8.491 ms) : 0, 8491
Flare Poller [baseline] (3.592 ms) : 0, 3592
Flare Poller [candidate] (3.645 ms) : 0, 3645
IAST [baseline] (26.87 ms) : 0, 26870
IAST [candidate] (27.342 ms) : 0, 27342
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.59.0-SNAPSHOT~7ed97d5f68, baseline=1.59.0-SNAPSHOT~419da213f7

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.087 s) : 0, 1087197
Total [baseline] (10.889 s) : 0, 10888827
Agent [candidate] (1.083 s) : 0, 1083299
Total [candidate] (10.854 s) : 0, 10854179
section appsec
Agent [baseline] (1.267 s) : 0, 1267342
Total [baseline] (10.973 s) : 0, 10973277
Agent [candidate] (1.271 s) : 0, 1270980
Total [candidate] (10.961 s) : 0, 10960674
section iast
Agent [baseline] (1.232 s) : 0, 1231797
Total [baseline] (11.115 s) : 0, 11114691
Agent [candidate] (1.221 s) : 0, 1221219
Total [candidate] (11.145 s) : 0, 11145274
section profiling
Agent [baseline] (1.209 s) : 0, 1209261
Total [baseline] (10.863 s) : 0, 10863392
Agent [candidate] (1.208 s) : 0, 1207663
Total [candidate] (11.037 s) : 0, 11036604
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.087 s -
Agent appsec 1.267 s 180.145 ms (16.6%)
Agent iast 1.232 s 144.6 ms (13.3%)
Agent profiling 1.209 s 122.065 ms (11.2%)
Total tracing 10.889 s -
Total appsec 10.973 s 84.45 ms (0.8%)
Total iast 11.115 s 225.864 ms (2.1%)
Total profiling 10.863 s -25.435 ms (-0.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.083 s -
Agent appsec 1.271 s 187.681 ms (17.3%)
Agent iast 1.221 s 137.92 ms (12.7%)
Agent profiling 1.208 s 124.364 ms (11.5%)
Total tracing 10.854 s -
Total appsec 10.961 s 106.495 ms (1.0%)
Total iast 11.145 s 291.096 ms (2.7%)
Total profiling 11.037 s 182.426 ms (1.7%) 
gantt
    title petclinic - break down per module: candidate=1.59.0-SNAPSHOT~7ed97d5f68, baseline=1.59.0-SNAPSHOT~419da213f7

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.184 ms) : 0, 1184
crashtracking [candidate] (1.178 ms) : 0, 1178
BytebuddyAgent [baseline] (652.91 ms) : 0, 652910
BytebuddyAgent [candidate] (650.517 ms) : 0, 650517
GlobalTracer [baseline] (283.076 ms) : 0, 283076
GlobalTracer [candidate] (281.845 ms) : 0, 281845
AppSec [baseline] (32.652 ms) : 0, 32652
AppSec [candidate] (32.616 ms) : 0, 32616
Debugger [baseline] (68.435 ms) : 0, 68435
Debugger [candidate] (68.214 ms) : 0, 68214
Remote Config [baseline] (627.03 µs) : 0, 627
Remote Config [candidate] (603.058 µs) : 0, 603
Telemetry [baseline] (9.029 ms) : 0, 9029
Telemetry [candidate] (9.041 ms) : 0, 9041
Flare Poller [baseline] (3.775 ms) : 0, 3775
Flare Poller [candidate] (3.832 ms) : 0, 3832
section appsec
crashtracking [baseline] (1.173 ms) : 0, 1173
crashtracking [candidate] (1.186 ms) : 0, 1186
BytebuddyAgent [baseline] (691.333 ms) : 0, 691333
BytebuddyAgent [candidate] (695.139 ms) : 0, 695139
GlobalTracer [baseline] (258.894 ms) : 0, 258894
GlobalTracer [candidate] (259.383 ms) : 0, 259383
AppSec [baseline] (173.164 ms) : 0, 173164
AppSec [candidate] (174.368 ms) : 0, 174368
Debugger [baseline] (68.722 ms) : 0, 68722
Debugger [candidate] (66.846 ms) : 0, 66846
Remote Config [baseline] (779.594 µs) : 0, 780
Remote Config [candidate] (772.996 µs) : 0, 773
Telemetry [baseline] (9.415 ms) : 0, 9415
Telemetry [candidate] (9.3 ms) : 0, 9300
Flare Poller [baseline] (3.724 ms) : 0, 3724
Flare Poller [candidate] (3.72 ms) : 0, 3720
IAST [baseline] (24.774 ms) : 0, 24774
IAST [candidate] (24.784 ms) : 0, 24784
section iast
crashtracking [baseline] (1.205 ms) : 0, 1205
crashtracking [candidate] (1.176 ms) : 0, 1176
BytebuddyAgent [baseline] (796.49 ms) : 0, 796490
BytebuddyAgent [candidate] (789.418 ms) : 0, 789418
GlobalTracer [baseline] (257.654 ms) : 0, 257654
GlobalTracer [candidate] (255.759 ms) : 0, 255759
AppSec [baseline] (32.15 ms) : 0, 32150
AppSec [candidate] (33.112 ms) : 0, 33112
Debugger [baseline] (69.132 ms) : 0, 69132
Debugger [candidate] (66.9 ms) : 0, 66900
Remote Config [baseline] (557.311 µs) : 0, 557
Remote Config [candidate] (581.964 µs) : 0, 582
Telemetry [baseline] (8.468 ms) : 0, 8468
Telemetry [candidate] (8.443 ms) : 0, 8443
Flare Poller [baseline] (3.553 ms) : 0, 3553
Flare Poller [candidate] (3.586 ms) : 0, 3586
IAST [baseline] (27.129 ms) : 0, 27129
IAST [candidate] (26.906 ms) : 0, 26906
section profiling
crashtracking [baseline] (1.213 ms) : 0, 1213
crashtracking [candidate] (1.215 ms) : 0, 1215
BytebuddyAgent [baseline] (706.236 ms) : 0, 706236
BytebuddyAgent [candidate] (704.777 ms) : 0, 704777
GlobalTracer [baseline] (221.106 ms) : 0, 221106
GlobalTracer [candidate] (221.056 ms) : 0, 221056
AppSec [baseline] (32.309 ms) : 0, 32309
AppSec [candidate] (32.359 ms) : 0, 32359
Debugger [baseline] (68.584 ms) : 0, 68584
Debugger [candidate] (68.177 ms) : 0, 68177
Remote Config [baseline] (646.853 µs) : 0, 647
Remote Config [candidate] (635.876 µs) : 0, 636
Telemetry [baseline] (8.707 ms) : 0, 8707
Telemetry [candidate] (8.639 ms) : 0, 8639
Flare Poller [baseline] (3.638 ms) : 0, 3638
Flare Poller [candidate] (3.641 ms) : 0, 3641
ProfilingAgent [baseline] (96.6 ms) : 0, 96600
ProfilingAgent [candidate] (97.289 ms) : 0, 97289
Profiling [baseline] (97.193 ms) : 0, 97193
Profiling [candidate] (97.878 ms) : 0, 97878
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/fix-aoobe-er
git_commit_date 1767821642 1767868814
git_commit_sha 419da21 7ed97d5
release_version 1.59.0-SNAPSHOT~419da213f7 1.59.0-SNAPSHOT~7ed97d5f68
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1767871171 1767871171
ci_job_id 1335480411 1335480411
ci_pipeline_id 89634637 89634637
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-m9hqbwao 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-m9hqbwao 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 19 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:petclinic:code_origins:high_load better
[-1477.515µs; -487.345µs] or [-7.969%; -2.629%]		 unsure
[-1702.828µs; -48.347µs] or [-5.713%; -0.162%]		 unstable
[-13.148op/s; +36.961op/s] or [-5.290%; +14.872%]		 17.557ms 28.931ms 260.438op/s 18.540ms 29.806ms 248.531op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~7ed97d5f68, baseline=1.59.0-SNAPSHOT~419da213f7
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.186 ms) : 1174, 1197
.   : milestone, 1186,
iast (3.168 ms) : 3130, 3205
.   : milestone, 3168,
iast_FULL (5.831 ms) : 5772, 5889
.   : milestone, 5831,
iast_GLOBAL (3.507 ms) : 3452, 3563
.   : milestone, 3507,
profiling (1.934 ms) : 1917, 1950
.   : milestone, 1934,
tracing (1.816 ms) : 1801, 1831
.   : milestone, 1816,
section candidate
no_agent (1.173 ms) : 1162, 1184
.   : milestone, 1173,
iast (3.206 ms) : 3169, 3244
.   : milestone, 3206,
iast_FULL (5.621 ms) : 5566, 5677
.   : milestone, 5621,
iast_GLOBAL (3.56 ms) : 3504, 3616
.   : milestone, 3560,
profiling (1.976 ms) : 1959, 1993
.   : milestone, 1976,
tracing (1.786 ms) : 1770, 1803
.   : milestone, 1786,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.186 ms [1.174 ms, 1.197 ms] -
iast 3.168 ms [3.13 ms, 3.205 ms] 1.982 ms (167.1%)
iast_FULL 5.831 ms [5.772 ms, 5.889 ms] 4.645 ms (391.7%)
iast_GLOBAL 3.507 ms [3.452 ms, 3.563 ms] 2.321 ms (195.8%)
profiling 1.934 ms [1.917 ms, 1.95 ms] 747.711 µs (63.1%)
tracing 1.816 ms [1.801 ms, 1.831 ms] 630.106 µs (53.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.173 ms [1.162 ms, 1.184 ms] -
iast 3.206 ms [3.169 ms, 3.244 ms] 2.034 ms (173.4%)
iast_FULL 5.621 ms [5.566 ms, 5.677 ms] 4.449 ms (379.3%)
iast_GLOBAL 3.56 ms [3.504 ms, 3.616 ms] 2.387 ms (203.5%)
profiling 1.976 ms [1.959 ms, 1.993 ms] 802.874 µs (68.5%)
tracing 1.786 ms [1.77 ms, 1.803 ms] 613.393 µs (52.3%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~7ed97d5f68, baseline=1.59.0-SNAPSHOT~419da213f7
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.066 ms) : 17882, 18250
.   : milestone, 18066,
appsec (18.522 ms) : 18334, 18711
.   : milestone, 18522,
code_origins (18.783 ms) : 18592, 18973
.   : milestone, 18783,
iast (17.565 ms) : 17387, 17742
.   : milestone, 17565,
profiling (18.715 ms) : 18528, 18901
.   : milestone, 18715,
tracing (17.575 ms) : 17403, 17747
.   : milestone, 17575,
section candidate
no_agent (19.125 ms) : 18927, 19324
.   : milestone, 19125,
appsec (18.346 ms) : 18162, 18530
.   : milestone, 18346,
code_origins (17.917 ms) : 17737, 18096
.   : milestone, 17917,
iast (17.491 ms) : 17315, 17668
.   : milestone, 17491,
profiling (18.804 ms) : 18619, 18989
.   : milestone, 18804,
tracing (17.871 ms) : 17695, 18047
.   : milestone, 17871,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.066 ms [17.882 ms, 18.25 ms] -
appsec 18.522 ms [18.334 ms, 18.711 ms] 455.755 µs (2.5%)
code_origins 18.783 ms [18.592 ms, 18.973 ms] 716.199 µs (4.0%)
iast 17.565 ms [17.387 ms, 17.742 ms] -501.734 µs (-2.8%)
profiling 18.715 ms [18.528 ms, 18.901 ms] 648.321 µs (3.6%)
tracing 17.575 ms [17.403 ms, 17.747 ms] -491.235 µs (-2.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.125 ms [18.927 ms, 19.324 ms] -
appsec 18.346 ms [18.162 ms, 18.53 ms] -779.295 µs (-4.1%)
code_origins 17.917 ms [17.737 ms, 18.096 ms] -1.209 ms (-6.3%)
iast 17.491 ms [17.315 ms, 17.668 ms] -1.634 ms (-8.5%)
profiling 18.804 ms [18.619 ms, 18.989 ms] -321.37 µs (-1.7%)
tracing 17.871 ms [17.695 ms, 18.047 ms] -1.254 ms (-6.6%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/fix-aoobe-er
git_commit_date 1767821642 1767868814
git_commit_sha 419da21 7ed97d5
release_version 1.59.0-SNAPSHOT~419da213f7 1.59.0-SNAPSHOT~7ed97d5f68
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1767870924 1767870924
ci_job_id 1335480412 1335480412
ci_pipeline_id 89634637 89634637
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-b63w5mhq 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-b63w5mhq 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~7ed97d5f68, baseline=1.59.0-SNAPSHOT~419da213f7
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.471 ms) : 1459, 1482
.   : milestone, 1471,
appsec (3.657 ms) : 3441, 3874
.   : milestone, 3657,
iast (2.213 ms) : 2148, 2279
.   : milestone, 2213,
iast_GLOBAL (2.258 ms) : 2193, 2324
.   : milestone, 2258,
profiling (2.096 ms) : 2041, 2150
.   : milestone, 2096,
tracing (2.043 ms) : 1992, 2094
.   : milestone, 2043,
section candidate
no_agent (1.47 ms) : 1459, 1482
.   : milestone, 1470,
appsec (3.658 ms) : 3442, 3873
.   : milestone, 3658,
iast (2.212 ms) : 2147, 2277
.   : milestone, 2212,
iast_GLOBAL (2.253 ms) : 2187, 2319
.   : milestone, 2253,
profiling (2.089 ms) : 2035, 2144
.   : milestone, 2089,
tracing (2.046 ms) : 1995, 2097
.   : milestone, 2046,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.471 ms [1.459 ms, 1.482 ms] -
appsec 3.657 ms [3.441 ms, 3.874 ms] 2.186 ms (148.6%)
iast 2.213 ms [2.148 ms, 2.279 ms] 742.539 µs (50.5%)
iast_GLOBAL 2.258 ms [2.193 ms, 2.324 ms] 787.467 µs (53.5%)
profiling 2.096 ms [2.041 ms, 2.15 ms] 624.802 µs (42.5%)
tracing 2.043 ms [1.992 ms, 2.094 ms] 572.219 µs (38.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.47 ms [1.459 ms, 1.482 ms] -
appsec 3.658 ms [3.442 ms, 3.873 ms] 2.187 ms (148.8%)
iast 2.212 ms [2.147 ms, 2.277 ms] 741.209 µs (50.4%)
iast_GLOBAL 2.253 ms [2.187 ms, 2.319 ms] 782.666 µs (53.2%)
profiling 2.089 ms [2.035 ms, 2.144 ms] 618.679 µs (42.1%)
tracing 2.046 ms [1.995 ms, 2.097 ms] 575.283 µs (39.1%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~7ed97d5f68, baseline=1.59.0-SNAPSHOT~419da213f7
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.029 s) : 15029000, 15029000
.   : milestone, 15029000,
appsec (14.631 s) : 14631000, 14631000
.   : milestone, 14631000,
iast (18.667 s) : 18667000, 18667000
.   : milestone, 18667000,
iast_GLOBAL (17.842 s) : 17842000, 17842000
.   : milestone, 17842000,
profiling (14.821 s) : 14821000, 14821000
.   : milestone, 14821000,
tracing (14.75 s) : 14750000, 14750000
.   : milestone, 14750000,
section candidate
no_agent (15.687 s) : 15687000, 15687000
.   : milestone, 15687000,
appsec (14.509 s) : 14509000, 14509000
.   : milestone, 14509000,
iast (18.589 s) : 18589000, 18589000
.   : milestone, 18589000,
iast_GLOBAL (18.045 s) : 18045000, 18045000
.   : milestone, 18045000,
profiling (14.902 s) : 14902000, 14902000
.   : milestone, 14902000,
tracing (14.64 s) : 14640000, 14640000
.   : milestone, 14640000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.029 s [15.029 s, 15.029 s] -
appsec 14.631 s [14.631 s, 14.631 s] -398.0 ms (-2.6%)
iast 18.667 s [18.667 s, 18.667 s] 3.638 s (24.2%)
iast_GLOBAL 17.842 s [17.842 s, 17.842 s] 2.813 s (18.7%)
profiling 14.821 s [14.821 s, 14.821 s] -208.0 ms (-1.4%)
tracing 14.75 s [14.75 s, 14.75 s] -279.0 ms (-1.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.687 s [15.687 s, 15.687 s] -
appsec 14.509 s [14.509 s, 14.509 s] -1.178 s (-7.5%)
iast 18.589 s [18.589 s, 18.589 s] 2.902 s (18.5%)
iast_GLOBAL 18.045 s [18.045 s, 18.045 s] 2.358 s (15.0%)
profiling 14.902 s [14.902 s, 14.902 s] -785.0 ms (-5.0%)
tracing 14.64 s [14.64 s, 14.64 s] -1.047 s (-6.7%)