Strip temp suffix from known library names by amarziali · Pull Request #10335 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/normalize-crash-known-names
git_commit_date 1768216781 1768223847
git_commit_sha 645ed32 42fbc0d
release_version 1.59.0-SNAPSHOT~645ed325fc 1.59.0-SNAPSHOT~42fbc0dcaa
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1768225707 1768225707
ci_job_id 1342860623 1342860623
ci_pipeline_id 90185109 90185109
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-mo741kku 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-mo741kku 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 57 metrics, 8 unstable metrics.

Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.59.0-SNAPSHOT~42fbc0dcaa, baseline=1.59.0-SNAPSHOT~645ed325fc

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.084 s) : 0, 1083623
Total [baseline] (8.72 s) : 0, 8719892
Agent [candidate] (1.082 s) : 0, 1081713
Total [candidate] (8.697 s) : 0, 8696874
section iast
Agent [baseline] (1.227 s) : 0, 1226980
Total [baseline] (9.331 s) : 0, 9330870
Agent [candidate] (1.232 s) : 0, 1231634
Total [candidate] (9.283 s) : 0, 9282616
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.084 s -
Agent iast 1.227 s 143.357 ms (13.2%)
Total tracing 8.72 s -
Total iast 9.331 s 610.978 ms (7.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.082 s -
Agent iast 1.232 s 149.921 ms (13.9%)
Total tracing 8.697 s -
Total iast 9.283 s 585.742 ms (6.7%)
gantt
    title insecure-bank - break down per module: candidate=1.59.0-SNAPSHOT~42fbc0dcaa, baseline=1.59.0-SNAPSHOT~645ed325fc

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.179 ms) : 0, 1179
crashtracking [candidate] (1.183 ms) : 0, 1183
BytebuddyAgent [baseline] (651.151 ms) : 0, 651151
BytebuddyAgent [candidate] (650.056 ms) : 0, 650056
GlobalTracer [baseline] (282.86 ms) : 0, 282860
GlobalTracer [candidate] (282.468 ms) : 0, 282468
AppSec [baseline] (32.584 ms) : 0, 32584
AppSec [candidate] (32.682 ms) : 0, 32682
Debugger [baseline] (66.928 ms) : 0, 66928
Debugger [candidate] (66.59 ms) : 0, 66590
Remote Config [baseline] (632.648 µs) : 0, 633
Remote Config [candidate] (646.765 µs) : 0, 647
Telemetry [baseline] (8.985 ms) : 0, 8985
Telemetry [candidate] (8.923 ms) : 0, 8923
Flare Poller [baseline] (3.807 ms) : 0, 3807
Flare Poller [candidate] (3.75 ms) : 0, 3750
section iast
crashtracking [baseline] (1.187 ms) : 0, 1187
crashtracking [candidate] (1.198 ms) : 0, 1198
BytebuddyAgent [baseline] (794.694 ms) : 0, 794694
BytebuddyAgent [candidate] (797.226 ms) : 0, 797226
GlobalTracer [baseline] (256.594 ms) : 0, 256594
GlobalTracer [candidate] (257.866 ms) : 0, 257866
IAST [baseline] (27.115 ms) : 0, 27115
IAST [candidate] (27.159 ms) : 0, 27159
AppSec [baseline] (32.743 ms) : 0, 32743
AppSec [candidate] (34.146 ms) : 0, 34146
Debugger [baseline] (66.696 ms) : 0, 66696
Debugger [candidate] (65.765 ms) : 0, 65765
Remote Config [baseline] (584.131 µs) : 0, 584
Remote Config [candidate] (562.068 µs) : 0, 562
Telemetry [baseline] (8.361 ms) : 0, 8361
Telemetry [candidate] (8.479 ms) : 0, 8479
Flare Poller [baseline] (3.581 ms) : 0, 3581
Flare Poller [candidate] (3.59 ms) : 0, 3590
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.59.0-SNAPSHOT~42fbc0dcaa, baseline=1.59.0-SNAPSHOT~645ed325fc

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.092 s) : 0, 1091512
Total [baseline] (10.718 s) : 0, 10717699
Agent [candidate] (1.084 s) : 0, 1083625
Total [candidate] (10.748 s) : 0, 10748397
section appsec
Agent [baseline] (1.259 s) : 0, 1258853
Total [baseline] (10.89 s) : 0, 10890359
Agent [candidate] (1.264 s) : 0, 1264405
Total [candidate] (11.023 s) : 0, 11022762
section iast
Agent [baseline] (1.222 s) : 0, 1222244
Total [baseline] (11.113 s) : 0, 11112672
Agent [candidate] (1.231 s) : 0, 1230628
Total [candidate] (11.087 s) : 0, 11086657
section profiling
Agent [baseline] (1.219 s) : 0, 1219262
Total [baseline] (10.992 s) : 0, 10991893
Agent [candidate] (1.201 s) : 0, 1201191
Total [candidate] (10.818 s) : 0, 10818141
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.092 s -
Agent appsec 1.259 s 167.341 ms (15.3%)
Agent iast 1.222 s 130.732 ms (12.0%)
Agent profiling 1.219 s 127.75 ms (11.7%)
Total tracing 10.718 s -
Total appsec 10.89 s 172.661 ms (1.6%)
Total iast 11.113 s 394.973 ms (3.7%)
Total profiling 10.992 s 274.194 ms (2.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.084 s -
Agent appsec 1.264 s 180.78 ms (16.7%)
Agent iast 1.231 s 147.003 ms (13.6%)
Agent profiling 1.201 s 117.566 ms (10.8%)
Total tracing 10.748 s -
Total appsec 11.023 s 274.365 ms (2.6%)
Total iast 11.087 s 338.26 ms (3.1%)
Total profiling 10.818 s 69.745 ms (0.6%)
gantt
    title petclinic - break down per module: candidate=1.59.0-SNAPSHOT~42fbc0dcaa, baseline=1.59.0-SNAPSHOT~645ed325fc

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.203 ms) : 0, 1203
crashtracking [candidate] (1.177 ms) : 0, 1177
BytebuddyAgent [baseline] (655.54 ms) : 0, 655540
BytebuddyAgent [candidate] (650.632 ms) : 0, 650632
GlobalTracer [baseline] (284.136 ms) : 0, 284136
GlobalTracer [candidate] (282.772 ms) : 0, 282772
AppSec [baseline] (32.945 ms) : 0, 32945
AppSec [candidate] (32.652 ms) : 0, 32652
Debugger [baseline] (68.564 ms) : 0, 68564
Debugger [candidate] (67.599 ms) : 0, 67599
Remote Config [baseline] (628.576 µs) : 0, 629
Remote Config [candidate] (625.274 µs) : 0, 625
Telemetry [baseline] (9.05 ms) : 0, 9050
Telemetry [candidate] (8.958 ms) : 0, 8958
Flare Poller [baseline] (3.81 ms) : 0, 3810
Flare Poller [candidate] (3.774 ms) : 0, 3774
section appsec
crashtracking [baseline] (1.172 ms) : 0, 1172
crashtracking [candidate] (1.185 ms) : 0, 1185
BytebuddyAgent [baseline] (687.325 ms) : 0, 687325
BytebuddyAgent [candidate] (690.024 ms) : 0, 690024
GlobalTracer [baseline] (257.21 ms) : 0, 257210
GlobalTracer [candidate] (258.115 ms) : 0, 258115
IAST [baseline] (24.479 ms) : 0, 24479
IAST [candidate] (24.394 ms) : 0, 24394
AppSec [baseline] (173.031 ms) : 0, 173031
AppSec [candidate] (172.021 ms) : 0, 172021
Debugger [baseline] (66.765 ms) : 0, 66765
Debugger [candidate] (69.301 ms) : 0, 69301
Remote Config [baseline] (759.803 µs) : 0, 760
Remote Config [candidate] (750.09 µs) : 0, 750
Telemetry [baseline] (9.194 ms) : 0, 9194
Telemetry [candidate] (9.446 ms) : 0, 9446
Flare Poller [baseline] (3.67 ms) : 0, 3670
Flare Poller [candidate] (3.747 ms) : 0, 3747
section iast
crashtracking [baseline] (1.181 ms) : 0, 1181
crashtracking [candidate] (1.195 ms) : 0, 1195
BytebuddyAgent [baseline] (790.923 ms) : 0, 790923
BytebuddyAgent [candidate] (797.554 ms) : 0, 797554
GlobalTracer [baseline] (255.843 ms) : 0, 255843
GlobalTracer [candidate] (257.34 ms) : 0, 257340
IAST [baseline] (26.931 ms) : 0, 26931
IAST [candidate] (26.875 ms) : 0, 26875
AppSec [baseline] (34.303 ms) : 0, 34303
AppSec [candidate] (33.337 ms) : 0, 33337
Debugger [baseline] (65.248 ms) : 0, 65248
Debugger [candidate] (66.453 ms) : 0, 66453
Remote Config [baseline] (563.69 µs) : 0, 564
Remote Config [candidate] (572.345 µs) : 0, 572
Telemetry [baseline] (8.42 ms) : 0, 8420
Telemetry [candidate] (8.374 ms) : 0, 8374
Flare Poller [baseline] (3.532 ms) : 0, 3532
Flare Poller [candidate] (3.506 ms) : 0, 3506
section profiling
crashtracking [baseline] (1.225 ms) : 0, 1225
crashtracking [candidate] (1.202 ms) : 0, 1202
BytebuddyAgent [baseline] (711.581 ms) : 0, 711581
BytebuddyAgent [candidate] (699.622 ms) : 0, 699622
GlobalTracer [baseline] (222.515 ms) : 0, 222515
GlobalTracer [candidate] (220.093 ms) : 0, 220093
AppSec [baseline] (32.664 ms) : 0, 32664
AppSec [candidate] (32.154 ms) : 0, 32154
Debugger [baseline] (69.152 ms) : 0, 69152
Debugger [candidate] (68.141 ms) : 0, 68141
Remote Config [baseline] (645.751 µs) : 0, 646
Remote Config [candidate] (654.793 µs) : 0, 655
Telemetry [baseline] (9.166 ms) : 0, 9166
Telemetry [candidate] (9.001 ms) : 0, 9001
Flare Poller [baseline] (3.87 ms) : 0, 3870
Flare Poller [candidate] (3.783 ms) : 0, 3783
ProfilingAgent [baseline] (98.04 ms) : 0, 98040
ProfilingAgent [candidate] (96.895 ms) : 0, 96895
Profiling [baseline] (98.624 ms) : 0, 98624
Profiling [candidate] (97.475 ms) : 0, 97475
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/normalize-crash-known-names
git_commit_date 1768216781 1768223847
git_commit_sha 645ed32 42fbc0d
release_version 1.59.0-SNAPSHOT~645ed325fc 1.59.0-SNAPSHOT~42fbc0dcaa
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1768226207 1768226207
ci_job_id 1342860625 1342860625
ci_pipeline_id 90185109 90185109
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-a1xdaagl 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-a1xdaagl 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 2 performance regressions! Performance is the same for 18 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:petclinic:profiling:high_load worse
[+0.708ms; +1.551ms] or [+3.886%; +8.513%]
worse
[+0.692ms; +2.260ms] or [+2.328%; +7.604%]
unstable
[-37.646op/s; +9.896op/s] or [-14.984%; +3.939%]
19.344ms 31.205ms 237.375op/s 18.215ms 29.728ms 251.250op/s
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~42fbc0dcaa, baseline=1.59.0-SNAPSHOT~645ed325fc
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.92 ms) : 18725, 19114
.   : milestone, 18920,
appsec (18.75 ms) : 18562, 18939
.   : milestone, 18750,
code_origins (17.62 ms) : 17444, 17796
.   : milestone, 17620,
iast (17.804 ms) : 17629, 17979
.   : milestone, 17804,
profiling (18.574 ms) : 18389, 18760
.   : milestone, 18574,
tracing (17.806 ms) : 17630, 17982
.   : milestone, 17806,
section candidate
no_agent (18.262 ms) : 18075, 18450
.   : milestone, 18262,
appsec (19.001 ms) : 18810, 19192
.   : milestone, 19001,
code_origins (17.911 ms) : 17733, 18089
.   : milestone, 17911,
iast (17.765 ms) : 17590, 17939
.   : milestone, 17765,
profiling (19.671 ms) : 19470, 19872
.   : milestone, 19671,
tracing (17.92 ms) : 17742, 18098
.   : milestone, 17920,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.92 ms [18.725 ms, 19.114 ms] -
appsec 18.75 ms [18.562 ms, 18.939 ms] -169.522 µs (-0.9%)
code_origins 17.62 ms [17.444 ms, 17.796 ms] -1.299 ms (-6.9%)
iast 17.804 ms [17.629 ms, 17.979 ms] -1.116 ms (-5.9%)
profiling 18.574 ms [18.389 ms, 18.76 ms] -345.483 µs (-1.8%)
tracing 17.806 ms [17.63 ms, 17.982 ms] -1.114 ms (-5.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.262 ms [18.075 ms, 18.45 ms] -
appsec 19.001 ms [18.81 ms, 19.192 ms] 738.614 µs (4.0%)
code_origins 17.911 ms [17.733 ms, 18.089 ms] -350.899 µs (-1.9%)
iast 17.765 ms [17.59 ms, 17.939 ms] -497.719 µs (-2.7%)
profiling 19.671 ms [19.47 ms, 19.872 ms] 1.409 ms (7.7%)
tracing 17.92 ms [17.742 ms, 18.098 ms] -342.325 µs (-1.9%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~42fbc0dcaa, baseline=1.59.0-SNAPSHOT~645ed325fc
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.188 ms) : 1176, 1200
.   : milestone, 1188,
iast (3.193 ms) : 3151, 3235
.   : milestone, 3193,
iast_FULL (5.668 ms) : 5611, 5725
.   : milestone, 5668,
iast_GLOBAL (3.595 ms) : 3542, 3647
.   : milestone, 3595,
profiling (2.056 ms) : 2036, 2076
.   : milestone, 2056,
tracing (1.771 ms) : 1755, 1786
.   : milestone, 1771,
section candidate
no_agent (1.2 ms) : 1189, 1212
.   : milestone, 1200,
iast (3.214 ms) : 3171, 3257
.   : milestone, 3214,
iast_FULL (5.712 ms) : 5655, 5769
.   : milestone, 5712,
iast_GLOBAL (3.671 ms) : 3618, 3724
.   : milestone, 3671,
profiling (1.957 ms) : 1940, 1974
.   : milestone, 1957,
tracing (1.758 ms) : 1744, 1772
.   : milestone, 1758,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.188 ms [1.176 ms, 1.2 ms] -
iast 3.193 ms [3.151 ms, 3.235 ms] 2.005 ms (168.8%)
iast_FULL 5.668 ms [5.611 ms, 5.725 ms] 4.48 ms (377.1%)
iast_GLOBAL 3.595 ms [3.542 ms, 3.647 ms] 2.407 ms (202.6%)
profiling 2.056 ms [2.036 ms, 2.076 ms] 867.556 µs (73.0%)
tracing 1.771 ms [1.755 ms, 1.786 ms] 582.544 µs (49.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.2 ms [1.189 ms, 1.212 ms] -
iast 3.214 ms [3.171 ms, 3.257 ms] 2.013 ms (167.7%)
iast_FULL 5.712 ms [5.655 ms, 5.769 ms] 4.512 ms (375.8%)
iast_GLOBAL 3.671 ms [3.618 ms, 3.724 ms] 2.471 ms (205.8%)
profiling 1.957 ms [1.94 ms, 1.974 ms] 756.609 µs (63.0%)
tracing 1.758 ms [1.744 ms, 1.772 ms] 557.461 µs (46.4%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/normalize-crash-known-names
git_commit_date 1768216781 1768223847
git_commit_sha 645ed32 42fbc0d
release_version 1.59.0-SNAPSHOT~645ed325fc 1.59.0-SNAPSHOT~42fbc0dcaa
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1768226035 1768226035
ci_job_id 1342860626 1342860626
ci_pipeline_id 90185109 90185109
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-q6ohl3wa 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-q6ohl3wa 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~42fbc0dcaa, baseline=1.59.0-SNAPSHOT~645ed325fc
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.698 s) : 15698000, 15698000
.   : milestone, 15698000,
appsec (14.762 s) : 14762000, 14762000
.   : milestone, 14762000,
iast (18.528 s) : 18528000, 18528000
.   : milestone, 18528000,
iast_GLOBAL (17.861 s) : 17861000, 17861000
.   : milestone, 17861000,
profiling (14.98 s) : 14980000, 14980000
.   : milestone, 14980000,
tracing (14.614 s) : 14614000, 14614000
.   : milestone, 14614000,
section candidate
no_agent (15.597 s) : 15597000, 15597000
.   : milestone, 15597000,
appsec (14.883 s) : 14883000, 14883000
.   : milestone, 14883000,
iast (17.757 s) : 17757000, 17757000
.   : milestone, 17757000,
iast_GLOBAL (17.905 s) : 17905000, 17905000
.   : milestone, 17905000,
profiling (14.882 s) : 14882000, 14882000
.   : milestone, 14882000,
tracing (14.895 s) : 14895000, 14895000
.   : milestone, 14895000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.698 s [15.698 s, 15.698 s] -
appsec 14.762 s [14.762 s, 14.762 s] -936.0 ms (-6.0%)
iast 18.528 s [18.528 s, 18.528 s] 2.83 s (18.0%)
iast_GLOBAL 17.861 s [17.861 s, 17.861 s] 2.163 s (13.8%)
profiling 14.98 s [14.98 s, 14.98 s] -718.0 ms (-4.6%)
tracing 14.614 s [14.614 s, 14.614 s] -1.084 s (-6.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.597 s [15.597 s, 15.597 s] -
appsec 14.883 s [14.883 s, 14.883 s] -714.0 ms (-4.6%)
iast 17.757 s [17.757 s, 17.757 s] 2.16 s (13.8%)
iast_GLOBAL 17.905 s [17.905 s, 17.905 s] 2.308 s (14.8%)
profiling 14.882 s [14.882 s, 14.882 s] -715.0 ms (-4.6%)
tracing 14.895 s [14.895 s, 14.895 s] -702.0 ms (-4.5%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~42fbc0dcaa, baseline=1.59.0-SNAPSHOT~645ed325fc
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.486 ms) : 1475, 1498
.   : milestone, 1486,
appsec (3.763 ms) : 3542, 3985
.   : milestone, 3763,
iast (2.245 ms) : 2179, 2311
.   : milestone, 2245,
iast_GLOBAL (2.281 ms) : 2214, 2347
.   : milestone, 2281,
profiling (2.109 ms) : 2054, 2164
.   : milestone, 2109,
tracing (2.068 ms) : 2016, 2120
.   : milestone, 2068,
section candidate
no_agent (1.483 ms) : 1471, 1495
.   : milestone, 1483,
appsec (3.754 ms) : 3534, 3975
.   : milestone, 3754,
iast (2.242 ms) : 2176, 2308
.   : milestone, 2242,
iast_GLOBAL (2.287 ms) : 2220, 2353
.   : milestone, 2287,
profiling (2.103 ms) : 2048, 2158
.   : milestone, 2103,
tracing (2.061 ms) : 2009, 2113
.   : milestone, 2061,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.486 ms [1.475 ms, 1.498 ms] -
appsec 3.763 ms [3.542 ms, 3.985 ms] 2.277 ms (153.2%)
iast 2.245 ms [2.179 ms, 2.311 ms] 758.685 µs (51.0%)
iast_GLOBAL 2.281 ms [2.214 ms, 2.347 ms] 794.123 µs (53.4%)
profiling 2.109 ms [2.054 ms, 2.164 ms] 622.618 µs (41.9%)
tracing 2.068 ms [2.016 ms, 2.12 ms] 581.513 µs (39.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.483 ms [1.471 ms, 1.495 ms] -
appsec 3.754 ms [3.534 ms, 3.975 ms] 2.271 ms (153.2%)
iast 2.242 ms [2.176 ms, 2.308 ms] 759.045 µs (51.2%)
iast_GLOBAL 2.287 ms [2.22 ms, 2.353 ms] 803.625 µs (54.2%)
profiling 2.103 ms [2.048 ms, 2.158 ms] 619.728 µs (41.8%)
tracing 2.061 ms [2.009 ms, 2.113 ms] 577.902 µs (39.0%)