Home Original page

Don't send crash-ping to error tracking if not enabled by amarziali · Pull Request #10170 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/crasherror
git_commit_date 1765453400 1765470912
git_commit_sha 015be6d 2f138af
release_version 1.57.0-SNAPSHOT~015be6d1b3 1.57.0-SNAPSHOT~2f138af11c
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1765473025 1765473025
ci_job_id 1287990946 1287990946
ci_pipeline_id 86261573 86261573
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-udgoh1mb 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-udgoh1mb 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 59 metrics, 6 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.57.0-SNAPSHOT~2f138af11c, baseline=1.57.0-SNAPSHOT~015be6d1b3

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.096 s) : 0, 1096399
Total [baseline] (10.897 s) : 0, 10896709
Agent [candidate] (1.083 s) : 0, 1082954
Total [candidate] (10.854 s) : 0, 10853544
section appsec
Agent [baseline] (1.267 s) : 0, 1267049
Total [baseline] (11.112 s) : 0, 11112301
Agent [candidate] (1.27 s) : 0, 1269751
Total [candidate] (11.141 s) : 0, 11141032
section iast
Agent [baseline] (1.225 s) : 0, 1225117
Total [baseline] (11.101 s) : 0, 11100607
Agent [candidate] (1.219 s) : 0, 1219461
Total [candidate] (11.168 s) : 0, 11167991
section profiling
Agent [baseline] (1.213 s) : 0, 1212828
Total [baseline] (11.03 s) : 0, 11030461
Agent [candidate] (1.208 s) : 0, 1207854
Total [candidate] (11.084 s) : 0, 11084308
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.096 s -
Agent appsec 1.267 s 170.649 ms (15.6%)
Agent iast 1.225 s 128.717 ms (11.7%)
Agent profiling 1.213 s 116.429 ms (10.6%)
Total tracing 10.897 s -
Total appsec 11.112 s 215.592 ms (2.0%)
Total iast 11.101 s 203.897 ms (1.9%)
Total profiling 11.03 s 133.752 ms (1.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.083 s -
Agent appsec 1.27 s 186.797 ms (17.2%)
Agent iast 1.219 s 136.508 ms (12.6%)
Agent profiling 1.208 s 124.901 ms (11.5%)
Total tracing 10.854 s -
Total appsec 11.141 s 287.488 ms (2.6%)
Total iast 11.168 s 314.447 ms (2.9%)
Total profiling 11.084 s 230.763 ms (2.1%) 
gantt
    title petclinic - break down per module: candidate=1.57.0-SNAPSHOT~2f138af11c, baseline=1.57.0-SNAPSHOT~015be6d1b3

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.219 ms) : 0, 1219
crashtracking [candidate] (1.198 ms) : 0, 1198
BytebuddyAgent [baseline] (658.305 ms) : 0, 658305
BytebuddyAgent [candidate] (649.519 ms) : 0, 649519
GlobalTracer [baseline] (285.947 ms) : 0, 285947
GlobalTracer [candidate] (282.354 ms) : 0, 282354
AppSec [baseline] (32.663 ms) : 0, 32663
AppSec [candidate] (32.474 ms) : 0, 32474
Debugger [baseline] (68.696 ms) : 0, 68696
Debugger [candidate] (68.434 ms) : 0, 68434
Remote Config [baseline] (639.262 µs) : 0, 639
Remote Config [candidate] (647.755 µs) : 0, 648
Telemetry [baseline] (9.252 ms) : 0, 9252
Telemetry [candidate] (9.026 ms) : 0, 9026
Flare Poller [baseline] (3.805 ms) : 0, 3805
Flare Poller [candidate] (3.79 ms) : 0, 3790
section appsec
crashtracking [baseline] (1.205 ms) : 0, 1205
crashtracking [candidate] (1.212 ms) : 0, 1212
BytebuddyAgent [baseline] (690.521 ms) : 0, 690521
BytebuddyAgent [candidate] (693.176 ms) : 0, 693176
GlobalTracer [baseline] (259.652 ms) : 0, 259652
GlobalTracer [candidate] (260.108 ms) : 0, 260108
IAST [baseline] (24.811 ms) : 0, 24811
IAST [candidate] (24.697 ms) : 0, 24697
AppSec [baseline] (174.461 ms) : 0, 174461
AppSec [candidate] (174.114 ms) : 0, 174114
Debugger [baseline] (67.22 ms) : 0, 67220
Debugger [candidate] (67.186 ms) : 0, 67186
Remote Config [baseline] (726.509 µs) : 0, 727
Remote Config [candidate] (725.625 µs) : 0, 726
Telemetry [baseline] (8.912 ms) : 0, 8912
Telemetry [candidate] (9.051 ms) : 0, 9051
Flare Poller [baseline] (3.856 ms) : 0, 3856
Flare Poller [candidate] (3.953 ms) : 0, 3953
section iast
crashtracking [baseline] (1.206 ms) : 0, 1206
crashtracking [candidate] (1.197 ms) : 0, 1197
BytebuddyAgent [baseline] (792.121 ms) : 0, 792121
BytebuddyAgent [candidate] (788.311 ms) : 0, 788311
GlobalTracer [baseline] (255.558 ms) : 0, 255558
GlobalTracer [candidate] (254.904 ms) : 0, 254904
IAST [baseline] (27.019 ms) : 0, 27019
IAST [candidate] (26.855 ms) : 0, 26855
AppSec [baseline] (33.667 ms) : 0, 33667
AppSec [candidate] (35.184 ms) : 0, 35184
Debugger [baseline] (67.623 ms) : 0, 67623
Debugger [candidate] (65.318 ms) : 0, 65318
Remote Config [baseline] (552.081 µs) : 0, 552
Remote Config [candidate] (535.716 µs) : 0, 536
Telemetry [baseline] (8.453 ms) : 0, 8453
Telemetry [candidate] (8.387 ms) : 0, 8387
Flare Poller [baseline] (3.464 ms) : 0, 3464
Flare Poller [candidate] (3.459 ms) : 0, 3459
section profiling
crashtracking [baseline] (1.21 ms) : 0, 1210
crashtracking [candidate] (1.204 ms) : 0, 1204
BytebuddyAgent [baseline] (707.546 ms) : 0, 707546
BytebuddyAgent [candidate] (704.972 ms) : 0, 704972
GlobalTracer [baseline] (222.386 ms) : 0, 222386
GlobalTracer [candidate] (220.822 ms) : 0, 220822
AppSec [baseline] (32.596 ms) : 0, 32596
AppSec [candidate] (32.275 ms) : 0, 32275
Debugger [baseline] (68.055 ms) : 0, 68055
Debugger [candidate] (68.098 ms) : 0, 68098
Remote Config [baseline] (641.969 µs) : 0, 642
Remote Config [candidate] (656.951 µs) : 0, 657
Telemetry [baseline] (9.122 ms) : 0, 9122
Telemetry [candidate] (9.027 ms) : 0, 9027
Flare Poller [baseline] (3.767 ms) : 0, 3767
Flare Poller [candidate] (3.804 ms) : 0, 3804
ProfilingAgent [baseline] (97.42 ms) : 0, 97420
ProfilingAgent [candidate] (97.143 ms) : 0, 97143
Profiling [baseline] (98.013 ms) : 0, 98013
Profiling [candidate] (97.718 ms) : 0, 97718
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.57.0-SNAPSHOT~2f138af11c, baseline=1.57.0-SNAPSHOT~015be6d1b3

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.079 s) : 0, 1078781
Total [baseline] (8.752 s) : 0, 8751664
Agent [candidate] (1.095 s) : 0, 1095425
Total [candidate] (8.824 s) : 0, 8824488
section iast
Agent [baseline] (1.219 s) : 0, 1218667
Total [baseline] (9.433 s) : 0, 9433382
Agent [candidate] (1.229 s) : 0, 1229035
Total [candidate] (9.476 s) : 0, 9475765
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.079 s -
Agent iast 1.219 s 139.886 ms (13.0%)
Total tracing 8.752 s -
Total iast 9.433 s 681.718 ms (7.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.095 s -
Agent iast 1.229 s 133.609 ms (12.2%)
Total tracing 8.824 s -
Total iast 9.476 s 651.277 ms (7.4%) 
gantt
    title insecure-bank - break down per module: candidate=1.57.0-SNAPSHOT~2f138af11c, baseline=1.57.0-SNAPSHOT~015be6d1b3

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.193 ms) : 0, 1193
crashtracking [candidate] (1.216 ms) : 0, 1216
BytebuddyAgent [baseline] (647.819 ms) : 0, 647819
BytebuddyAgent [candidate] (658.063 ms) : 0, 658063
GlobalTracer [baseline] (281.127 ms) : 0, 281127
GlobalTracer [candidate] (285.494 ms) : 0, 285494
AppSec [baseline] (32.31 ms) : 0, 32310
AppSec [candidate] (32.902 ms) : 0, 32902
Debugger [baseline] (67.175 ms) : 0, 67175
Debugger [candidate] (68.162 ms) : 0, 68162
Remote Config [baseline] (657.384 µs) : 0, 657
Remote Config [candidate] (646.839 µs) : 0, 647
Telemetry [baseline] (9.052 ms) : 0, 9052
Telemetry [candidate] (9.119 ms) : 0, 9119
Flare Poller [baseline] (3.764 ms) : 0, 3764
Flare Poller [candidate] (3.835 ms) : 0, 3835
section iast
crashtracking [baseline] (1.188 ms) : 0, 1188
crashtracking [candidate] (1.217 ms) : 0, 1217
BytebuddyAgent [baseline] (788.691 ms) : 0, 788691
BytebuddyAgent [candidate] (795.416 ms) : 0, 795416
GlobalTracer [baseline] (254.933 ms) : 0, 254933
GlobalTracer [candidate] (256.791 ms) : 0, 256791
IAST [baseline] (26.917 ms) : 0, 26917
IAST [candidate] (27.146 ms) : 0, 27146
AppSec [baseline] (34.233 ms) : 0, 34233
AppSec [candidate] (35.419 ms) : 0, 35419
Debugger [baseline] (64.832 ms) : 0, 64832
Debugger [candidate] (64.868 ms) : 0, 64868
Remote Config [baseline] (611.543 µs) : 0, 612
Remote Config [candidate] (553.348 µs) : 0, 553
Telemetry [baseline] (8.434 ms) : 0, 8434
Telemetry [candidate] (8.557 ms) : 0, 8557
Flare Poller [baseline] (3.447 ms) : 0, 3447
Flare Poller [candidate] (3.481 ms) : 0, 3481
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/crasherror
git_commit_date 1765453400 1765470912
git_commit_sha 015be6d 2f138af
release_version 1.57.0-SNAPSHOT~015be6d1b3 1.57.0-SNAPSHOT~2f138af11c
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1765473297 1765473297
ci_job_id 1287990951 1287990951
ci_pipeline_id 86261573 86261573
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-k7svv9a8 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-k7svv9a8 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 2 performance regressions! Performance is the same for 15 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast:high_load better
[-240.416µs; -145.881µs] or [-9.222%; -5.596%]		 better
[-549.466µs; -194.312µs] or [-7.320%; -2.589%]		 unstable
[-65.916op/s; +237.291op/s] or [-4.773%; +17.182%]		 2.414ms 7.134ms 1466.719op/s 2.607ms 7.506ms 1381.031op/s
scenario:load:petclinic:profiling:high_load worse
[+0.982ms; +1.787ms] or [+5.457%; +9.933%]		 worse
[+0.737ms; +2.170ms] or [+2.499%; +7.363%]		 unstable
[-41.502op/s; +9.627op/s] or [-16.366%; +3.796%]		 19.377ms 30.929ms 237.656op/s 17.992ms 29.476ms 253.594op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~2f138af11c, baseline=1.57.0-SNAPSHOT~015be6d1b3
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.196 ms) : 1185, 1208
.   : milestone, 1196,
iast (3.315 ms) : 3276, 3354
.   : milestone, 3315,
iast_FULL (5.824 ms) : 5766, 5883
.   : milestone, 5824,
iast_GLOBAL (3.605 ms) : 3553, 3657
.   : milestone, 3605,
profiling (2.073 ms) : 2055, 2092
.   : milestone, 2073,
tracing (1.862 ms) : 1843, 1880
.   : milestone, 1862,
section candidate
no_agent (1.221 ms) : 1209, 1233
.   : milestone, 1221,
iast (3.118 ms) : 3078, 3158
.   : milestone, 3118,
iast_FULL (5.785 ms) : 5727, 5843
.   : milestone, 5785,
iast_GLOBAL (3.644 ms) : 3589, 3699
.   : milestone, 3644,
profiling (2.036 ms) : 2018, 2054
.   : milestone, 2036,
tracing (1.797 ms) : 1782, 1812
.   : milestone, 1797,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.196 ms [1.185 ms, 1.208 ms] -
iast 3.315 ms [3.276 ms, 3.354 ms] 2.119 ms (177.1%)
iast_FULL 5.824 ms [5.766 ms, 5.883 ms] 4.628 ms (386.8%)
iast_GLOBAL 3.605 ms [3.553 ms, 3.657 ms] 2.409 ms (201.4%)
profiling 2.073 ms [2.055 ms, 2.092 ms] 877.029 µs (73.3%)
tracing 1.862 ms [1.843 ms, 1.88 ms] 665.395 µs (55.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.221 ms [1.209 ms, 1.233 ms] -
iast 3.118 ms [3.078 ms, 3.158 ms] 1.897 ms (155.3%)
iast_FULL 5.785 ms [5.727 ms, 5.843 ms] 4.564 ms (373.8%)
iast_GLOBAL 3.644 ms [3.589 ms, 3.699 ms] 2.423 ms (198.5%)
profiling 2.036 ms [2.018 ms, 2.054 ms] 814.798 µs (66.7%)
tracing 1.797 ms [1.782 ms, 1.812 ms] 576.415 µs (47.2%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~2f138af11c, baseline=1.57.0-SNAPSHOT~015be6d1b3
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.182 ms) : 17999, 18364
.   : milestone, 18182,
appsec (18.805 ms) : 18611, 18998
.   : milestone, 18805,
code_origins (17.489 ms) : 17315, 17663
.   : milestone, 17489,
iast (17.435 ms) : 17261, 17608
.   : milestone, 17435,
profiling (18.401 ms) : 18218, 18585
.   : milestone, 18401,
tracing (17.691 ms) : 17516, 17865
.   : milestone, 17691,
section candidate
no_agent (19.654 ms) : 19443, 19865
.   : milestone, 19654,
appsec (18.626 ms) : 18440, 18813
.   : milestone, 18626,
code_origins (17.912 ms) : 17733, 18091
.   : milestone, 17912,
iast (17.532 ms) : 17357, 17707
.   : milestone, 17532,
profiling (19.64 ms) : 19441, 19840
.   : milestone, 19640,
tracing (17.419 ms) : 17247, 17591
.   : milestone, 17419,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.182 ms [17.999 ms, 18.364 ms] -
appsec 18.805 ms [18.611 ms, 18.998 ms] 622.927 µs (3.4%)
code_origins 17.489 ms [17.315 ms, 17.663 ms] -692.558 µs (-3.8%)
iast 17.435 ms [17.261 ms, 17.608 ms] -747.082 µs (-4.1%)
profiling 18.401 ms [18.218 ms, 18.585 ms] 219.749 µs (1.2%)
tracing 17.691 ms [17.516 ms, 17.865 ms] -490.802 µs (-2.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.654 ms [19.443 ms, 19.865 ms] -
appsec 18.626 ms [18.44 ms, 18.813 ms] -1.028 ms (-5.2%)
code_origins 17.912 ms [17.733 ms, 18.091 ms] -1.742 ms (-8.9%)
iast 17.532 ms [17.357 ms, 17.707 ms] -2.122 ms (-10.8%)
profiling 19.64 ms [19.441 ms, 19.84 ms] -13.51 µs (-0.1%)
tracing 17.419 ms [17.247 ms, 17.591 ms] -2.235 ms (-11.4%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/crasherror
git_commit_date 1765453400 1765470912
git_commit_sha 015be6d 2f138af
release_version 1.57.0-SNAPSHOT~015be6d1b3 1.57.0-SNAPSHOT~2f138af11c
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1765473309 1765473309
ci_job_id 1287990955 1287990955
ci_pipeline_id 86261573 86261573
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-s056dvf6 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-s056dvf6 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~2f138af11c, baseline=1.57.0-SNAPSHOT~015be6d1b3
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.626 s) : 15626000, 15626000
.   : milestone, 15626000,
appsec (14.671 s) : 14671000, 14671000
.   : milestone, 14671000,
iast (17.979 s) : 17979000, 17979000
.   : milestone, 17979000,
iast_GLOBAL (18.009 s) : 18009000, 18009000
.   : milestone, 18009000,
profiling (14.643 s) : 14643000, 14643000
.   : milestone, 14643000,
tracing (14.79 s) : 14790000, 14790000
.   : milestone, 14790000,
section candidate
no_agent (15.302 s) : 15302000, 15302000
.   : milestone, 15302000,
appsec (14.858 s) : 14858000, 14858000
.   : milestone, 14858000,
iast (18.264 s) : 18264000, 18264000
.   : milestone, 18264000,
iast_GLOBAL (17.973 s) : 17973000, 17973000
.   : milestone, 17973000,
profiling (14.593 s) : 14593000, 14593000
.   : milestone, 14593000,
tracing (14.571 s) : 14571000, 14571000
.   : milestone, 14571000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.626 s [15.626 s, 15.626 s] -
appsec 14.671 s [14.671 s, 14.671 s] -955.0 ms (-6.1%)
iast 17.979 s [17.979 s, 17.979 s] 2.353 s (15.1%)
iast_GLOBAL 18.009 s [18.009 s, 18.009 s] 2.383 s (15.3%)
profiling 14.643 s [14.643 s, 14.643 s] -983.0 ms (-6.3%)
tracing 14.79 s [14.79 s, 14.79 s] -836.0 ms (-5.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.302 s [15.302 s, 15.302 s] -
appsec 14.858 s [14.858 s, 14.858 s] -444.0 ms (-2.9%)
iast 18.264 s [18.264 s, 18.264 s] 2.962 s (19.4%)
iast_GLOBAL 17.973 s [17.973 s, 17.973 s] 2.671 s (17.5%)
profiling 14.593 s [14.593 s, 14.593 s] -709.0 ms (-4.6%)
tracing 14.571 s [14.571 s, 14.571 s] -731.0 ms (-4.8%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~2f138af11c, baseline=1.57.0-SNAPSHOT~015be6d1b3
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.483 ms) : 1472, 1495
.   : milestone, 1483,
appsec (2.53 ms) : 2475, 2584
.   : milestone, 2530,
iast (2.223 ms) : 2159, 2288
.   : milestone, 2223,
iast_GLOBAL (2.27 ms) : 2205, 2335
.   : milestone, 2270,
profiling (2.088 ms) : 2035, 2141
.   : milestone, 2088,
tracing (2.058 ms) : 2007, 2109
.   : milestone, 2058,
section candidate
no_agent (1.483 ms) : 1471, 1494
.   : milestone, 1483,
appsec (3.684 ms) : 3469, 3899
.   : milestone, 3684,
iast (2.223 ms) : 2158, 2287
.   : milestone, 2223,
iast_GLOBAL (2.278 ms) : 2213, 2343
.   : milestone, 2278,
profiling (2.086 ms) : 2032, 2140
.   : milestone, 2086,
tracing (2.056 ms) : 2005, 2107
.   : milestone, 2056,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.483 ms [1.472 ms, 1.495 ms] -
appsec 2.53 ms [2.475 ms, 2.584 ms] 1.046 ms (70.5%)
iast 2.223 ms [2.159 ms, 2.288 ms] 739.831 µs (49.9%)
iast_GLOBAL 2.27 ms [2.205 ms, 2.335 ms] 786.898 µs (53.0%)
profiling 2.088 ms [2.035 ms, 2.141 ms] 604.685 µs (40.8%)
tracing 2.058 ms [2.007 ms, 2.109 ms] 574.582 µs (38.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.483 ms [1.471 ms, 1.494 ms] -
appsec 3.684 ms [3.469 ms, 3.899 ms] 2.201 ms (148.5%)
iast 2.223 ms [2.158 ms, 2.287 ms] 740.234 µs (49.9%)
iast_GLOBAL 2.278 ms [2.213 ms, 2.343 ms] 795.772 µs (53.7%)
profiling 2.086 ms [2.032 ms, 2.14 ms] 603.589 µs (40.7%)
tracing 2.056 ms [2.005 ms, 2.107 ms] 573.271 µs (38.7%)