Home Original page

Store some crashtracking options on initialisation by amarziali · Pull Request #10036 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/dualship
git_commit_date 1764165027 1764166744
git_commit_sha 0df702a 2563480
release_version 1.57.0-SNAPSHOT~0df702a3d3 1.57.0-SNAPSHOT~2563480753
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1764168478 1764168478
ci_job_id 1258415762 1258415762
ci_pipeline_id 84108836 84108836
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-chrjzu4i 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-chrjzu4i 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 54 metrics, 11 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.57.0-SNAPSHOT~2563480753, baseline=1.57.0-SNAPSHOT~0df702a3d3

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.057 s) : 0, 1056902
Total [baseline] (8.735 s) : 0, 8735332
Agent [candidate] (1.053 s) : 0, 1052564
Total [candidate] (8.71 s) : 0, 8709726
section iast
Agent [baseline] (1.192 s) : 0, 1191583
Total [baseline] (9.352 s) : 0, 9352256
Agent [candidate] (1.187 s) : 0, 1187393
Total [candidate] (9.31 s) : 0, 9309885
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.057 s -
Agent iast 1.192 s 134.681 ms (12.7%)
Total tracing 8.735 s -
Total iast 9.352 s 616.925 ms (7.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.053 s -
Agent iast 1.187 s 134.829 ms (12.8%)
Total tracing 8.71 s -
Total iast 9.31 s 600.159 ms (6.9%) 
gantt
    title insecure-bank - break down per module: candidate=1.57.0-SNAPSHOT~2563480753, baseline=1.57.0-SNAPSHOT~0df702a3d3

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.497 ms) : 0, 1497
crashtracking [candidate] (1.484 ms) : 0, 1484
BytebuddyAgent [baseline] (710.768 ms) : 0, 710768
BytebuddyAgent [candidate] (707.793 ms) : 0, 707793
GlobalTracer [baseline] (250.036 ms) : 0, 250036
GlobalTracer [candidate] (249.027 ms) : 0, 249027
AppSec [baseline] (32.269 ms) : 0, 32269
AppSec [candidate] (32.209 ms) : 0, 32209
Debugger [baseline] (6.471 ms) : 0, 6471
Debugger [candidate] (6.404 ms) : 0, 6404
Remote Config [baseline] (685.638 µs) : 0, 686
Remote Config [candidate] (678.687 µs) : 0, 679
Telemetry [baseline] (14.565 ms) : 0, 14565
Telemetry [candidate] (14.583 ms) : 0, 14583
Flare Poller [baseline] (5.624 ms) : 0, 5624
Flare Poller [candidate] (5.539 ms) : 0, 5539
section iast
crashtracking [baseline] (1.488 ms) : 0, 1488
crashtracking [candidate] (1.475 ms) : 0, 1475
BytebuddyAgent [baseline] (830.801 ms) : 0, 830801
BytebuddyAgent [candidate] (828.656 ms) : 0, 828656
GlobalTracer [baseline] (237.723 ms) : 0, 237723
GlobalTracer [candidate] (236.787 ms) : 0, 236787
AppSec [baseline] (29.677 ms) : 0, 29677
AppSec [candidate] (26.722 ms) : 0, 26722
Debugger [baseline] (6.121 ms) : 0, 6121
Debugger [candidate] (5.924 ms) : 0, 5924
Remote Config [baseline] (624.254 µs) : 0, 624
Remote Config [candidate] (603.511 µs) : 0, 604
Telemetry [baseline] (7.908 ms) : 0, 7908
Telemetry [candidate] (7.765 ms) : 0, 7765
Flare Poller [baseline] (10.822 ms) : 0, 10822
Flare Poller [candidate] (10.675 ms) : 0, 10675
IAST [baseline] (31.536 ms) : 0, 31536
IAST [candidate] (34.07 ms) : 0, 34070
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.57.0-SNAPSHOT~2563480753, baseline=1.57.0-SNAPSHOT~0df702a3d3

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.052 s) : 0, 1051886
Total [baseline] (10.787 s) : 0, 10787115
Agent [candidate] (1.059 s) : 0, 1059400
Total [candidate] (10.85 s) : 0, 10850147
section appsec
Agent [baseline] (1.241 s) : 0, 1240994
Total [baseline] (10.88 s) : 0, 10880491
Agent [candidate] (1.235 s) : 0, 1235246
Total [candidate] (10.969 s) : 0, 10968725
section iast
Agent [baseline] (1.193 s) : 0, 1192825
Total [baseline] (11.223 s) : 0, 11222923
Agent [candidate] (1.203 s) : 0, 1203288
Total [candidate] (11.358 s) : 0, 11357805
section profiling
Agent [baseline] (1.204 s) : 0, 1204475
Total [baseline] (10.941 s) : 0, 10940563
Agent [candidate] (1.199 s) : 0, 1198534
Total [candidate] (11.006 s) : 0, 11005763
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.052 s -
Agent appsec 1.241 s 189.108 ms (18.0%)
Agent iast 1.193 s 140.94 ms (13.4%)
Agent profiling 1.204 s 152.589 ms (14.5%)
Total tracing 10.787 s -
Total appsec 10.88 s 93.377 ms (0.9%)
Total iast 11.223 s 435.809 ms (4.0%)
Total profiling 10.941 s 153.448 ms (1.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.059 s -
Agent appsec 1.235 s 175.846 ms (16.6%)
Agent iast 1.203 s 143.889 ms (13.6%)
Agent profiling 1.199 s 139.134 ms (13.1%)
Total tracing 10.85 s -
Total appsec 10.969 s 118.578 ms (1.1%)
Total iast 11.358 s 507.658 ms (4.7%)
Total profiling 11.006 s 155.616 ms (1.4%) 
gantt
    title petclinic - break down per module: candidate=1.57.0-SNAPSHOT~2563480753, baseline=1.57.0-SNAPSHOT~0df702a3d3

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.489 ms) : 0, 1489
crashtracking [candidate] (1.491 ms) : 0, 1491
BytebuddyAgent [baseline] (706.795 ms) : 0, 706795
BytebuddyAgent [candidate] (712.049 ms) : 0, 712049
GlobalTracer [baseline] (249.143 ms) : 0, 249143
GlobalTracer [candidate] (250.663 ms) : 0, 250663
AppSec [baseline] (31.941 ms) : 0, 31941
AppSec [candidate] (32.476 ms) : 0, 32476
Debugger [baseline] (6.362 ms) : 0, 6362
Debugger [candidate] (6.53 ms) : 0, 6530
Remote Config [baseline] (678.042 µs) : 0, 678
Remote Config [candidate] (685.819 µs) : 0, 686
Telemetry [baseline] (14.219 ms) : 0, 14219
Telemetry [candidate] (14.798 ms) : 0, 14798
Flare Poller [baseline] (6.48 ms) : 0, 6480
Flare Poller [candidate] (5.68 ms) : 0, 5680
section appsec
crashtracking [baseline] (1.506 ms) : 0, 1506
crashtracking [candidate] (1.496 ms) : 0, 1496
BytebuddyAgent [baseline] (740.337 ms) : 0, 740337
BytebuddyAgent [candidate] (735.776 ms) : 0, 735776
GlobalTracer [baseline] (243.18 ms) : 0, 243180
GlobalTracer [candidate] (242.04 ms) : 0, 242040
IAST [baseline] (25.283 ms) : 0, 25283
IAST [candidate] (25.043 ms) : 0, 25043
AppSec [baseline] (176.135 ms) : 0, 176135
AppSec [candidate] (176.327 ms) : 0, 176327
Debugger [baseline] (6.346 ms) : 0, 6346
Debugger [candidate] (6.369 ms) : 0, 6369
Remote Config [baseline] (702.137 µs) : 0, 702
Remote Config [candidate] (705.645 µs) : 0, 706
Telemetry [baseline] (8.22 ms) : 0, 8220
Telemetry [candidate] (8.301 ms) : 0, 8301
Flare Poller [baseline] (4.039 ms) : 0, 4039
Flare Poller [candidate] (4.054 ms) : 0, 4054
section iast
crashtracking [baseline] (1.479 ms) : 0, 1479
crashtracking [candidate] (1.493 ms) : 0, 1493
BytebuddyAgent [baseline] (831.338 ms) : 0, 831338
BytebuddyAgent [candidate] (839.571 ms) : 0, 839571
GlobalTracer [baseline] (238.355 ms) : 0, 238355
GlobalTracer [candidate] (239.241 ms) : 0, 239241
IAST [baseline] (32.457 ms) : 0, 32457
IAST [candidate] (29.303 ms) : 0, 29303
AppSec [baseline] (28.794 ms) : 0, 28794
AppSec [candidate] (32.833 ms) : 0, 32833
Debugger [baseline] (6.087 ms) : 0, 6087
Debugger [candidate] (6.129 ms) : 0, 6129
Remote Config [baseline] (604.724 µs) : 0, 605
Remote Config [candidate] (627.955 µs) : 0, 628
Telemetry [baseline] (7.916 ms) : 0, 7916
Telemetry [candidate] (8.144 ms) : 0, 8144
Flare Poller [baseline] (10.988 ms) : 0, 10988
Flare Poller [candidate] (10.82 ms) : 0, 10820
section profiling
crashtracking [baseline] (1.442 ms) : 0, 1442
crashtracking [candidate] (1.438 ms) : 0, 1438
BytebuddyAgent [baseline] (737.347 ms) : 0, 737347
BytebuddyAgent [candidate] (734.275 ms) : 0, 734275
GlobalTracer [baseline] (223.237 ms) : 0, 223237
GlobalTracer [candidate] (222.312 ms) : 0, 222312
AppSec [baseline] (32.352 ms) : 0, 32352
AppSec [candidate] (32.072 ms) : 0, 32072
Debugger [baseline] (7.643 ms) : 0, 7643
Debugger [candidate] (6.857 ms) : 0, 6857
Remote Config [baseline] (719.318 µs) : 0, 719
Remote Config [candidate] (1.467 ms) : 0, 1467
Telemetry [baseline] (15.476 ms) : 0, 15476
Telemetry [candidate] (15.528 ms) : 0, 15528
Flare Poller [baseline] (4.181 ms) : 0, 4181
Flare Poller [candidate] (4.171 ms) : 0, 4171
ProfilingAgent [baseline] (112.575 ms) : 0, 112575
ProfilingAgent [candidate] (111.302 ms) : 0, 111302
Profiling [baseline] (113.21 ms) : 0, 113210
Profiling [candidate] (111.929 ms) : 0, 111929
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/dualship
git_commit_date 1764165027 1764166744
git_commit_sha 0df702a 2563480
release_version 1.57.0-SNAPSHOT~0df702a3d3 1.57.0-SNAPSHOT~2563480753
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1764168960 1764168960
ci_job_id 1258415763 1258415763
ci_pipeline_id 84108836 84108836
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-4obe8tjs 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-4obe8tjs 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 2 performance regressions! Performance is the same for 17 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_FULL:high_load unsure
[+81.920µs; +283.679µs] or [+1.599%; +5.535%]		 worse
[+311.187µs; +1026.048µs] or [+2.571%; +8.478%]		 unstable
[-106.503op/s; +47.628op/s] or [-13.312%; +5.953%]		 5.308ms 12.770ms 770.625op/s 5.125ms 12.102ms 800.062op/s
scenario:load:petclinic:no_agent:high_load worse
[+1.316ms; +2.765ms] or [+7.685%; +16.146%]		 unstable
[+0.917ms; +4.198ms] or [+3.168%; +14.502%]		 unstable
[-55.408op/s; +4.095op/s] or [-20.951%; +1.549%]		 19.168ms 31.507ms 238.812op/s 17.127ms 28.950ms 264.469op/s
scenario:load:petclinic:appsec:high_load better
[-1225.300µs; -576.400µs] or [-6.349%; -2.987%]		 same
[-1071.118µs; +337.474µs] or [-3.482%; +1.097%]		 unstable
[-18.915op/s; +35.478op/s] or [-7.864%; +14.750%]		 18.398ms 30.393ms 248.812op/s 19.299ms 30.760ms 240.531op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~2563480753, baseline=1.57.0-SNAPSHOT~0df702a3d3
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.64 ms) : 17459, 17821
.   : milestone, 17640,
appsec (19.41 ms) : 19212, 19607
.   : milestone, 19410,
code_origins (17.667 ms) : 17492, 17842
.   : milestone, 17667,
iast (17.725 ms) : 17546, 17905
.   : milestone, 17725,
profiling (18.735 ms) : 18544, 18925
.   : milestone, 18735,
tracing (17.379 ms) : 17210, 17548
.   : milestone, 17379,
section candidate
no_agent (19.551 ms) : 19350, 19752
.   : milestone, 19551,
appsec (18.755 ms) : 18561, 18949
.   : milestone, 18755,
code_origins (17.698 ms) : 17525, 17871
.   : milestone, 17698,
iast (17.813 ms) : 17636, 17991
.   : milestone, 17813,
profiling (18.705 ms) : 18518, 18891
.   : milestone, 18705,
tracing (17.82 ms) : 17637, 18004
.   : milestone, 17820,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.64 ms [17.459 ms, 17.821 ms] -
appsec 19.41 ms [19.212 ms, 19.607 ms] 1.769 ms (10.0%)
code_origins 17.667 ms [17.492 ms, 17.842 ms] 26.796 µs (0.2%)
iast 17.725 ms [17.546 ms, 17.905 ms] 85.027 µs (0.5%)
profiling 18.735 ms [18.544 ms, 18.925 ms] 1.094 ms (6.2%)
tracing 17.379 ms [17.21 ms, 17.548 ms] -261.29 µs (-1.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.551 ms [19.35 ms, 19.752 ms] -
appsec 18.755 ms [18.561 ms, 18.949 ms] -796.04 µs (-4.1%)
code_origins 17.698 ms [17.525 ms, 17.871 ms] -1.853 ms (-9.5%)
iast 17.813 ms [17.636 ms, 17.991 ms] -1.738 ms (-8.9%)
profiling 18.705 ms [18.518 ms, 18.891 ms] -846.362 µs (-4.3%)
tracing 17.82 ms [17.637 ms, 18.004 ms] -1.731 ms (-8.9%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~2563480753, baseline=1.57.0-SNAPSHOT~0df702a3d3
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.214 ms) : 1202, 1226
.   : milestone, 1214,
iast (3.182 ms) : 3139, 3224
.   : milestone, 3182,
iast_FULL (5.778 ms) : 5720, 5835
.   : milestone, 5778,
iast_GLOBAL (3.602 ms) : 3548, 3656
.   : milestone, 3602,
profiling (2.204 ms) : 2183, 2225
.   : milestone, 2204,
tracing (1.876 ms) : 1858, 1894
.   : milestone, 1876,
section candidate
no_agent (1.21 ms) : 1198, 1222
.   : milestone, 1210,
iast (3.27 ms) : 3226, 3314
.   : milestone, 3270,
iast_FULL (6.002 ms) : 5940, 6064
.   : milestone, 6002,
iast_GLOBAL (3.602 ms) : 3553, 3651
.   : milestone, 3602,
profiling (2.051 ms) : 2034, 2069
.   : milestone, 2051,
tracing (1.77 ms) : 1756, 1785
.   : milestone, 1770,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.214 ms [1.202 ms, 1.226 ms] -
iast 3.182 ms [3.139 ms, 3.224 ms] 1.967 ms (162.0%)
iast_FULL 5.778 ms [5.72 ms, 5.835 ms] 4.563 ms (375.8%)
iast_GLOBAL 3.602 ms [3.548 ms, 3.656 ms] 2.388 ms (196.7%)
profiling 2.204 ms [2.183 ms, 2.225 ms] 989.742 µs (81.5%)
tracing 1.876 ms [1.858 ms, 1.894 ms] 662.087 µs (54.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.21 ms [1.198 ms, 1.222 ms] -
iast 3.27 ms [3.226 ms, 3.314 ms] 2.059 ms (170.2%)
iast_FULL 6.002 ms [5.94 ms, 6.064 ms] 4.792 ms (395.9%)
iast_GLOBAL 3.602 ms [3.553 ms, 3.651 ms] 2.391 ms (197.6%)
profiling 2.051 ms [2.034 ms, 2.069 ms] 840.821 µs (69.5%)
tracing 1.77 ms [1.756 ms, 1.785 ms] 559.863 µs (46.3%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/dualship
git_commit_date 1764165027 1764166744
git_commit_sha 0df702a 2563480
release_version 1.57.0-SNAPSHOT~0df702a3d3 1.57.0-SNAPSHOT~2563480753
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1764168670 1764168670
ci_job_id 1258415764 1258415764
ci_pipeline_id 84108836 84108836
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-asl401k2 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-asl401k2 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~2563480753, baseline=1.57.0-SNAPSHOT~0df702a3d3
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.105 s) : 15105000, 15105000
.   : milestone, 15105000,
appsec (14.542 s) : 14542000, 14542000
.   : milestone, 14542000,
iast (18.766 s) : 18766000, 18766000
.   : milestone, 18766000,
iast_GLOBAL (17.88 s) : 17880000, 17880000
.   : milestone, 17880000,
profiling (15.121 s) : 15121000, 15121000
.   : milestone, 15121000,
tracing (14.761 s) : 14761000, 14761000
.   : milestone, 14761000,
section candidate
no_agent (14.976 s) : 14976000, 14976000
.   : milestone, 14976000,
appsec (14.831 s) : 14831000, 14831000
.   : milestone, 14831000,
iast (18.289 s) : 18289000, 18289000
.   : milestone, 18289000,
iast_GLOBAL (17.99 s) : 17990000, 17990000
.   : milestone, 17990000,
profiling (14.651 s) : 14651000, 14651000
.   : milestone, 14651000,
tracing (14.939 s) : 14939000, 14939000
.   : milestone, 14939000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.105 s [15.105 s, 15.105 s] -
appsec 14.542 s [14.542 s, 14.542 s] -563.0 ms (-3.7%)
iast 18.766 s [18.766 s, 18.766 s] 3.661 s (24.2%)
iast_GLOBAL 17.88 s [17.88 s, 17.88 s] 2.775 s (18.4%)
profiling 15.121 s [15.121 s, 15.121 s] 16.0 ms (0.1%)
tracing 14.761 s [14.761 s, 14.761 s] -344.0 ms (-2.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.976 s [14.976 s, 14.976 s] -
appsec 14.831 s [14.831 s, 14.831 s] -145.0 ms (-1.0%)
iast 18.289 s [18.289 s, 18.289 s] 3.313 s (22.1%)
iast_GLOBAL 17.99 s [17.99 s, 17.99 s] 3.014 s (20.1%)
profiling 14.651 s [14.651 s, 14.651 s] -325.0 ms (-2.2%)
tracing 14.939 s [14.939 s, 14.939 s] -37.0 ms (-0.2%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~2563480753, baseline=1.57.0-SNAPSHOT~0df702a3d3
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.481 ms) : 1469, 1493
.   : milestone, 1481,
appsec (3.694 ms) : 3475, 3912
.   : milestone, 3694,
iast (2.222 ms) : 2157, 2287
.   : milestone, 2222,
iast_GLOBAL (2.26 ms) : 2195, 2325
.   : milestone, 2260,
profiling (2.062 ms) : 2009, 2114
.   : milestone, 2062,
tracing (2.053 ms) : 2002, 2104
.   : milestone, 2053,
section candidate
no_agent (1.48 ms) : 1468, 1491
.   : milestone, 1480,
appsec (3.648 ms) : 3434, 3863
.   : milestone, 3648,
iast (2.221 ms) : 2156, 2287
.   : milestone, 2221,
iast_GLOBAL (2.266 ms) : 2201, 2332
.   : milestone, 2266,
profiling (2.067 ms) : 2014, 2120
.   : milestone, 2067,
tracing (2.057 ms) : 2006, 2108
.   : milestone, 2057,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.481 ms [1.469 ms, 1.493 ms] -
appsec 3.694 ms [3.475 ms, 3.912 ms] 2.213 ms (149.4%)
iast 2.222 ms [2.157 ms, 2.287 ms] 741.303 µs (50.1%)
iast_GLOBAL 2.26 ms [2.195 ms, 2.325 ms] 778.675 µs (52.6%)
profiling 2.062 ms [2.009 ms, 2.114 ms] 580.758 µs (39.2%)
tracing 2.053 ms [2.002 ms, 2.104 ms] 572.196 µs (38.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.48 ms [1.468 ms, 1.491 ms] -
appsec 3.648 ms [3.434 ms, 3.863 ms] 2.169 ms (146.6%)
iast 2.221 ms [2.156 ms, 2.287 ms] 741.651 µs (50.1%)
iast_GLOBAL 2.266 ms [2.201 ms, 2.332 ms] 786.685 µs (53.2%)
profiling 2.067 ms [2.014 ms, 2.12 ms] 587.126 µs (39.7%)
tracing 2.057 ms [2.006 ms, 2.108 ms] 577.248 µs (39.0%)