Home Original page

Don't send IO failures to telemetry logs by amarziali · Pull Request #10210 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/exclude-from-telemetry
git_commit_date 1765795037 1765796536
git_commit_sha 1f4c004 be072c8
release_version 1.57.0-SNAPSHOT~1f4c004d2a 1.57.0-SNAPSHOT~be072c8003
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1765798527 1765798527
ci_job_id 1294769748 1294769748
ci_pipeline_id 86739132 86739132
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-a67loqr1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-a67loqr1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 57 metrics, 8 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.57.0-SNAPSHOT~be072c8003, baseline=1.57.0-SNAPSHOT~1f4c004d2a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.078 s) : 0, 1078027
Total [baseline] (10.809 s) : 0, 10809175
Agent [candidate] (1.085 s) : 0, 1085205
Total [candidate] (10.916 s) : 0, 10915641
section appsec
Agent [baseline] (1.265 s) : 0, 1264601
Total [baseline] (11.016 s) : 0, 11015960
Agent [candidate] (1.269 s) : 0, 1269001
Total [candidate] (11.126 s) : 0, 11125565
section iast
Agent [baseline] (1.227 s) : 0, 1226819
Total [baseline] (11.225 s) : 0, 11225247
Agent [candidate] (1.217 s) : 0, 1216869
Total [candidate] (11.073 s) : 0, 11073131
section profiling
Agent [baseline] (1.198 s) : 0, 1198378
Total [baseline] (10.902 s) : 0, 10901985
Agent [candidate] (1.201 s) : 0, 1200577
Total [candidate] (10.891 s) : 0, 10890522
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.078 s -
Agent appsec 1.265 s 186.574 ms (17.3%)
Agent iast 1.227 s 148.792 ms (13.8%)
Agent profiling 1.198 s 120.351 ms (11.2%)
Total tracing 10.809 s -
Total appsec 11.016 s 206.785 ms (1.9%)
Total iast 11.225 s 416.072 ms (3.8%)
Total profiling 10.902 s 92.81 ms (0.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.085 s -
Agent appsec 1.269 s 183.796 ms (16.9%)
Agent iast 1.217 s 131.664 ms (12.1%)
Agent profiling 1.201 s 115.372 ms (10.6%)
Total tracing 10.916 s -
Total appsec 11.126 s 209.924 ms (1.9%)
Total iast 11.073 s 157.49 ms (1.4%)
Total profiling 10.891 s -25.119 ms (-0.2%) 
gantt
    title petclinic - break down per module: candidate=1.57.0-SNAPSHOT~be072c8003, baseline=1.57.0-SNAPSHOT~1f4c004d2a

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.18 ms) : 0, 1180
crashtracking [candidate] (1.193 ms) : 0, 1193
BytebuddyAgent [baseline] (646.738 ms) : 0, 646738
BytebuddyAgent [candidate] (651.035 ms) : 0, 651035
GlobalTracer [baseline] (281.313 ms) : 0, 281313
GlobalTracer [candidate] (283.323 ms) : 0, 283323
AppSec [baseline] (32.259 ms) : 0, 32259
AppSec [candidate] (32.46 ms) : 0, 32460
Debugger [baseline] (67.746 ms) : 0, 67746
Debugger [candidate] (68.087 ms) : 0, 68087
Remote Config [baseline] (607.622 µs) : 0, 608
Remote Config [candidate] (625.498 µs) : 0, 625
Telemetry [baseline] (9.033 ms) : 0, 9033
Telemetry [candidate] (9.127 ms) : 0, 9127
Flare Poller [baseline] (3.699 ms) : 0, 3699
Flare Poller [candidate] (3.746 ms) : 0, 3746
section appsec
crashtracking [baseline] (1.182 ms) : 0, 1182
crashtracking [candidate] (1.194 ms) : 0, 1194
BytebuddyAgent [baseline] (689.261 ms) : 0, 689261
BytebuddyAgent [candidate] (691.662 ms) : 0, 691662
GlobalTracer [baseline] (258.661 ms) : 0, 258661
GlobalTracer [candidate] (259.408 ms) : 0, 259408
IAST [baseline] (24.537 ms) : 0, 24537
IAST [candidate] (24.786 ms) : 0, 24786
AppSec [baseline] (172.96 ms) : 0, 172960
AppSec [candidate] (173.138 ms) : 0, 173138
Debugger [baseline] (68.714 ms) : 0, 68714
Debugger [candidate] (69.494 ms) : 0, 69494
Remote Config [baseline] (714.68 µs) : 0, 715
Remote Config [candidate] (751.763 µs) : 0, 752
Telemetry [baseline] (9.085 ms) : 0, 9085
Telemetry [candidate] (9.043 ms) : 0, 9043
Flare Poller [baseline] (3.996 ms) : 0, 3996
Flare Poller [candidate] (3.814 ms) : 0, 3814
section iast
crashtracking [baseline] (1.187 ms) : 0, 1187
crashtracking [candidate] (1.164 ms) : 0, 1164
BytebuddyAgent [baseline] (793.024 ms) : 0, 793024
BytebuddyAgent [candidate] (785.867 ms) : 0, 785867
GlobalTracer [baseline] (256.673 ms) : 0, 256673
GlobalTracer [candidate] (254.784 ms) : 0, 254784
IAST [baseline] (27.182 ms) : 0, 27182
IAST [candidate] (26.918 ms) : 0, 26918
AppSec [baseline] (33.781 ms) : 0, 33781
AppSec [candidate] (33.71 ms) : 0, 33710
Debugger [baseline] (67.111 ms) : 0, 67111
Debugger [candidate] (66.764 ms) : 0, 66764
Remote Config [baseline] (582.595 µs) : 0, 583
Remote Config [candidate] (618.823 µs) : 0, 619
Telemetry [baseline] (8.422 ms) : 0, 8422
Telemetry [candidate] (8.334 ms) : 0, 8334
Flare Poller [baseline] (3.53 ms) : 0, 3530
Flare Poller [candidate] (3.504 ms) : 0, 3504
section profiling
crashtracking [baseline] (1.195 ms) : 0, 1195
crashtracking [candidate] (1.202 ms) : 0, 1202
BytebuddyAgent [baseline] (697.901 ms) : 0, 697901
BytebuddyAgent [candidate] (699.113 ms) : 0, 699113
GlobalTracer [baseline] (219.88 ms) : 0, 219880
GlobalTracer [candidate] (220.897 ms) : 0, 220897
AppSec [baseline] (31.958 ms) : 0, 31958
AppSec [candidate] (32.019 ms) : 0, 32019
Debugger [baseline] (68.104 ms) : 0, 68104
Debugger [candidate] (67.926 ms) : 0, 67926
Remote Config [baseline] (610.617 µs) : 0, 611
Remote Config [candidate] (619.289 µs) : 0, 619
Telemetry [baseline] (8.913 ms) : 0, 8913
Telemetry [candidate] (8.753 ms) : 0, 8753
Flare Poller [baseline] (3.76 ms) : 0, 3760
Flare Poller [candidate] (3.745 ms) : 0, 3745
ProfilingAgent [baseline] (96.648 ms) : 0, 96648
ProfilingAgent [candidate] (96.705 ms) : 0, 96705
Profiling [baseline] (97.219 ms) : 0, 97219
Profiling [candidate] (97.294 ms) : 0, 97294
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.57.0-SNAPSHOT~be072c8003, baseline=1.57.0-SNAPSHOT~1f4c004d2a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.078 s) : 0, 1078399
Total [baseline] (8.718 s) : 0, 8717700
Agent [candidate] (1.076 s) : 0, 1076246
Total [candidate] (8.698 s) : 0, 8698309
section iast
Agent [baseline] (1.224 s) : 0, 1223586
Total [baseline] (9.476 s) : 0, 9475996
Agent [candidate] (1.23 s) : 0, 1230405
Total [candidate] (9.423 s) : 0, 9423201
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.078 s -
Agent iast 1.224 s 145.186 ms (13.5%)
Total tracing 8.718 s -
Total iast 9.476 s 758.296 ms (8.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.076 s -
Agent iast 1.23 s 154.158 ms (14.3%)
Total tracing 8.698 s -
Total iast 9.423 s 724.892 ms (8.3%) 
gantt
    title insecure-bank - break down per module: candidate=1.57.0-SNAPSHOT~be072c8003, baseline=1.57.0-SNAPSHOT~1f4c004d2a

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.179 ms) : 0, 1179
crashtracking [candidate] (1.179 ms) : 0, 1179
BytebuddyAgent [baseline] (646.734 ms) : 0, 646734
BytebuddyAgent [candidate] (645.94 ms) : 0, 645940
GlobalTracer [baseline] (281.864 ms) : 0, 281864
GlobalTracer [candidate] (281.897 ms) : 0, 281897
AppSec [baseline] (32.185 ms) : 0, 32185
AppSec [candidate] (31.996 ms) : 0, 31996
Debugger [baseline] (67.502 ms) : 0, 67502
Debugger [candidate] (66.487 ms) : 0, 66487
Remote Config [baseline] (632.783 µs) : 0, 633
Remote Config [candidate] (622.323 µs) : 0, 622
Telemetry [baseline] (9.116 ms) : 0, 9116
Telemetry [candidate] (8.943 ms) : 0, 8943
Flare Poller [baseline] (3.751 ms) : 0, 3751
Flare Poller [candidate] (3.723 ms) : 0, 3723
section iast
crashtracking [baseline] (1.2 ms) : 0, 1200
crashtracking [candidate] (1.2 ms) : 0, 1200
BytebuddyAgent [baseline] (789.502 ms) : 0, 789502
BytebuddyAgent [candidate] (797.153 ms) : 0, 797153
GlobalTracer [baseline] (256.973 ms) : 0, 256973
GlobalTracer [candidate] (257.039 ms) : 0, 257039
IAST [baseline] (27.363 ms) : 0, 27363
IAST [candidate] (27.22 ms) : 0, 27220
AppSec [baseline] (33.754 ms) : 0, 33754
AppSec [candidate] (33.604 ms) : 0, 33604
Debugger [baseline] (66.804 ms) : 0, 66804
Debugger [candidate] (66.081 ms) : 0, 66081
Remote Config [baseline] (598.89 µs) : 0, 599
Remote Config [candidate] (578.745 µs) : 0, 579
Telemetry [baseline] (8.456 ms) : 0, 8456
Telemetry [candidate] (8.406 ms) : 0, 8406
Flare Poller [baseline] (3.584 ms) : 0, 3584
Flare Poller [candidate] (3.526 ms) : 0, 3526
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/exclude-from-telemetry
git_commit_date 1765795037 1765796536
git_commit_sha 1f4c004 be072c8
release_version 1.57.0-SNAPSHOT~1f4c004d2a 1.57.0-SNAPSHOT~be072c8003
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1765799017 1765799017
ci_job_id 1294769751 1294769751
ci_pipeline_id 86739132 86739132
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-quzkch7o 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-quzkch7o 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 1 performance regressions! Performance is the same for 15 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast:high_load better
[-208.536µs; -109.238µs] or [-8.275%; -4.335%]		 unsure
[-492.712µs; -75.600µs] or [-6.684%; -1.026%]		 unstable
[-80.079op/s; +239.454op/s] or [-5.656%; +16.913%]		 2.361ms 7.087ms 1495.500op/s 2.520ms 7.371ms 1415.812op/s
scenario:load:insecure-bank:profiling:high_load worse
[+63.427µs; +203.657µs] or [+3.888%; +12.485%]		 unstable
[+321.723µs; +1235.155µs] or [+7.127%; +27.363%]		 unstable
[-524.073op/s; +10.323op/s] or [-22.846%; +0.450%]		 1.765ms 5.292ms 2037.094op/s 1.631ms 4.514ms 2293.969op/s
scenario:load:petclinic:profiling:high_load better
[-1.935ms; -0.874ms] or [-9.786%; -4.418%]		 better
[-2.430ms; -0.982ms] or [-7.782%; -3.147%]		 unstable
[-13.948op/s; +41.823op/s] or [-5.939%; +17.809%]		 18.369ms 29.515ms 248.781op/s 19.773ms 31.222ms 234.844op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~be072c8003, baseline=1.57.0-SNAPSHOT~1f4c004d2a
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.0 ms) : 18809, 19191
.   : milestone, 19000,
appsec (18.959 ms) : 18768, 19151
.   : milestone, 18959,
code_origins (17.766 ms) : 17587, 17945
.   : milestone, 17766,
iast (17.664 ms) : 17490, 17839
.   : milestone, 17664,
profiling (19.883 ms) : 19682, 20083
.   : milestone, 19883,
tracing (17.588 ms) : 17415, 17761
.   : milestone, 17588,
section candidate
no_agent (18.174 ms) : 17989, 18359
.   : milestone, 18174,
appsec (18.378 ms) : 18191, 18566
.   : milestone, 18378,
code_origins (17.754 ms) : 17576, 17931
.   : milestone, 17754,
iast (17.757 ms) : 17581, 17932
.   : milestone, 17757,
profiling (18.755 ms) : 18571, 18939
.   : milestone, 18755,
tracing (18.089 ms) : 17908, 18269
.   : milestone, 18089,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.0 ms [18.809 ms, 19.191 ms] -
appsec 18.959 ms [18.768 ms, 19.151 ms] -40.758 µs (-0.2%)
code_origins 17.766 ms [17.587 ms, 17.945 ms] -1.234 ms (-6.5%)
iast 17.664 ms [17.49 ms, 17.839 ms] -1.336 ms (-7.0%)
profiling 19.883 ms [19.682 ms, 20.083 ms] 882.541 µs (4.6%)
tracing 17.588 ms [17.415 ms, 17.761 ms] -1.412 ms (-7.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.174 ms [17.989 ms, 18.359 ms] -
appsec 18.378 ms [18.191 ms, 18.566 ms] 204.175 µs (1.1%)
code_origins 17.754 ms [17.576 ms, 17.931 ms] -420.588 µs (-2.3%)
iast 17.757 ms [17.581 ms, 17.932 ms] -417.61 µs (-2.3%)
profiling 18.755 ms [18.571 ms, 18.939 ms] 580.636 µs (3.2%)
tracing 18.089 ms [17.908 ms, 18.269 ms] -85.574 µs (-0.5%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~be072c8003, baseline=1.57.0-SNAPSHOT~1f4c004d2a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.209 ms) : 1197, 1221
.   : milestone, 1209,
iast (3.231 ms) : 3190, 3273
.   : milestone, 3231,
iast_FULL (5.763 ms) : 5705, 5820
.   : milestone, 5763,
iast_GLOBAL (3.652 ms) : 3599, 3705
.   : milestone, 3652,
profiling (1.965 ms) : 1947, 1984
.   : milestone, 1965,
tracing (1.816 ms) : 1801, 1831
.   : milestone, 1816,
section candidate
no_agent (1.204 ms) : 1192, 1216
.   : milestone, 1204,
iast (3.054 ms) : 3018, 3091
.   : milestone, 3054,
iast_FULL (5.939 ms) : 5878, 6000
.   : milestone, 5939,
iast_GLOBAL (3.65 ms) : 3592, 3709
.   : milestone, 3650,
profiling (2.222 ms) : 2202, 2243
.   : milestone, 2222,
tracing (1.837 ms) : 1822, 1852
.   : milestone, 1837,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.209 ms [1.197 ms, 1.221 ms] -
iast 3.231 ms [3.19 ms, 3.273 ms] 2.022 ms (167.3%)
iast_FULL 5.763 ms [5.705 ms, 5.82 ms] 4.554 ms (376.6%)
iast_GLOBAL 3.652 ms [3.599 ms, 3.705 ms] 2.443 ms (202.1%)
profiling 1.965 ms [1.947 ms, 1.984 ms] 756.127 µs (62.5%)
tracing 1.816 ms [1.801 ms, 1.831 ms] 607.236 µs (50.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.204 ms [1.192 ms, 1.216 ms] -
iast 3.054 ms [3.018 ms, 3.091 ms] 1.85 ms (153.7%)
iast_FULL 5.939 ms [5.878 ms, 6.0 ms] 4.735 ms (393.3%)
iast_GLOBAL 3.65 ms [3.592 ms, 3.709 ms] 2.446 ms (203.2%)
profiling 2.222 ms [2.202 ms, 2.243 ms] 1.018 ms (84.6%)
tracing 1.837 ms [1.822 ms, 1.852 ms] 632.753 µs (52.6%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/exclude-from-telemetry
git_commit_date 1765795037 1765796536
git_commit_sha 1f4c004 be072c8
release_version 1.57.0-SNAPSHOT~1f4c004d2a 1.57.0-SNAPSHOT~be072c8003
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1765798654 1765798654
ci_job_id 1294769753 1294769753
ci_pipeline_id 86739132 86739132
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-019g9jkj 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-019g9jkj 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~be072c8003, baseline=1.57.0-SNAPSHOT~1f4c004d2a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.479 ms) : 1467, 1490
.   : milestone, 1479,
appsec (2.486 ms) : 2434, 2538
.   : milestone, 2486,
iast (2.217 ms) : 2152, 2281
.   : milestone, 2217,
iast_GLOBAL (2.267 ms) : 2201, 2332
.   : milestone, 2267,
profiling (2.081 ms) : 2028, 2134
.   : milestone, 2081,
tracing (2.062 ms) : 2010, 2113
.   : milestone, 2062,
section candidate
no_agent (1.476 ms) : 1465, 1488
.   : milestone, 1476,
appsec (3.727 ms) : 3508, 3946
.   : milestone, 3727,
iast (2.216 ms) : 2151, 2281
.   : milestone, 2216,
iast_GLOBAL (2.258 ms) : 2193, 2323
.   : milestone, 2258,
profiling (2.083 ms) : 2030, 2136
.   : milestone, 2083,
tracing (2.06 ms) : 2009, 2112
.   : milestone, 2060,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.479 ms [1.467 ms, 1.49 ms] -
appsec 2.486 ms [2.434 ms, 2.538 ms] 1.007 ms (68.1%)
iast 2.217 ms [2.152 ms, 2.281 ms] 738.022 µs (49.9%)
iast_GLOBAL 2.267 ms [2.201 ms, 2.332 ms] 787.997 µs (53.3%)
profiling 2.081 ms [2.028 ms, 2.134 ms] 602.157 µs (40.7%)
tracing 2.062 ms [2.01 ms, 2.113 ms] 582.943 µs (39.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.465 ms, 1.488 ms] -
appsec 3.727 ms [3.508 ms, 3.946 ms] 2.251 ms (152.5%)
iast 2.216 ms [2.151 ms, 2.281 ms] 739.84 µs (50.1%)
iast_GLOBAL 2.258 ms [2.193 ms, 2.323 ms] 781.658 µs (52.9%)
profiling 2.083 ms [2.03 ms, 2.136 ms] 607.013 µs (41.1%)
tracing 2.06 ms [2.009 ms, 2.112 ms] 584.063 µs (39.6%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~be072c8003, baseline=1.57.0-SNAPSHOT~1f4c004d2a
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.158 s) : 15158000, 15158000
.   : milestone, 15158000,
appsec (15.026 s) : 15026000, 15026000
.   : milestone, 15026000,
iast (17.837 s) : 17837000, 17837000
.   : milestone, 17837000,
iast_GLOBAL (17.73 s) : 17730000, 17730000
.   : milestone, 17730000,
profiling (15.098 s) : 15098000, 15098000
.   : milestone, 15098000,
tracing (14.767 s) : 14767000, 14767000
.   : milestone, 14767000,
section candidate
no_agent (14.98 s) : 14980000, 14980000
.   : milestone, 14980000,
appsec (14.837 s) : 14837000, 14837000
.   : milestone, 14837000,
iast (18.345 s) : 18345000, 18345000
.   : milestone, 18345000,
iast_GLOBAL (17.79 s) : 17790000, 17790000
.   : milestone, 17790000,
profiling (14.607 s) : 14607000, 14607000
.   : milestone, 14607000,
tracing (14.547 s) : 14547000, 14547000
.   : milestone, 14547000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.158 s [15.158 s, 15.158 s] -
appsec 15.026 s [15.026 s, 15.026 s] -132.0 ms (-0.9%)
iast 17.837 s [17.837 s, 17.837 s] 2.679 s (17.7%)
iast_GLOBAL 17.73 s [17.73 s, 17.73 s] 2.572 s (17.0%)
profiling 15.098 s [15.098 s, 15.098 s] -60.0 ms (-0.4%)
tracing 14.767 s [14.767 s, 14.767 s] -391.0 ms (-2.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.98 s [14.98 s, 14.98 s] -
appsec 14.837 s [14.837 s, 14.837 s] -143.0 ms (-1.0%)
iast 18.345 s [18.345 s, 18.345 s] 3.365 s (22.5%)
iast_GLOBAL 17.79 s [17.79 s, 17.79 s] 2.81 s (18.8%)
profiling 14.607 s [14.607 s, 14.607 s] -373.0 ms (-2.5%)
tracing 14.547 s [14.547 s, 14.547 s] -433.0 ms (-2.9%)