Home Original page

Avoid primitive boxing in v0.5 serializer by dougqh · Pull Request #10471 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master dougqh/v05-serializer-no-boxing
git_commit_date 1769704474 1769705151
git_commit_sha 02cc483 955fa92
release_version 1.59.0-SNAPSHOT~02cc48359b 1.59.0-SNAPSHOT~955fa92a61
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1769706987 1769706987
ci_job_id 1387452776 1387452776
ci_pipeline_id 93589437 93589437
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-l92iuk6v 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-l92iuk6v 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 63 metrics, 8 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.59.0-SNAPSHOT~955fa92a61, baseline=1.59.0-SNAPSHOT~02cc48359b

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.064 s) : 0, 1063976
Total [baseline] (10.965 s) : 0, 10964936
Agent [candidate] (1.059 s) : 0, 1059050
Total [candidate] (10.934 s) : 0, 10934030
section appsec
Agent [baseline] (1.243 s) : 0, 1242606
Total [baseline] (10.99 s) : 0, 10990031
Agent [candidate] (1.236 s) : 0, 1236143
Total [candidate] (11.09 s) : 0, 11090494
section iast
Agent [baseline] (1.242 s) : 0, 1241612
Total [baseline] (11.22 s) : 0, 11220059
Agent [candidate] (1.238 s) : 0, 1237697
Total [candidate] (11.222 s) : 0, 11222413
section profiling
Agent [baseline] (1.185 s) : 0, 1184610
Total [baseline] (10.886 s) : 0, 10886038
Agent [candidate] (1.186 s) : 0, 1185918
Total [candidate] (10.941 s) : 0, 10940687
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.064 s -
Agent appsec 1.243 s 178.63 ms (16.8%)
Agent iast 1.242 s 177.637 ms (16.7%)
Agent profiling 1.185 s 120.635 ms (11.3%)
Total tracing 10.965 s -
Total appsec 10.99 s 25.095 ms (0.2%)
Total iast 11.22 s 255.122 ms (2.3%)
Total profiling 10.886 s -78.898 ms (-0.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.059 s -
Agent appsec 1.236 s 177.093 ms (16.7%)
Agent iast 1.238 s 178.647 ms (16.9%)
Agent profiling 1.186 s 126.868 ms (12.0%)
Total tracing 10.934 s -
Total appsec 11.09 s 156.464 ms (1.4%)
Total iast 11.222 s 288.383 ms (2.6%)
Total profiling 10.941 s 6.656 ms (0.1%) 
gantt
    title petclinic - break down per module: candidate=1.59.0-SNAPSHOT~955fa92a61, baseline=1.59.0-SNAPSHOT~02cc48359b

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.182 ms) : 0, 1182
crashtracking [candidate] (1.185 ms) : 0, 1185
BytebuddyAgent [baseline] (627.33 ms) : 0, 627330
BytebuddyAgent [candidate] (623.491 ms) : 0, 623491
AgentMeter [baseline] (28.946 ms) : 0, 28946
AgentMeter [candidate] (28.681 ms) : 0, 28681
GlobalTracer [baseline] (258.997 ms) : 0, 258997
GlobalTracer [candidate] (257.492 ms) : 0, 257492
AppSec [baseline] (33.255 ms) : 0, 33255
AppSec [candidate] (32.891 ms) : 0, 32891
Debugger [baseline] (62.615 ms) : 0, 62615
Debugger [candidate] (63.865 ms) : 0, 63865
Remote Config [baseline] (616.471 µs) : 0, 616
Remote Config [candidate] (602.46 µs) : 0, 602
Telemetry [baseline] (10.016 ms) : 0, 10016
Telemetry [candidate] (9.199 ms) : 0, 9199
Flare Poller [baseline] (5.371 ms) : 0, 5371
Flare Poller [candidate] (6.115 ms) : 0, 6115
section appsec
crashtracking [baseline] (1.188 ms) : 0, 1188
crashtracking [candidate] (1.189 ms) : 0, 1189
BytebuddyAgent [baseline] (656.701 ms) : 0, 656701
BytebuddyAgent [candidate] (653.581 ms) : 0, 653581
AgentMeter [baseline] (11.962 ms) : 0, 11962
AgentMeter [candidate] (11.888 ms) : 0, 11888
GlobalTracer [baseline] (260.045 ms) : 0, 260045
GlobalTracer [candidate] (258.399 ms) : 0, 258399
AppSec [baseline] (169.114 ms) : 0, 169114
AppSec [candidate] (168.14 ms) : 0, 168140
Debugger [baseline] (68.413 ms) : 0, 68413
Debugger [candidate] (68.22 ms) : 0, 68220
Remote Config [baseline] (662.457 µs) : 0, 662
Remote Config [candidate] (666.626 µs) : 0, 667
Telemetry [baseline] (9.312 ms) : 0, 9312
Telemetry [candidate] (9.466 ms) : 0, 9466
Flare Poller [baseline] (3.739 ms) : 0, 3739
Flare Poller [candidate] (3.738 ms) : 0, 3738
IAST [baseline] (26.043 ms) : 0, 26043
IAST [candidate] (25.495 ms) : 0, 25495
section iast
crashtracking [baseline] (1.206 ms) : 0, 1206
crashtracking [candidate] (1.194 ms) : 0, 1194
BytebuddyAgent [baseline] (803.062 ms) : 0, 803062
BytebuddyAgent [candidate] (796.939 ms) : 0, 796939
AgentMeter [baseline] (11.776 ms) : 0, 11776
AgentMeter [candidate] (11.483 ms) : 0, 11483
GlobalTracer [baseline] (249.784 ms) : 0, 249784
GlobalTracer [candidate] (250.296 ms) : 0, 250296
AppSec [baseline] (35.37 ms) : 0, 35370
AppSec [candidate] (36.005 ms) : 0, 36005
Debugger [baseline] (65.075 ms) : 0, 65075
Debugger [candidate] (65.982 ms) : 0, 65982
Remote Config [baseline] (558.262 µs) : 0, 558
Remote Config [candidate] (560.904 µs) : 0, 561
Telemetry [baseline] (8.672 ms) : 0, 8672
Telemetry [candidate] (8.837 ms) : 0, 8837
Flare Poller [baseline] (3.513 ms) : 0, 3513
Flare Poller [candidate] (3.563 ms) : 0, 3563
IAST [baseline] (26.89 ms) : 0, 26890
IAST [candidate] (27.186 ms) : 0, 27186
section profiling
ProfilingAgent [baseline] (98.588 ms) : 0, 98588
ProfilingAgent [candidate] (99.262 ms) : 0, 99262
crashtracking [baseline] (1.216 ms) : 0, 1216
crashtracking [candidate] (1.214 ms) : 0, 1214
BytebuddyAgent [baseline] (676.82 ms) : 0, 676820
BytebuddyAgent [candidate] (676.952 ms) : 0, 676952
AgentMeter [baseline] (8.64 ms) : 0, 8640
AgentMeter [candidate] (8.664 ms) : 0, 8664
GlobalTracer [baseline] (216.638 ms) : 0, 216638
GlobalTracer [candidate] (216.764 ms) : 0, 216764
AppSec [baseline] (32.122 ms) : 0, 32122
AppSec [candidate] (32.196 ms) : 0, 32196
Debugger [baseline] (67.666 ms) : 0, 67666
Debugger [candidate] (67.869 ms) : 0, 67869
Remote Config [baseline] (583.75 µs) : 0, 584
Remote Config [candidate] (588.788 µs) : 0, 589
Telemetry [baseline] (8.745 ms) : 0, 8745
Telemetry [candidate] (8.72 ms) : 0, 8720
Flare Poller [baseline] (3.746 ms) : 0, 3746
Flare Poller [candidate] (3.746 ms) : 0, 3746
Profiling [baseline] (99.155 ms) : 0, 99155
Profiling [candidate] (99.861 ms) : 0, 99861
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.59.0-SNAPSHOT~955fa92a61, baseline=1.59.0-SNAPSHOT~02cc48359b

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.057 s) : 0, 1056798
Total [baseline] (8.703 s) : 0, 8703381
Agent [candidate] (1.061 s) : 0, 1060811
Total [candidate] (8.713 s) : 0, 8713226
section iast
Agent [baseline] (1.226 s) : 0, 1225541
Total [baseline] (9.385 s) : 0, 9385182
Agent [candidate] (1.231 s) : 0, 1231398
Total [candidate] (9.397 s) : 0, 9396912
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.057 s -
Agent iast 1.226 s 168.742 ms (16.0%)
Total tracing 8.703 s -
Total iast 9.385 s 681.801 ms (7.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.061 s -
Agent iast 1.231 s 170.587 ms (16.1%)
Total tracing 8.713 s -
Total iast 9.397 s 683.687 ms (7.8%) 
gantt
    title insecure-bank - break down per module: candidate=1.59.0-SNAPSHOT~955fa92a61, baseline=1.59.0-SNAPSHOT~02cc48359b

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.192 ms) : 0, 1192
crashtracking [candidate] (1.18 ms) : 0, 1180
BytebuddyAgent [baseline] (621.745 ms) : 0, 621745
BytebuddyAgent [candidate] (625.563 ms) : 0, 625563
AgentMeter [baseline] (28.603 ms) : 0, 28603
AgentMeter [candidate] (28.725 ms) : 0, 28725
GlobalTracer [baseline] (256.753 ms) : 0, 256753
GlobalTracer [candidate] (257.957 ms) : 0, 257957
AppSec [baseline] (32.719 ms) : 0, 32719
AppSec [candidate] (32.873 ms) : 0, 32873
Debugger [baseline] (62.234 ms) : 0, 62234
Debugger [candidate] (62.488 ms) : 0, 62488
Remote Config [baseline] (597.118 µs) : 0, 597
Remote Config [candidate] (599.725 µs) : 0, 600
Telemetry [baseline] (10.603 ms) : 0, 10603
Telemetry [candidate] (9.826 ms) : 0, 9826
Flare Poller [baseline] (6.899 ms) : 0, 6899
Flare Poller [candidate] (6.062 ms) : 0, 6062
section iast
crashtracking [baseline] (1.176 ms) : 0, 1176
crashtracking [candidate] (1.208 ms) : 0, 1208
BytebuddyAgent [baseline] (790.547 ms) : 0, 790547
BytebuddyAgent [candidate] (795.69 ms) : 0, 795690
AgentMeter [baseline] (11.168 ms) : 0, 11168
AgentMeter [candidate] (11.162 ms) : 0, 11162
GlobalTracer [baseline] (247.933 ms) : 0, 247933
GlobalTracer [candidate] (247.772 ms) : 0, 247772
IAST [baseline] (26.833 ms) : 0, 26833
IAST [candidate] (26.763 ms) : 0, 26763
AppSec [baseline] (33.15 ms) : 0, 33150
AppSec [candidate] (34.844 ms) : 0, 34844
Debugger [baseline] (66.934 ms) : 0, 66934
Debugger [candidate] (65.596 ms) : 0, 65596
Remote Config [baseline] (541.999 µs) : 0, 542
Remote Config [candidate] (548.986 µs) : 0, 549
Telemetry [baseline] (8.451 ms) : 0, 8451
Telemetry [candidate] (8.667 ms) : 0, 8667
Flare Poller [baseline] (3.457 ms) : 0, 3457
Flare Poller [candidate] (3.56 ms) : 0, 3560
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master dougqh/v05-serializer-no-boxing
git_commit_date 1769704474 1769705151
git_commit_sha 02cc483 955fa92
release_version 1.59.0-SNAPSHOT~02cc48359b 1.59.0-SNAPSHOT~955fa92a61
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1769707587 1769707587
ci_job_id 1387452777 1387452777
ci_pipeline_id 93589437 93589437
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-2bjla345 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-2bjla345 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 2 performance regressions! Performance is the same for 17 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load worse
[+68.336µs; +187.628µs] or [+2.604%; +7.150%]		 unsure
[+96.693µs; +491.101µs] or [+1.279%; +6.495%]		 unstable
[-169.302op/s; +74.239op/s] or [-12.530%; +5.495%]		 2.752ms 7.855ms 1303.594op/s 2.624ms 7.561ms 1351.125op/s
scenario:load:insecure-bank:iast_FULL:high_load worse
[+113.950µs; +325.745µs] or [+2.244%; +6.415%]		 unsure
[+118.211µs; +701.553µs] or [+0.976%; +5.795%]		 unstable
[-108.302op/s; +38.177op/s] or [-13.378%; +4.716%]		 5.297ms 12.516ms 774.469op/s 5.078ms 12.106ms 809.531op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~955fa92a61, baseline=1.59.0-SNAPSHOT~02cc48359b
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.203 ms) : 1191, 1215
.   : milestone, 1203,
iast (3.211 ms) : 3167, 3256
.   : milestone, 3211,
iast_FULL (5.71 ms) : 5653, 5766
.   : milestone, 5710,
iast_GLOBAL (3.39 ms) : 3338, 3441
.   : milestone, 3390,
profiling (2.172 ms) : 2153, 2191
.   : milestone, 2172,
tracing (1.847 ms) : 1830, 1864
.   : milestone, 1847,
section candidate
no_agent (1.177 ms) : 1166, 1189
.   : milestone, 1177,
iast (3.294 ms) : 3247, 3341
.   : milestone, 3294,
iast_FULL (5.969 ms) : 5909, 6029
.   : milestone, 5969,
iast_GLOBAL (3.516 ms) : 3465, 3568
.   : milestone, 3516,
profiling (2.328 ms) : 2304, 2353
.   : milestone, 2328,
tracing (1.824 ms) : 1808, 1839
.   : milestone, 1824,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.203 ms [1.191 ms, 1.215 ms] -
iast 3.211 ms [3.167 ms, 3.256 ms] 2.008 ms (166.9%)
iast_FULL 5.71 ms [5.653 ms, 5.766 ms] 4.506 ms (374.5%)
iast_GLOBAL 3.39 ms [3.338 ms, 3.441 ms] 2.186 ms (181.7%)
profiling 2.172 ms [2.153 ms, 2.191 ms] 968.632 µs (80.5%)
tracing 1.847 ms [1.83 ms, 1.864 ms] 643.912 µs (53.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.177 ms [1.166 ms, 1.189 ms] -
iast 3.294 ms [3.247 ms, 3.341 ms] 2.117 ms (179.8%)
iast_FULL 5.969 ms [5.909 ms, 6.029 ms] 4.792 ms (407.0%)
iast_GLOBAL 3.516 ms [3.465 ms, 3.568 ms] 2.339 ms (198.7%)
profiling 2.328 ms [2.304 ms, 2.353 ms] 1.151 ms (97.8%)
tracing 1.824 ms [1.808 ms, 1.839 ms] 646.221 µs (54.9%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~955fa92a61, baseline=1.59.0-SNAPSHOT~02cc48359b
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.37 ms) : 18179, 18561
.   : milestone, 18370,
appsec (18.296 ms) : 18109, 18484
.   : milestone, 18296,
code_origins (17.67 ms) : 17492, 17848
.   : milestone, 17670,
iast (17.598 ms) : 17423, 17772
.   : milestone, 17598,
profiling (18.684 ms) : 18497, 18872
.   : milestone, 18684,
tracing (17.798 ms) : 17623, 17974
.   : milestone, 17798,
section candidate
no_agent (18.259 ms) : 18068, 18450
.   : milestone, 18259,
appsec (18.734 ms) : 18542, 18925
.   : milestone, 18734,
code_origins (17.788 ms) : 17609, 17966
.   : milestone, 17788,
iast (18.061 ms) : 17879, 18244
.   : milestone, 18061,
profiling (18.866 ms) : 18674, 19057
.   : milestone, 18866,
tracing (17.844 ms) : 17669, 18020
.   : milestone, 17844,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.37 ms [18.179 ms, 18.561 ms] -
appsec 18.296 ms [18.109 ms, 18.484 ms] -73.284 µs (-0.4%)
code_origins 17.67 ms [17.492 ms, 17.848 ms] -699.571 µs (-3.8%)
iast 17.598 ms [17.423 ms, 17.772 ms] -772.031 µs (-4.2%)
profiling 18.684 ms [18.497 ms, 18.872 ms] 314.795 µs (1.7%)
tracing 17.798 ms [17.623 ms, 17.974 ms] -571.338 µs (-3.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.259 ms [18.068 ms, 18.45 ms] -
appsec 18.734 ms [18.542 ms, 18.925 ms] 474.942 µs (2.6%)
code_origins 17.788 ms [17.609 ms, 17.966 ms] -471.1 µs (-2.6%)
iast 18.061 ms [17.879 ms, 18.244 ms] -197.278 µs (-1.1%)
profiling 18.866 ms [18.674 ms, 19.057 ms] 607.179 µs (3.3%)
tracing 17.844 ms [17.669 ms, 18.02 ms] -414.24 µs (-2.3%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master dougqh/v05-serializer-no-boxing
git_commit_date 1769704474 1769705151
git_commit_sha 02cc483 955fa92
release_version 1.59.0-SNAPSHOT~02cc48359b 1.59.0-SNAPSHOT~955fa92a61
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1769707328 1769707328
ci_job_id 1387452778 1387452778
ci_pipeline_id 93589437 93589437
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-3yvdmhp9 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-3yvdmhp9 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~955fa92a61, baseline=1.59.0-SNAPSHOT~02cc48359b
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.474 ms) : 1462, 1485
.   : milestone, 1474,
appsec (3.792 ms) : 3568, 4015
.   : milestone, 3792,
iast (2.26 ms) : 2190, 2329
.   : milestone, 2260,
iast_GLOBAL (2.308 ms) : 2237, 2378
.   : milestone, 2308,
profiling (2.088 ms) : 2033, 2144
.   : milestone, 2088,
tracing (2.064 ms) : 2010, 2118
.   : milestone, 2064,
section candidate
no_agent (1.472 ms) : 1460, 1483
.   : milestone, 1472,
appsec (3.795 ms) : 3571, 4018
.   : milestone, 3795,
iast (2.26 ms) : 2190, 2329
.   : milestone, 2260,
iast_GLOBAL (2.304 ms) : 2234, 2374
.   : milestone, 2304,
profiling (2.09 ms) : 2034, 2146
.   : milestone, 2090,
tracing (2.079 ms) : 2024, 2133
.   : milestone, 2079,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.462 ms, 1.485 ms] -
appsec 3.792 ms [3.568 ms, 4.015 ms] 2.318 ms (157.3%)
iast 2.26 ms [2.19 ms, 2.329 ms] 785.738 µs (53.3%)
iast_GLOBAL 2.308 ms [2.237 ms, 2.378 ms] 833.786 µs (56.6%)
profiling 2.088 ms [2.033 ms, 2.144 ms] 614.394 µs (41.7%)
tracing 2.064 ms [2.01 ms, 2.118 ms] 590.397 µs (40.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.472 ms [1.46 ms, 1.483 ms] -
appsec 3.795 ms [3.571 ms, 4.018 ms] 2.323 ms (157.8%)
iast 2.26 ms [2.19 ms, 2.329 ms] 787.634 µs (53.5%)
iast_GLOBAL 2.304 ms [2.234 ms, 2.374 ms] 832.048 µs (56.5%)
profiling 2.09 ms [2.034 ms, 2.146 ms] 617.943 µs (42.0%)
tracing 2.079 ms [2.024 ms, 2.133 ms] 606.97 µs (41.2%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~955fa92a61, baseline=1.59.0-SNAPSHOT~02cc48359b
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.624 s) : 15624000, 15624000
.   : milestone, 15624000,
appsec (14.892 s) : 14892000, 14892000
.   : milestone, 14892000,
iast (18.172 s) : 18172000, 18172000
.   : milestone, 18172000,
iast_GLOBAL (17.637 s) : 17637000, 17637000
.   : milestone, 17637000,
profiling (15.084 s) : 15084000, 15084000
.   : milestone, 15084000,
tracing (14.827 s) : 14827000, 14827000
.   : milestone, 14827000,
section candidate
no_agent (14.951 s) : 14951000, 14951000
.   : milestone, 14951000,
appsec (15.061 s) : 15061000, 15061000
.   : milestone, 15061000,
iast (18.492 s) : 18492000, 18492000
.   : milestone, 18492000,
iast_GLOBAL (17.585 s) : 17585000, 17585000
.   : milestone, 17585000,
profiling (15.461 s) : 15461000, 15461000
.   : milestone, 15461000,
tracing (14.652 s) : 14652000, 14652000
.   : milestone, 14652000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.624 s [15.624 s, 15.624 s] -
appsec 14.892 s [14.892 s, 14.892 s] -732.0 ms (-4.7%)
iast 18.172 s [18.172 s, 18.172 s] 2.548 s (16.3%)
iast_GLOBAL 17.637 s [17.637 s, 17.637 s] 2.013 s (12.9%)
profiling 15.084 s [15.084 s, 15.084 s] -540.0 ms (-3.5%)
tracing 14.827 s [14.827 s, 14.827 s] -797.0 ms (-5.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.951 s [14.951 s, 14.951 s] -
appsec 15.061 s [15.061 s, 15.061 s] 110.0 ms (0.7%)
iast 18.492 s [18.492 s, 18.492 s] 3.541 s (23.7%)
iast_GLOBAL 17.585 s [17.585 s, 17.585 s] 2.634 s (17.6%)
profiling 15.461 s [15.461 s, 15.461 s] 510.0 ms (3.4%)
tracing 14.652 s [14.652 s, 14.652 s] -299.0 ms (-2.0%)