Home Original page

Implement OpenTelemetry Observable Metrics API by mcculls · Pull Request #10631 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/otel-metrics-async-storage
git_commit_date 1771506111 1771506252
git_commit_sha 8203a22 4da900e
release_version 1.60.0-SNAPSHOT~8203a22d82 1.60.0-SNAPSHOT~4da900ef0f
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1771508075 1771508075
ci_job_id 1439085218 1439085218
ci_pipeline_id 97528920 97528920
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-qt82zsd2 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-qt82zsd2 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 61 metrics, 10 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~4da900ef0f, baseline=1.60.0-SNAPSHOT~8203a22d82

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.064 s) : 0, 1063693
Total [baseline] (8.772 s) : 0, 8772172
Agent [candidate] (1.073 s) : 0, 1072779
Total [candidate] (8.745 s) : 0, 8745486
section iast
Agent [baseline] (1.228 s) : 0, 1228461
Total [baseline] (9.364 s) : 0, 9363728
Agent [candidate] (1.232 s) : 0, 1232378
Total [candidate] (9.371 s) : 0, 9371287
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.064 s -
Agent iast 1.228 s 164.768 ms (15.5%)
Total tracing 8.772 s -
Total iast 9.364 s 591.556 ms (6.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.073 s -
Agent iast 1.232 s 159.599 ms (14.9%)
Total tracing 8.745 s -
Total iast 9.371 s 625.802 ms (7.2%) 
gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~4da900ef0f, baseline=1.60.0-SNAPSHOT~8203a22d82

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.199 ms) : 0, 1199
crashtracking [candidate] (1.217 ms) : 0, 1217
BytebuddyAgent [baseline] (627.712 ms) : 0, 627712
BytebuddyAgent [candidate] (632.953 ms) : 0, 632953
AgentMeter [baseline] (29.081 ms) : 0, 29081
AgentMeter [candidate] (29.43 ms) : 0, 29430
GlobalTracer [baseline] (257.612 ms) : 0, 257612
GlobalTracer [candidate] (259.474 ms) : 0, 259474
AppSec [baseline] (33.126 ms) : 0, 33126
AppSec [candidate] (33.215 ms) : 0, 33215
Debugger [baseline] (62.87 ms) : 0, 62870
Debugger [candidate] (64.635 ms) : 0, 64635
Remote Config [baseline] (605.17 µs) : 0, 605
Remote Config [candidate] (653.982 µs) : 0, 654
Telemetry [baseline] (9.886 ms) : 0, 9886
Telemetry [candidate] (11.049 ms) : 0, 11049
Flare Poller [baseline] (5.328 ms) : 0, 5328
Flare Poller [candidate] (3.85 ms) : 0, 3850
section iast
crashtracking [baseline] (1.192 ms) : 0, 1192
crashtracking [candidate] (1.21 ms) : 0, 1210
BytebuddyAgent [baseline] (793.412 ms) : 0, 793412
BytebuddyAgent [candidate] (795.763 ms) : 0, 795763
AgentMeter [baseline] (11.342 ms) : 0, 11342
AgentMeter [candidate] (11.358 ms) : 0, 11358
GlobalTracer [baseline] (247.27 ms) : 0, 247270
GlobalTracer [candidate] (248.345 ms) : 0, 248345
IAST [baseline] (27.007 ms) : 0, 27007
IAST [candidate] (26.975 ms) : 0, 26975
AppSec [baseline] (33.11 ms) : 0, 33110
AppSec [candidate] (34.004 ms) : 0, 34004
Debugger [baseline] (66.493 ms) : 0, 66493
Debugger [candidate] (65.903 ms) : 0, 65903
Remote Config [baseline] (529.538 µs) : 0, 530
Remote Config [candidate] (530.493 µs) : 0, 530
Telemetry [baseline] (8.601 ms) : 0, 8601
Telemetry [candidate] (8.643 ms) : 0, 8643
Flare Poller [baseline] (3.458 ms) : 0, 3458
Flare Poller [candidate] (3.489 ms) : 0, 3489
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~4da900ef0f, baseline=1.60.0-SNAPSHOT~8203a22d82

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.067 s) : 0, 1066903
Total [baseline] (10.878 s) : 0, 10877621
Agent [candidate] (1.069 s) : 0, 1069410
Total [candidate] (10.874 s) : 0, 10873891
section appsec
Agent [baseline] (1.242 s) : 0, 1241702
Total [baseline] (11.104 s) : 0, 11104150
Agent [candidate] (1.24 s) : 0, 1239842
Total [candidate] (11.093 s) : 0, 11093454
section iast
Agent [baseline] (1.231 s) : 0, 1230547
Total [baseline] (11.24 s) : 0, 11240420
Agent [candidate] (1.232 s) : 0, 1232223
Total [candidate] (11.214 s) : 0, 11213971
section profiling
Agent [baseline] (1.192 s) : 0, 1192195
Total [baseline] (10.967 s) : 0, 10966691
Agent [candidate] (1.198 s) : 0, 1198397
Total [candidate] (10.928 s) : 0, 10928474
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.067 s -
Agent appsec 1.242 s 174.799 ms (16.4%)
Agent iast 1.231 s 163.644 ms (15.3%)
Agent profiling 1.192 s 125.292 ms (11.7%)
Total tracing 10.878 s -
Total appsec 11.104 s 226.529 ms (2.1%)
Total iast 11.24 s 362.798 ms (3.3%)
Total profiling 10.967 s 89.07 ms (0.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.069 s -
Agent appsec 1.24 s 170.432 ms (15.9%)
Agent iast 1.232 s 162.814 ms (15.2%)
Agent profiling 1.198 s 128.987 ms (12.1%)
Total tracing 10.874 s -
Total appsec 11.093 s 219.563 ms (2.0%)
Total iast 11.214 s 340.08 ms (3.1%)
Total profiling 10.928 s 54.583 ms (0.5%) 
gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~4da900ef0f, baseline=1.60.0-SNAPSHOT~8203a22d82

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.189 ms) : 0, 1189
crashtracking [candidate] (1.202 ms) : 0, 1202
BytebuddyAgent [baseline] (627.555 ms) : 0, 627555
BytebuddyAgent [candidate] (629.383 ms) : 0, 629383
AgentMeter [baseline] (29.076 ms) : 0, 29076
AgentMeter [candidate] (29.383 ms) : 0, 29383
GlobalTracer [baseline] (257.774 ms) : 0, 257774
GlobalTracer [candidate] (259.355 ms) : 0, 259355
AppSec [baseline] (32.934 ms) : 0, 32934
AppSec [candidate] (33.197 ms) : 0, 33197
Debugger [baseline] (68.622 ms) : 0, 68622
Debugger [candidate] (65.072 ms) : 0, 65072
Remote Config [baseline] (623.192 µs) : 0, 623
Remote Config [candidate] (614.151 µs) : 0, 614
Telemetry [baseline] (9.158 ms) : 0, 9158
Telemetry [candidate] (11.307 ms) : 0, 11307
Flare Poller [baseline] (3.792 ms) : 0, 3792
Flare Poller [candidate] (3.745 ms) : 0, 3745
section appsec
crashtracking [baseline] (1.188 ms) : 0, 1188
crashtracking [candidate] (1.21 ms) : 0, 1210
BytebuddyAgent [baseline] (659.233 ms) : 0, 659233
BytebuddyAgent [candidate] (658.564 ms) : 0, 658564
AgentMeter [baseline] (11.984 ms) : 0, 11984
AgentMeter [candidate] (11.998 ms) : 0, 11998
GlobalTracer [baseline] (258.43 ms) : 0, 258430
GlobalTracer [candidate] (258.622 ms) : 0, 258622
AppSec [baseline] (167.991 ms) : 0, 167991
AppSec [candidate] (168.1 ms) : 0, 168100
Debugger [baseline] (67.064 ms) : 0, 67064
Debugger [candidate] (66.146 ms) : 0, 66146
Remote Config [baseline] (664.738 µs) : 0, 665
Remote Config [candidate] (656.537 µs) : 0, 657
Telemetry [baseline] (9.631 ms) : 0, 9631
Telemetry [candidate] (9.326 ms) : 0, 9326
Flare Poller [baseline] (3.788 ms) : 0, 3788
Flare Poller [candidate] (3.696 ms) : 0, 3696
IAST [baseline] (25.609 ms) : 0, 25609
IAST [candidate] (25.437 ms) : 0, 25437
section iast
crashtracking [baseline] (1.204 ms) : 0, 1204
crashtracking [candidate] (1.19 ms) : 0, 1190
BytebuddyAgent [baseline] (794.081 ms) : 0, 794081
BytebuddyAgent [candidate] (795.479 ms) : 0, 795479
AgentMeter [baseline] (11.301 ms) : 0, 11301
AgentMeter [candidate] (11.31 ms) : 0, 11310
GlobalTracer [baseline] (247.532 ms) : 0, 247532
GlobalTracer [candidate] (247.939 ms) : 0, 247939
AppSec [baseline] (33.867 ms) : 0, 33867
AppSec [candidate] (33.847 ms) : 0, 33847
Debugger [baseline] (66.941 ms) : 0, 66941
Debugger [candidate] (66.723 ms) : 0, 66723
Remote Config [baseline] (540.681 µs) : 0, 541
Remote Config [candidate] (551.082 µs) : 0, 551
Telemetry [baseline] (8.619 ms) : 0, 8619
Telemetry [candidate] (8.649 ms) : 0, 8649
Flare Poller [baseline] (3.442 ms) : 0, 3442
Flare Poller [candidate] (3.415 ms) : 0, 3415
IAST [baseline] (26.964 ms) : 0, 26964
IAST [candidate] (26.992 ms) : 0, 26992
section profiling
ProfilingAgent [baseline] (99.63 ms) : 0, 99630
ProfilingAgent [candidate] (99.729 ms) : 0, 99729
crashtracking [baseline] (1.193 ms) : 0, 1193
crashtracking [candidate] (1.201 ms) : 0, 1201
BytebuddyAgent [baseline] (683.05 ms) : 0, 683050
BytebuddyAgent [candidate] (685.62 ms) : 0, 685620
AgentMeter [baseline] (8.535 ms) : 0, 8535
AgentMeter [candidate] (8.569 ms) : 0, 8569
GlobalTracer [baseline] (215.726 ms) : 0, 215726
GlobalTracer [candidate] (217.129 ms) : 0, 217129
AppSec [baseline] (32.536 ms) : 0, 32536
AppSec [candidate] (32.824 ms) : 0, 32824
Debugger [baseline] (67.537 ms) : 0, 67537
Debugger [candidate] (68.634 ms) : 0, 68634
Remote Config [baseline] (622.057 µs) : 0, 622
Remote Config [candidate] (643.697 µs) : 0, 644
Telemetry [baseline] (8.866 ms) : 0, 8866
Telemetry [candidate] (9.128 ms) : 0, 9128
Flare Poller [baseline] (3.762 ms) : 0, 3762
Flare Poller [candidate] (3.785 ms) : 0, 3785
Profiling [baseline] (100.198 ms) : 0, 100198
Profiling [candidate] (100.323 ms) : 0, 100323
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/otel-metrics-async-storage
git_commit_date 1771506111 1771506252
git_commit_sha 8203a22 4da900e
release_version 1.60.0-SNAPSHOT~8203a22d82 1.60.0-SNAPSHOT~4da900ef0f
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1771508482 1771508482
ci_job_id 1439085222 1439085222
ci_pipeline_id 97528920 97528920
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-oxuo1p0f 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-oxuo1p0f 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 1 performance regressions! Performance is the same for 16 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast:high_load worse
[+99.641µs; +227.028µs] or [+4.210%; +9.591%]		 unsure
[+76.162µs; +538.474µs] or [+1.084%; +7.667%]		 unstable
[-239.435op/s; +79.498op/s] or [-16.063%; +5.333%]		 2.530ms 7.330ms 1410.656op/s 2.367ms 7.023ms 1490.625op/s
scenario:load:insecure-bank:iast_FULL:high_load better
[-391.881µs; -117.136µs] or [-7.456%; -2.229%]		 better
[-1177.815µs; -467.847µs] or [-9.253%; -3.675%]		 unstable
[-47.449op/s; +122.636op/s] or [-6.116%; +15.808%]		 5.002ms 11.906ms 813.375op/s 5.256ms 12.729ms 775.781op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~4da900ef0f, baseline=1.60.0-SNAPSHOT~8203a22d82
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.178 ms) : 18978, 19379
.   : milestone, 19178,
appsec (18.275 ms) : 18094, 18456
.   : milestone, 18275,
code_origins (17.939 ms) : 17759, 18120
.   : milestone, 17939,
iast (18.557 ms) : 18371, 18742
.   : milestone, 18557,
profiling (19.193 ms) : 18997, 19389
.   : milestone, 19193,
tracing (17.562 ms) : 17386, 17738
.   : milestone, 17562,
section candidate
no_agent (18.186 ms) : 17999, 18374
.   : milestone, 18186,
appsec (18.394 ms) : 18208, 18580
.   : milestone, 18394,
code_origins (17.671 ms) : 17497, 17844
.   : milestone, 17671,
iast (18.383 ms) : 18202, 18563
.   : milestone, 18383,
profiling (18.634 ms) : 18449, 18818
.   : milestone, 18634,
tracing (17.431 ms) : 17259, 17604
.   : milestone, 17431,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.178 ms [18.978 ms, 19.379 ms] -
appsec 18.275 ms [18.094 ms, 18.456 ms] -903.31 µs (-4.7%)
code_origins 17.939 ms [17.759 ms, 18.12 ms] -1.239 ms (-6.5%)
iast 18.557 ms [18.371 ms, 18.742 ms] -621.325 µs (-3.2%)
profiling 19.193 ms [18.997 ms, 19.389 ms] 14.876 µs (0.1%)
tracing 17.562 ms [17.386 ms, 17.738 ms] -1.616 ms (-8.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.186 ms [17.999 ms, 18.374 ms] -
appsec 18.394 ms [18.208 ms, 18.58 ms] 207.593 µs (1.1%)
code_origins 17.671 ms [17.497 ms, 17.844 ms] -515.626 µs (-2.8%)
iast 18.383 ms [18.202 ms, 18.563 ms] 196.487 µs (1.1%)
profiling 18.634 ms [18.449 ms, 18.818 ms] 447.525 µs (2.5%)
tracing 17.431 ms [17.259 ms, 17.604 ms] -754.788 µs (-4.2%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~4da900ef0f, baseline=1.60.0-SNAPSHOT~8203a22d82
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.17 ms) : 1159, 1181
.   : milestone, 1170,
iast (3.065 ms) : 3027, 3104
.   : milestone, 3065,
iast_FULL (5.96 ms) : 5898, 6021
.   : milestone, 5960,
iast_GLOBAL (3.612 ms) : 3558, 3666
.   : milestone, 3612,
profiling (1.983 ms) : 1965, 2000
.   : milestone, 1983,
tracing (1.771 ms) : 1756, 1786
.   : milestone, 1771,
section candidate
no_agent (1.191 ms) : 1179, 1203
.   : milestone, 1191,
iast (3.244 ms) : 3199, 3289
.   : milestone, 3244,
iast_FULL (5.682 ms) : 5626, 5738
.   : milestone, 5682,
iast_GLOBAL (3.684 ms) : 3630, 3738
.   : milestone, 3684,
profiling (2.102 ms) : 2081, 2124
.   : milestone, 2102,
tracing (1.75 ms) : 1736, 1764
.   : milestone, 1750,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.17 ms [1.159 ms, 1.181 ms] -
iast 3.065 ms [3.027 ms, 3.104 ms] 1.895 ms (162.0%)
iast_FULL 5.96 ms [5.898 ms, 6.021 ms] 4.79 ms (409.4%)
iast_GLOBAL 3.612 ms [3.558 ms, 3.666 ms] 2.442 ms (208.7%)
profiling 1.983 ms [1.965 ms, 2.0 ms] 812.956 µs (69.5%)
tracing 1.771 ms [1.756 ms, 1.786 ms] 601.315 µs (51.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.191 ms [1.179 ms, 1.203 ms] -
iast 3.244 ms [3.199 ms, 3.289 ms] 2.053 ms (172.4%)
iast_FULL 5.682 ms [5.626 ms, 5.738 ms] 4.491 ms (377.1%)
iast_GLOBAL 3.684 ms [3.63 ms, 3.738 ms] 2.493 ms (209.3%)
profiling 2.102 ms [2.081 ms, 2.124 ms] 911.416 µs (76.5%)
tracing 1.75 ms [1.736 ms, 1.764 ms] 559.629 µs (47.0%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/otel-metrics-async-storage
git_commit_date 1771506111 1771506252
git_commit_sha 8203a22 4da900e
release_version 1.60.0-SNAPSHOT~8203a22d82 1.60.0-SNAPSHOT~4da900ef0f
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1771508153 1771508153
ci_job_id 1439085225 1439085225
ci_pipeline_id 97528920 97528920
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-dqz0fc7g 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-dqz0fc7g 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~4da900ef0f, baseline=1.60.0-SNAPSHOT~8203a22d82
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.285 s) : 15285000, 15285000
.   : milestone, 15285000,
appsec (14.881 s) : 14881000, 14881000
.   : milestone, 14881000,
iast (18.072 s) : 18072000, 18072000
.   : milestone, 18072000,
iast_GLOBAL (17.783 s) : 17783000, 17783000
.   : milestone, 17783000,
profiling (15.258 s) : 15258000, 15258000
.   : milestone, 15258000,
tracing (14.754 s) : 14754000, 14754000
.   : milestone, 14754000,
section candidate
no_agent (14.971 s) : 14971000, 14971000
.   : milestone, 14971000,
appsec (14.807 s) : 14807000, 14807000
.   : milestone, 14807000,
iast (17.913 s) : 17913000, 17913000
.   : milestone, 17913000,
iast_GLOBAL (18.044 s) : 18044000, 18044000
.   : milestone, 18044000,
profiling (15.347 s) : 15347000, 15347000
.   : milestone, 15347000,
tracing (14.73 s) : 14730000, 14730000
.   : milestone, 14730000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.285 s [15.285 s, 15.285 s] -
appsec 14.881 s [14.881 s, 14.881 s] -404.0 ms (-2.6%)
iast 18.072 s [18.072 s, 18.072 s] 2.787 s (18.2%)
iast_GLOBAL 17.783 s [17.783 s, 17.783 s] 2.498 s (16.3%)
profiling 15.258 s [15.258 s, 15.258 s] -27.0 ms (-0.2%)
tracing 14.754 s [14.754 s, 14.754 s] -531.0 ms (-3.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.971 s [14.971 s, 14.971 s] -
appsec 14.807 s [14.807 s, 14.807 s] -164.0 ms (-1.1%)
iast 17.913 s [17.913 s, 17.913 s] 2.942 s (19.7%)
iast_GLOBAL 18.044 s [18.044 s, 18.044 s] 3.073 s (20.5%)
profiling 15.347 s [15.347 s, 15.347 s] 376.0 ms (2.5%)
tracing 14.73 s [14.73 s, 14.73 s] -241.0 ms (-1.6%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~4da900ef0f, baseline=1.60.0-SNAPSHOT~8203a22d82
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.479 ms) : 1467, 1490
.   : milestone, 1479,
appsec (3.783 ms) : 3562, 4003
.   : milestone, 3783,
iast (2.261 ms) : 2192, 2331
.   : milestone, 2261,
iast_GLOBAL (2.307 ms) : 2237, 2377
.   : milestone, 2307,
profiling (2.128 ms) : 2071, 2185
.   : milestone, 2128,
tracing (2.076 ms) : 2022, 2130
.   : milestone, 2076,
section candidate
no_agent (1.475 ms) : 1463, 1486
.   : milestone, 1475,
appsec (3.79 ms) : 3569, 4011
.   : milestone, 3790,
iast (2.264 ms) : 2194, 2333
.   : milestone, 2264,
iast_GLOBAL (2.304 ms) : 2234, 2374
.   : milestone, 2304,
profiling (2.073 ms) : 2018, 2128
.   : milestone, 2073,
tracing (2.071 ms) : 2018, 2125
.   : milestone, 2071,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.479 ms [1.467 ms, 1.49 ms] -
appsec 3.783 ms [3.562 ms, 4.003 ms] 2.304 ms (155.8%)
iast 2.261 ms [2.192 ms, 2.331 ms] 782.428 µs (52.9%)
iast_GLOBAL 2.307 ms [2.237 ms, 2.377 ms] 827.944 µs (56.0%)
profiling 2.128 ms [2.071 ms, 2.185 ms] 649.085 µs (43.9%)
tracing 2.076 ms [2.022 ms, 2.13 ms] 597.294 µs (40.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.475 ms [1.463 ms, 1.486 ms] -
appsec 3.79 ms [3.569 ms, 4.011 ms] 2.315 ms (156.9%)
iast 2.264 ms [2.194 ms, 2.333 ms] 788.562 µs (53.5%)
iast_GLOBAL 2.304 ms [2.234 ms, 2.374 ms] 828.822 µs (56.2%)
profiling 2.073 ms [2.018 ms, 2.128 ms] 598.165 µs (40.6%)
tracing 2.071 ms [2.018 ms, 2.125 ms] 596.291 µs (40.4%)