Home Original page

Atomics benchmark by dougqh · Pull Request #10862 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master dougqh/atomics-benchmark
git_commit_date 1773686106 1773686814
git_commit_sha 3c59e03 a18c330
release_version 1.61.0-SNAPSHOT~3c59e03c2c 1.61.0-SNAPSHOT~a18c330344
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1773688572 1773688572
ci_job_id 1510192425 1510192425
ci_pipeline_id 102772893 102772893
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-tjd6s88f 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-tjd6s88f 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 66 metrics, 5 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.61.0-SNAPSHOT~a18c330344, baseline=1.61.0-SNAPSHOT~3c59e03c2c

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.058 s) : 0, 1058134
Total [baseline] (8.851 s) : 0, 8850769
Agent [candidate] (1.07 s) : 0, 1070240
Total [candidate] (8.892 s) : 0, 8891526
section iast
Agent [baseline] (1.224 s) : 0, 1224129
Total [baseline] (9.581 s) : 0, 9581023
Agent [candidate] (1.228 s) : 0, 1227589
Total [candidate] (9.585 s) : 0, 9585066
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.058 s -
Agent iast 1.224 s 165.995 ms (15.7%)
Total tracing 8.851 s -
Total iast 9.581 s 730.253 ms (8.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.07 s -
Agent iast 1.228 s 157.35 ms (14.7%)
Total tracing 8.892 s -
Total iast 9.585 s 693.54 ms (7.8%) 
gantt
    title insecure-bank - break down per module: candidate=1.61.0-SNAPSHOT~a18c330344, baseline=1.61.0-SNAPSHOT~3c59e03c2c

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.207 ms) : 0, 1207
crashtracking [candidate] (1.209 ms) : 0, 1209
BytebuddyAgent [baseline] (628.028 ms) : 0, 628028
BytebuddyAgent [candidate] (636.812 ms) : 0, 636812
AgentMeter [baseline] (29.286 ms) : 0, 29286
AgentMeter [candidate] (29.489 ms) : 0, 29489
GlobalTracer [baseline] (257.262 ms) : 0, 257262
GlobalTracer [candidate] (260.129 ms) : 0, 260129
AppSec [baseline] (31.609 ms) : 0, 31609
AppSec [candidate] (32.07 ms) : 0, 32070
Debugger [baseline] (58.818 ms) : 0, 58818
Debugger [candidate] (59.704 ms) : 0, 59704
Remote Config [baseline] (586.633 µs) : 0, 587
Remote Config [candidate] (600.677 µs) : 0, 601
Telemetry [baseline] (8.024 ms) : 0, 8024
Telemetry [candidate] (8.129 ms) : 0, 8129
Flare Poller [baseline] (7.191 ms) : 0, 7191
Flare Poller [candidate] (5.747 ms) : 0, 5747
section iast
crashtracking [baseline] (1.198 ms) : 0, 1198
crashtracking [candidate] (1.195 ms) : 0, 1195
BytebuddyAgent [baseline] (794.314 ms) : 0, 794314
BytebuddyAgent [candidate] (795.388 ms) : 0, 795388
AgentMeter [baseline] (11.33 ms) : 0, 11330
AgentMeter [candidate] (11.418 ms) : 0, 11418
GlobalTracer [baseline] (247.197 ms) : 0, 247197
GlobalTracer [candidate] (248.854 ms) : 0, 248854
AppSec [baseline] (26.427 ms) : 0, 26427
AppSec [candidate] (26.656 ms) : 0, 26656
Debugger [baseline] (62.585 ms) : 0, 62585
Debugger [candidate] (62.834 ms) : 0, 62834
Remote Config [baseline] (511.73 µs) : 0, 512
Remote Config [candidate] (503.202 µs) : 0, 503
Telemetry [baseline] (14.245 ms) : 0, 14245
Telemetry [candidate] (14.209 ms) : 0, 14209
Flare Poller [baseline] (4.902 ms) : 0, 4902
Flare Poller [candidate] (4.918 ms) : 0, 4918
IAST [baseline] (25.296 ms) : 0, 25296
IAST [candidate] (25.485 ms) : 0, 25485
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.61.0-SNAPSHOT~a18c330344, baseline=1.61.0-SNAPSHOT~3c59e03c2c

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.071 s) : 0, 1071041
Total [baseline] (11.136 s) : 0, 11135538
Agent [candidate] (1.06 s) : 0, 1060416
Total [candidate] (11.165 s) : 0, 11164876
section appsec
Agent [baseline] (1.247 s) : 0, 1247015
Total [baseline] (11.238 s) : 0, 11238166
Agent [candidate] (1.252 s) : 0, 1252338
Total [candidate] (11.166 s) : 0, 11166042
section iast
Agent [baseline] (1.228 s) : 0, 1227670
Total [baseline] (11.346 s) : 0, 11346449
Agent [candidate] (1.227 s) : 0, 1227461
Total [candidate] (11.338 s) : 0, 11337549
section profiling
Agent [baseline] (1.182 s) : 0, 1182107
Total [baseline] (11.136 s) : 0, 11135744
Agent [candidate] (1.186 s) : 0, 1186448
Total [candidate] (11.107 s) : 0, 11107470
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.071 s -
Agent appsec 1.247 s 175.974 ms (16.4%)
Agent iast 1.228 s 156.629 ms (14.6%)
Agent profiling 1.182 s 111.066 ms (10.4%)
Total tracing 11.136 s -
Total appsec 11.238 s 102.628 ms (0.9%)
Total iast 11.346 s 210.911 ms (1.9%)
Total profiling 11.136 s 205.917 µs (0.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.06 s -
Agent appsec 1.252 s 191.922 ms (18.1%)
Agent iast 1.227 s 167.045 ms (15.8%)
Agent profiling 1.186 s 126.032 ms (11.9%)
Total tracing 11.165 s -
Total appsec 11.166 s 1.166 ms (0.0%)
Total iast 11.338 s 172.673 ms (1.5%)
Total profiling 11.107 s -57.406 ms (-0.5%) 
gantt
    title petclinic - break down per module: candidate=1.61.0-SNAPSHOT~a18c330344, baseline=1.61.0-SNAPSHOT~3c59e03c2c

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.22 ms) : 0, 1220
crashtracking [candidate] (1.199 ms) : 0, 1199
BytebuddyAgent [baseline] (636.456 ms) : 0, 636456
BytebuddyAgent [candidate] (628.422 ms) : 0, 628422
AgentMeter [baseline] (29.51 ms) : 0, 29510
AgentMeter [candidate] (29.131 ms) : 0, 29131
GlobalTracer [baseline] (259.739 ms) : 0, 259739
GlobalTracer [candidate] (257.888 ms) : 0, 257888
AppSec [baseline] (32.146 ms) : 0, 32146
AppSec [candidate] (31.747 ms) : 0, 31747
Debugger [baseline] (60.313 ms) : 0, 60313
Debugger [candidate] (59.553 ms) : 0, 59553
Remote Config [baseline] (607.779 µs) : 0, 608
Remote Config [candidate] (591.333 µs) : 0, 591
Telemetry [baseline] (8.226 ms) : 0, 8226
Telemetry [candidate] (8.014 ms) : 0, 8014
Flare Poller [baseline] (6.545 ms) : 0, 6545
Flare Poller [candidate] (7.867 ms) : 0, 7867
section appsec
crashtracking [baseline] (1.2 ms) : 0, 1200
crashtracking [candidate] (1.211 ms) : 0, 1211
BytebuddyAgent [baseline] (658.263 ms) : 0, 658263
BytebuddyAgent [candidate] (663.307 ms) : 0, 663307
AgentMeter [baseline] (12.101 ms) : 0, 12101
AgentMeter [candidate] (12.116 ms) : 0, 12116
GlobalTracer [baseline] (258.645 ms) : 0, 258645
GlobalTracer [candidate] (259.236 ms) : 0, 259236
AppSec [baseline] (177.79 ms) : 0, 177790
AppSec [candidate] (177.806 ms) : 0, 177806
Debugger [baseline] (66.021 ms) : 0, 66021
Debugger [candidate] (65.571 ms) : 0, 65571
Remote Config [baseline] (617.879 µs) : 0, 618
Remote Config [candidate] (627.073 µs) : 0, 627
Telemetry [baseline] (8.211 ms) : 0, 8211
Telemetry [candidate] (8.218 ms) : 0, 8218
Flare Poller [baseline] (3.586 ms) : 0, 3586
Flare Poller [candidate] (3.608 ms) : 0, 3608
IAST [baseline] (24.226 ms) : 0, 24226
IAST [candidate] (24.146 ms) : 0, 24146
section iast
crashtracking [baseline] (1.196 ms) : 0, 1196
crashtracking [candidate] (1.198 ms) : 0, 1198
BytebuddyAgent [baseline] (796.21 ms) : 0, 796210
BytebuddyAgent [candidate] (795.904 ms) : 0, 795904
AgentMeter [baseline] (11.378 ms) : 0, 11378
AgentMeter [candidate] (11.378 ms) : 0, 11378
GlobalTracer [baseline] (247.686 ms) : 0, 247686
GlobalTracer [candidate] (247.712 ms) : 0, 247712
AppSec [baseline] (26.566 ms) : 0, 26566
AppSec [candidate] (27.36 ms) : 0, 27360
Debugger [baseline] (70.072 ms) : 0, 70072
Debugger [candidate] (69.334 ms) : 0, 69334
Remote Config [baseline] (528.137 µs) : 0, 528
Remote Config [candidate] (525.673 µs) : 0, 526
Telemetry [baseline] (9.196 ms) : 0, 9196
Telemetry [candidate] (9.188 ms) : 0, 9188
Flare Poller [baseline] (3.359 ms) : 0, 3359
Flare Poller [candidate] (3.341 ms) : 0, 3341
IAST [baseline] (25.332 ms) : 0, 25332
IAST [candidate] (25.31 ms) : 0, 25310
section profiling
crashtracking [baseline] (1.172 ms) : 0, 1172
crashtracking [candidate] (1.164 ms) : 0, 1164
BytebuddyAgent [baseline] (682.397 ms) : 0, 682397
BytebuddyAgent [candidate] (684.593 ms) : 0, 684593
AgentMeter [baseline] (8.635 ms) : 0, 8635
AgentMeter [candidate] (8.686 ms) : 0, 8686
GlobalTracer [baseline] (215.526 ms) : 0, 215526
GlobalTracer [candidate] (216.936 ms) : 0, 216936
AppSec [baseline] (32.267 ms) : 0, 32267
AppSec [candidate] (32.468 ms) : 0, 32468
Debugger [baseline] (64.628 ms) : 0, 64628
Debugger [candidate] (64.28 ms) : 0, 64280
Remote Config [baseline] (580.971 µs) : 0, 581
Remote Config [candidate] (583.834 µs) : 0, 584
Telemetry [baseline] (7.641 ms) : 0, 7641
Telemetry [candidate] (9.202 ms) : 0, 9202
Flare Poller [baseline] (4.254 ms) : 0, 4254
Flare Poller [candidate] (3.492 ms) : 0, 3492
ProfilingAgent [baseline] (94.152 ms) : 0, 94152
ProfilingAgent [candidate] (94.081 ms) : 0, 94081
Profiling [baseline] (94.721 ms) : 0, 94721
Profiling [candidate] (94.649 ms) : 0, 94649
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master dougqh/atomics-benchmark
git_commit_date 1773686106 1773686814
git_commit_sha 3c59e03 a18c330
release_version 1.61.0-SNAPSHOT~3c59e03c2c 1.61.0-SNAPSHOT~a18c330344
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1773688978 1773688978
ci_job_id 1510192426 1510192426
ci_pipeline_id 102772893 102772893
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-c6ym27se 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-c6ym27se 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 2 performance regressions! Performance is the same for 17 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast:high_load worse
[+70.772µs; +138.114µs] or [+2.899%; +5.658%]		 unsure
[+19.490µs; +444.727µs] or [+0.271%; +6.174%]		 unstable
[-200.708op/s; +106.021op/s] or [-13.802%; +7.291%]		 2.545ms 7.436ms 1406.812op/s 2.441ms 7.204ms 1454.156op/s
scenario:load:insecure-bank:iast_GLOBAL:high_load worse
[+67.643µs; +173.053µs] or [+2.446%; +6.257%]		 unsure
[+53.950µs; +445.287µs] or [+0.693%; +5.718%]		 unstable
[-173.793op/s; +104.231op/s] or [-13.377%; +8.023%]		 2.886ms 8.037ms 1264.406op/s 2.766ms 7.787ms 1299.188op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~a18c330344, baseline=1.61.0-SNAPSHOT~3c59e03c2c
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.191 ms) : 1179, 1203
.   : milestone, 1191,
iast (3.145 ms) : 3103, 3187
.   : milestone, 3145,
iast_FULL (6.084 ms) : 6022, 6146
.   : milestone, 6084,
iast_GLOBAL (3.53 ms) : 3467, 3593
.   : milestone, 3530,
profiling (2.25 ms) : 2229, 2272
.   : milestone, 2250,
tracing (1.821 ms) : 1804, 1839
.   : milestone, 1821,
section candidate
no_agent (1.171 ms) : 1160, 1183
.   : milestone, 1171,
iast (3.252 ms) : 3209, 3295
.   : milestone, 3252,
iast_FULL (5.905 ms) : 5845, 5965
.   : milestone, 5905,
iast_GLOBAL (3.629 ms) : 3568, 3689
.   : milestone, 3629,
profiling (2.267 ms) : 2244, 2289
.   : milestone, 2267,
tracing (1.833 ms) : 1817, 1849
.   : milestone, 1833,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.191 ms [1.179 ms, 1.203 ms] -
iast 3.145 ms [3.103 ms, 3.187 ms] 1.954 ms (164.0%)
iast_FULL 6.084 ms [6.022 ms, 6.146 ms] 4.893 ms (410.8%)
iast_GLOBAL 3.53 ms [3.467 ms, 3.593 ms] 2.339 ms (196.3%)
profiling 2.25 ms [2.229 ms, 2.272 ms] 1.059 ms (88.9%)
tracing 1.821 ms [1.804 ms, 1.839 ms] 630.367 µs (52.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.171 ms [1.16 ms, 1.183 ms] -
iast 3.252 ms [3.209 ms, 3.295 ms] 2.08 ms (177.6%)
iast_FULL 5.905 ms [5.845 ms, 5.965 ms] 4.734 ms (404.1%)
iast_GLOBAL 3.629 ms [3.568 ms, 3.689 ms] 2.457 ms (209.7%)
profiling 2.267 ms [2.244 ms, 2.289 ms] 1.095 ms (93.5%)
tracing 1.833 ms [1.817 ms, 1.849 ms] 661.523 µs (56.5%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~a18c330344, baseline=1.61.0-SNAPSHOT~3c59e03c2c
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.376 ms) : 18184, 18569
.   : milestone, 18376,
appsec (18.51 ms) : 18322, 18698
.   : milestone, 18510,
code_origins (17.784 ms) : 17608, 17960
.   : milestone, 17784,
iast (17.907 ms) : 17729, 18085
.   : milestone, 17907,
profiling (18.693 ms) : 18508, 18878
.   : milestone, 18693,
tracing (18.023 ms) : 17847, 18200
.   : milestone, 18023,
section candidate
no_agent (18.033 ms) : 17848, 18217
.   : milestone, 18033,
appsec (18.511 ms) : 18323, 18700
.   : milestone, 18511,
code_origins (17.972 ms) : 17791, 18152
.   : milestone, 17972,
iast (17.802 ms) : 17622, 17981
.   : milestone, 17802,
profiling (18.684 ms) : 18496, 18871
.   : milestone, 18684,
tracing (17.752 ms) : 17576, 17928
.   : milestone, 17752,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.376 ms [18.184 ms, 18.569 ms] -
appsec 18.51 ms [18.322 ms, 18.698 ms] 133.805 µs (0.7%)
code_origins 17.784 ms [17.608 ms, 17.96 ms] -592.607 µs (-3.2%)
iast 17.907 ms [17.729 ms, 18.085 ms] -469.453 µs (-2.6%)
profiling 18.693 ms [18.508 ms, 18.878 ms] 316.318 µs (1.7%)
tracing 18.023 ms [17.847 ms, 18.2 ms] -353.073 µs (-1.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.033 ms [17.848 ms, 18.217 ms] -
appsec 18.511 ms [18.323 ms, 18.7 ms] 478.857 µs (2.7%)
code_origins 17.972 ms [17.791 ms, 18.152 ms] -60.984 µs (-0.3%)
iast 17.802 ms [17.622 ms, 17.981 ms] -230.901 µs (-1.3%)
profiling 18.684 ms [18.496 ms, 18.871 ms] 651.158 µs (3.6%)
tracing 17.752 ms [17.576 ms, 17.928 ms] -280.894 µs (-1.6%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master dougqh/atomics-benchmark
git_commit_date 1773686106 1773686814
git_commit_sha 3c59e03 a18c330
release_version 1.61.0-SNAPSHOT~3c59e03c2c 1.61.0-SNAPSHOT~a18c330344
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1773688730 1773688730
ci_job_id 1510192428 1510192428
ci_pipeline_id 102772893 102772893
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-dwip10iq 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-dwip10iq 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~a18c330344, baseline=1.61.0-SNAPSHOT~3c59e03c2c
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.47 ms) : 1459, 1482
.   : milestone, 1470,
appsec (3.768 ms) : 3544, 3992
.   : milestone, 3768,
iast (2.252 ms) : 2183, 2321
.   : milestone, 2252,
iast_GLOBAL (2.29 ms) : 2220, 2359
.   : milestone, 2290,
profiling (2.076 ms) : 2021, 2131
.   : milestone, 2076,
tracing (2.063 ms) : 2009, 2116
.   : milestone, 2063,
section candidate
no_agent (1.473 ms) : 1462, 1485
.   : milestone, 1473,
appsec (3.792 ms) : 3572, 4012
.   : milestone, 3792,
iast (2.26 ms) : 2191, 2330
.   : milestone, 2260,
iast_GLOBAL (2.293 ms) : 2224, 2362
.   : milestone, 2293,
profiling (2.07 ms) : 2015, 2124
.   : milestone, 2070,
tracing (2.053 ms) : 2000, 2106
.   : milestone, 2053,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.47 ms [1.459 ms, 1.482 ms] -
appsec 3.768 ms [3.544 ms, 3.992 ms] 2.298 ms (156.3%)
iast 2.252 ms [2.183 ms, 2.321 ms] 781.846 µs (53.2%)
iast_GLOBAL 2.29 ms [2.22 ms, 2.359 ms] 819.268 µs (55.7%)
profiling 2.076 ms [2.021 ms, 2.131 ms] 605.668 µs (41.2%)
tracing 2.063 ms [2.009 ms, 2.116 ms] 592.262 µs (40.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.473 ms [1.462 ms, 1.485 ms] -
appsec 3.792 ms [3.572 ms, 4.012 ms] 2.319 ms (157.4%)
iast 2.26 ms [2.191 ms, 2.33 ms] 787.207 µs (53.4%)
iast_GLOBAL 2.293 ms [2.224 ms, 2.362 ms] 820.008 µs (55.7%)
profiling 2.07 ms [2.015 ms, 2.124 ms] 596.764 µs (40.5%)
tracing 2.053 ms [2.0 ms, 2.106 ms] 580.076 µs (39.4%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~a18c330344, baseline=1.61.0-SNAPSHOT~3c59e03c2c
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.998 s) : 14998000, 14998000
.   : milestone, 14998000,
appsec (15.044 s) : 15044000, 15044000
.   : milestone, 15044000,
iast (18.257 s) : 18257000, 18257000
.   : milestone, 18257000,
iast_GLOBAL (17.915 s) : 17915000, 17915000
.   : milestone, 17915000,
profiling (14.837 s) : 14837000, 14837000
.   : milestone, 14837000,
tracing (15.03 s) : 15030000, 15030000
.   : milestone, 15030000,
section candidate
no_agent (15.605 s) : 15605000, 15605000
.   : milestone, 15605000,
appsec (14.843 s) : 14843000, 14843000
.   : milestone, 14843000,
iast (17.756 s) : 17756000, 17756000
.   : milestone, 17756000,
iast_GLOBAL (17.785 s) : 17785000, 17785000
.   : milestone, 17785000,
profiling (14.906 s) : 14906000, 14906000
.   : milestone, 14906000,
tracing (15.116 s) : 15116000, 15116000
.   : milestone, 15116000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.998 s [14.998 s, 14.998 s] -
appsec 15.044 s [15.044 s, 15.044 s] 46.0 ms (0.3%)
iast 18.257 s [18.257 s, 18.257 s] 3.259 s (21.7%)
iast_GLOBAL 17.915 s [17.915 s, 17.915 s] 2.917 s (19.4%)
profiling 14.837 s [14.837 s, 14.837 s] -161.0 ms (-1.1%)
tracing 15.03 s [15.03 s, 15.03 s] 32.0 ms (0.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.605 s [15.605 s, 15.605 s] -
appsec 14.843 s [14.843 s, 14.843 s] -762.0 ms (-4.9%)
iast 17.756 s [17.756 s, 17.756 s] 2.151 s (13.8%)
iast_GLOBAL 17.785 s [17.785 s, 17.785 s] 2.18 s (14.0%)
profiling 14.906 s [14.906 s, 14.906 s] -699.0 ms (-4.5%)
tracing 15.116 s [15.116 s, 15.116 s] -489.0 ms (-3.1%)