Home Original page

List iteration benchmark by dougqh · Pull Request #10888 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master dougqh/list-iteration-benchmark
git_commit_date 1773841815 1773876833
git_commit_sha f4fa29a d002783
release_version 1.61.0-SNAPSHOT~f4fa29a892 1.61.0-SNAPSHOT~d002783f13
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1773878613 1773878613
ci_job_id 1520012688 1520012688
ci_pipeline_id 103410619 103410619
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-pbqswi2u 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-pbqswi2u 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 63 metrics, 8 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.61.0-SNAPSHOT~d002783f13, baseline=1.61.0-SNAPSHOT~f4fa29a892

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.055 s) : 0, 1054868
Total [baseline] (8.868 s) : 0, 8868099
Agent [candidate] (1.066 s) : 0, 1066480
Total [candidate] (8.918 s) : 0, 8918167
section iast
Agent [baseline] (1.236 s) : 0, 1236129
Total [baseline] (9.567 s) : 0, 9566726
Agent [candidate] (1.229 s) : 0, 1229034
Total [candidate] (9.566 s) : 0, 9565875
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.055 s -
Agent iast 1.236 s 181.261 ms (17.2%)
Total tracing 8.868 s -
Total iast 9.567 s 698.627 ms (7.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.066 s -
Agent iast 1.229 s 162.554 ms (15.2%)
Total tracing 8.918 s -
Total iast 9.566 s 647.708 ms (7.3%) 
gantt
    title insecure-bank - break down per module: candidate=1.61.0-SNAPSHOT~d002783f13, baseline=1.61.0-SNAPSHOT~f4fa29a892

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.192 ms) : 0, 1192
crashtracking [candidate] (1.215 ms) : 0, 1215
BytebuddyAgent [baseline] (627.108 ms) : 0, 627108
BytebuddyAgent [candidate] (635.538 ms) : 0, 635538
AgentMeter [baseline] (29.121 ms) : 0, 29121
AgentMeter [candidate] (29.546 ms) : 0, 29546
GlobalTracer [baseline] (256.493 ms) : 0, 256493
GlobalTracer [candidate] (259.639 ms) : 0, 259639
AppSec [baseline] (31.488 ms) : 0, 31488
AppSec [candidate] (31.881 ms) : 0, 31881
Debugger [baseline] (59.146 ms) : 0, 59146
Debugger [candidate] (60.143 ms) : 0, 60143
Remote Config [baseline] (577.849 µs) : 0, 578
Remote Config [candidate] (586.636 µs) : 0, 587
Telemetry [baseline] (7.946 ms) : 0, 7946
Telemetry [candidate] (8.103 ms) : 0, 8103
Flare Poller [baseline] (5.774 ms) : 0, 5774
Flare Poller [candidate] (3.539 ms) : 0, 3539
section iast
crashtracking [baseline] (1.203 ms) : 0, 1203
crashtracking [candidate] (1.199 ms) : 0, 1199
BytebuddyAgent [baseline] (803.572 ms) : 0, 803572
BytebuddyAgent [candidate] (796.947 ms) : 0, 796947
AgentMeter [baseline] (11.432 ms) : 0, 11432
AgentMeter [candidate] (11.342 ms) : 0, 11342
GlobalTracer [baseline] (248.684 ms) : 0, 248684
GlobalTracer [candidate] (247.836 ms) : 0, 247836
IAST [baseline] (25.536 ms) : 0, 25536
IAST [candidate] (25.35 ms) : 0, 25350
AppSec [baseline] (26.717 ms) : 0, 26717
AppSec [candidate] (26.549 ms) : 0, 26549
Debugger [baseline] (69.624 ms) : 0, 69624
Debugger [candidate] (69.042 ms) : 0, 69042
Remote Config [baseline] (525.403 µs) : 0, 525
Remote Config [candidate] (548.849 µs) : 0, 549
Telemetry [baseline] (9.131 ms) : 0, 9131
Telemetry [candidate] (10.308 ms) : 0, 10308
Flare Poller [baseline] (3.323 ms) : 0, 3323
Flare Poller [candidate] (3.71 ms) : 0, 3710
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.61.0-SNAPSHOT~d002783f13, baseline=1.61.0-SNAPSHOT~f4fa29a892

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.059 s) : 0, 1058930
Total [baseline] (11.127 s) : 0, 11126903
Agent [candidate] (1.061 s) : 0, 1060894
Total [candidate] (11.142 s) : 0, 11141528
section appsec
Agent [baseline] (1.247 s) : 0, 1247236
Total [baseline] (11.183 s) : 0, 11183096
Agent [candidate] (1.264 s) : 0, 1264210
Total [candidate] (11.304 s) : 0, 11303715
section iast
Agent [baseline] (1.234 s) : 0, 1233658
Total [baseline] (11.46 s) : 0, 11460196
Agent [candidate] (1.244 s) : 0, 1244282
Total [candidate] (11.437 s) : 0, 11436824
section profiling
Agent [baseline] (1.185 s) : 0, 1184839
Total [baseline] (11.119 s) : 0, 11119135
Agent [candidate] (1.191 s) : 0, 1191013
Total [candidate] (11.071 s) : 0, 11070668
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.059 s -
Agent appsec 1.247 s 188.306 ms (17.8%)
Agent iast 1.234 s 174.728 ms (16.5%)
Agent profiling 1.185 s 125.91 ms (11.9%)
Total tracing 11.127 s -
Total appsec 11.183 s 56.193 ms (0.5%)
Total iast 11.46 s 333.293 ms (3.0%)
Total profiling 11.119 s -7.768 ms (-0.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.061 s -
Agent appsec 1.264 s 203.315 ms (19.2%)
Agent iast 1.244 s 183.387 ms (17.3%)
Agent profiling 1.191 s 130.119 ms (12.3%)
Total tracing 11.142 s -
Total appsec 11.304 s 162.187 ms (1.5%)
Total iast 11.437 s 295.296 ms (2.7%)
Total profiling 11.071 s -70.859 ms (-0.6%) 
gantt
    title petclinic - break down per module: candidate=1.61.0-SNAPSHOT~d002783f13, baseline=1.61.0-SNAPSHOT~f4fa29a892

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.191 ms) : 0, 1191
crashtracking [candidate] (1.192 ms) : 0, 1192
BytebuddyAgent [baseline] (629.235 ms) : 0, 629235
BytebuddyAgent [candidate] (629.044 ms) : 0, 629044
AgentMeter [baseline] (29.221 ms) : 0, 29221
AgentMeter [candidate] (29.173 ms) : 0, 29173
GlobalTracer [baseline] (258.01 ms) : 0, 258010
GlobalTracer [candidate] (257.585 ms) : 0, 257585
AppSec [baseline] (31.804 ms) : 0, 31804
AppSec [candidate] (31.657 ms) : 0, 31657
Debugger [baseline] (60.422 ms) : 0, 60422
Debugger [candidate] (60.289 ms) : 0, 60289
Remote Config [baseline] (587.374 µs) : 0, 587
Remote Config [candidate] (593.491 µs) : 0, 593
Telemetry [baseline] (7.995 ms) : 0, 7995
Telemetry [candidate] (8.012 ms) : 0, 8012
Flare Poller [baseline] (4.314 ms) : 0, 4314
Flare Poller [candidate] (7.285 ms) : 0, 7285
section appsec
crashtracking [baseline] (1.188 ms) : 0, 1188
crashtracking [candidate] (1.229 ms) : 0, 1229
BytebuddyAgent [baseline] (658.667 ms) : 0, 658667
BytebuddyAgent [candidate] (668.221 ms) : 0, 668221
AgentMeter [baseline] (11.957 ms) : 0, 11957
AgentMeter [candidate] (12.166 ms) : 0, 12166
GlobalTracer [baseline] (258.224 ms) : 0, 258224
GlobalTracer [candidate] (261.77 ms) : 0, 261770
IAST [baseline] (24.17 ms) : 0, 24170
IAST [candidate] (24.607 ms) : 0, 24607
AppSec [baseline] (177.778 ms) : 0, 177778
AppSec [candidate] (179.476 ms) : 0, 179476
Debugger [baseline] (66.271 ms) : 0, 66271
Debugger [candidate] (67.191 ms) : 0, 67191
Remote Config [baseline] (658.434 µs) : 0, 658
Remote Config [candidate] (641.762 µs) : 0, 642
Telemetry [baseline] (8.431 ms) : 0, 8431
Telemetry [candidate] (8.52 ms) : 0, 8520
Flare Poller [baseline] (3.596 ms) : 0, 3596
Flare Poller [candidate] (3.719 ms) : 0, 3719
section iast
crashtracking [baseline] (1.213 ms) : 0, 1213
crashtracking [candidate] (1.202 ms) : 0, 1202
BytebuddyAgent [baseline] (800.364 ms) : 0, 800364
BytebuddyAgent [candidate] (806.602 ms) : 0, 806602
AgentMeter [baseline] (11.32 ms) : 0, 11320
AgentMeter [candidate] (11.539 ms) : 0, 11539
GlobalTracer [baseline] (247.915 ms) : 0, 247915
GlobalTracer [candidate] (250.705 ms) : 0, 250705
IAST [baseline] (25.345 ms) : 0, 25345
IAST [candidate] (25.827 ms) : 0, 25827
AppSec [baseline] (26.513 ms) : 0, 26513
AppSec [candidate] (27.109 ms) : 0, 27109
Debugger [baseline] (71.481 ms) : 0, 71481
Debugger [candidate] (71.571 ms) : 0, 71571
Remote Config [baseline] (543.022 µs) : 0, 543
Remote Config [candidate] (546.399 µs) : 0, 546
Telemetry [baseline] (9.255 ms) : 0, 9255
Telemetry [candidate] (9.377 ms) : 0, 9377
Flare Poller [baseline] (3.394 ms) : 0, 3394
Flare Poller [candidate] (3.482 ms) : 0, 3482
section profiling
crashtracking [baseline] (1.17 ms) : 0, 1170
crashtracking [candidate] (1.19 ms) : 0, 1190
BytebuddyAgent [baseline] (684.736 ms) : 0, 684736
BytebuddyAgent [candidate] (688.922 ms) : 0, 688922
AgentMeter [baseline] (8.606 ms) : 0, 8606
AgentMeter [candidate] (8.658 ms) : 0, 8658
GlobalTracer [baseline] (215.3 ms) : 0, 215300
GlobalTracer [candidate] (216.852 ms) : 0, 216852
AppSec [baseline] (32.333 ms) : 0, 32333
AppSec [candidate] (32.531 ms) : 0, 32531
Debugger [baseline] (65.25 ms) : 0, 65250
Debugger [candidate] (66.244 ms) : 0, 66244
Remote Config [baseline] (564.343 µs) : 0, 564
Remote Config [candidate] (556.051 µs) : 0, 556
Telemetry [baseline] (7.734 ms) : 0, 7734
Telemetry [candidate] (7.712 ms) : 0, 7712
Flare Poller [baseline] (4.25 ms) : 0, 4250
Flare Poller [candidate] (3.477 ms) : 0, 3477
ProfilingAgent [baseline] (93.973 ms) : 0, 93973
ProfilingAgent [candidate] (94.052 ms) : 0, 94052
Profiling [baseline] (94.536 ms) : 0, 94536
Profiling [candidate] (94.601 ms) : 0, 94601
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master dougqh/list-iteration-benchmark
git_commit_date 1773841815 1773876833
git_commit_sha f4fa29a d002783
release_version 1.61.0-SNAPSHOT~f4fa29a892 1.61.0-SNAPSHOT~d002783f13
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1773879070 1773879070
ci_job_id 1520012689 1520012689
ci_pipeline_id 103410619 103410619
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-k8sh0rvf 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-k8sh0rvf 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 7 performance improvements and 0 performance regressions! Performance is the same for 13 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load better
[-381.833µs; -270.912µs] or [-13.012%; -9.232%]		 better
[-774.144µs; -363.467µs] or [-9.405%; -4.416%]		 unstable
[-19.760op/s; +247.573op/s] or [-1.593%; +19.959%]		 2.608ms 7.662ms 1354.312op/s 2.934ms 8.231ms 1240.406op/s
scenario:load:petclinic:tracing:high_load better
[-1.465ms; -0.570ms] or [-8.012%; -3.117%]		 better
[-2.140ms; -0.689ms] or [-7.101%; -2.285%]		 unstable
[-13.457op/s; +39.520op/s] or [-5.375%; +15.784%]		 17.266ms 28.726ms 263.406op/s 18.283ms 30.140ms 250.375op/s
scenario:load:petclinic:code_origins:high_load better
[-1.614ms; -0.817ms] or [-8.709%; -4.410%]		 unsure
[-2.024ms; -0.532ms] or [-6.773%; -1.779%]		 unstable
[-12.167op/s; +40.792op/s] or [-4.897%; +16.417%]		 17.311ms 28.600ms 262.781op/s 18.527ms 29.878ms 248.469op/s
scenario:load:petclinic:iast:high_load better
[-1.697ms; -0.783ms] or [-9.128%; -4.210%]		 better
[-2.708ms; -1.207ms] or [-8.990%; -4.005%]		 unstable
[-11.082op/s; +42.395op/s] or [-4.462%; +17.071%]		 17.351ms 28.168ms 264.000op/s 18.591ms 30.125ms 248.344op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~d002783f13, baseline=1.61.0-SNAPSHOT~f4fa29a892
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.186 ms) : 1175, 1197
.   : milestone, 1186,
iast (3.22 ms) : 3178, 3263
.   : milestone, 3220,
iast_FULL (5.918 ms) : 5859, 5977
.   : milestone, 5918,
iast_GLOBAL (3.7 ms) : 3642, 3758
.   : milestone, 3700,
profiling (2.134 ms) : 2110, 2157
.   : milestone, 2134,
tracing (1.807 ms) : 1793, 1821
.   : milestone, 1807,
section candidate
no_agent (1.178 ms) : 1167, 1190
.   : milestone, 1178,
iast (3.172 ms) : 3124, 3220
.   : milestone, 3172,
iast_FULL (6.001 ms) : 5940, 6062
.   : milestone, 6001,
iast_GLOBAL (3.382 ms) : 3331, 3433
.   : milestone, 3382,
profiling (2.116 ms) : 2093, 2139
.   : milestone, 2116,
tracing (1.776 ms) : 1761, 1790
.   : milestone, 1776,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.186 ms [1.175 ms, 1.197 ms] -
iast 3.22 ms [3.178 ms, 3.263 ms] 2.034 ms (171.6%)
iast_FULL 5.918 ms [5.859 ms, 5.977 ms] 4.732 ms (399.1%)
iast_GLOBAL 3.7 ms [3.642 ms, 3.758 ms] 2.514 ms (212.0%)
profiling 2.134 ms [2.11 ms, 2.157 ms] 948.004 µs (79.9%)
tracing 1.807 ms [1.793 ms, 1.821 ms] 621.12 µs (52.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.178 ms [1.167 ms, 1.19 ms] -
iast 3.172 ms [3.124 ms, 3.22 ms] 1.993 ms (169.2%)
iast_FULL 6.001 ms [5.94 ms, 6.062 ms] 4.822 ms (409.2%)
iast_GLOBAL 3.382 ms [3.331 ms, 3.433 ms] 2.203 ms (187.0%)
profiling 2.116 ms [2.093 ms, 2.139 ms] 937.474 µs (79.5%)
tracing 1.776 ms [1.761 ms, 1.79 ms] 597.069 µs (50.7%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~d002783f13, baseline=1.61.0-SNAPSHOT~f4fa29a892
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.923 ms) : 17741, 18105
.   : milestone, 17923,
appsec (18.781 ms) : 18592, 18970
.   : milestone, 18781,
code_origins (18.777 ms) : 18588, 18966
.   : milestone, 18777,
iast (18.795 ms) : 18605, 18985
.   : milestone, 18795,
profiling (18.721 ms) : 18532, 18910
.   : milestone, 18721,
tracing (18.637 ms) : 18447, 18828
.   : milestone, 18637,
section candidate
no_agent (17.128 ms) : 16958, 17299
.   : milestone, 17128,
appsec (18.697 ms) : 18509, 18886
.   : milestone, 18697,
code_origins (17.755 ms) : 17578, 17933
.   : milestone, 17755,
iast (17.675 ms) : 17502, 17848
.   : milestone, 17675,
profiling (18.828 ms) : 18638, 19017
.   : milestone, 18828,
tracing (17.712 ms) : 17535, 17890
.   : milestone, 17712,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.923 ms [17.741 ms, 18.105 ms] -
appsec 18.781 ms [18.592 ms, 18.97 ms] 857.939 µs (4.8%)
code_origins 18.777 ms [18.588 ms, 18.966 ms] 853.993 µs (4.8%)
iast 18.795 ms [18.605 ms, 18.985 ms] 872.431 µs (4.9%)
profiling 18.721 ms [18.532 ms, 18.91 ms] 798.306 µs (4.5%)
tracing 18.637 ms [18.447 ms, 18.828 ms] 714.534 µs (4.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.128 ms [16.958 ms, 17.299 ms] -
appsec 18.697 ms [18.509 ms, 18.886 ms] 1.569 ms (9.2%)
code_origins 17.755 ms [17.578 ms, 17.933 ms] 626.799 µs (3.7%)
iast 17.675 ms [17.502 ms, 17.848 ms] 546.639 µs (3.2%)
profiling 18.828 ms [18.638 ms, 19.017 ms] 1.699 ms (9.9%)
tracing 17.712 ms [17.535 ms, 17.89 ms] 583.679 µs (3.4%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master dougqh/list-iteration-benchmark
git_commit_date 1773841815 1773876833
git_commit_sha f4fa29a d002783
release_version 1.61.0-SNAPSHOT~f4fa29a892 1.61.0-SNAPSHOT~d002783f13
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1773878824 1773878824
ci_job_id 1520012690 1520012690
ci_pipeline_id 103410619 103410619
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-7nb1briu 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-7nb1briu 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~d002783f13, baseline=1.61.0-SNAPSHOT~f4fa29a892
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.474 ms) : 1462, 1485
.   : milestone, 1474,
appsec (3.789 ms) : 3568, 4009
.   : milestone, 3789,
iast (2.254 ms) : 2185, 2322
.   : milestone, 2254,
iast_GLOBAL (2.3 ms) : 2230, 2369
.   : milestone, 2300,
profiling (2.102 ms) : 2046, 2158
.   : milestone, 2102,
tracing (2.066 ms) : 2013, 2120
.   : milestone, 2066,
section candidate
no_agent (1.467 ms) : 1456, 1479
.   : milestone, 1467,
appsec (3.799 ms) : 3578, 4021
.   : milestone, 3799,
iast (2.251 ms) : 2182, 2320
.   : milestone, 2251,
iast_GLOBAL (2.3 ms) : 2231, 2369
.   : milestone, 2300,
profiling (2.087 ms) : 2031, 2142
.   : milestone, 2087,
tracing (2.067 ms) : 2014, 2120
.   : milestone, 2067,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.462 ms, 1.485 ms] -
appsec 3.789 ms [3.568 ms, 4.009 ms] 2.315 ms (157.1%)
iast 2.254 ms [2.185 ms, 2.322 ms] 780.292 µs (53.0%)
iast_GLOBAL 2.3 ms [2.23 ms, 2.369 ms] 826.225 µs (56.1%)
profiling 2.102 ms [2.046 ms, 2.158 ms] 628.339 µs (42.6%)
tracing 2.066 ms [2.013 ms, 2.12 ms] 592.933 µs (40.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.467 ms [1.456 ms, 1.479 ms] -
appsec 3.799 ms [3.578 ms, 4.021 ms] 2.332 ms (158.9%)
iast 2.251 ms [2.182 ms, 2.32 ms] 783.392 µs (53.4%)
iast_GLOBAL 2.3 ms [2.231 ms, 2.369 ms] 832.72 µs (56.7%)
profiling 2.087 ms [2.031 ms, 2.142 ms] 619.364 µs (42.2%)
tracing 2.067 ms [2.014 ms, 2.12 ms] 599.561 µs (40.9%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~d002783f13, baseline=1.61.0-SNAPSHOT~f4fa29a892
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.504 s) : 15504000, 15504000
.   : milestone, 15504000,
appsec (15.047 s) : 15047000, 15047000
.   : milestone, 15047000,
iast (18.469 s) : 18469000, 18469000
.   : milestone, 18469000,
iast_GLOBAL (18.298 s) : 18298000, 18298000
.   : milestone, 18298000,
profiling (15.599 s) : 15599000, 15599000
.   : milestone, 15599000,
tracing (14.93 s) : 14930000, 14930000
.   : milestone, 14930000,
section candidate
no_agent (15.274 s) : 15274000, 15274000
.   : milestone, 15274000,
appsec (14.873 s) : 14873000, 14873000
.   : milestone, 14873000,
iast (18.503 s) : 18503000, 18503000
.   : milestone, 18503000,
iast_GLOBAL (17.852 s) : 17852000, 17852000
.   : milestone, 17852000,
profiling (14.8 s) : 14800000, 14800000
.   : milestone, 14800000,
tracing (14.859 s) : 14859000, 14859000
.   : milestone, 14859000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.504 s [15.504 s, 15.504 s] -
appsec 15.047 s [15.047 s, 15.047 s] -457.0 ms (-2.9%)
iast 18.469 s [18.469 s, 18.469 s] 2.965 s (19.1%)
iast_GLOBAL 18.298 s [18.298 s, 18.298 s] 2.794 s (18.0%)
profiling 15.599 s [15.599 s, 15.599 s] 95.0 ms (0.6%)
tracing 14.93 s [14.93 s, 14.93 s] -574.0 ms (-3.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.274 s [15.274 s, 15.274 s] -
appsec 14.873 s [14.873 s, 14.873 s] -401.0 ms (-2.6%)
iast 18.503 s [18.503 s, 18.503 s] 3.229 s (21.1%)
iast_GLOBAL 17.852 s [17.852 s, 17.852 s] 2.578 s (16.9%)
profiling 14.8 s [14.8 s, 14.8 s] -474.0 ms (-3.1%)
tracing 14.859 s [14.859 s, 14.859 s] -415.0 ms (-2.7%)