Fixed issue with recursive calls which can cause StackOverflowError. by AlexeyKuznetsov-DD · Pull Request #10535 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/fix-wrap-runnable-so-error
git_commit_date 1770395081 1770395236
git_commit_sha 1e93c87 39e9e29
release_version 1.60.0-SNAPSHOT~1e93c87a84 1.60.0-SNAPSHOT~39e9e29c41
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1770396904 1770396904
ci_job_id 1406802144 1406802144
ci_pipeline_id 95023434 95023434
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-j8ah3fop 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-j8ah3fop 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 64 metrics, 7 unstable metrics.

Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~39e9e29c41, baseline=1.60.0-SNAPSHOT~1e93c87a84

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.065 s) : 0, 1064838
Total [baseline] (10.863 s) : 0, 10862547
Agent [candidate] (1.074 s) : 0, 1073536
Total [candidate] (10.887 s) : 0, 10886998
section appsec
Agent [baseline] (1.24 s) : 0, 1240367
Total [baseline] (10.982 s) : 0, 10981734
Agent [candidate] (1.237 s) : 0, 1237423
Total [candidate] (10.96 s) : 0, 10959997
section iast
Agent [baseline] (1.231 s) : 0, 1231412
Total [baseline] (11.213 s) : 0, 11213342
Agent [candidate] (1.232 s) : 0, 1231801
Total [candidate] (11.158 s) : 0, 11158429
section profiling
Agent [baseline] (1.189 s) : 0, 1189277
Total [baseline] (10.907 s) : 0, 10907079
Agent [candidate] (1.197 s) : 0, 1197020
Total [candidate] (11.009 s) : 0, 11009235
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.065 s -
Agent appsec 1.24 s 175.528 ms (16.5%)
Agent iast 1.231 s 166.574 ms (15.6%)
Agent profiling 1.189 s 124.439 ms (11.7%)
Total tracing 10.863 s -
Total appsec 10.982 s 119.187 ms (1.1%)
Total iast 11.213 s 350.795 ms (3.2%)
Total profiling 10.907 s 44.532 ms (0.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.074 s -
Agent appsec 1.237 s 163.887 ms (15.3%)
Agent iast 1.232 s 158.265 ms (14.7%)
Agent profiling 1.197 s 123.484 ms (11.5%)
Total tracing 10.887 s -
Total appsec 10.96 s 72.999 ms (0.7%)
Total iast 11.158 s 271.431 ms (2.5%)
Total profiling 11.009 s 122.237 ms (1.1%)
gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~39e9e29c41, baseline=1.60.0-SNAPSHOT~1e93c87a84

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.182 ms) : 0, 1182
crashtracking [candidate] (1.198 ms) : 0, 1198
BytebuddyAgent [baseline] (629.753 ms) : 0, 629753
BytebuddyAgent [candidate] (632.061 ms) : 0, 632061
AgentMeter [baseline] (28.911 ms) : 0, 28911
AgentMeter [candidate] (29.3 ms) : 0, 29300
GlobalTracer [baseline] (258.271 ms) : 0, 258271
GlobalTracer [candidate] (260.599 ms) : 0, 260599
AppSec [baseline] (32.841 ms) : 0, 32841
AppSec [candidate] (33.483 ms) : 0, 33483
Debugger [baseline] (63.422 ms) : 0, 63422
Debugger [candidate] (61.519 ms) : 0, 61519
Remote Config [baseline] (608.592 µs) : 0, 609
Remote Config [candidate] (641.159 µs) : 0, 641
Telemetry [baseline] (10.721 ms) : 0, 10721
Telemetry [candidate] (14.728 ms) : 0, 14728
Flare Poller [baseline] (3.767 ms) : 0, 3767
Flare Poller [candidate] (4.601 ms) : 0, 4601
section appsec
crashtracking [baseline] (1.18 ms) : 0, 1180
crashtracking [candidate] (1.181 ms) : 0, 1181
BytebuddyAgent [baseline] (659.386 ms) : 0, 659386
BytebuddyAgent [candidate] (657.627 ms) : 0, 657627
AgentMeter [baseline] (11.933 ms) : 0, 11933
AgentMeter [candidate] (11.919 ms) : 0, 11919
GlobalTracer [baseline] (258.865 ms) : 0, 258865
GlobalTracer [candidate] (258.19 ms) : 0, 258190
IAST [baseline] (25.268 ms) : 0, 25268
IAST [candidate] (25.224 ms) : 0, 25224
AppSec [baseline] (167.762 ms) : 0, 167762
AppSec [candidate] (167.536 ms) : 0, 167536
Debugger [baseline] (67.316 ms) : 0, 67316
Debugger [candidate] (67.045 ms) : 0, 67045
Remote Config [baseline] (671.217 µs) : 0, 671
Remote Config [candidate] (655.333 µs) : 0, 655
Telemetry [baseline] (9.103 ms) : 0, 9103
Telemetry [candidate] (9.104 ms) : 0, 9104
Flare Poller [baseline] (3.655 ms) : 0, 3655
Flare Poller [candidate] (3.642 ms) : 0, 3642
section iast
crashtracking [baseline] (1.182 ms) : 0, 1182
crashtracking [candidate] (1.203 ms) : 0, 1203
BytebuddyAgent [baseline] (795.018 ms) : 0, 795018
BytebuddyAgent [candidate] (795.466 ms) : 0, 795466
AgentMeter [baseline] (11.283 ms) : 0, 11283
AgentMeter [candidate] (11.24 ms) : 0, 11240
GlobalTracer [baseline] (248.402 ms) : 0, 248402
GlobalTracer [candidate] (248.53 ms) : 0, 248530
IAST [baseline] (26.906 ms) : 0, 26906
IAST [candidate] (26.908 ms) : 0, 26908
AppSec [baseline] (35.448 ms) : 0, 35448
AppSec [candidate] (32.069 ms) : 0, 32069
Debugger [baseline] (65.295 ms) : 0, 65295
Debugger [candidate] (68.522 ms) : 0, 68522
Remote Config [baseline] (541.916 µs) : 0, 542
Remote Config [candidate] (541.459 µs) : 0, 541
Telemetry [baseline] (8.671 ms) : 0, 8671
Telemetry [candidate] (8.634 ms) : 0, 8634
Flare Poller [baseline] (3.449 ms) : 0, 3449
Flare Poller [candidate] (3.508 ms) : 0, 3508
section profiling
crashtracking [baseline] (1.21 ms) : 0, 1210
crashtracking [candidate] (1.227 ms) : 0, 1227
BytebuddyAgent [baseline] (681.518 ms) : 0, 681518
BytebuddyAgent [candidate] (686.504 ms) : 0, 686504
AgentMeter [baseline] (8.79 ms) : 0, 8790
AgentMeter [candidate] (8.781 ms) : 0, 8781
GlobalTracer [baseline] (215.816 ms) : 0, 215816
GlobalTracer [candidate] (217.569 ms) : 0, 217569
AppSec [baseline] (32.406 ms) : 0, 32406
AppSec [candidate] (32.702 ms) : 0, 32702
Debugger [baseline] (68.102 ms) : 0, 68102
Debugger [candidate] (67.9 ms) : 0, 67900
Remote Config [baseline] (591.144 µs) : 0, 591
Remote Config [candidate] (601.073 µs) : 0, 601
Telemetry [baseline] (8.793 ms) : 0, 8793
Telemetry [candidate] (8.905 ms) : 0, 8905
Flare Poller [baseline] (3.686 ms) : 0, 3686
Flare Poller [candidate] (3.74 ms) : 0, 3740
ProfilingAgent [baseline] (98.595 ms) : 0, 98595
ProfilingAgent [candidate] (98.787 ms) : 0, 98787
Profiling [baseline] (99.163 ms) : 0, 99163
Profiling [candidate] (99.35 ms) : 0, 99350
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~39e9e29c41, baseline=1.60.0-SNAPSHOT~1e93c87a84

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.076 s) : 0, 1076445
Total [baseline] (8.797 s) : 0, 8797299
Agent [candidate] (1.067 s) : 0, 1067060
Total [candidate] (8.72 s) : 0, 8719646
section iast
Agent [baseline] (1.239 s) : 0, 1239094
Total [baseline] (9.357 s) : 0, 9356657
Agent [candidate] (1.229 s) : 0, 1228915
Total [candidate] (9.371 s) : 0, 9370845
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.076 s -
Agent iast 1.239 s 162.649 ms (15.1%)
Total tracing 8.797 s -
Total iast 9.357 s 559.359 ms (6.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.067 s -
Agent iast 1.229 s 161.855 ms (15.2%)
Total tracing 8.72 s -
Total iast 9.371 s 651.199 ms (7.5%)
gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~39e9e29c41, baseline=1.60.0-SNAPSHOT~1e93c87a84

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.204 ms) : 0, 1204
crashtracking [candidate] (1.186 ms) : 0, 1186
BytebuddyAgent [baseline] (633.721 ms) : 0, 633721
BytebuddyAgent [candidate] (629.44 ms) : 0, 629440
AgentMeter [baseline] (29.408 ms) : 0, 29408
AgentMeter [candidate] (28.893 ms) : 0, 28893
GlobalTracer [baseline] (260.824 ms) : 0, 260824
GlobalTracer [candidate] (258.179 ms) : 0, 258179
AppSec [baseline] (33.478 ms) : 0, 33478
AppSec [candidate] (32.949 ms) : 0, 32949
Debugger [baseline] (63.918 ms) : 0, 63918
Debugger [candidate] (60.37 ms) : 0, 60370
Remote Config [baseline] (619.041 µs) : 0, 619
Remote Config [candidate] (617.707 µs) : 0, 618
Telemetry [baseline] (12.985 ms) : 0, 12985
Telemetry [candidate] (13.877 ms) : 0, 13877
Flare Poller [baseline] (4.646 ms) : 0, 4646
Flare Poller [candidate] (6.105 ms) : 0, 6105
section iast
crashtracking [baseline] (1.194 ms) : 0, 1194
crashtracking [candidate] (1.188 ms) : 0, 1188
BytebuddyAgent [baseline] (801.034 ms) : 0, 801034
BytebuddyAgent [candidate] (794.089 ms) : 0, 794089
AgentMeter [baseline] (11.5 ms) : 0, 11500
AgentMeter [candidate] (11.207 ms) : 0, 11207
GlobalTracer [baseline] (249.81 ms) : 0, 249810
GlobalTracer [candidate] (248.096 ms) : 0, 248096
IAST [baseline] (27.263 ms) : 0, 27263
IAST [candidate] (26.967 ms) : 0, 26967
AppSec [baseline] (34.062 ms) : 0, 34062
AppSec [candidate] (34.012 ms) : 0, 34012
Debugger [baseline] (66.076 ms) : 0, 66076
Debugger [candidate] (65.486 ms) : 0, 65486
Remote Config [baseline] (529.813 µs) : 0, 530
Remote Config [candidate] (540.13 µs) : 0, 540
Telemetry [baseline] (8.698 ms) : 0, 8698
Telemetry [candidate] (8.59 ms) : 0, 8590
Flare Poller [baseline] (3.48 ms) : 0, 3480
Flare Poller [candidate] (3.533 ms) : 0, 3533
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/fix-wrap-runnable-so-error
git_commit_date 1770395081 1770395236
git_commit_sha 1e93c87 39e9e29
release_version 1.60.0-SNAPSHOT~1e93c87a84 1.60.0-SNAPSHOT~39e9e29c41
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1770397400 1770397400
ci_job_id 1406802146 1406802146
ci_pipeline_id 95023434 95023434
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-sr0og2em 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-sr0og2em 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 3 performance regressions! Performance is the same for 14 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:profiling:high_load better
[-157.276µs; -34.565µs] or [-9.148%; -2.011%]
unstable
[-993.188µs; -91.515µs] or [-19.130%; -1.763%]
unstable
[-74.005op/s; +485.005op/s] or [-3.581%; +23.468%]
1.623ms 4.650ms 2272.125op/s 1.719ms 5.192ms 2066.625op/s
scenario:load:insecure-bank:iast_GLOBAL:high_load better
[-262.705µs; -151.682µs] or [-9.518%; -5.495%]
better
[-572.852µs; -202.196µs] or [-7.324%; -2.585%]
unstable
[-75.625op/s; +241.000op/s] or [-5.762%; +18.362%]
2.553ms 7.434ms 1395.188op/s 2.760ms 7.821ms 1312.500op/s
scenario:load:petclinic:tracing:high_load worse
[+492.825µs; +1180.562µs] or [+2.818%; +6.751%]
unsure
[+0.423ms; +1.735ms] or [+1.479%; +6.066%]
unstable
[-36.807op/s; +15.370op/s] or [-14.087%; +5.882%]
18.323ms 29.678ms 250.562op/s 17.487ms 28.599ms 261.281op/s
scenario:load:petclinic:code_origins:high_load worse
[+0.591ms; +1.649ms] or [+3.425%; +9.557%]
worse
[+1.215ms; +2.632ms] or [+4.317%; +9.355%]
unstable
[-43.447op/s; +10.010op/s] or [-16.370%; +3.771%]
18.372ms 30.057ms 248.688op/s 17.252ms 28.134ms 265.406op/s
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~39e9e29c41, baseline=1.60.0-SNAPSHOT~1e93c87a84
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.041 ms) : 17860, 18222
.   : milestone, 18041,
appsec (18.512 ms) : 18328, 18696
.   : milestone, 18512,
code_origins (17.579 ms) : 17407, 17751
.   : milestone, 17579,
iast (17.69 ms) : 17513, 17867
.   : milestone, 17690,
profiling (18.554 ms) : 18370, 18738
.   : milestone, 18554,
tracing (17.858 ms) : 17682, 18034
.   : milestone, 17858,
section candidate
no_agent (18.433 ms) : 18244, 18623
.   : milestone, 18433,
appsec (18.628 ms) : 18442, 18814
.   : milestone, 18628,
code_origins (18.771 ms) : 18580, 18961
.   : milestone, 18771,
iast (17.784 ms) : 17605, 17963
.   : milestone, 17784,
profiling (18.489 ms) : 18302, 18676
.   : milestone, 18489,
tracing (18.629 ms) : 18441, 18817
.   : milestone, 18629,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.041 ms [17.86 ms, 18.222 ms] -
appsec 18.512 ms [18.328 ms, 18.696 ms] 471.008 µs (2.6%)
code_origins 17.579 ms [17.407 ms, 17.751 ms] -462.173 µs (-2.6%)
iast 17.69 ms [17.513 ms, 17.867 ms] -351.165 µs (-1.9%)
profiling 18.554 ms [18.37 ms, 18.738 ms] 512.665 µs (2.8%)
tracing 17.858 ms [17.682 ms, 18.034 ms] -183.309 µs (-1.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.433 ms [18.244 ms, 18.623 ms] -
appsec 18.628 ms [18.442 ms, 18.814 ms] 194.462 µs (1.1%)
code_origins 18.771 ms [18.58 ms, 18.961 ms] 337.345 µs (1.8%)
iast 17.784 ms [17.605 ms, 17.963 ms] -649.357 µs (-3.5%)
profiling 18.489 ms [18.302 ms, 18.676 ms] 55.19 µs (0.3%)
tracing 18.629 ms [18.441 ms, 18.817 ms] 195.397 µs (1.1%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~39e9e29c41, baseline=1.60.0-SNAPSHOT~1e93c87a84
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.193 ms) : 1182, 1205
.   : milestone, 1193,
iast (3.096 ms) : 3051, 3141
.   : milestone, 3096,
iast_FULL (5.915 ms) : 5856, 5974
.   : milestone, 5915,
iast_GLOBAL (3.493 ms) : 3444, 3542
.   : milestone, 3493,
profiling (2.191 ms) : 2172, 2211
.   : milestone, 2191,
tracing (1.787 ms) : 1771, 1802
.   : milestone, 1787,
section candidate
no_agent (1.172 ms) : 1160, 1183
.   : milestone, 1172,
iast (3.03 ms) : 2994, 3067
.   : milestone, 3030,
iast_FULL (5.774 ms) : 5717, 5831
.   : milestone, 5774,
iast_GLOBAL (3.281 ms) : 3238, 3324
.   : milestone, 3281,
profiling (1.987 ms) : 1970, 2004
.   : milestone, 1987,
tracing (1.792 ms) : 1775, 1809
.   : milestone, 1792,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.193 ms [1.182 ms, 1.205 ms] -
iast 3.096 ms [3.051 ms, 3.141 ms] 1.902 ms (159.4%)
iast_FULL 5.915 ms [5.856 ms, 5.974 ms] 4.721 ms (395.6%)
iast_GLOBAL 3.493 ms [3.444 ms, 3.542 ms] 2.299 ms (192.6%)
profiling 2.191 ms [2.172 ms, 2.211 ms] 997.721 µs (83.6%)
tracing 1.787 ms [1.771 ms, 1.802 ms] 593.133 µs (49.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.172 ms [1.16 ms, 1.183 ms] -
iast 3.03 ms [2.994 ms, 3.067 ms] 1.859 ms (158.6%)
iast_FULL 5.774 ms [5.717 ms, 5.831 ms] 4.602 ms (392.8%)
iast_GLOBAL 3.281 ms [3.238 ms, 3.324 ms] 2.109 ms (180.0%)
profiling 1.987 ms [1.97 ms, 2.004 ms] 815.648 µs (69.6%)
tracing 1.792 ms [1.775 ms, 1.809 ms] 620.345 µs (52.9%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/fix-wrap-runnable-so-error
git_commit_date 1770395081 1770395236
git_commit_sha 1e93c87 39e9e29
release_version 1.60.0-SNAPSHOT~1e93c87a84 1.60.0-SNAPSHOT~39e9e29c41
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1770397117 1770397117
ci_job_id 1406802148 1406802148
ci_pipeline_id 95023434 95023434
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-7iqlfw26 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-7iqlfw26 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~39e9e29c41, baseline=1.60.0-SNAPSHOT~1e93c87a84
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.471 ms) : 1459, 1482
.   : milestone, 1471,
appsec (2.503 ms) : 2448, 2557
.   : milestone, 2503,
iast (2.243 ms) : 2175, 2312
.   : milestone, 2243,
iast_GLOBAL (2.278 ms) : 2209, 2347
.   : milestone, 2278,
profiling (2.096 ms) : 2040, 2151
.   : milestone, 2096,
tracing (2.065 ms) : 2011, 2118
.   : milestone, 2065,
section candidate
no_agent (1.467 ms) : 1455, 1478
.   : milestone, 1467,
appsec (3.778 ms) : 3558, 3997
.   : milestone, 3778,
iast (2.245 ms) : 2177, 2314
.   : milestone, 2245,
iast_GLOBAL (2.283 ms) : 2214, 2352
.   : milestone, 2283,
profiling (2.081 ms) : 2025, 2136
.   : milestone, 2081,
tracing (2.062 ms) : 2009, 2116
.   : milestone, 2062,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.471 ms [1.459 ms, 1.482 ms] -
appsec 2.503 ms [2.448 ms, 2.557 ms] 1.032 ms (70.2%)
iast 2.243 ms [2.175 ms, 2.312 ms] 772.602 µs (52.5%)
iast_GLOBAL 2.278 ms [2.209 ms, 2.347 ms] 807.184 µs (54.9%)
profiling 2.096 ms [2.04 ms, 2.151 ms] 625.065 µs (42.5%)
tracing 2.065 ms [2.011 ms, 2.118 ms] 594.224 µs (40.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.467 ms [1.455 ms, 1.478 ms] -
appsec 3.778 ms [3.558 ms, 3.997 ms] 2.311 ms (157.6%)
iast 2.245 ms [2.177 ms, 2.314 ms] 778.817 µs (53.1%)
iast_GLOBAL 2.283 ms [2.214 ms, 2.352 ms] 816.698 µs (55.7%)
profiling 2.081 ms [2.025 ms, 2.136 ms] 614.186 µs (41.9%)
tracing 2.062 ms [2.009 ms, 2.116 ms] 595.66 µs (40.6%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~39e9e29c41, baseline=1.60.0-SNAPSHOT~1e93c87a84
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.512 s) : 15512000, 15512000
.   : milestone, 15512000,
appsec (15.136 s) : 15136000, 15136000
.   : milestone, 15136000,
iast (18.168 s) : 18168000, 18168000
.   : milestone, 18168000,
iast_GLOBAL (17.848 s) : 17848000, 17848000
.   : milestone, 17848000,
profiling (15.35 s) : 15350000, 15350000
.   : milestone, 15350000,
tracing (14.575 s) : 14575000, 14575000
.   : milestone, 14575000,
section candidate
no_agent (15.566 s) : 15566000, 15566000
.   : milestone, 15566000,
appsec (15.103 s) : 15103000, 15103000
.   : milestone, 15103000,
iast (17.797 s) : 17797000, 17797000
.   : milestone, 17797000,
iast_GLOBAL (17.753 s) : 17753000, 17753000
.   : milestone, 17753000,
profiling (15.025 s) : 15025000, 15025000
.   : milestone, 15025000,
tracing (14.835 s) : 14835000, 14835000
.   : milestone, 14835000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.512 s [15.512 s, 15.512 s] -
appsec 15.136 s [15.136 s, 15.136 s] -376.0 ms (-2.4%)
iast 18.168 s [18.168 s, 18.168 s] 2.656 s (17.1%)
iast_GLOBAL 17.848 s [17.848 s, 17.848 s] 2.336 s (15.1%)
profiling 15.35 s [15.35 s, 15.35 s] -162.0 ms (-1.0%)
tracing 14.575 s [14.575 s, 14.575 s] -937.0 ms (-6.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.566 s [15.566 s, 15.566 s] -
appsec 15.103 s [15.103 s, 15.103 s] -463.0 ms (-3.0%)
iast 17.797 s [17.797 s, 17.797 s] 2.231 s (14.3%)
iast_GLOBAL 17.753 s [17.753 s, 17.753 s] 2.187 s (14.0%)
profiling 15.025 s [15.025 s, 15.025 s] -541.0 ms (-3.5%)
tracing 14.835 s [14.835 s, 14.835 s] -731.0 ms (-4.7%)