Use component as framework tag in manual API by daniel-mohedano · Pull Request #10313 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/manual-instrumentation-framework
git_commit_date 1767720455 1767863066
git_commit_sha 92c84e2 478272c
release_version 1.59.0-SNAPSHOT~92c84e28db 1.59.0-SNAPSHOT~478272cb03
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1767864924 1767864924
ci_job_id 1335259937 1335259937
ci_pipeline_id 89624640 89624640
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-il90te4z 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-il90te4z 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 55 metrics, 9 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:petclinic:tracing:Remote Config better
[-55.316µs; -13.869µs] or [-8.611%; -2.159%]
607.830µs 642.423µs
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.59.0-SNAPSHOT~478272cb03, baseline=1.59.0-SNAPSHOT~92c84e28db

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.085 s) : 0, 1085144
Total [baseline] (10.824 s) : 0, 10823651
Agent [candidate] (1.085 s) : 0, 1084554
Total [candidate] (10.856 s) : 0, 10856307
section appsec
Agent [baseline] (1.266 s) : 0, 1265914
Total [baseline] (10.943 s) : 0, 10942704
Agent [candidate] (1.271 s) : 0, 1271267
Total [candidate] (10.982 s) : 0, 10982024
section iast
Agent [baseline] (1.234 s) : 0, 1233593
Total [baseline] (11.236 s) : 0, 11235525
Agent [candidate] (1.235 s) : 0, 1235354
Total [candidate] (11.227 s) : 0, 11227032
section profiling
Agent [baseline] (1.226 s) : 0, 1226390
Total [baseline] (10.924 s) : 0, 10923571
Agent [candidate] (1.226 s) : 0, 1225649
Total [candidate] (10.97 s) : 0, 10970264
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.085 s -
Agent appsec 1.266 s 180.77 ms (16.7%)
Agent iast 1.234 s 148.449 ms (13.7%)
Agent profiling 1.226 s 141.245 ms (13.0%)
Total tracing 10.824 s -
Total appsec 10.943 s 119.053 ms (1.1%)
Total iast 11.236 s 411.874 ms (3.8%)
Total profiling 10.924 s 99.92 ms (0.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.085 s -
Agent appsec 1.271 s 186.712 ms (17.2%)
Agent iast 1.235 s 150.8 ms (13.9%)
Agent profiling 1.226 s 141.095 ms (13.0%)
Total tracing 10.856 s -
Total appsec 10.982 s 125.717 ms (1.2%)
Total iast 11.227 s 370.725 ms (3.4%)
Total profiling 10.97 s 113.957 ms (1.0%)
gantt
    title petclinic - break down per module: candidate=1.59.0-SNAPSHOT~478272cb03, baseline=1.59.0-SNAPSHOT~92c84e28db

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.18 ms) : 0, 1180
crashtracking [candidate] (1.175 ms) : 0, 1175
BytebuddyAgent [baseline] (651.116 ms) : 0, 651116
BytebuddyAgent [candidate] (650.827 ms) : 0, 650827
GlobalTracer [baseline] (282.767 ms) : 0, 282767
GlobalTracer [candidate] (282.536 ms) : 0, 282536
AppSec [baseline] (32.55 ms) : 0, 32550
AppSec [candidate] (32.672 ms) : 0, 32672
Debugger [baseline] (67.67 ms) : 0, 67670
Debugger [candidate] (68.49 ms) : 0, 68490
Remote Config [baseline] (642.423 µs) : 0, 642
Remote Config [candidate] (607.83 µs) : 0, 608
Telemetry [baseline] (9.106 ms) : 0, 9106
Telemetry [candidate] (8.987 ms) : 0, 8987
Flare Poller [baseline] (4.625 ms) : 0, 4625
Flare Poller [candidate] (3.674 ms) : 0, 3674
section appsec
crashtracking [baseline] (1.183 ms) : 0, 1183
crashtracking [candidate] (1.185 ms) : 0, 1185
BytebuddyAgent [baseline] (691.862 ms) : 0, 691862
BytebuddyAgent [candidate] (693.785 ms) : 0, 693785
GlobalTracer [baseline] (258.548 ms) : 0, 258548
GlobalTracer [candidate] (259.741 ms) : 0, 259741
AppSec [baseline] (174.143 ms) : 0, 174143
AppSec [candidate] (173.822 ms) : 0, 173822
Debugger [baseline] (66.51 ms) : 0, 66510
Debugger [candidate] (68.403 ms) : 0, 68403
Remote Config [baseline] (757.584 µs) : 0, 758
Remote Config [candidate] (783.721 µs) : 0, 784
Telemetry [baseline] (9.317 ms) : 0, 9317
Telemetry [candidate] (9.485 ms) : 0, 9485
Flare Poller [baseline] (3.674 ms) : 0, 3674
Flare Poller [candidate] (3.83 ms) : 0, 3830
IAST [baseline] (24.518 ms) : 0, 24518
IAST [candidate] (24.849 ms) : 0, 24849
section iast
crashtracking [baseline] (1.193 ms) : 0, 1193
crashtracking [candidate] (1.199 ms) : 0, 1199
BytebuddyAgent [baseline] (798.424 ms) : 0, 798424
BytebuddyAgent [candidate] (798.426 ms) : 0, 798426
GlobalTracer [baseline] (257.57 ms) : 0, 257570
GlobalTracer [candidate] (258.288 ms) : 0, 258288
AppSec [baseline] (32.73 ms) : 0, 32730
AppSec [candidate] (33.724 ms) : 0, 33724
Debugger [baseline] (68.062 ms) : 0, 68062
Debugger [candidate] (67.592 ms) : 0, 67592
Remote Config [baseline] (590.973 µs) : 0, 591
Remote Config [candidate] (718.032 µs) : 0, 718
Telemetry [baseline] (8.639 ms) : 0, 8639
Telemetry [candidate] (8.657 ms) : 0, 8657
Flare Poller [baseline] (3.665 ms) : 0, 3665
Flare Poller [candidate] (3.647 ms) : 0, 3647
IAST [baseline] (27.154 ms) : 0, 27154
IAST [candidate] (27.364 ms) : 0, 27364
section profiling
crashtracking [baseline] (1.243 ms) : 0, 1243
crashtracking [candidate] (1.243 ms) : 0, 1243
BytebuddyAgent [baseline] (717.694 ms) : 0, 717694
BytebuddyAgent [candidate] (717.247 ms) : 0, 717247
GlobalTracer [baseline] (223.329 ms) : 0, 223329
GlobalTracer [candidate] (223.61 ms) : 0, 223610
AppSec [baseline] (32.755 ms) : 0, 32755
AppSec [candidate] (32.923 ms) : 0, 32923
Debugger [baseline] (70.028 ms) : 0, 70028
Debugger [candidate] (68.795 ms) : 0, 68795
Remote Config [baseline] (637.284 µs) : 0, 637
Remote Config [candidate] (641.874 µs) : 0, 642
Telemetry [baseline] (8.96 ms) : 0, 8960
Telemetry [candidate] (8.731 ms) : 0, 8731
Flare Poller [baseline] (3.779 ms) : 0, 3779
Flare Poller [candidate] (3.672 ms) : 0, 3672
ProfilingAgent [baseline] (96.929 ms) : 0, 96929
ProfilingAgent [candidate] (97.725 ms) : 0, 97725
Profiling [baseline] (97.519 ms) : 0, 97519
Profiling [candidate] (98.304 ms) : 0, 98304
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.59.0-SNAPSHOT~478272cb03, baseline=1.59.0-SNAPSHOT~92c84e28db

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.083 s) : 0, 1083120
Total [baseline] (8.785 s) : 0, 8785258
Agent [candidate] (1.087 s) : 0, 1086996
Total [candidate] (8.742 s) : 0, 8741749
section iast
Agent [baseline] (1.224 s) : 0, 1223907
Total [baseline] (9.326 s) : 0, 9326123
Agent [candidate] (1.221 s) : 0, 1220936
Total [candidate] (9.365 s) : 0, 9365464
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.083 s -
Agent iast 1.224 s 140.787 ms (13.0%)
Total tracing 8.785 s -
Total iast 9.326 s 540.865 ms (6.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.087 s -
Agent iast 1.221 s 133.94 ms (12.3%)
Total tracing 8.742 s -
Total iast 9.365 s 623.715 ms (7.1%)
gantt
    title insecure-bank - break down per module: candidate=1.59.0-SNAPSHOT~478272cb03, baseline=1.59.0-SNAPSHOT~92c84e28db

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.199 ms) : 0, 1199
crashtracking [candidate] (1.192 ms) : 0, 1192
BytebuddyAgent [baseline] (651.172 ms) : 0, 651172
BytebuddyAgent [candidate] (652.846 ms) : 0, 652846
GlobalTracer [baseline] (281.992 ms) : 0, 281992
GlobalTracer [candidate] (283.44 ms) : 0, 283440
AppSec [baseline] (32.553 ms) : 0, 32553
AppSec [candidate] (32.638 ms) : 0, 32638
Debugger [baseline] (67.516 ms) : 0, 67516
Debugger [candidate] (67.832 ms) : 0, 67832
Remote Config [baseline] (633.804 µs) : 0, 634
Remote Config [candidate] (644.889 µs) : 0, 645
Telemetry [baseline] (8.927 ms) : 0, 8927
Telemetry [candidate] (9.02 ms) : 0, 9020
Flare Poller [baseline] (3.701 ms) : 0, 3701
Flare Poller [candidate] (3.816 ms) : 0, 3816
section iast
crashtracking [baseline] (1.191 ms) : 0, 1191
crashtracking [candidate] (1.195 ms) : 0, 1195
BytebuddyAgent [baseline] (792.068 ms) : 0, 792068
BytebuddyAgent [candidate] (789.116 ms) : 0, 789116
GlobalTracer [baseline] (256.217 ms) : 0, 256217
GlobalTracer [candidate] (255.223 ms) : 0, 255223
AppSec [baseline] (33.636 ms) : 0, 33636
AppSec [candidate] (34.163 ms) : 0, 34163
Debugger [baseline] (65.537 ms) : 0, 65537
Debugger [candidate] (65.777 ms) : 0, 65777
Remote Config [baseline] (591.923 µs) : 0, 592
Remote Config [candidate] (577.686 µs) : 0, 578
Telemetry [baseline] (8.48 ms) : 0, 8480
Telemetry [candidate] (8.75 ms) : 0, 8750
Flare Poller [baseline] (3.571 ms) : 0, 3571
Flare Poller [candidate] (3.665 ms) : 0, 3665
IAST [baseline] (26.942 ms) : 0, 26942
IAST [candidate] (27.02 ms) : 0, 27020
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/manual-instrumentation-framework
git_commit_date 1767720455 1767863066
git_commit_sha 92c84e2 478272c
release_version 1.59.0-SNAPSHOT~92c84e28db 1.59.0-SNAPSHOT~478272cb03
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1767865415 1767865415
ci_job_id 1335259938 1335259938
ci_pipeline_id 89624640 89624640
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-9xgt14if 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-9xgt14if 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 4 performance regressions! Performance is the same for 15 metrics, 15 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:profiling:high_load better
[-175.116µs; -61.947µs] or [-10.179%; -3.601%]
unstable
[-1099.348µs; -310.826µs] or [-21.525%; -6.086%]
unstable
[-17.750op/s; +501.688op/s] or [-0.852%; +24.075%]
1.602ms 4.402ms 2325.844op/s 1.720ms 5.107ms 2083.875op/s
scenario:load:petclinic:iast:high_load unsure
[-1019.790µs; -268.265µs] or [-5.602%; -1.474%]
better
[-2.200ms; -0.888ms] or [-7.293%; -2.943%]
unstable
[-15.715op/s; +34.277op/s] or [-6.264%; +13.663%]
17.560ms 28.628ms 260.156op/s 18.204ms 30.172ms 250.875op/s
scenario:load:petclinic:tracing:high_load worse
[+556.797µs; +1367.319µs] or [+3.239%; +7.953%]
worse
[+0.573ms; +1.808ms] or [+2.018%; +6.366%]
unstable
[-37.726op/s; +13.413op/s] or [-14.265%; +5.072%]
18.154ms 29.585ms 252.312op/s 17.192ms 28.394ms 264.469op/s
scenario:load:petclinic:no_agent:high_load worse
[+1.171ms; +2.516ms] or [+6.946%; +14.929%]
worse
[+0.982ms; +3.800ms] or [+3.457%; +13.376%]
unstable
[-52.833op/s; +1.833op/s] or [-19.593%; +0.680%]
18.696ms 30.798ms 244.156op/s 16.853ms 28.407ms 269.656op/s
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~478272cb03, baseline=1.59.0-SNAPSHOT~92c84e28db
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.299 ms) : 17127, 17472
.   : milestone, 17299,
appsec (18.63 ms) : 18442, 18819
.   : milestone, 18630,
code_origins (17.97 ms) : 17788, 18151
.   : milestone, 17970,
iast (18.602 ms) : 18412, 18791
.   : milestone, 18602,
profiling (18.625 ms) : 18440, 18809
.   : milestone, 18625,
tracing (17.643 ms) : 17471, 17815
.   : milestone, 17643,
section candidate
no_agent (19.122 ms) : 18928, 19316
.   : milestone, 19122,
appsec (18.575 ms) : 18385, 18764
.   : milestone, 18575,
code_origins (17.765 ms) : 17592, 17938
.   : milestone, 17765,
iast (17.935 ms) : 17762, 18107
.   : milestone, 17935,
profiling (18.754 ms) : 18563, 18944
.   : milestone, 18754,
tracing (18.497 ms) : 18311, 18684
.   : milestone, 18497,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.299 ms [17.127 ms, 17.472 ms] -
appsec 18.63 ms [18.442 ms, 18.819 ms] 1.331 ms (7.7%)
code_origins 17.97 ms [17.788 ms, 18.151 ms] 670.139 µs (3.9%)
iast 18.602 ms [18.412 ms, 18.791 ms] 1.302 ms (7.5%)
profiling 18.625 ms [18.44 ms, 18.809 ms] 1.325 ms (7.7%)
tracing 17.643 ms [17.471 ms, 17.815 ms] 343.474 µs (2.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.122 ms [18.928 ms, 19.316 ms] -
appsec 18.575 ms [18.385 ms, 18.764 ms] -546.825 µs (-2.9%)
code_origins 17.765 ms [17.592 ms, 17.938 ms] -1.357 ms (-7.1%)
iast 17.935 ms [17.762 ms, 18.107 ms] -1.187 ms (-6.2%)
profiling 18.754 ms [18.563 ms, 18.944 ms] -368.258 µs (-1.9%)
tracing 18.497 ms [18.311 ms, 18.684 ms] -624.511 µs (-3.3%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~478272cb03, baseline=1.59.0-SNAPSHOT~92c84e28db
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.191 ms) : 1179, 1203
.   : milestone, 1191,
iast (3.039 ms) : 3003, 3075
.   : milestone, 3039,
iast_FULL (5.877 ms) : 5818, 5936
.   : milestone, 5877,
iast_GLOBAL (3.597 ms) : 3542, 3652
.   : milestone, 3597,
profiling (2.172 ms) : 2152, 2192
.   : milestone, 2172,
tracing (1.808 ms) : 1794, 1823
.   : milestone, 1808,
section candidate
no_agent (1.189 ms) : 1177, 1201
.   : milestone, 1189,
iast (3.107 ms) : 3068, 3145
.   : milestone, 3107,
iast_FULL (5.74 ms) : 5683, 5796
.   : milestone, 5740,
iast_GLOBAL (3.59 ms) : 3534, 3647
.   : milestone, 3590,
profiling (1.939 ms) : 1923, 1956
.   : milestone, 1939,
tracing (1.825 ms) : 1809, 1841
.   : milestone, 1825,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.191 ms [1.179 ms, 1.203 ms] -
iast 3.039 ms [3.003 ms, 3.075 ms] 1.848 ms (155.2%)
iast_FULL 5.877 ms [5.818 ms, 5.936 ms] 4.686 ms (393.4%)
iast_GLOBAL 3.597 ms [3.542 ms, 3.652 ms] 2.406 ms (202.0%)
profiling 2.172 ms [2.152 ms, 2.192 ms] 980.893 µs (82.4%)
tracing 1.808 ms [1.794 ms, 1.823 ms] 617.314 µs (51.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.189 ms [1.177 ms, 1.201 ms] -
iast 3.107 ms [3.068 ms, 3.145 ms] 1.918 ms (161.3%)
iast_FULL 5.74 ms [5.683 ms, 5.796 ms] 4.55 ms (382.6%)
iast_GLOBAL 3.59 ms [3.534 ms, 3.647 ms] 2.401 ms (201.9%)
profiling 1.939 ms [1.923 ms, 1.956 ms] 750.009 µs (63.1%)
tracing 1.825 ms [1.809 ms, 1.841 ms] 635.67 µs (53.5%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/manual-instrumentation-framework
git_commit_date 1767720455 1767863066
git_commit_sha 92c84e2 478272c
release_version 1.59.0-SNAPSHOT~92c84e28db 1.59.0-SNAPSHOT~478272cb03
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1767865212 1767865212
ci_job_id 1335259940 1335259940
ci_pipeline_id 89624640 89624640
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-5j10pznh 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-5j10pznh 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:dacapo:tomcat:appsec better
[-1.421ms; -1.076ms] or [-38.180%; -28.910%]
2.473ms 3.721ms
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~478272cb03, baseline=1.59.0-SNAPSHOT~92c84e28db
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.485 ms) : 1473, 1497
.   : milestone, 1485,
appsec (3.721 ms) : 3501, 3942
.   : milestone, 3721,
iast (2.228 ms) : 2162, 2293
.   : milestone, 2228,
iast_GLOBAL (2.277 ms) : 2212, 2342
.   : milestone, 2277,
profiling (2.096 ms) : 2043, 2150
.   : milestone, 2096,
tracing (2.063 ms) : 2011, 2114
.   : milestone, 2063,
section candidate
no_agent (1.484 ms) : 1472, 1495
.   : milestone, 1484,
appsec (2.473 ms) : 2420, 2525
.   : milestone, 2473,
iast (2.222 ms) : 2157, 2287
.   : milestone, 2222,
iast_GLOBAL (2.283 ms) : 2218, 2349
.   : milestone, 2283,
profiling (2.068 ms) : 2015, 2120
.   : milestone, 2068,
tracing (2.064 ms) : 2013, 2116
.   : milestone, 2064,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.485 ms [1.473 ms, 1.497 ms] -
appsec 3.721 ms [3.501 ms, 3.942 ms] 2.236 ms (150.6%)
iast 2.228 ms [2.162 ms, 2.293 ms] 742.399 µs (50.0%)
iast_GLOBAL 2.277 ms [2.212 ms, 2.342 ms] 791.853 µs (53.3%)
profiling 2.096 ms [2.043 ms, 2.15 ms] 611.358 µs (41.2%)
tracing 2.063 ms [2.011 ms, 2.114 ms] 577.732 µs (38.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.484 ms [1.472 ms, 1.495 ms] -
appsec 2.473 ms [2.42 ms, 2.525 ms] 989.259 µs (66.7%)
iast 2.222 ms [2.157 ms, 2.287 ms] 738.025 µs (49.7%)
iast_GLOBAL 2.283 ms [2.218 ms, 2.349 ms] 799.828 µs (53.9%)
profiling 2.068 ms [2.015 ms, 2.12 ms] 583.916 µs (39.4%)
tracing 2.064 ms [2.013 ms, 2.116 ms] 580.742 µs (39.1%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~478272cb03, baseline=1.59.0-SNAPSHOT~92c84e28db
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.749 s) : 15749000, 15749000
.   : milestone, 15749000,
appsec (14.733 s) : 14733000, 14733000
.   : milestone, 14733000,
iast (18.117 s) : 18117000, 18117000
.   : milestone, 18117000,
iast_GLOBAL (18.186 s) : 18186000, 18186000
.   : milestone, 18186000,
profiling (14.614 s) : 14614000, 14614000
.   : milestone, 14614000,
tracing (14.609 s) : 14609000, 14609000
.   : milestone, 14609000,
section candidate
no_agent (15.349 s) : 15349000, 15349000
.   : milestone, 15349000,
appsec (14.361 s) : 14361000, 14361000
.   : milestone, 14361000,
iast (18.194 s) : 18194000, 18194000
.   : milestone, 18194000,
iast_GLOBAL (17.764 s) : 17764000, 17764000
.   : milestone, 17764000,
profiling (14.528 s) : 14528000, 14528000
.   : milestone, 14528000,
tracing (14.705 s) : 14705000, 14705000
.   : milestone, 14705000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.749 s [15.749 s, 15.749 s] -
appsec 14.733 s [14.733 s, 14.733 s] -1.016 s (-6.5%)
iast 18.117 s [18.117 s, 18.117 s] 2.368 s (15.0%)
iast_GLOBAL 18.186 s [18.186 s, 18.186 s] 2.437 s (15.5%)
profiling 14.614 s [14.614 s, 14.614 s] -1.135 s (-7.2%)
tracing 14.609 s [14.609 s, 14.609 s] -1.14 s (-7.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.349 s [15.349 s, 15.349 s] -
appsec 14.361 s [14.361 s, 14.361 s] -988.0 ms (-6.4%)
iast 18.194 s [18.194 s, 18.194 s] 2.845 s (18.5%)
iast_GLOBAL 17.764 s [17.764 s, 17.764 s] 2.415 s (15.7%)
profiling 14.528 s [14.528 s, 14.528 s] -821.0 ms (-5.3%)
tracing 14.705 s [14.705 s, 14.705 s] -644.0 ms (-4.2%)