Use component as framework tag in manual API by daniel-mohedano · Pull Request #10313 · DataDog/dd-trace-java
Benchmarks
Startup
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | daniel.mohedano/manual-instrumentation-framework |
| git_commit_date | 1767720455 | 1767863066 |
| git_commit_sha | 92c84e2 | 478272c |
| release_version | 1.59.0-SNAPSHOT~92c84e28db | 1.59.0-SNAPSHOT~478272cb03 |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | insecure-bank | insecure-bank |
| ci_job_date | 1767864924 | 1767864924 |
| ci_job_id | 1335259937 | 1335259937 |
| ci_pipeline_id | 89624640 | 89624640 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-0-il90te4z 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-0-il90te4z 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
| module | Agent | Agent |
| parent | None | None |
Summary
Found 1 performance improvements and 0 performance regressions! Performance is the same for 55 metrics, 9 unstable metrics.
| scenario | Δ mean execution_time | candidate mean execution_time | baseline mean execution_time |
|---|---|---|---|
| scenario:startup:petclinic:tracing:Remote Config | better [-55.316µs; -13.869µs] or [-8.611%; -2.159%] |
607.830µs | 642.423µs |
Startup time reports for petclinic
gantt
title petclinic - global startup overhead: candidate=1.59.0-SNAPSHOT~478272cb03, baseline=1.59.0-SNAPSHOT~92c84e28db
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.085 s) : 0, 1085144
Total [baseline] (10.824 s) : 0, 10823651
Agent [candidate] (1.085 s) : 0, 1084554
Total [candidate] (10.856 s) : 0, 10856307
section appsec
Agent [baseline] (1.266 s) : 0, 1265914
Total [baseline] (10.943 s) : 0, 10942704
Agent [candidate] (1.271 s) : 0, 1271267
Total [candidate] (10.982 s) : 0, 10982024
section iast
Agent [baseline] (1.234 s) : 0, 1233593
Total [baseline] (11.236 s) : 0, 11235525
Agent [candidate] (1.235 s) : 0, 1235354
Total [candidate] (11.227 s) : 0, 11227032
section profiling
Agent [baseline] (1.226 s) : 0, 1226390
Total [baseline] (10.924 s) : 0, 10923571
Agent [candidate] (1.226 s) : 0, 1225649
Total [candidate] (10.97 s) : 0, 10970264
- baseline results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.085 s | - |
| Agent | appsec | 1.266 s | 180.77 ms (16.7%) |
| Agent | iast | 1.234 s | 148.449 ms (13.7%) |
| Agent | profiling | 1.226 s | 141.245 ms (13.0%) |
| Total | tracing | 10.824 s | - |
| Total | appsec | 10.943 s | 119.053 ms (1.1%) |
| Total | iast | 11.236 s | 411.874 ms (3.8%) |
| Total | profiling | 10.924 s | 99.92 ms (0.9%) |
- candidate results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.085 s | - |
| Agent | appsec | 1.271 s | 186.712 ms (17.2%) |
| Agent | iast | 1.235 s | 150.8 ms (13.9%) |
| Agent | profiling | 1.226 s | 141.095 ms (13.0%) |
| Total | tracing | 10.856 s | - |
| Total | appsec | 10.982 s | 125.717 ms (1.2%) |
| Total | iast | 11.227 s | 370.725 ms (3.4%) |
| Total | profiling | 10.97 s | 113.957 ms (1.0%) |
gantt
title petclinic - break down per module: candidate=1.59.0-SNAPSHOT~478272cb03, baseline=1.59.0-SNAPSHOT~92c84e28db
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.18 ms) : 0, 1180
crashtracking [candidate] (1.175 ms) : 0, 1175
BytebuddyAgent [baseline] (651.116 ms) : 0, 651116
BytebuddyAgent [candidate] (650.827 ms) : 0, 650827
GlobalTracer [baseline] (282.767 ms) : 0, 282767
GlobalTracer [candidate] (282.536 ms) : 0, 282536
AppSec [baseline] (32.55 ms) : 0, 32550
AppSec [candidate] (32.672 ms) : 0, 32672
Debugger [baseline] (67.67 ms) : 0, 67670
Debugger [candidate] (68.49 ms) : 0, 68490
Remote Config [baseline] (642.423 µs) : 0, 642
Remote Config [candidate] (607.83 µs) : 0, 608
Telemetry [baseline] (9.106 ms) : 0, 9106
Telemetry [candidate] (8.987 ms) : 0, 8987
Flare Poller [baseline] (4.625 ms) : 0, 4625
Flare Poller [candidate] (3.674 ms) : 0, 3674
section appsec
crashtracking [baseline] (1.183 ms) : 0, 1183
crashtracking [candidate] (1.185 ms) : 0, 1185
BytebuddyAgent [baseline] (691.862 ms) : 0, 691862
BytebuddyAgent [candidate] (693.785 ms) : 0, 693785
GlobalTracer [baseline] (258.548 ms) : 0, 258548
GlobalTracer [candidate] (259.741 ms) : 0, 259741
AppSec [baseline] (174.143 ms) : 0, 174143
AppSec [candidate] (173.822 ms) : 0, 173822
Debugger [baseline] (66.51 ms) : 0, 66510
Debugger [candidate] (68.403 ms) : 0, 68403
Remote Config [baseline] (757.584 µs) : 0, 758
Remote Config [candidate] (783.721 µs) : 0, 784
Telemetry [baseline] (9.317 ms) : 0, 9317
Telemetry [candidate] (9.485 ms) : 0, 9485
Flare Poller [baseline] (3.674 ms) : 0, 3674
Flare Poller [candidate] (3.83 ms) : 0, 3830
IAST [baseline] (24.518 ms) : 0, 24518
IAST [candidate] (24.849 ms) : 0, 24849
section iast
crashtracking [baseline] (1.193 ms) : 0, 1193
crashtracking [candidate] (1.199 ms) : 0, 1199
BytebuddyAgent [baseline] (798.424 ms) : 0, 798424
BytebuddyAgent [candidate] (798.426 ms) : 0, 798426
GlobalTracer [baseline] (257.57 ms) : 0, 257570
GlobalTracer [candidate] (258.288 ms) : 0, 258288
AppSec [baseline] (32.73 ms) : 0, 32730
AppSec [candidate] (33.724 ms) : 0, 33724
Debugger [baseline] (68.062 ms) : 0, 68062
Debugger [candidate] (67.592 ms) : 0, 67592
Remote Config [baseline] (590.973 µs) : 0, 591
Remote Config [candidate] (718.032 µs) : 0, 718
Telemetry [baseline] (8.639 ms) : 0, 8639
Telemetry [candidate] (8.657 ms) : 0, 8657
Flare Poller [baseline] (3.665 ms) : 0, 3665
Flare Poller [candidate] (3.647 ms) : 0, 3647
IAST [baseline] (27.154 ms) : 0, 27154
IAST [candidate] (27.364 ms) : 0, 27364
section profiling
crashtracking [baseline] (1.243 ms) : 0, 1243
crashtracking [candidate] (1.243 ms) : 0, 1243
BytebuddyAgent [baseline] (717.694 ms) : 0, 717694
BytebuddyAgent [candidate] (717.247 ms) : 0, 717247
GlobalTracer [baseline] (223.329 ms) : 0, 223329
GlobalTracer [candidate] (223.61 ms) : 0, 223610
AppSec [baseline] (32.755 ms) : 0, 32755
AppSec [candidate] (32.923 ms) : 0, 32923
Debugger [baseline] (70.028 ms) : 0, 70028
Debugger [candidate] (68.795 ms) : 0, 68795
Remote Config [baseline] (637.284 µs) : 0, 637
Remote Config [candidate] (641.874 µs) : 0, 642
Telemetry [baseline] (8.96 ms) : 0, 8960
Telemetry [candidate] (8.731 ms) : 0, 8731
Flare Poller [baseline] (3.779 ms) : 0, 3779
Flare Poller [candidate] (3.672 ms) : 0, 3672
ProfilingAgent [baseline] (96.929 ms) : 0, 96929
ProfilingAgent [candidate] (97.725 ms) : 0, 97725
Profiling [baseline] (97.519 ms) : 0, 97519
Profiling [candidate] (98.304 ms) : 0, 98304
Startup time reports for insecure-bank
gantt
title insecure-bank - global startup overhead: candidate=1.59.0-SNAPSHOT~478272cb03, baseline=1.59.0-SNAPSHOT~92c84e28db
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.083 s) : 0, 1083120
Total [baseline] (8.785 s) : 0, 8785258
Agent [candidate] (1.087 s) : 0, 1086996
Total [candidate] (8.742 s) : 0, 8741749
section iast
Agent [baseline] (1.224 s) : 0, 1223907
Total [baseline] (9.326 s) : 0, 9326123
Agent [candidate] (1.221 s) : 0, 1220936
Total [candidate] (9.365 s) : 0, 9365464
- baseline results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.083 s | - |
| Agent | iast | 1.224 s | 140.787 ms (13.0%) |
| Total | tracing | 8.785 s | - |
| Total | iast | 9.326 s | 540.865 ms (6.2%) |
- candidate results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.087 s | - |
| Agent | iast | 1.221 s | 133.94 ms (12.3%) |
| Total | tracing | 8.742 s | - |
| Total | iast | 9.365 s | 623.715 ms (7.1%) |
gantt
title insecure-bank - break down per module: candidate=1.59.0-SNAPSHOT~478272cb03, baseline=1.59.0-SNAPSHOT~92c84e28db
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.199 ms) : 0, 1199
crashtracking [candidate] (1.192 ms) : 0, 1192
BytebuddyAgent [baseline] (651.172 ms) : 0, 651172
BytebuddyAgent [candidate] (652.846 ms) : 0, 652846
GlobalTracer [baseline] (281.992 ms) : 0, 281992
GlobalTracer [candidate] (283.44 ms) : 0, 283440
AppSec [baseline] (32.553 ms) : 0, 32553
AppSec [candidate] (32.638 ms) : 0, 32638
Debugger [baseline] (67.516 ms) : 0, 67516
Debugger [candidate] (67.832 ms) : 0, 67832
Remote Config [baseline] (633.804 µs) : 0, 634
Remote Config [candidate] (644.889 µs) : 0, 645
Telemetry [baseline] (8.927 ms) : 0, 8927
Telemetry [candidate] (9.02 ms) : 0, 9020
Flare Poller [baseline] (3.701 ms) : 0, 3701
Flare Poller [candidate] (3.816 ms) : 0, 3816
section iast
crashtracking [baseline] (1.191 ms) : 0, 1191
crashtracking [candidate] (1.195 ms) : 0, 1195
BytebuddyAgent [baseline] (792.068 ms) : 0, 792068
BytebuddyAgent [candidate] (789.116 ms) : 0, 789116
GlobalTracer [baseline] (256.217 ms) : 0, 256217
GlobalTracer [candidate] (255.223 ms) : 0, 255223
AppSec [baseline] (33.636 ms) : 0, 33636
AppSec [candidate] (34.163 ms) : 0, 34163
Debugger [baseline] (65.537 ms) : 0, 65537
Debugger [candidate] (65.777 ms) : 0, 65777
Remote Config [baseline] (591.923 µs) : 0, 592
Remote Config [candidate] (577.686 µs) : 0, 578
Telemetry [baseline] (8.48 ms) : 0, 8480
Telemetry [candidate] (8.75 ms) : 0, 8750
Flare Poller [baseline] (3.571 ms) : 0, 3571
Flare Poller [candidate] (3.665 ms) : 0, 3665
IAST [baseline] (26.942 ms) : 0, 26942
IAST [candidate] (27.02 ms) : 0, 27020
Load
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | daniel.mohedano/manual-instrumentation-framework |
| git_commit_date | 1767720455 | 1767863066 |
| git_commit_sha | 92c84e2 | 478272c |
| release_version | 1.59.0-SNAPSHOT~92c84e28db | 1.59.0-SNAPSHOT~478272cb03 |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | insecure-bank | insecure-bank |
| ci_job_date | 1767865415 | 1767865415 |
| ci_job_id | 1335259938 | 1335259938 |
| ci_pipeline_id | 89624640 | 89624640 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-0-9xgt14if 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-0-9xgt14if 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
Summary
Found 2 performance improvements and 4 performance regressions! Performance is the same for 15 metrics, 15 unstable metrics.
| scenario | Δ mean agg_http_req_duration_p50 | Δ mean agg_http_req_duration_p95 | Δ mean throughput | candidate mean agg_http_req_duration_p50 | candidate mean agg_http_req_duration_p95 | candidate mean throughput | baseline mean agg_http_req_duration_p50 | baseline mean agg_http_req_duration_p95 | baseline mean throughput |
|---|---|---|---|---|---|---|---|---|---|
| scenario:load:insecure-bank:profiling:high_load | better [-175.116µs; -61.947µs] or [-10.179%; -3.601%] |
unstable [-1099.348µs; -310.826µs] or [-21.525%; -6.086%] |
unstable [-17.750op/s; +501.688op/s] or [-0.852%; +24.075%] |
1.602ms | 4.402ms | 2325.844op/s | 1.720ms | 5.107ms | 2083.875op/s |
| scenario:load:petclinic:iast:high_load | unsure [-1019.790µs; -268.265µs] or [-5.602%; -1.474%] |
better [-2.200ms; -0.888ms] or [-7.293%; -2.943%] |
unstable [-15.715op/s; +34.277op/s] or [-6.264%; +13.663%] |
17.560ms | 28.628ms | 260.156op/s | 18.204ms | 30.172ms | 250.875op/s |
| scenario:load:petclinic:tracing:high_load | worse [+556.797µs; +1367.319µs] or [+3.239%; +7.953%] |
worse [+0.573ms; +1.808ms] or [+2.018%; +6.366%] |
unstable [-37.726op/s; +13.413op/s] or [-14.265%; +5.072%] |
18.154ms | 29.585ms | 252.312op/s | 17.192ms | 28.394ms | 264.469op/s |
| scenario:load:petclinic:no_agent:high_load | worse [+1.171ms; +2.516ms] or [+6.946%; +14.929%] |
worse [+0.982ms; +3.800ms] or [+3.457%; +13.376%] |
unstable [-52.833op/s; +1.833op/s] or [-19.593%; +0.680%] |
18.696ms | 30.798ms | 244.156op/s | 16.853ms | 28.407ms | 269.656op/s |
Request duration reports for petclinic
gantt
title petclinic - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~478272cb03, baseline=1.59.0-SNAPSHOT~92c84e28db
dateFormat X
axisFormat %s
section baseline
no_agent (17.299 ms) : 17127, 17472
. : milestone, 17299,
appsec (18.63 ms) : 18442, 18819
. : milestone, 18630,
code_origins (17.97 ms) : 17788, 18151
. : milestone, 17970,
iast (18.602 ms) : 18412, 18791
. : milestone, 18602,
profiling (18.625 ms) : 18440, 18809
. : milestone, 18625,
tracing (17.643 ms) : 17471, 17815
. : milestone, 17643,
section candidate
no_agent (19.122 ms) : 18928, 19316
. : milestone, 19122,
appsec (18.575 ms) : 18385, 18764
. : milestone, 18575,
code_origins (17.765 ms) : 17592, 17938
. : milestone, 17765,
iast (17.935 ms) : 17762, 18107
. : milestone, 17935,
profiling (18.754 ms) : 18563, 18944
. : milestone, 18754,
tracing (18.497 ms) : 18311, 18684
. : milestone, 18497,
- baseline results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 17.299 ms [17.127 ms, 17.472 ms] | - |
| appsec | 18.63 ms [18.442 ms, 18.819 ms] | 1.331 ms (7.7%) |
| code_origins | 17.97 ms [17.788 ms, 18.151 ms] | 670.139 µs (3.9%) |
| iast | 18.602 ms [18.412 ms, 18.791 ms] | 1.302 ms (7.5%) |
| profiling | 18.625 ms [18.44 ms, 18.809 ms] | 1.325 ms (7.7%) |
| tracing | 17.643 ms [17.471 ms, 17.815 ms] | 343.474 µs (2.0%) |
- candidate results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 19.122 ms [18.928 ms, 19.316 ms] | - |
| appsec | 18.575 ms [18.385 ms, 18.764 ms] | -546.825 µs (-2.9%) |
| code_origins | 17.765 ms [17.592 ms, 17.938 ms] | -1.357 ms (-7.1%) |
| iast | 17.935 ms [17.762 ms, 18.107 ms] | -1.187 ms (-6.2%) |
| profiling | 18.754 ms [18.563 ms, 18.944 ms] | -368.258 µs (-1.9%) |
| tracing | 18.497 ms [18.311 ms, 18.684 ms] | -624.511 µs (-3.3%) |
Request duration reports for insecure-bank
gantt
title insecure-bank - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~478272cb03, baseline=1.59.0-SNAPSHOT~92c84e28db
dateFormat X
axisFormat %s
section baseline
no_agent (1.191 ms) : 1179, 1203
. : milestone, 1191,
iast (3.039 ms) : 3003, 3075
. : milestone, 3039,
iast_FULL (5.877 ms) : 5818, 5936
. : milestone, 5877,
iast_GLOBAL (3.597 ms) : 3542, 3652
. : milestone, 3597,
profiling (2.172 ms) : 2152, 2192
. : milestone, 2172,
tracing (1.808 ms) : 1794, 1823
. : milestone, 1808,
section candidate
no_agent (1.189 ms) : 1177, 1201
. : milestone, 1189,
iast (3.107 ms) : 3068, 3145
. : milestone, 3107,
iast_FULL (5.74 ms) : 5683, 5796
. : milestone, 5740,
iast_GLOBAL (3.59 ms) : 3534, 3647
. : milestone, 3590,
profiling (1.939 ms) : 1923, 1956
. : milestone, 1939,
tracing (1.825 ms) : 1809, 1841
. : milestone, 1825,
- baseline results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.191 ms [1.179 ms, 1.203 ms] | - |
| iast | 3.039 ms [3.003 ms, 3.075 ms] | 1.848 ms (155.2%) |
| iast_FULL | 5.877 ms [5.818 ms, 5.936 ms] | 4.686 ms (393.4%) |
| iast_GLOBAL | 3.597 ms [3.542 ms, 3.652 ms] | 2.406 ms (202.0%) |
| profiling | 2.172 ms [2.152 ms, 2.192 ms] | 980.893 µs (82.4%) |
| tracing | 1.808 ms [1.794 ms, 1.823 ms] | 617.314 µs (51.8%) |
- candidate results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.189 ms [1.177 ms, 1.201 ms] | - |
| iast | 3.107 ms [3.068 ms, 3.145 ms] | 1.918 ms (161.3%) |
| iast_FULL | 5.74 ms [5.683 ms, 5.796 ms] | 4.55 ms (382.6%) |
| iast_GLOBAL | 3.59 ms [3.534 ms, 3.647 ms] | 2.401 ms (201.9%) |
| profiling | 1.939 ms [1.923 ms, 1.956 ms] | 750.009 µs (63.1%) |
| tracing | 1.825 ms [1.809 ms, 1.841 ms] | 635.67 µs (53.5%) |
Dacapo
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | daniel.mohedano/manual-instrumentation-framework |
| git_commit_date | 1767720455 | 1767863066 |
| git_commit_sha | 92c84e2 | 478272c |
| release_version | 1.59.0-SNAPSHOT~92c84e28db | 1.59.0-SNAPSHOT~478272cb03 |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | biojava | biojava |
| ci_job_date | 1767865212 | 1767865212 |
| ci_job_id | 1335259940 | 1335259940 |
| ci_pipeline_id | 89624640 | 89624640 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-0-5j10pznh 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-0-5j10pznh 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
Summary
Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.
| scenario | Δ mean execution_time | candidate mean execution_time | baseline mean execution_time |
|---|---|---|---|
| scenario:dacapo:tomcat:appsec | better [-1.421ms; -1.076ms] or [-38.180%; -28.910%] |
2.473ms | 3.721ms |
Execution time for tomcat
gantt
title tomcat - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~478272cb03, baseline=1.59.0-SNAPSHOT~92c84e28db
dateFormat X
axisFormat %s
section baseline
no_agent (1.485 ms) : 1473, 1497
. : milestone, 1485,
appsec (3.721 ms) : 3501, 3942
. : milestone, 3721,
iast (2.228 ms) : 2162, 2293
. : milestone, 2228,
iast_GLOBAL (2.277 ms) : 2212, 2342
. : milestone, 2277,
profiling (2.096 ms) : 2043, 2150
. : milestone, 2096,
tracing (2.063 ms) : 2011, 2114
. : milestone, 2063,
section candidate
no_agent (1.484 ms) : 1472, 1495
. : milestone, 1484,
appsec (2.473 ms) : 2420, 2525
. : milestone, 2473,
iast (2.222 ms) : 2157, 2287
. : milestone, 2222,
iast_GLOBAL (2.283 ms) : 2218, 2349
. : milestone, 2283,
profiling (2.068 ms) : 2015, 2120
. : milestone, 2068,
tracing (2.064 ms) : 2013, 2116
. : milestone, 2064,
- baseline results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.485 ms [1.473 ms, 1.497 ms] | - |
| appsec | 3.721 ms [3.501 ms, 3.942 ms] | 2.236 ms (150.6%) |
| iast | 2.228 ms [2.162 ms, 2.293 ms] | 742.399 µs (50.0%) |
| iast_GLOBAL | 2.277 ms [2.212 ms, 2.342 ms] | 791.853 µs (53.3%) |
| profiling | 2.096 ms [2.043 ms, 2.15 ms] | 611.358 µs (41.2%) |
| tracing | 2.063 ms [2.011 ms, 2.114 ms] | 577.732 µs (38.9%) |
- candidate results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.484 ms [1.472 ms, 1.495 ms] | - |
| appsec | 2.473 ms [2.42 ms, 2.525 ms] | 989.259 µs (66.7%) |
| iast | 2.222 ms [2.157 ms, 2.287 ms] | 738.025 µs (49.7%) |
| iast_GLOBAL | 2.283 ms [2.218 ms, 2.349 ms] | 799.828 µs (53.9%) |
| profiling | 2.068 ms [2.015 ms, 2.12 ms] | 583.916 µs (39.4%) |
| tracing | 2.064 ms [2.013 ms, 2.116 ms] | 580.742 µs (39.1%) |
Execution time for biojava
gantt
title biojava - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~478272cb03, baseline=1.59.0-SNAPSHOT~92c84e28db
dateFormat X
axisFormat %s
section baseline
no_agent (15.749 s) : 15749000, 15749000
. : milestone, 15749000,
appsec (14.733 s) : 14733000, 14733000
. : milestone, 14733000,
iast (18.117 s) : 18117000, 18117000
. : milestone, 18117000,
iast_GLOBAL (18.186 s) : 18186000, 18186000
. : milestone, 18186000,
profiling (14.614 s) : 14614000, 14614000
. : milestone, 14614000,
tracing (14.609 s) : 14609000, 14609000
. : milestone, 14609000,
section candidate
no_agent (15.349 s) : 15349000, 15349000
. : milestone, 15349000,
appsec (14.361 s) : 14361000, 14361000
. : milestone, 14361000,
iast (18.194 s) : 18194000, 18194000
. : milestone, 18194000,
iast_GLOBAL (17.764 s) : 17764000, 17764000
. : milestone, 17764000,
profiling (14.528 s) : 14528000, 14528000
. : milestone, 14528000,
tracing (14.705 s) : 14705000, 14705000
. : milestone, 14705000,
- baseline results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 15.749 s [15.749 s, 15.749 s] | - |
| appsec | 14.733 s [14.733 s, 14.733 s] | -1.016 s (-6.5%) |
| iast | 18.117 s [18.117 s, 18.117 s] | 2.368 s (15.0%) |
| iast_GLOBAL | 18.186 s [18.186 s, 18.186 s] | 2.437 s (15.5%) |
| profiling | 14.614 s [14.614 s, 14.614 s] | -1.135 s (-7.2%) |
| tracing | 14.609 s [14.609 s, 14.609 s] | -1.14 s (-7.2%) |
- candidate results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 15.349 s [15.349 s, 15.349 s] | - |
| appsec | 14.361 s [14.361 s, 14.361 s] | -988.0 ms (-6.4%) |
| iast | 18.194 s [18.194 s, 18.194 s] | 2.845 s (18.5%) |
| iast_GLOBAL | 17.764 s [17.764 s, 17.764 s] | 2.415 s (15.7%) |
| profiling | 14.528 s [14.528 s, 14.528 s] | -821.0 ms (-5.3%) |
| tracing | 14.705 s [14.705 s, 14.705 s] | -644.0 ms (-4.2%) |