Fixed issue with recursive calls which can cause StackOverflowError. by AlexeyKuznetsov-DD · Pull Request #10535 · DataDog/dd-trace-java
Benchmarks
Startup
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | alexeyk/fix-wrap-runnable-so-error |
| git_commit_date | 1770395081 | 1770395236 |
| git_commit_sha | 1e93c87 | 39e9e29 |
| release_version | 1.60.0-SNAPSHOT~1e93c87a84 | 1.60.0-SNAPSHOT~39e9e29c41 |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | insecure-bank | insecure-bank |
| ci_job_date | 1770396904 | 1770396904 |
| ci_job_id | 1406802144 | 1406802144 |
| ci_pipeline_id | 95023434 | 95023434 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-0-j8ah3fop 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-0-j8ah3fop 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
| module | Agent | Agent |
| parent | None | None |
Summary
Found 0 performance improvements and 0 performance regressions! Performance is the same for 64 metrics, 7 unstable metrics.
Startup time reports for petclinic
gantt
title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~39e9e29c41, baseline=1.60.0-SNAPSHOT~1e93c87a84
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.065 s) : 0, 1064838
Total [baseline] (10.863 s) : 0, 10862547
Agent [candidate] (1.074 s) : 0, 1073536
Total [candidate] (10.887 s) : 0, 10886998
section appsec
Agent [baseline] (1.24 s) : 0, 1240367
Total [baseline] (10.982 s) : 0, 10981734
Agent [candidate] (1.237 s) : 0, 1237423
Total [candidate] (10.96 s) : 0, 10959997
section iast
Agent [baseline] (1.231 s) : 0, 1231412
Total [baseline] (11.213 s) : 0, 11213342
Agent [candidate] (1.232 s) : 0, 1231801
Total [candidate] (11.158 s) : 0, 11158429
section profiling
Agent [baseline] (1.189 s) : 0, 1189277
Total [baseline] (10.907 s) : 0, 10907079
Agent [candidate] (1.197 s) : 0, 1197020
Total [candidate] (11.009 s) : 0, 11009235
- baseline results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.065 s | - |
| Agent | appsec | 1.24 s | 175.528 ms (16.5%) |
| Agent | iast | 1.231 s | 166.574 ms (15.6%) |
| Agent | profiling | 1.189 s | 124.439 ms (11.7%) |
| Total | tracing | 10.863 s | - |
| Total | appsec | 10.982 s | 119.187 ms (1.1%) |
| Total | iast | 11.213 s | 350.795 ms (3.2%) |
| Total | profiling | 10.907 s | 44.532 ms (0.4%) |
- candidate results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.074 s | - |
| Agent | appsec | 1.237 s | 163.887 ms (15.3%) |
| Agent | iast | 1.232 s | 158.265 ms (14.7%) |
| Agent | profiling | 1.197 s | 123.484 ms (11.5%) |
| Total | tracing | 10.887 s | - |
| Total | appsec | 10.96 s | 72.999 ms (0.7%) |
| Total | iast | 11.158 s | 271.431 ms (2.5%) |
| Total | profiling | 11.009 s | 122.237 ms (1.1%) |
gantt
title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~39e9e29c41, baseline=1.60.0-SNAPSHOT~1e93c87a84
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.182 ms) : 0, 1182
crashtracking [candidate] (1.198 ms) : 0, 1198
BytebuddyAgent [baseline] (629.753 ms) : 0, 629753
BytebuddyAgent [candidate] (632.061 ms) : 0, 632061
AgentMeter [baseline] (28.911 ms) : 0, 28911
AgentMeter [candidate] (29.3 ms) : 0, 29300
GlobalTracer [baseline] (258.271 ms) : 0, 258271
GlobalTracer [candidate] (260.599 ms) : 0, 260599
AppSec [baseline] (32.841 ms) : 0, 32841
AppSec [candidate] (33.483 ms) : 0, 33483
Debugger [baseline] (63.422 ms) : 0, 63422
Debugger [candidate] (61.519 ms) : 0, 61519
Remote Config [baseline] (608.592 µs) : 0, 609
Remote Config [candidate] (641.159 µs) : 0, 641
Telemetry [baseline] (10.721 ms) : 0, 10721
Telemetry [candidate] (14.728 ms) : 0, 14728
Flare Poller [baseline] (3.767 ms) : 0, 3767
Flare Poller [candidate] (4.601 ms) : 0, 4601
section appsec
crashtracking [baseline] (1.18 ms) : 0, 1180
crashtracking [candidate] (1.181 ms) : 0, 1181
BytebuddyAgent [baseline] (659.386 ms) : 0, 659386
BytebuddyAgent [candidate] (657.627 ms) : 0, 657627
AgentMeter [baseline] (11.933 ms) : 0, 11933
AgentMeter [candidate] (11.919 ms) : 0, 11919
GlobalTracer [baseline] (258.865 ms) : 0, 258865
GlobalTracer [candidate] (258.19 ms) : 0, 258190
IAST [baseline] (25.268 ms) : 0, 25268
IAST [candidate] (25.224 ms) : 0, 25224
AppSec [baseline] (167.762 ms) : 0, 167762
AppSec [candidate] (167.536 ms) : 0, 167536
Debugger [baseline] (67.316 ms) : 0, 67316
Debugger [candidate] (67.045 ms) : 0, 67045
Remote Config [baseline] (671.217 µs) : 0, 671
Remote Config [candidate] (655.333 µs) : 0, 655
Telemetry [baseline] (9.103 ms) : 0, 9103
Telemetry [candidate] (9.104 ms) : 0, 9104
Flare Poller [baseline] (3.655 ms) : 0, 3655
Flare Poller [candidate] (3.642 ms) : 0, 3642
section iast
crashtracking [baseline] (1.182 ms) : 0, 1182
crashtracking [candidate] (1.203 ms) : 0, 1203
BytebuddyAgent [baseline] (795.018 ms) : 0, 795018
BytebuddyAgent [candidate] (795.466 ms) : 0, 795466
AgentMeter [baseline] (11.283 ms) : 0, 11283
AgentMeter [candidate] (11.24 ms) : 0, 11240
GlobalTracer [baseline] (248.402 ms) : 0, 248402
GlobalTracer [candidate] (248.53 ms) : 0, 248530
IAST [baseline] (26.906 ms) : 0, 26906
IAST [candidate] (26.908 ms) : 0, 26908
AppSec [baseline] (35.448 ms) : 0, 35448
AppSec [candidate] (32.069 ms) : 0, 32069
Debugger [baseline] (65.295 ms) : 0, 65295
Debugger [candidate] (68.522 ms) : 0, 68522
Remote Config [baseline] (541.916 µs) : 0, 542
Remote Config [candidate] (541.459 µs) : 0, 541
Telemetry [baseline] (8.671 ms) : 0, 8671
Telemetry [candidate] (8.634 ms) : 0, 8634
Flare Poller [baseline] (3.449 ms) : 0, 3449
Flare Poller [candidate] (3.508 ms) : 0, 3508
section profiling
crashtracking [baseline] (1.21 ms) : 0, 1210
crashtracking [candidate] (1.227 ms) : 0, 1227
BytebuddyAgent [baseline] (681.518 ms) : 0, 681518
BytebuddyAgent [candidate] (686.504 ms) : 0, 686504
AgentMeter [baseline] (8.79 ms) : 0, 8790
AgentMeter [candidate] (8.781 ms) : 0, 8781
GlobalTracer [baseline] (215.816 ms) : 0, 215816
GlobalTracer [candidate] (217.569 ms) : 0, 217569
AppSec [baseline] (32.406 ms) : 0, 32406
AppSec [candidate] (32.702 ms) : 0, 32702
Debugger [baseline] (68.102 ms) : 0, 68102
Debugger [candidate] (67.9 ms) : 0, 67900
Remote Config [baseline] (591.144 µs) : 0, 591
Remote Config [candidate] (601.073 µs) : 0, 601
Telemetry [baseline] (8.793 ms) : 0, 8793
Telemetry [candidate] (8.905 ms) : 0, 8905
Flare Poller [baseline] (3.686 ms) : 0, 3686
Flare Poller [candidate] (3.74 ms) : 0, 3740
ProfilingAgent [baseline] (98.595 ms) : 0, 98595
ProfilingAgent [candidate] (98.787 ms) : 0, 98787
Profiling [baseline] (99.163 ms) : 0, 99163
Profiling [candidate] (99.35 ms) : 0, 99350
Startup time reports for insecure-bank
gantt
title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~39e9e29c41, baseline=1.60.0-SNAPSHOT~1e93c87a84
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.076 s) : 0, 1076445
Total [baseline] (8.797 s) : 0, 8797299
Agent [candidate] (1.067 s) : 0, 1067060
Total [candidate] (8.72 s) : 0, 8719646
section iast
Agent [baseline] (1.239 s) : 0, 1239094
Total [baseline] (9.357 s) : 0, 9356657
Agent [candidate] (1.229 s) : 0, 1228915
Total [candidate] (9.371 s) : 0, 9370845
- baseline results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.076 s | - |
| Agent | iast | 1.239 s | 162.649 ms (15.1%) |
| Total | tracing | 8.797 s | - |
| Total | iast | 9.357 s | 559.359 ms (6.4%) |
- candidate results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.067 s | - |
| Agent | iast | 1.229 s | 161.855 ms (15.2%) |
| Total | tracing | 8.72 s | - |
| Total | iast | 9.371 s | 651.199 ms (7.5%) |
gantt
title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~39e9e29c41, baseline=1.60.0-SNAPSHOT~1e93c87a84
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.204 ms) : 0, 1204
crashtracking [candidate] (1.186 ms) : 0, 1186
BytebuddyAgent [baseline] (633.721 ms) : 0, 633721
BytebuddyAgent [candidate] (629.44 ms) : 0, 629440
AgentMeter [baseline] (29.408 ms) : 0, 29408
AgentMeter [candidate] (28.893 ms) : 0, 28893
GlobalTracer [baseline] (260.824 ms) : 0, 260824
GlobalTracer [candidate] (258.179 ms) : 0, 258179
AppSec [baseline] (33.478 ms) : 0, 33478
AppSec [candidate] (32.949 ms) : 0, 32949
Debugger [baseline] (63.918 ms) : 0, 63918
Debugger [candidate] (60.37 ms) : 0, 60370
Remote Config [baseline] (619.041 µs) : 0, 619
Remote Config [candidate] (617.707 µs) : 0, 618
Telemetry [baseline] (12.985 ms) : 0, 12985
Telemetry [candidate] (13.877 ms) : 0, 13877
Flare Poller [baseline] (4.646 ms) : 0, 4646
Flare Poller [candidate] (6.105 ms) : 0, 6105
section iast
crashtracking [baseline] (1.194 ms) : 0, 1194
crashtracking [candidate] (1.188 ms) : 0, 1188
BytebuddyAgent [baseline] (801.034 ms) : 0, 801034
BytebuddyAgent [candidate] (794.089 ms) : 0, 794089
AgentMeter [baseline] (11.5 ms) : 0, 11500
AgentMeter [candidate] (11.207 ms) : 0, 11207
GlobalTracer [baseline] (249.81 ms) : 0, 249810
GlobalTracer [candidate] (248.096 ms) : 0, 248096
IAST [baseline] (27.263 ms) : 0, 27263
IAST [candidate] (26.967 ms) : 0, 26967
AppSec [baseline] (34.062 ms) : 0, 34062
AppSec [candidate] (34.012 ms) : 0, 34012
Debugger [baseline] (66.076 ms) : 0, 66076
Debugger [candidate] (65.486 ms) : 0, 65486
Remote Config [baseline] (529.813 µs) : 0, 530
Remote Config [candidate] (540.13 µs) : 0, 540
Telemetry [baseline] (8.698 ms) : 0, 8698
Telemetry [candidate] (8.59 ms) : 0, 8590
Flare Poller [baseline] (3.48 ms) : 0, 3480
Flare Poller [candidate] (3.533 ms) : 0, 3533
Load
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | alexeyk/fix-wrap-runnable-so-error |
| git_commit_date | 1770395081 | 1770395236 |
| git_commit_sha | 1e93c87 | 39e9e29 |
| release_version | 1.60.0-SNAPSHOT~1e93c87a84 | 1.60.0-SNAPSHOT~39e9e29c41 |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | insecure-bank | insecure-bank |
| ci_job_date | 1770397400 | 1770397400 |
| ci_job_id | 1406802146 | 1406802146 |
| ci_pipeline_id | 95023434 | 95023434 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-0-sr0og2em 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-0-sr0og2em 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
Summary
Found 3 performance improvements and 3 performance regressions! Performance is the same for 14 metrics, 16 unstable metrics.
| scenario | Δ mean agg_http_req_duration_p50 | Δ mean agg_http_req_duration_p95 | Δ mean throughput | candidate mean agg_http_req_duration_p50 | candidate mean agg_http_req_duration_p95 | candidate mean throughput | baseline mean agg_http_req_duration_p50 | baseline mean agg_http_req_duration_p95 | baseline mean throughput |
|---|---|---|---|---|---|---|---|---|---|
| scenario:load:insecure-bank:profiling:high_load | better [-157.276µs; -34.565µs] or [-9.148%; -2.011%] |
unstable [-993.188µs; -91.515µs] or [-19.130%; -1.763%] |
unstable [-74.005op/s; +485.005op/s] or [-3.581%; +23.468%] |
1.623ms | 4.650ms | 2272.125op/s | 1.719ms | 5.192ms | 2066.625op/s |
| scenario:load:insecure-bank:iast_GLOBAL:high_load | better [-262.705µs; -151.682µs] or [-9.518%; -5.495%] |
better [-572.852µs; -202.196µs] or [-7.324%; -2.585%] |
unstable [-75.625op/s; +241.000op/s] or [-5.762%; +18.362%] |
2.553ms | 7.434ms | 1395.188op/s | 2.760ms | 7.821ms | 1312.500op/s |
| scenario:load:petclinic:tracing:high_load | worse [+492.825µs; +1180.562µs] or [+2.818%; +6.751%] |
unsure [+0.423ms; +1.735ms] or [+1.479%; +6.066%] |
unstable [-36.807op/s; +15.370op/s] or [-14.087%; +5.882%] |
18.323ms | 29.678ms | 250.562op/s | 17.487ms | 28.599ms | 261.281op/s |
| scenario:load:petclinic:code_origins:high_load | worse [+0.591ms; +1.649ms] or [+3.425%; +9.557%] |
worse [+1.215ms; +2.632ms] or [+4.317%; +9.355%] |
unstable [-43.447op/s; +10.010op/s] or [-16.370%; +3.771%] |
18.372ms | 30.057ms | 248.688op/s | 17.252ms | 28.134ms | 265.406op/s |
Request duration reports for petclinic
gantt
title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~39e9e29c41, baseline=1.60.0-SNAPSHOT~1e93c87a84
dateFormat X
axisFormat %s
section baseline
no_agent (18.041 ms) : 17860, 18222
. : milestone, 18041,
appsec (18.512 ms) : 18328, 18696
. : milestone, 18512,
code_origins (17.579 ms) : 17407, 17751
. : milestone, 17579,
iast (17.69 ms) : 17513, 17867
. : milestone, 17690,
profiling (18.554 ms) : 18370, 18738
. : milestone, 18554,
tracing (17.858 ms) : 17682, 18034
. : milestone, 17858,
section candidate
no_agent (18.433 ms) : 18244, 18623
. : milestone, 18433,
appsec (18.628 ms) : 18442, 18814
. : milestone, 18628,
code_origins (18.771 ms) : 18580, 18961
. : milestone, 18771,
iast (17.784 ms) : 17605, 17963
. : milestone, 17784,
profiling (18.489 ms) : 18302, 18676
. : milestone, 18489,
tracing (18.629 ms) : 18441, 18817
. : milestone, 18629,
- baseline results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 18.041 ms [17.86 ms, 18.222 ms] | - |
| appsec | 18.512 ms [18.328 ms, 18.696 ms] | 471.008 µs (2.6%) |
| code_origins | 17.579 ms [17.407 ms, 17.751 ms] | -462.173 µs (-2.6%) |
| iast | 17.69 ms [17.513 ms, 17.867 ms] | -351.165 µs (-1.9%) |
| profiling | 18.554 ms [18.37 ms, 18.738 ms] | 512.665 µs (2.8%) |
| tracing | 17.858 ms [17.682 ms, 18.034 ms] | -183.309 µs (-1.0%) |
- candidate results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 18.433 ms [18.244 ms, 18.623 ms] | - |
| appsec | 18.628 ms [18.442 ms, 18.814 ms] | 194.462 µs (1.1%) |
| code_origins | 18.771 ms [18.58 ms, 18.961 ms] | 337.345 µs (1.8%) |
| iast | 17.784 ms [17.605 ms, 17.963 ms] | -649.357 µs (-3.5%) |
| profiling | 18.489 ms [18.302 ms, 18.676 ms] | 55.19 µs (0.3%) |
| tracing | 18.629 ms [18.441 ms, 18.817 ms] | 195.397 µs (1.1%) |
Request duration reports for insecure-bank
gantt
title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~39e9e29c41, baseline=1.60.0-SNAPSHOT~1e93c87a84
dateFormat X
axisFormat %s
section baseline
no_agent (1.193 ms) : 1182, 1205
. : milestone, 1193,
iast (3.096 ms) : 3051, 3141
. : milestone, 3096,
iast_FULL (5.915 ms) : 5856, 5974
. : milestone, 5915,
iast_GLOBAL (3.493 ms) : 3444, 3542
. : milestone, 3493,
profiling (2.191 ms) : 2172, 2211
. : milestone, 2191,
tracing (1.787 ms) : 1771, 1802
. : milestone, 1787,
section candidate
no_agent (1.172 ms) : 1160, 1183
. : milestone, 1172,
iast (3.03 ms) : 2994, 3067
. : milestone, 3030,
iast_FULL (5.774 ms) : 5717, 5831
. : milestone, 5774,
iast_GLOBAL (3.281 ms) : 3238, 3324
. : milestone, 3281,
profiling (1.987 ms) : 1970, 2004
. : milestone, 1987,
tracing (1.792 ms) : 1775, 1809
. : milestone, 1792,
- baseline results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.193 ms [1.182 ms, 1.205 ms] | - |
| iast | 3.096 ms [3.051 ms, 3.141 ms] | 1.902 ms (159.4%) |
| iast_FULL | 5.915 ms [5.856 ms, 5.974 ms] | 4.721 ms (395.6%) |
| iast_GLOBAL | 3.493 ms [3.444 ms, 3.542 ms] | 2.299 ms (192.6%) |
| profiling | 2.191 ms [2.172 ms, 2.211 ms] | 997.721 µs (83.6%) |
| tracing | 1.787 ms [1.771 ms, 1.802 ms] | 593.133 µs (49.7%) |
- candidate results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.172 ms [1.16 ms, 1.183 ms] | - |
| iast | 3.03 ms [2.994 ms, 3.067 ms] | 1.859 ms (158.6%) |
| iast_FULL | 5.774 ms [5.717 ms, 5.831 ms] | 4.602 ms (392.8%) |
| iast_GLOBAL | 3.281 ms [3.238 ms, 3.324 ms] | 2.109 ms (180.0%) |
| profiling | 1.987 ms [1.97 ms, 2.004 ms] | 815.648 µs (69.6%) |
| tracing | 1.792 ms [1.775 ms, 1.809 ms] | 620.345 µs (52.9%) |
Dacapo
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | alexeyk/fix-wrap-runnable-so-error |
| git_commit_date | 1770395081 | 1770395236 |
| git_commit_sha | 1e93c87 | 39e9e29 |
| release_version | 1.60.0-SNAPSHOT~1e93c87a84 | 1.60.0-SNAPSHOT~39e9e29c41 |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | biojava | biojava |
| ci_job_date | 1770397117 | 1770397117 |
| ci_job_id | 1406802148 | 1406802148 |
| ci_pipeline_id | 95023434 | 95023434 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-1-7iqlfw26 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-1-7iqlfw26 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
Summary
Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.
Execution time for tomcat
gantt
title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~39e9e29c41, baseline=1.60.0-SNAPSHOT~1e93c87a84
dateFormat X
axisFormat %s
section baseline
no_agent (1.471 ms) : 1459, 1482
. : milestone, 1471,
appsec (2.503 ms) : 2448, 2557
. : milestone, 2503,
iast (2.243 ms) : 2175, 2312
. : milestone, 2243,
iast_GLOBAL (2.278 ms) : 2209, 2347
. : milestone, 2278,
profiling (2.096 ms) : 2040, 2151
. : milestone, 2096,
tracing (2.065 ms) : 2011, 2118
. : milestone, 2065,
section candidate
no_agent (1.467 ms) : 1455, 1478
. : milestone, 1467,
appsec (3.778 ms) : 3558, 3997
. : milestone, 3778,
iast (2.245 ms) : 2177, 2314
. : milestone, 2245,
iast_GLOBAL (2.283 ms) : 2214, 2352
. : milestone, 2283,
profiling (2.081 ms) : 2025, 2136
. : milestone, 2081,
tracing (2.062 ms) : 2009, 2116
. : milestone, 2062,
- baseline results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.471 ms [1.459 ms, 1.482 ms] | - |
| appsec | 2.503 ms [2.448 ms, 2.557 ms] | 1.032 ms (70.2%) |
| iast | 2.243 ms [2.175 ms, 2.312 ms] | 772.602 µs (52.5%) |
| iast_GLOBAL | 2.278 ms [2.209 ms, 2.347 ms] | 807.184 µs (54.9%) |
| profiling | 2.096 ms [2.04 ms, 2.151 ms] | 625.065 µs (42.5%) |
| tracing | 2.065 ms [2.011 ms, 2.118 ms] | 594.224 µs (40.4%) |
- candidate results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.467 ms [1.455 ms, 1.478 ms] | - |
| appsec | 3.778 ms [3.558 ms, 3.997 ms] | 2.311 ms (157.6%) |
| iast | 2.245 ms [2.177 ms, 2.314 ms] | 778.817 µs (53.1%) |
| iast_GLOBAL | 2.283 ms [2.214 ms, 2.352 ms] | 816.698 µs (55.7%) |
| profiling | 2.081 ms [2.025 ms, 2.136 ms] | 614.186 µs (41.9%) |
| tracing | 2.062 ms [2.009 ms, 2.116 ms] | 595.66 µs (40.6%) |
Execution time for biojava
gantt
title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~39e9e29c41, baseline=1.60.0-SNAPSHOT~1e93c87a84
dateFormat X
axisFormat %s
section baseline
no_agent (15.512 s) : 15512000, 15512000
. : milestone, 15512000,
appsec (15.136 s) : 15136000, 15136000
. : milestone, 15136000,
iast (18.168 s) : 18168000, 18168000
. : milestone, 18168000,
iast_GLOBAL (17.848 s) : 17848000, 17848000
. : milestone, 17848000,
profiling (15.35 s) : 15350000, 15350000
. : milestone, 15350000,
tracing (14.575 s) : 14575000, 14575000
. : milestone, 14575000,
section candidate
no_agent (15.566 s) : 15566000, 15566000
. : milestone, 15566000,
appsec (15.103 s) : 15103000, 15103000
. : milestone, 15103000,
iast (17.797 s) : 17797000, 17797000
. : milestone, 17797000,
iast_GLOBAL (17.753 s) : 17753000, 17753000
. : milestone, 17753000,
profiling (15.025 s) : 15025000, 15025000
. : milestone, 15025000,
tracing (14.835 s) : 14835000, 14835000
. : milestone, 14835000,
- baseline results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 15.512 s [15.512 s, 15.512 s] | - |
| appsec | 15.136 s [15.136 s, 15.136 s] | -376.0 ms (-2.4%) |
| iast | 18.168 s [18.168 s, 18.168 s] | 2.656 s (17.1%) |
| iast_GLOBAL | 17.848 s [17.848 s, 17.848 s] | 2.336 s (15.1%) |
| profiling | 15.35 s [15.35 s, 15.35 s] | -162.0 ms (-1.0%) |
| tracing | 14.575 s [14.575 s, 14.575 s] | -937.0 ms (-6.0%) |
- candidate results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 15.566 s [15.566 s, 15.566 s] | - |
| appsec | 15.103 s [15.103 s, 15.103 s] | -463.0 ms (-3.0%) |
| iast | 17.797 s [17.797 s, 17.797 s] | 2.231 s (14.3%) |
| iast_GLOBAL | 17.753 s [17.753 s, 17.753 s] | 2.187 s (14.0%) |
| profiling | 15.025 s [15.025 s, 15.025 s] | -541.0 ms (-3.5%) |
| tracing | 14.835 s [14.835 s, 14.835 s] | -731.0 ms (-4.7%) |