Refactor execution policies by daniel-mohedano · Pull Request #10676 · DataDog/dd-trace-java
Benchmarks
Startup
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | daniel.mohedano/refactor-execution-policies |
| git_commit_date | 1772065756 | 1772095493 |
| git_commit_sha | 969d21d | 68fd45d |
| release_version | 1.60.0-SNAPSHOT~969d21d507 | 1.60.0-SNAPSHOT~68fd45d135 |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | insecure-bank | insecure-bank |
| ci_job_date | 1772097299 | 1772097299 |
| ci_job_id | 1457972781 | 1457972781 |
| ci_pipeline_id | 99083591 | 99083591 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-1-lbgb7djv 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-1-lbgb7djv 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
| module | Agent | Agent |
| parent | None | None |
Summary
Found 0 performance improvements and 0 performance regressions! Performance is the same for 62 metrics, 9 unstable metrics.
Startup time reports for petclinic
gantt
title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~68fd45d135, baseline=1.60.0-SNAPSHOT~969d21d507
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.063 s) : 0, 1063405
Total [baseline] (10.885 s) : 0, 10884998
Agent [candidate] (1.065 s) : 0, 1065280
Total [candidate] (10.963 s) : 0, 10963443
section appsec
Agent [baseline] (1.239 s) : 0, 1238966
Total [baseline] (11.057 s) : 0, 11056545
Agent [candidate] (1.239 s) : 0, 1239465
Total [candidate] (11.031 s) : 0, 11030825
section iast
Agent [baseline] (1.247 s) : 0, 1246855
Total [baseline] (11.322 s) : 0, 11322044
Agent [candidate] (1.231 s) : 0, 1230823
Total [candidate] (11.246 s) : 0, 11246249
section profiling
Agent [baseline] (1.191 s) : 0, 1191112
Total [baseline] (10.986 s) : 0, 10986255
Agent [candidate] (1.191 s) : 0, 1191448
Total [candidate] (10.937 s) : 0, 10937029
- baseline results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.063 s | - |
| Agent | appsec | 1.239 s | 175.561 ms (16.5%) |
| Agent | iast | 1.247 s | 183.449 ms (17.3%) |
| Agent | profiling | 1.191 s | 127.706 ms (12.0%) |
| Total | tracing | 10.885 s | - |
| Total | appsec | 11.057 s | 171.547 ms (1.6%) |
| Total | iast | 11.322 s | 437.046 ms (4.0%) |
| Total | profiling | 10.986 s | 101.257 ms (0.9%) |
- candidate results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.065 s | - |
| Agent | appsec | 1.239 s | 174.186 ms (16.4%) |
| Agent | iast | 1.231 s | 165.543 ms (15.5%) |
| Agent | profiling | 1.191 s | 126.168 ms (11.8%) |
| Total | tracing | 10.963 s | - |
| Total | appsec | 11.031 s | 67.382 ms (0.6%) |
| Total | iast | 11.246 s | 282.806 ms (2.6%) |
| Total | profiling | 10.937 s | -26.414 ms (-0.2%) |
gantt
title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~68fd45d135, baseline=1.60.0-SNAPSHOT~969d21d507
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.199 ms) : 0, 1199
crashtracking [candidate] (1.186 ms) : 0, 1186
BytebuddyAgent [baseline] (626.032 ms) : 0, 626032
BytebuddyAgent [candidate] (628.154 ms) : 0, 628154
AgentMeter [baseline] (29.1 ms) : 0, 29100
AgentMeter [candidate] (29.502 ms) : 0, 29502
GlobalTracer [baseline] (256.963 ms) : 0, 256963
GlobalTracer [candidate] (257.988 ms) : 0, 257988
AppSec [baseline] (33.033 ms) : 0, 33033
AppSec [candidate] (32.843 ms) : 0, 32843
Debugger [baseline] (65.109 ms) : 0, 65109
Debugger [candidate] (66.049 ms) : 0, 66049
Remote Config [baseline] (623.319 µs) : 0, 623
Remote Config [candidate] (603.895 µs) : 0, 604
Telemetry [baseline] (10.699 ms) : 0, 10699
Telemetry [candidate] (9.061 ms) : 0, 9061
Flare Poller [baseline] (4.569 ms) : 0, 4569
Flare Poller [candidate] (3.776 ms) : 0, 3776
section appsec
crashtracking [baseline] (1.184 ms) : 0, 1184
crashtracking [candidate] (1.194 ms) : 0, 1194
BytebuddyAgent [baseline] (658.343 ms) : 0, 658343
BytebuddyAgent [candidate] (658.268 ms) : 0, 658268
AgentMeter [baseline] (11.952 ms) : 0, 11952
AgentMeter [candidate] (11.95 ms) : 0, 11950
GlobalTracer [baseline] (258.017 ms) : 0, 258017
GlobalTracer [candidate] (258.576 ms) : 0, 258576
AppSec [baseline] (167.757 ms) : 0, 167757
AppSec [candidate] (167.654 ms) : 0, 167654
Debugger [baseline] (66.671 ms) : 0, 66671
Debugger [candidate] (66.903 ms) : 0, 66903
Remote Config [baseline] (658.936 µs) : 0, 659
Remote Config [candidate] (647.849 µs) : 0, 648
Telemetry [baseline] (9.431 ms) : 0, 9431
Telemetry [candidate] (9.487 ms) : 0, 9487
Flare Poller [baseline] (3.624 ms) : 0, 3624
Flare Poller [candidate] (3.634 ms) : 0, 3634
IAST [baseline] (25.329 ms) : 0, 25329
IAST [candidate] (25.155 ms) : 0, 25155
section iast
crashtracking [baseline] (1.201 ms) : 0, 1201
crashtracking [candidate] (1.184 ms) : 0, 1184
BytebuddyAgent [baseline] (807.32 ms) : 0, 807320
BytebuddyAgent [candidate] (794.863 ms) : 0, 794863
AgentMeter [baseline] (11.737 ms) : 0, 11737
AgentMeter [candidate] (11.222 ms) : 0, 11222
GlobalTracer [baseline] (249.646 ms) : 0, 249646
GlobalTracer [candidate] (247.18 ms) : 0, 247180
AppSec [baseline] (35.898 ms) : 0, 35898
AppSec [candidate] (34.711 ms) : 0, 34711
Debugger [baseline] (64.773 ms) : 0, 64773
Debugger [candidate] (65.92 ms) : 0, 65920
Remote Config [baseline] (539.425 µs) : 0, 539
Remote Config [candidate] (548.041 µs) : 0, 548
Telemetry [baseline] (8.659 ms) : 0, 8659
Telemetry [candidate] (8.752 ms) : 0, 8752
Flare Poller [baseline] (3.438 ms) : 0, 3438
Flare Poller [candidate] (3.502 ms) : 0, 3502
IAST [baseline] (27.431 ms) : 0, 27431
IAST [candidate] (26.919 ms) : 0, 26919
section profiling
crashtracking [baseline] (1.163 ms) : 0, 1163
crashtracking [candidate] (1.162 ms) : 0, 1162
BytebuddyAgent [baseline] (681.797 ms) : 0, 681797
BytebuddyAgent [candidate] (682.772 ms) : 0, 682772
AgentMeter [baseline] (8.564 ms) : 0, 8564
AgentMeter [candidate] (8.537 ms) : 0, 8537
GlobalTracer [baseline] (215.951 ms) : 0, 215951
GlobalTracer [candidate] (215.899 ms) : 0, 215899
AppSec [baseline] (32.565 ms) : 0, 32565
AppSec [candidate] (32.41 ms) : 0, 32410
Debugger [baseline] (67.308 ms) : 0, 67308
Debugger [candidate] (67.103 ms) : 0, 67103
Remote Config [baseline] (632.03 µs) : 0, 632
Remote Config [candidate] (639.165 µs) : 0, 639
Telemetry [baseline] (9.007 ms) : 0, 9007
Telemetry [candidate] (8.919 ms) : 0, 8919
Flare Poller [baseline] (3.733 ms) : 0, 3733
Flare Poller [candidate] (3.765 ms) : 0, 3765
ProfilingAgent [baseline] (99.591 ms) : 0, 99591
ProfilingAgent [candidate] (99.447 ms) : 0, 99447
Profiling [baseline] (100.17 ms) : 0, 100170
Profiling [candidate] (100.025 ms) : 0, 100025
Startup time reports for insecure-bank
gantt
title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~68fd45d135, baseline=1.60.0-SNAPSHOT~969d21d507
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.076 s) : 0, 1076070
Total [baseline] (8.785 s) : 0, 8784719
Agent [candidate] (1.066 s) : 0, 1065985
Total [candidate] (8.748 s) : 0, 8747600
section iast
Agent [baseline] (1.245 s) : 0, 1245286
Total [baseline] (9.445 s) : 0, 9444987
Agent [candidate] (1.231 s) : 0, 1230769
Total [candidate] (9.368 s) : 0, 9367828
- baseline results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.076 s | - |
| Agent | iast | 1.245 s | 169.216 ms (15.7%) |
| Total | tracing | 8.785 s | - |
| Total | iast | 9.445 s | 660.268 ms (7.5%) |
- candidate results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.066 s | - |
| Agent | iast | 1.231 s | 164.784 ms (15.5%) |
| Total | tracing | 8.748 s | - |
| Total | iast | 9.368 s | 620.228 ms (7.1%) |
gantt
title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~68fd45d135, baseline=1.60.0-SNAPSHOT~969d21d507
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.204 ms) : 0, 1204
crashtracking [candidate] (1.192 ms) : 0, 1192
BytebuddyAgent [baseline] (636.062 ms) : 0, 636062
BytebuddyAgent [candidate] (629.081 ms) : 0, 629081
AgentMeter [baseline] (29.518 ms) : 0, 29518
AgentMeter [candidate] (29.173 ms) : 0, 29173
GlobalTracer [baseline] (259.763 ms) : 0, 259763
GlobalTracer [candidate] (257.97 ms) : 0, 257970
AppSec [baseline] (33.479 ms) : 0, 33479
AppSec [candidate] (32.903 ms) : 0, 32903
Debugger [baseline] (62.925 ms) : 0, 62925
Debugger [candidate] (64.529 ms) : 0, 64529
Remote Config [baseline] (628.146 µs) : 0, 628
Remote Config [candidate] (605.641 µs) : 0, 606
Telemetry [baseline] (10.046 ms) : 0, 10046
Telemetry [candidate] (9.816 ms) : 0, 9816
Flare Poller [baseline] (6.211 ms) : 0, 6211
Flare Poller [candidate] (4.488 ms) : 0, 4488
section iast
crashtracking [baseline] (1.214 ms) : 0, 1214
crashtracking [candidate] (1.194 ms) : 0, 1194
BytebuddyAgent [baseline] (806.109 ms) : 0, 806109
BytebuddyAgent [candidate] (795.933 ms) : 0, 795933
AgentMeter [baseline] (11.555 ms) : 0, 11555
AgentMeter [candidate] (11.291 ms) : 0, 11291
GlobalTracer [baseline] (248.716 ms) : 0, 248716
GlobalTracer [candidate] (246.923 ms) : 0, 246923
AppSec [baseline] (35.138 ms) : 0, 35138
AppSec [candidate] (32.394 ms) : 0, 32394
Debugger [baseline] (65.884 ms) : 0, 65884
Debugger [candidate] (67.153 ms) : 0, 67153
Remote Config [baseline] (552.251 µs) : 0, 552
Remote Config [candidate] (535.647 µs) : 0, 536
Telemetry [baseline] (8.905 ms) : 0, 8905
Telemetry [candidate] (8.572 ms) : 0, 8572
Flare Poller [baseline] (3.531 ms) : 0, 3531
Flare Poller [candidate] (3.525 ms) : 0, 3525
IAST [baseline] (27.234 ms) : 0, 27234
IAST [candidate] (27.177 ms) : 0, 27177
Load
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | daniel.mohedano/refactor-execution-policies |
| git_commit_date | 1772065756 | 1772095493 |
| git_commit_sha | 969d21d | 68fd45d |
| release_version | 1.60.0-SNAPSHOT~969d21d507 | 1.60.0-SNAPSHOT~68fd45d135 |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | insecure-bank | insecure-bank |
| ci_job_date | 1772097796 | 1772097796 |
| ci_job_id | 1457972783 | 1457972783 |
| ci_pipeline_id | 99083591 | 99083591 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-0-1ddu6w53 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-0-1ddu6w53 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
Summary
Found 0 performance improvements and 1 performance regressions! Performance is the same for 18 metrics, 17 unstable metrics.
| scenario | Δ mean agg_http_req_duration_p50 | Δ mean agg_http_req_duration_p95 | Δ mean throughput | candidate mean agg_http_req_duration_p50 | candidate mean agg_http_req_duration_p95 | candidate mean throughput | baseline mean agg_http_req_duration_p50 | baseline mean agg_http_req_duration_p95 | baseline mean throughput |
|---|---|---|---|---|---|---|---|---|---|
| scenario:load:petclinic:appsec:high_load | worse [+0.716ms; +1.417ms] or [+3.956%; +7.832%] |
unsure [+0.513ms; +2.058ms] or [+1.738%; +6.968%] |
unstable [-36.858op/s; +8.420op/s] or [-14.541%; +3.322%] |
19.160ms | 30.812ms | 239.250op/s | 18.093ms | 29.527ms | 253.469op/s |
Request duration reports for petclinic
gantt
title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~68fd45d135, baseline=1.60.0-SNAPSHOT~969d21d507
dateFormat X
axisFormat %s
section baseline
no_agent (19.276 ms) : 19077, 19474
. : milestone, 19276,
appsec (18.41 ms) : 18223, 18597
. : milestone, 18410,
code_origins (17.675 ms) : 17497, 17853
. : milestone, 17675,
iast (17.689 ms) : 17515, 17864
. : milestone, 17689,
profiling (18.676 ms) : 18489, 18862
. : milestone, 18676,
tracing (17.571 ms) : 17397, 17745
. : milestone, 17571,
section candidate
no_agent (19.194 ms) : 18997, 19391
. : milestone, 19194,
appsec (19.514 ms) : 19319, 19710
. : milestone, 19514,
code_origins (17.408 ms) : 17235, 17580
. : milestone, 17408,
iast (17.661 ms) : 17483, 17839
. : milestone, 17661,
profiling (18.995 ms) : 18805, 19184
. : milestone, 18995,
tracing (17.586 ms) : 17411, 17761
. : milestone, 17586,
- baseline results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 19.276 ms [19.077 ms, 19.474 ms] | - |
| appsec | 18.41 ms [18.223 ms, 18.597 ms] | -865.456 µs (-4.5%) |
| code_origins | 17.675 ms [17.497 ms, 17.853 ms] | -1.601 ms (-8.3%) |
| iast | 17.689 ms [17.515 ms, 17.864 ms] | -1.586 ms (-8.2%) |
| profiling | 18.676 ms [18.489 ms, 18.862 ms] | -600.035 µs (-3.1%) |
| tracing | 17.571 ms [17.397 ms, 17.745 ms] | -1.704 ms (-8.8%) |
- candidate results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 19.194 ms [18.997 ms, 19.391 ms] | - |
| appsec | 19.514 ms [19.319 ms, 19.71 ms] | 320.157 µs (1.7%) |
| code_origins | 17.408 ms [17.235 ms, 17.58 ms] | -1.786 ms (-9.3%) |
| iast | 17.661 ms [17.483 ms, 17.839 ms] | -1.533 ms (-8.0%) |
| profiling | 18.995 ms [18.805 ms, 19.184 ms] | -199.421 µs (-1.0%) |
| tracing | 17.586 ms [17.411 ms, 17.761 ms] | -1.608 ms (-8.4%) |
Request duration reports for insecure-bank
gantt
title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~68fd45d135, baseline=1.60.0-SNAPSHOT~969d21d507
dateFormat X
axisFormat %s
section baseline
no_agent (1.183 ms) : 1172, 1195
. : milestone, 1183,
iast (3.183 ms) : 3139, 3228
. : milestone, 3183,
iast_FULL (5.902 ms) : 5843, 5962
. : milestone, 5902,
iast_GLOBAL (3.491 ms) : 3436, 3546
. : milestone, 3491,
profiling (1.95 ms) : 1931, 1968
. : milestone, 1950,
tracing (1.769 ms) : 1754, 1783
. : milestone, 1769,
section candidate
no_agent (1.244 ms) : 1232, 1256
. : milestone, 1244,
iast (3.32 ms) : 3273, 3367
. : milestone, 3320,
iast_FULL (6.122 ms) : 6059, 6184
. : milestone, 6122,
iast_GLOBAL (3.557 ms) : 3494, 3620
. : milestone, 3557,
profiling (2.091 ms) : 2071, 2111
. : milestone, 2091,
tracing (1.797 ms) : 1781, 1813
. : milestone, 1797,
- baseline results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.183 ms [1.172 ms, 1.195 ms] | - |
| iast | 3.183 ms [3.139 ms, 3.228 ms] | 2.0 ms (169.0%) |
| iast_FULL | 5.902 ms [5.843 ms, 5.962 ms] | 4.719 ms (398.8%) |
| iast_GLOBAL | 3.491 ms [3.436 ms, 3.546 ms] | 2.308 ms (195.0%) |
| profiling | 1.95 ms [1.931 ms, 1.968 ms] | 766.186 µs (64.7%) |
| tracing | 1.769 ms [1.754 ms, 1.783 ms] | 585.341 µs (49.5%) |
- candidate results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.244 ms [1.232 ms, 1.256 ms] | - |
| iast | 3.32 ms [3.273 ms, 3.367 ms] | 2.076 ms (166.9%) |
| iast_FULL | 6.122 ms [6.059 ms, 6.184 ms] | 4.878 ms (392.2%) |
| iast_GLOBAL | 3.557 ms [3.494 ms, 3.62 ms] | 2.313 ms (186.0%) |
| profiling | 2.091 ms [2.071 ms, 2.111 ms] | 847.602 µs (68.1%) |
| tracing | 1.797 ms [1.781 ms, 1.813 ms] | 553.412 µs (44.5%) |
Dacapo
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | daniel.mohedano/refactor-execution-policies |
| git_commit_date | 1772065756 | 1772095493 |
| git_commit_sha | 969d21d | 68fd45d |
| release_version | 1.60.0-SNAPSHOT~969d21d507 | 1.60.0-SNAPSHOT~68fd45d135 |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | biojava | biojava |
| ci_job_date | 1772097581 | 1772097581 |
| ci_job_id | 1457972785 | 1457972785 |
| ci_pipeline_id | 99083591 | 99083591 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-1-6tui7myh 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-1-6tui7myh 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
Summary
Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.
Execution time for tomcat
gantt
title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~68fd45d135, baseline=1.60.0-SNAPSHOT~969d21d507
dateFormat X
axisFormat %s
section baseline
no_agent (1.479 ms) : 1468, 1491
. : milestone, 1479,
appsec (3.714 ms) : 3496, 3932
. : milestone, 3714,
iast (2.263 ms) : 2194, 2332
. : milestone, 2263,
iast_GLOBAL (2.304 ms) : 2234, 2373
. : milestone, 2304,
profiling (2.081 ms) : 2026, 2135
. : milestone, 2081,
tracing (2.076 ms) : 2022, 2130
. : milestone, 2076,
section candidate
no_agent (1.475 ms) : 1464, 1487
. : milestone, 1475,
appsec (3.752 ms) : 3530, 3974
. : milestone, 3752,
iast (2.249 ms) : 2180, 2318
. : milestone, 2249,
iast_GLOBAL (2.306 ms) : 2237, 2376
. : milestone, 2306,
profiling (2.105 ms) : 2049, 2161
. : milestone, 2105,
tracing (2.065 ms) : 2012, 2119
. : milestone, 2065,
- baseline results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.479 ms [1.468 ms, 1.491 ms] | - |
| appsec | 3.714 ms [3.496 ms, 3.932 ms] | 2.235 ms (151.1%) |
| iast | 2.263 ms [2.194 ms, 2.332 ms] | 783.686 µs (53.0%) |
| iast_GLOBAL | 2.304 ms [2.234 ms, 2.373 ms] | 824.481 µs (55.7%) |
| profiling | 2.081 ms [2.026 ms, 2.135 ms] | 601.511 µs (40.7%) |
| tracing | 2.076 ms [2.022 ms, 2.13 ms] | 596.911 µs (40.4%) |
- candidate results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.475 ms [1.464 ms, 1.487 ms] | - |
| appsec | 3.752 ms [3.53 ms, 3.974 ms] | 2.277 ms (154.4%) |
| iast | 2.249 ms [2.18 ms, 2.318 ms] | 774.023 µs (52.5%) |
| iast_GLOBAL | 2.306 ms [2.237 ms, 2.376 ms] | 831.287 µs (56.4%) |
| profiling | 2.105 ms [2.049 ms, 2.161 ms] | 629.804 µs (42.7%) |
| tracing | 2.065 ms [2.012 ms, 2.119 ms] | 590.346 µs (40.0%) |
Execution time for biojava
gantt
title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~68fd45d135, baseline=1.60.0-SNAPSHOT~969d21d507
dateFormat X
axisFormat %s
section baseline
no_agent (14.984 s) : 14984000, 14984000
. : milestone, 14984000,
appsec (14.906 s) : 14906000, 14906000
. : milestone, 14906000,
iast (18.251 s) : 18251000, 18251000
. : milestone, 18251000,
iast_GLOBAL (18.002 s) : 18002000, 18002000
. : milestone, 18002000,
profiling (15.309 s) : 15309000, 15309000
. : milestone, 15309000,
tracing (14.545 s) : 14545000, 14545000
. : milestone, 14545000,
section candidate
no_agent (15.062 s) : 15062000, 15062000
. : milestone, 15062000,
appsec (14.982 s) : 14982000, 14982000
. : milestone, 14982000,
iast (18.634 s) : 18634000, 18634000
. : milestone, 18634000,
iast_GLOBAL (17.644 s) : 17644000, 17644000
. : milestone, 17644000,
profiling (15.519 s) : 15519000, 15519000
. : milestone, 15519000,
tracing (14.857 s) : 14857000, 14857000
. : milestone, 14857000,
- baseline results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 14.984 s [14.984 s, 14.984 s] | - |
| appsec | 14.906 s [14.906 s, 14.906 s] | -78.0 ms (-0.5%) |
| iast | 18.251 s [18.251 s, 18.251 s] | 3.267 s (21.8%) |
| iast_GLOBAL | 18.002 s [18.002 s, 18.002 s] | 3.018 s (20.1%) |
| profiling | 15.309 s [15.309 s, 15.309 s] | 325.0 ms (2.2%) |
| tracing | 14.545 s [14.545 s, 14.545 s] | -439.0 ms (-2.9%) |
- candidate results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 15.062 s [15.062 s, 15.062 s] | - |
| appsec | 14.982 s [14.982 s, 14.982 s] | -80.0 ms (-0.5%) |
| iast | 18.634 s [18.634 s, 18.634 s] | 3.572 s (23.7%) |
| iast_GLOBAL | 17.644 s [17.644 s, 17.644 s] | 2.582 s (17.1%) |
| profiling | 15.519 s [15.519 s, 15.519 s] | 457.0 ms (3.0%) |
| tracing | 14.857 s [14.857 s, 14.857 s] | -205.0 ms (-1.4%) |