Home Original page

Remove tibco-testing pipeline by amarziali · Pull Request #10906 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/tibco
git_commit_date 1773923179 1773929656
git_commit_sha 018d1ea 3bd5cc4
release_version 1.61.0-SNAPSHOT~018d1ea157 1.61.0-SNAPSHOT~3bd5cc480e
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1773931478 1773931478
ci_job_id 1521613379 1521613379
ci_pipeline_id 103500005 103500005
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-a4w8mj5u 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-a4w8mj5u 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 62 metrics, 9 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.61.0-SNAPSHOT~3bd5cc480e, baseline=1.61.0-SNAPSHOT~018d1ea157

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.058 s) : 0, 1058183
Total [baseline] (11.056 s) : 0, 11055538
Agent [candidate] (1.06 s) : 0, 1059560
Total [candidate] (11.071 s) : 0, 11070571
section appsec
Agent [baseline] (1.246 s) : 0, 1245663
Total [baseline] (11.185 s) : 0, 11185019
Agent [candidate] (1.25 s) : 0, 1249750
Total [candidate] (11.23 s) : 0, 11230184
section iast
Agent [baseline] (1.228 s) : 0, 1228259
Total [baseline] (11.36 s) : 0, 11359832
Agent [candidate] (1.236 s) : 0, 1236020
Total [candidate] (11.418 s) : 0, 11418171
section profiling
Agent [baseline] (1.182 s) : 0, 1181560
Total [baseline] (11.025 s) : 0, 11025178
Agent [candidate] (1.183 s) : 0, 1182695
Total [candidate] (11.014 s) : 0, 11013575
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.058 s -
Agent appsec 1.246 s 187.479 ms (17.7%)
Agent iast 1.228 s 170.076 ms (16.1%)
Agent profiling 1.182 s 123.377 ms (11.7%)
Total tracing 11.056 s -
Total appsec 11.185 s 129.482 ms (1.2%)
Total iast 11.36 s 304.294 ms (2.8%)
Total profiling 11.025 s -30.359 ms (-0.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.06 s -
Agent appsec 1.25 s 190.19 ms (17.9%)
Agent iast 1.236 s 176.46 ms (16.7%)
Agent profiling 1.183 s 123.136 ms (11.6%)
Total tracing 11.071 s -
Total appsec 11.23 s 159.613 ms (1.4%)
Total iast 11.418 s 347.599 ms (3.1%)
Total profiling 11.014 s -56.996 ms (-0.5%) 
gantt
    title petclinic - break down per module: candidate=1.61.0-SNAPSHOT~3bd5cc480e, baseline=1.61.0-SNAPSHOT~018d1ea157

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.209 ms) : 0, 1209
crashtracking [candidate] (1.204 ms) : 0, 1204
BytebuddyAgent [baseline] (630.958 ms) : 0, 630958
BytebuddyAgent [candidate] (628.492 ms) : 0, 628492
AgentMeter [baseline] (29.065 ms) : 0, 29065
AgentMeter [candidate] (29.217 ms) : 0, 29217
GlobalTracer [baseline] (256.837 ms) : 0, 256837
GlobalTracer [candidate] (258.905 ms) : 0, 258905
AppSec [baseline] (31.681 ms) : 0, 31681
AppSec [candidate] (31.922 ms) : 0, 31922
Debugger [baseline] (60.23 ms) : 0, 60230
Debugger [candidate] (60.777 ms) : 0, 60777
Remote Config [baseline] (589.056 µs) : 0, 589
Remote Config [candidate] (589.14 µs) : 0, 589
Telemetry [baseline] (7.995 ms) : 0, 7995
Telemetry [candidate] (8.032 ms) : 0, 8032
Flare Poller [baseline] (3.526 ms) : 0, 3526
Flare Poller [candidate] (4.353 ms) : 0, 4353
section appsec
crashtracking [baseline] (1.195 ms) : 0, 1195
crashtracking [candidate] (1.186 ms) : 0, 1186
BytebuddyAgent [baseline] (658.073 ms) : 0, 658073
BytebuddyAgent [candidate] (658.39 ms) : 0, 658390
AgentMeter [baseline] (11.944 ms) : 0, 11944
AgentMeter [candidate] (12.094 ms) : 0, 12094
GlobalTracer [baseline] (257.786 ms) : 0, 257786
GlobalTracer [candidate] (259.39 ms) : 0, 259390
IAST [baseline] (24.131 ms) : 0, 24131
IAST [candidate] (24.438 ms) : 0, 24438
AppSec [baseline] (177.766 ms) : 0, 177766
AppSec [candidate] (178.456 ms) : 0, 178456
Debugger [baseline] (65.066 ms) : 0, 65066
Debugger [candidate] (66.698 ms) : 0, 66698
Remote Config [baseline] (657.973 µs) : 0, 658
Remote Config [candidate] (652.067 µs) : 0, 652
Telemetry [baseline] (8.349 ms) : 0, 8349
Telemetry [candidate] (8.447 ms) : 0, 8447
Flare Poller [baseline] (4.391 ms) : 0, 4391
Flare Poller [candidate] (3.634 ms) : 0, 3634
section iast
crashtracking [baseline] (1.206 ms) : 0, 1206
crashtracking [candidate] (1.208 ms) : 0, 1208
BytebuddyAgent [baseline] (796.651 ms) : 0, 796651
BytebuddyAgent [candidate] (800.721 ms) : 0, 800721
AgentMeter [baseline] (11.323 ms) : 0, 11323
AgentMeter [candidate] (11.61 ms) : 0, 11610
GlobalTracer [baseline] (247.061 ms) : 0, 247061
GlobalTracer [candidate] (248.737 ms) : 0, 248737
IAST [baseline] (25.367 ms) : 0, 25367
IAST [candidate] (25.809 ms) : 0, 25809
AppSec [baseline] (26.561 ms) : 0, 26561
AppSec [candidate] (27.051 ms) : 0, 27051
Debugger [baseline] (70.873 ms) : 0, 70873
Debugger [candidate] (71.414 ms) : 0, 71414
Remote Config [baseline] (533.687 µs) : 0, 534
Remote Config [candidate] (537.279 µs) : 0, 537
Telemetry [baseline] (9.222 ms) : 0, 9222
Telemetry [candidate] (9.231 ms) : 0, 9231
Flare Poller [baseline] (3.33 ms) : 0, 3330
Flare Poller [candidate] (3.428 ms) : 0, 3428
section profiling
crashtracking [baseline] (1.169 ms) : 0, 1169
crashtracking [candidate] (1.19 ms) : 0, 1190
BytebuddyAgent [baseline] (682.128 ms) : 0, 682128
BytebuddyAgent [candidate] (682.568 ms) : 0, 682568
AgentMeter [baseline] (8.625 ms) : 0, 8625
AgentMeter [candidate] (8.626 ms) : 0, 8626
GlobalTracer [baseline] (215.392 ms) : 0, 215392
GlobalTracer [candidate] (216.12 ms) : 0, 216120
AppSec [baseline] (32.16 ms) : 0, 32160
AppSec [candidate] (32.242 ms) : 0, 32242
Debugger [baseline] (64.906 ms) : 0, 64906
Debugger [candidate] (64.977 ms) : 0, 64977
Remote Config [baseline] (562.069 µs) : 0, 562
Remote Config [candidate] (563.546 µs) : 0, 564
Telemetry [baseline] (7.699 ms) : 0, 7699
Telemetry [candidate] (8.582 ms) : 0, 8582
Flare Poller [baseline] (4.243 ms) : 0, 4243
Flare Poller [candidate] (3.461 ms) : 0, 3461
ProfilingAgent [baseline] (93.787 ms) : 0, 93787
ProfilingAgent [candidate] (93.558 ms) : 0, 93558
Profiling [baseline] (94.345 ms) : 0, 94345
Profiling [candidate] (94.113 ms) : 0, 94113
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.61.0-SNAPSHOT~3bd5cc480e, baseline=1.61.0-SNAPSHOT~018d1ea157

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.066 s) : 0, 1065947
Total [baseline] (8.846 s) : 0, 8846261
Agent [candidate] (1.057 s) : 0, 1057347
Total [candidate] (8.823 s) : 0, 8823160
section iast
Agent [baseline] (1.246 s) : 0, 1245921
Total [baseline] (9.58 s) : 0, 9580026
Agent [candidate] (1.238 s) : 0, 1238107
Total [candidate] (9.564 s) : 0, 9564224
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.066 s -
Agent iast 1.246 s 179.974 ms (16.9%)
Total tracing 8.846 s -
Total iast 9.58 s 733.765 ms (8.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.057 s -
Agent iast 1.238 s 180.759 ms (17.1%)
Total tracing 8.823 s -
Total iast 9.564 s 741.064 ms (8.4%) 
gantt
    title insecure-bank - break down per module: candidate=1.61.0-SNAPSHOT~3bd5cc480e, baseline=1.61.0-SNAPSHOT~018d1ea157

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.22 ms) : 0, 1220
crashtracking [candidate] (1.197 ms) : 0, 1197
BytebuddyAgent [baseline] (633.698 ms) : 0, 633698
BytebuddyAgent [candidate] (629.214 ms) : 0, 629214
AgentMeter [baseline] (29.368 ms) : 0, 29368
AgentMeter [candidate] (29.235 ms) : 0, 29235
GlobalTracer [baseline] (260.35 ms) : 0, 260350
GlobalTracer [candidate] (257.435 ms) : 0, 257435
AppSec [baseline] (32.252 ms) : 0, 32252
AppSec [candidate] (31.739 ms) : 0, 31739
Debugger [baseline] (60.434 ms) : 0, 60434
Debugger [candidate] (59.487 ms) : 0, 59487
Remote Config [baseline] (613.138 µs) : 0, 613
Remote Config [candidate] (583.639 µs) : 0, 584
Telemetry [baseline] (8.142 ms) : 0, 8142
Telemetry [candidate] (8.883 ms) : 0, 8883
Flare Poller [baseline] (3.588 ms) : 0, 3588
Flare Poller [candidate] (3.504 ms) : 0, 3504
section iast
crashtracking [baseline] (1.215 ms) : 0, 1215
crashtracking [candidate] (1.22 ms) : 0, 1220
BytebuddyAgent [baseline] (809.445 ms) : 0, 809445
BytebuddyAgent [candidate] (803.657 ms) : 0, 803657
AgentMeter [baseline] (11.687 ms) : 0, 11687
AgentMeter [candidate] (11.574 ms) : 0, 11574
GlobalTracer [baseline] (250.323 ms) : 0, 250323
GlobalTracer [candidate] (249.304 ms) : 0, 249304
IAST [baseline] (25.828 ms) : 0, 25828
IAST [candidate] (25.632 ms) : 0, 25632
AppSec [baseline] (27.066 ms) : 0, 27066
AppSec [candidate] (26.84 ms) : 0, 26840
Debugger [baseline] (69.374 ms) : 0, 69374
Debugger [candidate] (67.767 ms) : 0, 67767
Remote Config [baseline] (531.463 µs) : 0, 531
Remote Config [candidate] (533.217 µs) : 0, 533
Telemetry [baseline] (10.205 ms) : 0, 10205
Telemetry [candidate] (11.298 ms) : 0, 11298
Flare Poller [baseline] (3.693 ms) : 0, 3693
Flare Poller [candidate] (3.987 ms) : 0, 3987
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/tibco
git_commit_date 1773923179 1773929656
git_commit_sha 018d1ea 3bd5cc4
release_version 1.61.0-SNAPSHOT~018d1ea157 1.61.0-SNAPSHOT~3bd5cc480e
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1773932036 1773932036
ci_job_id 1521613383 1521613383
ci_pipeline_id 103500005 103500005
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-3-rhump3ay 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-3-rhump3ay 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 5 performance regressions! Performance is the same for 13 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast:high_load worse
[+48.806µs; +192.761µs] or [+2.026%; +8.003%]		 worse
[+176.886µs; +643.100µs] or [+2.468%; +8.972%]		 unstable
[-211.732op/s; +94.544op/s] or [-14.529%; +6.487%]		 2.529ms 7.578ms 1398.750op/s 2.409ms 7.168ms 1457.344op/s
scenario:load:insecure-bank:profiling:high_load worse
[+41.807µs; +178.630µs] or [+2.572%; +10.988%]		 unstable
[+66.228µs; +973.326µs] or [+1.430%; +21.010%]		 unstable
[-457.678op/s; +66.366op/s] or [-20.100%; +2.915%]		 1.736ms 5.152ms 2081.344op/s 1.626ms 4.633ms 2277.000op/s
scenario:load:petclinic:appsec:high_load worse
[+0.877ms; +1.455ms] or [+4.847%; +8.043%]		 worse
[+0.832ms; +1.909ms] or [+2.802%; +6.433%]		 unstable
[-39.347op/s; +10.597op/s] or [-15.589%; +4.199%]		 19.262ms 31.051ms 238.031op/s 18.096ms 29.681ms 252.406op/s
scenario:load:petclinic:code_origins:high_load better
[-1.452ms; -0.592ms] or [-7.830%; -3.192%]		 unsure
[-2.034ms; -0.476ms] or [-6.804%; -1.591%]		 unstable
[-14.958op/s; +37.895op/s] or [-6.014%; +15.236%]		 17.525ms 28.639ms 260.188op/s 18.547ms 29.894ms 248.719op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~3bd5cc480e, baseline=1.61.0-SNAPSHOT~018d1ea157
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.144 ms) : 17957, 18331
.   : milestone, 18144,
appsec (18.492 ms) : 18303, 18682
.   : milestone, 18492,
code_origins (18.763 ms) : 18575, 18950
.   : milestone, 18763,
iast (17.707 ms) : 17533, 17881
.   : milestone, 17707,
profiling (18.343 ms) : 18163, 18522
.   : milestone, 18343,
tracing (17.507 ms) : 17332, 17681
.   : milestone, 17507,
section candidate
no_agent (17.895 ms) : 17716, 18074
.   : milestone, 17895,
appsec (19.61 ms) : 19410, 19810
.   : milestone, 19610,
code_origins (17.936 ms) : 17757, 18115
.   : milestone, 17936,
iast (17.912 ms) : 17731, 18092
.   : milestone, 17912,
profiling (18.281 ms) : 18101, 18461
.   : milestone, 18281,
tracing (17.459 ms) : 17288, 17629
.   : milestone, 17459,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.144 ms [17.957 ms, 18.331 ms] -
appsec 18.492 ms [18.303 ms, 18.682 ms] 348.055 µs (1.9%)
code_origins 18.763 ms [18.575 ms, 18.95 ms] 618.367 µs (3.4%)
iast 17.707 ms [17.533 ms, 17.881 ms] -437.593 µs (-2.4%)
profiling 18.343 ms [18.163 ms, 18.522 ms] 198.442 µs (1.1%)
tracing 17.507 ms [17.332 ms, 17.681 ms] -637.708 µs (-3.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.895 ms [17.716 ms, 18.074 ms] -
appsec 19.61 ms [19.41 ms, 19.81 ms] 1.715 ms (9.6%)
code_origins 17.936 ms [17.757 ms, 18.115 ms] 41.461 µs (0.2%)
iast 17.912 ms [17.731 ms, 18.092 ms] 16.985 µs (0.1%)
profiling 18.281 ms [18.101 ms, 18.461 ms] 386.443 µs (2.2%)
tracing 17.459 ms [17.288 ms, 17.629 ms] -436.049 µs (-2.4%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~3bd5cc480e, baseline=1.61.0-SNAPSHOT~018d1ea157
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.186 ms) : 1174, 1197
.   : milestone, 1186,
iast (3.138 ms) : 3098, 3177
.   : milestone, 3138,
iast_FULL (5.754 ms) : 5697, 5811
.   : milestone, 5754,
iast_GLOBAL (3.656 ms) : 3590, 3722
.   : milestone, 3656,
profiling (1.981 ms) : 1964, 1999
.   : milestone, 1981,
tracing (1.806 ms) : 1791, 1820
.   : milestone, 1806,
section candidate
no_agent (1.196 ms) : 1184, 1208
.   : milestone, 1196,
iast (3.271 ms) : 3230, 3313
.   : milestone, 3271,
iast_FULL (5.841 ms) : 5782, 5900
.   : milestone, 5841,
iast_GLOBAL (3.668 ms) : 3611, 3725
.   : milestone, 3668,
profiling (2.174 ms) : 2154, 2194
.   : milestone, 2174,
tracing (1.867 ms) : 1851, 1883
.   : milestone, 1867,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.186 ms [1.174 ms, 1.197 ms] -
iast 3.138 ms [3.098 ms, 3.177 ms] 1.952 ms (164.6%)
iast_FULL 5.754 ms [5.697 ms, 5.811 ms] 4.568 ms (385.3%)
iast_GLOBAL 3.656 ms [3.59 ms, 3.722 ms] 2.471 ms (208.4%)
profiling 1.981 ms [1.964 ms, 1.999 ms] 795.539 µs (67.1%)
tracing 1.806 ms [1.791 ms, 1.82 ms] 620.145 µs (52.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.196 ms [1.184 ms, 1.208 ms] -
iast 3.271 ms [3.23 ms, 3.313 ms] 2.075 ms (173.5%)
iast_FULL 5.841 ms [5.782 ms, 5.9 ms] 4.645 ms (388.3%)
iast_GLOBAL 3.668 ms [3.611 ms, 3.725 ms] 2.472 ms (206.7%)
profiling 2.174 ms [2.154 ms, 2.194 ms] 977.87 µs (81.8%)
tracing 1.867 ms [1.851 ms, 1.883 ms] 670.946 µs (56.1%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/tibco
git_commit_date 1773923179 1773929656
git_commit_sha 018d1ea 3bd5cc4
release_version 1.61.0-SNAPSHOT~018d1ea157 1.61.0-SNAPSHOT~3bd5cc480e
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1773931748 1773931748
ci_job_id 1521613387 1521613387
ci_pipeline_id 103500005 103500005
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-3-1domx6vx 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-3-1domx6vx 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~3bd5cc480e, baseline=1.61.0-SNAPSHOT~018d1ea157
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.469 ms) : 1458, 1481
.   : milestone, 1469,
appsec (2.512 ms) : 2457, 2567
.   : milestone, 2512,
iast (2.252 ms) : 2183, 2321
.   : milestone, 2252,
iast_GLOBAL (2.295 ms) : 2226, 2365
.   : milestone, 2295,
profiling (2.069 ms) : 2014, 2124
.   : milestone, 2069,
tracing (2.058 ms) : 2005, 2112
.   : milestone, 2058,
section candidate
no_agent (1.47 ms) : 1459, 1482
.   : milestone, 1470,
appsec (3.807 ms) : 3584, 4030
.   : milestone, 3807,
iast (2.244 ms) : 2176, 2313
.   : milestone, 2244,
iast_GLOBAL (2.294 ms) : 2224, 2363
.   : milestone, 2294,
profiling (2.092 ms) : 2037, 2147
.   : milestone, 2092,
tracing (2.049 ms) : 1996, 2103
.   : milestone, 2049,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.469 ms [1.458 ms, 1.481 ms] -
appsec 2.512 ms [2.457 ms, 2.567 ms] 1.042 ms (70.9%)
iast 2.252 ms [2.183 ms, 2.321 ms] 782.49 µs (53.2%)
iast_GLOBAL 2.295 ms [2.226 ms, 2.365 ms] 825.84 µs (56.2%)
profiling 2.069 ms [2.014 ms, 2.124 ms] 599.495 µs (40.8%)
tracing 2.058 ms [2.005 ms, 2.112 ms] 588.911 µs (40.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.47 ms [1.459 ms, 1.482 ms] -
appsec 3.807 ms [3.584 ms, 4.03 ms] 2.337 ms (158.9%)
iast 2.244 ms [2.176 ms, 2.313 ms] 774.209 µs (52.7%)
iast_GLOBAL 2.294 ms [2.224 ms, 2.363 ms] 823.429 µs (56.0%)
profiling 2.092 ms [2.037 ms, 2.147 ms] 622.083 µs (42.3%)
tracing 2.049 ms [1.996 ms, 2.103 ms] 579.268 µs (39.4%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~3bd5cc480e, baseline=1.61.0-SNAPSHOT~018d1ea157
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.573 s) : 15573000, 15573000
.   : milestone, 15573000,
appsec (14.663 s) : 14663000, 14663000
.   : milestone, 14663000,
iast (18.597 s) : 18597000, 18597000
.   : milestone, 18597000,
iast_GLOBAL (17.882 s) : 17882000, 17882000
.   : milestone, 17882000,
profiling (15.117 s) : 15117000, 15117000
.   : milestone, 15117000,
tracing (14.864 s) : 14864000, 14864000
.   : milestone, 14864000,
section candidate
no_agent (15.352 s) : 15352000, 15352000
.   : milestone, 15352000,
appsec (14.74 s) : 14740000, 14740000
.   : milestone, 14740000,
iast (18.162 s) : 18162000, 18162000
.   : milestone, 18162000,
iast_GLOBAL (18.178 s) : 18178000, 18178000
.   : milestone, 18178000,
profiling (15.317 s) : 15317000, 15317000
.   : milestone, 15317000,
tracing (14.721 s) : 14721000, 14721000
.   : milestone, 14721000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.573 s [15.573 s, 15.573 s] -
appsec 14.663 s [14.663 s, 14.663 s] -910.0 ms (-5.8%)
iast 18.597 s [18.597 s, 18.597 s] 3.024 s (19.4%)
iast_GLOBAL 17.882 s [17.882 s, 17.882 s] 2.309 s (14.8%)
profiling 15.117 s [15.117 s, 15.117 s] -456.0 ms (-2.9%)
tracing 14.864 s [14.864 s, 14.864 s] -709.0 ms (-4.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.352 s [15.352 s, 15.352 s] -
appsec 14.74 s [14.74 s, 14.74 s] -612.0 ms (-4.0%)
iast 18.162 s [18.162 s, 18.162 s] 2.81 s (18.3%)
iast_GLOBAL 18.178 s [18.178 s, 18.178 s] 2.826 s (18.4%)
profiling 15.317 s [15.317 s, 15.317 s] -35.0 ms (-0.2%)
tracing 14.721 s [14.721 s, 14.721 s] -631.0 ms (-4.1%)