Validate path traversals in repo root by daniel-mohedano · Pull Request #10568 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/VULN-17069
git_commit_date 1770814715 1770819616
git_commit_sha 326cc38 cf6e945
release_version 1.60.0-SNAPSHOT~326cc3877f 1.60.0-SNAPSHOT~cf6e945f67
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1770826036 1770826036
ci_job_id 1417792669 1417792669
ci_pipeline_id 95844395 95844395
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-s916cf8n 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-s916cf8n 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 65 metrics, 6 unstable metrics.

Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~cf6e945f67, baseline=1.60.0-SNAPSHOT~326cc3877f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.066 s) : 0, 1066402
Total [baseline] (8.766 s) : 0, 8765751
Agent [candidate] (1.07 s) : 0, 1069714
Total [candidate] (8.76 s) : 0, 8759896
section iast
Agent [baseline] (1.236 s) : 0, 1235521
Total [baseline] (9.4 s) : 0, 9399561
Agent [candidate] (1.232 s) : 0, 1232087
Total [candidate] (9.379 s) : 0, 9378637
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.066 s -
Agent iast 1.236 s 169.119 ms (15.9%)
Total tracing 8.766 s -
Total iast 9.4 s 633.811 ms (7.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.07 s -
Agent iast 1.232 s 162.373 ms (15.2%)
Total tracing 8.76 s -
Total iast 9.379 s 618.741 ms (7.1%)
gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~cf6e945f67, baseline=1.60.0-SNAPSHOT~326cc3877f

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.176 ms) : 0, 1176
crashtracking [candidate] (1.195 ms) : 0, 1195
BytebuddyAgent [baseline] (629.455 ms) : 0, 629455
BytebuddyAgent [candidate] (633.632 ms) : 0, 633632
AgentMeter [baseline] (29.03 ms) : 0, 29030
AgentMeter [candidate] (29.032 ms) : 0, 29032
GlobalTracer [baseline] (258.208 ms) : 0, 258208
GlobalTracer [candidate] (258.206 ms) : 0, 258206
AppSec [baseline] (32.886 ms) : 0, 32886
AppSec [candidate] (32.845 ms) : 0, 32845
Debugger [baseline] (60.567 ms) : 0, 60567
Debugger [candidate] (63.482 ms) : 0, 63482
Remote Config [baseline] (626.375 µs) : 0, 626
Remote Config [candidate] (613.633 µs) : 0, 614
Telemetry [baseline] (14.516 ms) : 0, 14516
Telemetry [candidate] (9.848 ms) : 0, 9848
Flare Poller [baseline] (4.623 ms) : 0, 4623
Flare Poller [candidate] (5.349 ms) : 0, 5349
section iast
crashtracking [baseline] (1.185 ms) : 0, 1185
crashtracking [candidate] (1.174 ms) : 0, 1174
BytebuddyAgent [baseline] (799.637 ms) : 0, 799637
BytebuddyAgent [candidate] (796.26 ms) : 0, 796260
AgentMeter [baseline] (11.285 ms) : 0, 11285
AgentMeter [candidate] (11.265 ms) : 0, 11265
GlobalTracer [baseline] (248.501 ms) : 0, 248501
GlobalTracer [candidate] (248.942 ms) : 0, 248942
AppSec [baseline] (34.634 ms) : 0, 34634
AppSec [candidate] (34.78 ms) : 0, 34780
Debugger [baseline] (65.053 ms) : 0, 65053
Debugger [candidate] (64.914 ms) : 0, 64914
Remote Config [baseline] (534.853 µs) : 0, 535
Remote Config [candidate] (534.05 µs) : 0, 534
Telemetry [baseline] (8.707 ms) : 0, 8707
Telemetry [candidate] (8.674 ms) : 0, 8674
Flare Poller [baseline] (3.571 ms) : 0, 3571
Flare Poller [candidate] (3.463 ms) : 0, 3463
IAST [baseline] (26.954 ms) : 0, 26954
IAST [candidate] (26.836 ms) : 0, 26836
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~cf6e945f67, baseline=1.60.0-SNAPSHOT~326cc3877f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.074 s) : 0, 1074269
Total [baseline] (11.032 s) : 0, 11031706
Agent [candidate] (1.079 s) : 0, 1078885
Total [candidate] (10.945 s) : 0, 10944622
section appsec
Agent [baseline] (1.236 s) : 0, 1235783
Total [baseline] (10.99 s) : 0, 10989766
Agent [candidate] (1.241 s) : 0, 1240699
Total [candidate] (11.057 s) : 0, 11057106
section iast
Agent [baseline] (1.235 s) : 0, 1234604
Total [baseline] (11.141 s) : 0, 11140863
Agent [candidate] (1.244 s) : 0, 1244461
Total [candidate] (11.269 s) : 0, 11269140
section profiling
Agent [baseline] (1.2 s) : 0, 1200115
Total [baseline] (11.106 s) : 0, 11105851
Agent [candidate] (1.195 s) : 0, 1194707
Total [candidate] (10.948 s) : 0, 10948365
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.074 s -
Agent appsec 1.236 s 161.514 ms (15.0%)
Agent iast 1.235 s 160.335 ms (14.9%)
Agent profiling 1.2 s 125.846 ms (11.7%)
Total tracing 11.032 s -
Total appsec 10.99 s -41.939 ms (-0.4%)
Total iast 11.141 s 109.157 ms (1.0%)
Total profiling 11.106 s 74.145 ms (0.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.079 s -
Agent appsec 1.241 s 161.814 ms (15.0%)
Agent iast 1.244 s 165.576 ms (15.3%)
Agent profiling 1.195 s 115.822 ms (10.7%)
Total tracing 10.945 s -
Total appsec 11.057 s 112.483 ms (1.0%)
Total iast 11.269 s 324.517 ms (3.0%)
Total profiling 10.948 s 3.743 ms (0.0%)
gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~cf6e945f67, baseline=1.60.0-SNAPSHOT~326cc3877f

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.213 ms) : 0, 1213
crashtracking [candidate] (1.198 ms) : 0, 1198
BytebuddyAgent [baseline] (634.321 ms) : 0, 634321
BytebuddyAgent [candidate] (636.583 ms) : 0, 636583
AgentMeter [baseline] (29.187 ms) : 0, 29187
AgentMeter [candidate] (29.33 ms) : 0, 29330
GlobalTracer [baseline] (259.547 ms) : 0, 259547
GlobalTracer [candidate] (260.438 ms) : 0, 260438
AppSec [baseline] (32.998 ms) : 0, 32998
AppSec [candidate] (33.059 ms) : 0, 33059
Debugger [baseline] (64.088 ms) : 0, 64088
Debugger [candidate] (62.718 ms) : 0, 62718
Remote Config [baseline] (621.865 µs) : 0, 622
Remote Config [candidate] (626.683 µs) : 0, 627
Telemetry [baseline] (12.23 ms) : 0, 12230
Telemetry [candidate] (12.332 ms) : 0, 12332
Flare Poller [baseline] (4.552 ms) : 0, 4552
Flare Poller [candidate] (6.984 ms) : 0, 6984
section appsec
crashtracking [baseline] (1.182 ms) : 0, 1182
crashtracking [candidate] (1.176 ms) : 0, 1176
BytebuddyAgent [baseline] (655.878 ms) : 0, 655878
BytebuddyAgent [candidate] (659.094 ms) : 0, 659094
AgentMeter [baseline] (11.943 ms) : 0, 11943
AgentMeter [candidate] (11.973 ms) : 0, 11973
GlobalTracer [baseline] (257.463 ms) : 0, 257463
GlobalTracer [candidate] (258.781 ms) : 0, 258781
AppSec [baseline] (167.598 ms) : 0, 167598
AppSec [candidate] (167.587 ms) : 0, 167587
Debugger [baseline] (67.514 ms) : 0, 67514
Debugger [candidate] (67.252 ms) : 0, 67252
Remote Config [baseline] (655.524 µs) : 0, 656
Remote Config [candidate] (658.83 µs) : 0, 659
Telemetry [baseline] (9.641 ms) : 0, 9641
Telemetry [candidate] (9.749 ms) : 0, 9749
Flare Poller [baseline] (3.786 ms) : 0, 3786
Flare Poller [candidate] (3.807 ms) : 0, 3807
IAST [baseline] (24.923 ms) : 0, 24923
IAST [candidate] (25.32 ms) : 0, 25320
section iast
crashtracking [baseline] (1.178 ms) : 0, 1178
crashtracking [candidate] (1.186 ms) : 0, 1186
BytebuddyAgent [baseline] (798.093 ms) : 0, 798093
BytebuddyAgent [candidate] (804.302 ms) : 0, 804302
AgentMeter [baseline] (11.288 ms) : 0, 11288
AgentMeter [candidate] (11.562 ms) : 0, 11562
GlobalTracer [baseline] (248.862 ms) : 0, 248862
GlobalTracer [candidate] (250.078 ms) : 0, 250078
AppSec [baseline] (34.818 ms) : 0, 34818
AppSec [candidate] (35.142 ms) : 0, 35142
Debugger [baseline] (65.667 ms) : 0, 65667
Debugger [candidate] (66.575 ms) : 0, 66575
Remote Config [baseline] (526.727 µs) : 0, 527
Remote Config [candidate] (543.113 µs) : 0, 543
Telemetry [baseline] (8.472 ms) : 0, 8472
Telemetry [candidate] (8.706 ms) : 0, 8706
Flare Poller [baseline] (3.433 ms) : 0, 3433
Flare Poller [candidate] (3.455 ms) : 0, 3455
IAST [baseline] (26.887 ms) : 0, 26887
IAST [candidate] (27.389 ms) : 0, 27389
section profiling
ProfilingAgent [baseline] (99.393 ms) : 0, 99393
ProfilingAgent [candidate] (99.898 ms) : 0, 99898
crashtracking [baseline] (1.221 ms) : 0, 1221
crashtracking [candidate] (1.222 ms) : 0, 1222
BytebuddyAgent [baseline] (689.064 ms) : 0, 689064
BytebuddyAgent [candidate] (684.446 ms) : 0, 684446
AgentMeter [baseline] (8.707 ms) : 0, 8707
AgentMeter [candidate] (8.609 ms) : 0, 8609
GlobalTracer [baseline] (217.75 ms) : 0, 217750
GlobalTracer [candidate] (216.648 ms) : 0, 216648
AppSec [baseline] (32.802 ms) : 0, 32802
AppSec [candidate] (32.519 ms) : 0, 32519
Debugger [baseline] (67.474 ms) : 0, 67474
Debugger [candidate] (67.901 ms) : 0, 67901
Remote Config [baseline] (626.142 µs) : 0, 626
Remote Config [candidate] (633.102 µs) : 0, 633
Telemetry [baseline] (8.912 ms) : 0, 8912
Telemetry [candidate] (8.967 ms) : 0, 8967
Flare Poller [baseline] (3.785 ms) : 0, 3785
Flare Poller [candidate] (3.768 ms) : 0, 3768
Profiling [baseline] (99.964 ms) : 0, 99964
Profiling [candidate] (100.491 ms) : 0, 100491
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/VULN-17069
git_commit_date 1770814715 1770819616
git_commit_sha 326cc38 cf6e945
release_version 1.60.0-SNAPSHOT~326cc3877f 1.60.0-SNAPSHOT~cf6e945f67
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1770826627 1770826627
ci_job_id 1417792671 1417792671
ci_pipeline_id 95844395 95844395
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-j0kb059b 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-j0kb059b 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 4 performance regressions! Performance is the same for 12 metrics, 18 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast:high_load better
[-163.978µs; -66.551µs] or [-6.614%; -2.684%]
unsure
[-484.146µs; -74.483µs] or [-6.570%; -1.011%]
unstable
[-97.101op/s; +220.101op/s] or [-6.799%; +15.412%]
2.364ms 7.090ms 1489.594op/s 2.479ms 7.369ms 1428.094op/s
scenario:load:insecure-bank:iast_FULL:high_load worse
[+218.269µs; +588.151µs] or [+4.306%; +11.604%]
worse
[+311.577µs; +1062.651µs] or [+2.541%; +8.665%]
unstable
[-132.071op/s; +34.571op/s] or [-16.398%; +4.292%]
5.472ms 12.951ms 756.656op/s 5.069ms 12.264ms 805.406op/s
scenario:load:petclinic:appsec:high_load better
[-1410.326µs; -577.880µs] or [-7.304%; -2.993%]
unsure
[-2.114ms; -0.410ms] or [-6.830%; -1.325%]
unstable
[-13.193op/s; +37.443op/s] or [-5.531%; +15.697%]
18.314ms 29.689ms 250.656op/s 19.308ms 30.951ms 238.531op/s
scenario:load:petclinic:profiling:high_load worse
[+1.651ms; +2.090ms] or [+8.894%; +11.261%]
worse
[+2.482ms; +3.578ms] or [+8.341%; +12.024%]
unstable
[-46.560op/s; +1.185op/s] or [-18.791%; +0.478%]
20.430ms 32.789ms 225.094op/s 18.560ms 29.759ms 247.781op/s
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~cf6e945f67, baseline=1.60.0-SNAPSHOT~326cc3877f
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.193 ms) : 1181, 1205
.   : milestone, 1193,
iast (3.21 ms) : 3167, 3253
.   : milestone, 3210,
iast_FULL (5.74 ms) : 5683, 5798
.   : milestone, 5740,
iast_GLOBAL (3.727 ms) : 3657, 3797
.   : milestone, 3727,
profiling (2.035 ms) : 2017, 2052
.   : milestone, 2035,
tracing (1.766 ms) : 1751, 1780
.   : milestone, 1766,
section candidate
no_agent (1.192 ms) : 1180, 1204
.   : milestone, 1192,
iast (3.068 ms) : 3031, 3105
.   : milestone, 3068,
iast_FULL (6.114 ms) : 6052, 6177
.   : milestone, 6114,
iast_GLOBAL (3.633 ms) : 3570, 3695
.   : milestone, 3633,
profiling (2.172 ms) : 2151, 2192
.   : milestone, 2172,
tracing (1.761 ms) : 1746, 1776
.   : milestone, 1761,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.193 ms [1.181 ms, 1.205 ms] -
iast 3.21 ms [3.167 ms, 3.253 ms] 2.017 ms (169.0%)
iast_FULL 5.74 ms [5.683 ms, 5.798 ms] 4.547 ms (381.1%)
iast_GLOBAL 3.727 ms [3.657 ms, 3.797 ms] 2.534 ms (212.4%)
profiling 2.035 ms [2.017 ms, 2.052 ms] 841.759 µs (70.5%)
tracing 1.766 ms [1.751 ms, 1.78 ms] 572.45 µs (48.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.192 ms [1.18 ms, 1.204 ms] -
iast 3.068 ms [3.031 ms, 3.105 ms] 1.876 ms (157.5%)
iast_FULL 6.114 ms [6.052 ms, 6.177 ms] 4.923 ms (413.1%)
iast_GLOBAL 3.633 ms [3.57 ms, 3.695 ms] 2.441 ms (204.8%)
profiling 2.172 ms [2.151 ms, 2.192 ms] 980.174 µs (82.3%)
tracing 1.761 ms [1.746 ms, 1.776 ms] 569.42 µs (47.8%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~cf6e945f67, baseline=1.60.0-SNAPSHOT~326cc3877f
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.441 ms) : 17268, 17614
.   : milestone, 17441,
appsec (19.567 ms) : 19369, 19766
.   : milestone, 19567,
code_origins (17.435 ms) : 17261, 17609
.   : milestone, 17435,
iast (17.552 ms) : 17374, 17729
.   : milestone, 17552,
profiling (18.833 ms) : 18645, 19020
.   : milestone, 18833,
tracing (18.047 ms) : 17864, 18230
.   : milestone, 18047,
section candidate
no_agent (17.239 ms) : 17069, 17410
.   : milestone, 17239,
appsec (18.618 ms) : 18430, 18806
.   : milestone, 18618,
code_origins (17.72 ms) : 17542, 17898
.   : milestone, 17720,
iast (17.921 ms) : 17745, 18096
.   : milestone, 17921,
profiling (20.75 ms) : 20541, 20959
.   : milestone, 20750,
tracing (17.634 ms) : 17458, 17810
.   : milestone, 17634,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.441 ms [17.268 ms, 17.614 ms] -
appsec 19.567 ms [19.369 ms, 19.766 ms] 2.126 ms (12.2%)
code_origins 17.435 ms [17.261 ms, 17.609 ms] -6.118 µs (-0.0%)
iast 17.552 ms [17.374 ms, 17.729 ms] 110.39 µs (0.6%)
profiling 18.833 ms [18.645 ms, 19.02 ms] 1.391 ms (8.0%)
tracing 18.047 ms [17.864 ms, 18.23 ms] 605.677 µs (3.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.239 ms [17.069 ms, 17.41 ms] -
appsec 18.618 ms [18.43 ms, 18.806 ms] 1.379 ms (8.0%)
code_origins 17.72 ms [17.542 ms, 17.898 ms] 480.836 µs (2.8%)
iast 17.921 ms [17.745 ms, 18.096 ms] 681.484 µs (4.0%)
profiling 20.75 ms [20.541 ms, 20.959 ms] 3.511 ms (20.4%)
tracing 17.634 ms [17.458 ms, 17.81 ms] 394.724 µs (2.3%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/VULN-17069
git_commit_date 1770814715 1770819616
git_commit_sha 326cc38 cf6e945
release_version 1.60.0-SNAPSHOT~326cc3877f 1.60.0-SNAPSHOT~cf6e945f67
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1770826333 1770826333
ci_job_id 1417792673 1417792673
ci_pipeline_id 95844395 95844395
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-hgyc70py 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-hgyc70py 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics.

Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~cf6e945f67, baseline=1.60.0-SNAPSHOT~326cc3877f
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.477 ms) : 1465, 1489
.   : milestone, 1477,
appsec (3.771 ms) : 3552, 3991
.   : milestone, 3771,
iast (2.257 ms) : 2188, 2326
.   : milestone, 2257,
iast_GLOBAL (2.296 ms) : 2227, 2365
.   : milestone, 2296,
profiling (2.505 ms) : 2340, 2670
.   : milestone, 2505,
tracing (2.06 ms) : 2007, 2113
.   : milestone, 2060,
section candidate
no_agent (1.476 ms) : 1464, 1487
.   : milestone, 1476,
appsec (3.725 ms) : 3508, 3942
.   : milestone, 3725,
iast (2.266 ms) : 2196, 2335
.   : milestone, 2266,
iast_GLOBAL (2.289 ms) : 2219, 2358
.   : milestone, 2289,
profiling (2.08 ms) : 2026, 2135
.   : milestone, 2080,
tracing (2.055 ms) : 2001, 2108
.   : milestone, 2055,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.477 ms [1.465 ms, 1.489 ms] -
appsec 3.771 ms [3.552 ms, 3.991 ms] 2.295 ms (155.4%)
iast 2.257 ms [2.188 ms, 2.326 ms] 780.006 µs (52.8%)
iast_GLOBAL 2.296 ms [2.227 ms, 2.365 ms] 819.099 µs (55.5%)
profiling 2.505 ms [2.34 ms, 2.67 ms] 1.028 ms (69.6%)
tracing 2.06 ms [2.007 ms, 2.113 ms] 583.064 µs (39.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.464 ms, 1.487 ms] -
appsec 3.725 ms [3.508 ms, 3.942 ms] 2.249 ms (152.4%)
iast 2.266 ms [2.196 ms, 2.335 ms] 789.743 µs (53.5%)
iast_GLOBAL 2.289 ms [2.219 ms, 2.358 ms] 812.761 µs (55.1%)
profiling 2.08 ms [2.026 ms, 2.135 ms] 604.216 µs (40.9%)
tracing 2.055 ms [2.001 ms, 2.108 ms] 578.836 µs (39.2%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~cf6e945f67, baseline=1.60.0-SNAPSHOT~326cc3877f
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.218 s) : 15218000, 15218000
.   : milestone, 15218000,
appsec (15.05 s) : 15050000, 15050000
.   : milestone, 15050000,
iast (18.615 s) : 18615000, 18615000
.   : milestone, 18615000,
iast_GLOBAL (17.948 s) : 17948000, 17948000
.   : milestone, 17948000,
profiling (14.583 s) : 14583000, 14583000
.   : milestone, 14583000,
tracing (14.769 s) : 14769000, 14769000
.   : milestone, 14769000,
section candidate
no_agent (15.311 s) : 15311000, 15311000
.   : milestone, 15311000,
appsec (14.667 s) : 14667000, 14667000
.   : milestone, 14667000,
iast (18.407 s) : 18407000, 18407000
.   : milestone, 18407000,
iast_GLOBAL (17.931 s) : 17931000, 17931000
.   : milestone, 17931000,
profiling (15.074 s) : 15074000, 15074000
.   : milestone, 15074000,
tracing (15.236 s) : 15236000, 15236000
.   : milestone, 15236000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.218 s [15.218 s, 15.218 s] -
appsec 15.05 s [15.05 s, 15.05 s] -168.0 ms (-1.1%)
iast 18.615 s [18.615 s, 18.615 s] 3.397 s (22.3%)
iast_GLOBAL 17.948 s [17.948 s, 17.948 s] 2.73 s (17.9%)
profiling 14.583 s [14.583 s, 14.583 s] -635.0 ms (-4.2%)
tracing 14.769 s [14.769 s, 14.769 s] -449.0 ms (-3.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.311 s [15.311 s, 15.311 s] -
appsec 14.667 s [14.667 s, 14.667 s] -644.0 ms (-4.2%)
iast 18.407 s [18.407 s, 18.407 s] 3.096 s (20.2%)
iast_GLOBAL 17.931 s [17.931 s, 17.931 s] 2.62 s (17.1%)
profiling 15.074 s [15.074 s, 15.074 s] -237.0 ms (-1.5%)
tracing 15.236 s [15.236 s, 15.236 s] -75.0 ms (-0.5%)