Combine dispatch span with request context in generic Servlet3 advice by mcculls · Pull Request #10557 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/servlet3-merge-ctx-with-dispatch
git_commit_date 1770571409 1770642128
git_commit_sha d10055d 54b3d90
release_version 1.60.0-SNAPSHOT~d10055d2a1 1.60.0-SNAPSHOT~54b3d90d45
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1770644015 1770644015
ci_job_id 1409442658 1409442658
ci_pipeline_id 95215973 95215973
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-ju7xafl7 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-ju7xafl7 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 63 metrics, 8 unstable metrics.

Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~54b3d90d45, baseline=1.60.0-SNAPSHOT~d10055d2a1

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.066 s) : 0, 1066065
Total [baseline] (8.791 s) : 0, 8791077
Agent [candidate] (1.068 s) : 0, 1067688
Total [candidate] (8.748 s) : 0, 8747612
section iast
Agent [baseline] (1.24 s) : 0, 1239727
Total [baseline] (9.397 s) : 0, 9397170
Agent [candidate] (1.237 s) : 0, 1236971
Total [candidate] (9.432 s) : 0, 9431599
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.066 s -
Agent iast 1.24 s 173.662 ms (16.3%)
Total tracing 8.791 s -
Total iast 9.397 s 606.092 ms (6.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.068 s -
Agent iast 1.237 s 169.283 ms (15.9%)
Total tracing 8.748 s -
Total iast 9.432 s 683.986 ms (7.8%)
gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~54b3d90d45, baseline=1.60.0-SNAPSHOT~d10055d2a1

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.213 ms) : 0, 1213
crashtracking [candidate] (1.195 ms) : 0, 1195
BytebuddyAgent [baseline] (630.816 ms) : 0, 630816
BytebuddyAgent [candidate] (630.059 ms) : 0, 630059
AgentMeter [baseline] (29.004 ms) : 0, 29004
AgentMeter [candidate] (28.972 ms) : 0, 28972
GlobalTracer [baseline] (258.299 ms) : 0, 258299
GlobalTracer [candidate] (258.529 ms) : 0, 258529
AppSec [baseline] (32.904 ms) : 0, 32904
AppSec [candidate] (32.758 ms) : 0, 32758
Debugger [baseline] (60.926 ms) : 0, 60926
Debugger [candidate] (63.334 ms) : 0, 63334
Remote Config [baseline] (614.291 µs) : 0, 614
Remote Config [candidate] (606.275 µs) : 0, 606
Telemetry [baseline] (11.34 ms) : 0, 11340
Telemetry [candidate] (10.55 ms) : 0, 10550
Flare Poller [baseline] (5.299 ms) : 0, 5299
Flare Poller [candidate] (6.212 ms) : 0, 6212
section iast
crashtracking [baseline] (1.195 ms) : 0, 1195
crashtracking [candidate] (1.185 ms) : 0, 1185
BytebuddyAgent [baseline] (801.392 ms) : 0, 801392
BytebuddyAgent [candidate] (799.499 ms) : 0, 799499
AgentMeter [baseline] (11.488 ms) : 0, 11488
AgentMeter [candidate] (11.308 ms) : 0, 11308
GlobalTracer [baseline] (249.996 ms) : 0, 249996
GlobalTracer [candidate] (248.94 ms) : 0, 248940
AppSec [baseline] (35.977 ms) : 0, 35977
AppSec [candidate] (32.564 ms) : 0, 32564
Debugger [baseline] (64.326 ms) : 0, 64326
Debugger [candidate] (68.182 ms) : 0, 68182
Remote Config [baseline] (542.568 µs) : 0, 543
Remote Config [candidate] (557.561 µs) : 0, 558
Telemetry [baseline] (8.719 ms) : 0, 8719
Telemetry [candidate] (8.811 ms) : 0, 8811
Flare Poller [baseline] (3.512 ms) : 0, 3512
Flare Poller [candidate] (3.505 ms) : 0, 3505
IAST [baseline] (27.139 ms) : 0, 27139
IAST [candidate] (26.851 ms) : 0, 26851
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~54b3d90d45, baseline=1.60.0-SNAPSHOT~d10055d2a1

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.067 s) : 0, 1067267
Total [baseline] (11.171 s) : 0, 11171131
Agent [candidate] (1.071 s) : 0, 1070724
Total [candidate] (10.966 s) : 0, 10965622
section appsec
Agent [baseline] (1.25 s) : 0, 1250170
Total [baseline] (11.194 s) : 0, 11194407
Agent [candidate] (1.241 s) : 0, 1240516
Total [candidate] (11.081 s) : 0, 11081238
section iast
Agent [baseline] (1.236 s) : 0, 1235914
Total [baseline] (11.199 s) : 0, 11198920
Agent [candidate] (1.234 s) : 0, 1233511
Total [candidate] (11.176 s) : 0, 11175768
section profiling
Agent [baseline] (1.193 s) : 0, 1193156
Total [baseline] (11.048 s) : 0, 11047727
Agent [candidate] (1.193 s) : 0, 1192524
Total [candidate] (11.025 s) : 0, 11025201
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.067 s -
Agent appsec 1.25 s 182.903 ms (17.1%)
Agent iast 1.236 s 168.647 ms (15.8%)
Agent profiling 1.193 s 125.889 ms (11.8%)
Total tracing 11.171 s -
Total appsec 11.194 s 23.276 ms (0.2%)
Total iast 11.199 s 27.79 ms (0.2%)
Total profiling 11.048 s -123.403 ms (-1.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.071 s -
Agent appsec 1.241 s 169.791 ms (15.9%)
Agent iast 1.234 s 162.787 ms (15.2%)
Agent profiling 1.193 s 121.8 ms (11.4%)
Total tracing 10.966 s -
Total appsec 11.081 s 115.616 ms (1.1%)
Total iast 11.176 s 210.146 ms (1.9%)
Total profiling 11.025 s 59.579 ms (0.5%)
gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~54b3d90d45, baseline=1.60.0-SNAPSHOT~d10055d2a1

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.182 ms) : 0, 1182
crashtracking [candidate] (1.178 ms) : 0, 1178
BytebuddyAgent [baseline] (629.362 ms) : 0, 629362
BytebuddyAgent [candidate] (631.061 ms) : 0, 631061
AgentMeter [baseline] (28.88 ms) : 0, 28880
AgentMeter [candidate] (29.218 ms) : 0, 29218
GlobalTracer [baseline] (258.275 ms) : 0, 258275
GlobalTracer [candidate] (259.888 ms) : 0, 259888
AppSec [baseline] (32.814 ms) : 0, 32814
AppSec [candidate] (33.286 ms) : 0, 33286
Debugger [baseline] (61.893 ms) : 0, 61893
Debugger [candidate] (62.153 ms) : 0, 62153
Remote Config [baseline] (624.01 µs) : 0, 624
Remote Config [candidate] (626.378 µs) : 0, 626
Telemetry [baseline] (14.029 ms) : 0, 14029
Telemetry [candidate] (12.407 ms) : 0, 12407
Flare Poller [baseline] (4.725 ms) : 0, 4725
Flare Poller [candidate] (5.395 ms) : 0, 5395
section appsec
crashtracking [baseline] (1.189 ms) : 0, 1189
crashtracking [candidate] (1.185 ms) : 0, 1185
BytebuddyAgent [baseline] (663.926 ms) : 0, 663926
BytebuddyAgent [candidate] (658.551 ms) : 0, 658551
AgentMeter [baseline] (12.071 ms) : 0, 12071
AgentMeter [candidate] (11.983 ms) : 0, 11983
GlobalTracer [baseline] (261.035 ms) : 0, 261035
GlobalTracer [candidate] (259.053 ms) : 0, 259053
IAST [baseline] (25.505 ms) : 0, 25505
IAST [candidate] (25.291 ms) : 0, 25291
AppSec [baseline] (169.32 ms) : 0, 169320
AppSec [candidate] (168.721 ms) : 0, 168721
Debugger [baseline] (67.912 ms) : 0, 67912
Debugger [candidate] (66.922 ms) : 0, 66922
Remote Config [baseline] (677.8 µs) : 0, 678
Remote Config [candidate] (655.465 µs) : 0, 655
Telemetry [baseline] (9.259 ms) : 0, 9259
Telemetry [candidate] (9.145 ms) : 0, 9145
Flare Poller [baseline] (3.707 ms) : 0, 3707
Flare Poller [candidate] (3.582 ms) : 0, 3582
section iast
crashtracking [baseline] (1.181 ms) : 0, 1181
crashtracking [candidate] (1.181 ms) : 0, 1181
BytebuddyAgent [baseline] (797.683 ms) : 0, 797683
BytebuddyAgent [candidate] (796.217 ms) : 0, 796217
AgentMeter [baseline] (11.294 ms) : 0, 11294
AgentMeter [candidate] (11.251 ms) : 0, 11251
GlobalTracer [baseline] (249.52 ms) : 0, 249520
GlobalTracer [candidate] (249.009 ms) : 0, 249009
IAST [baseline] (27.029 ms) : 0, 27029
IAST [candidate] (27.115 ms) : 0, 27115
AppSec [baseline] (33.394 ms) : 0, 33394
AppSec [candidate] (32.153 ms) : 0, 32153
Debugger [baseline] (67.543 ms) : 0, 67543
Debugger [candidate] (68.485 ms) : 0, 68485
Remote Config [baseline] (536.758 µs) : 0, 537
Remote Config [candidate] (535.603 µs) : 0, 536
Telemetry [baseline] (8.797 ms) : 0, 8797
Telemetry [candidate] (8.686 ms) : 0, 8686
Flare Poller [baseline] (3.539 ms) : 0, 3539
Flare Poller [candidate] (3.513 ms) : 0, 3513
section profiling
crashtracking [baseline] (1.219 ms) : 0, 1219
crashtracking [candidate] (1.217 ms) : 0, 1217
BytebuddyAgent [baseline] (683.485 ms) : 0, 683485
BytebuddyAgent [candidate] (682.52 ms) : 0, 682520
AgentMeter [baseline] (8.652 ms) : 0, 8652
AgentMeter [candidate] (8.58 ms) : 0, 8580
GlobalTracer [baseline] (216.24 ms) : 0, 216240
GlobalTracer [candidate] (216.062 ms) : 0, 216062
AppSec [baseline] (32.401 ms) : 0, 32401
AppSec [candidate] (32.316 ms) : 0, 32316
Debugger [baseline] (68.272 ms) : 0, 68272
Debugger [candidate] (67.864 ms) : 0, 67864
Remote Config [baseline] (600.464 µs) : 0, 600
Remote Config [candidate] (607.912 µs) : 0, 608
Telemetry [baseline] (8.854 ms) : 0, 8854
Telemetry [candidate] (9.013 ms) : 0, 9013
Flare Poller [baseline] (3.738 ms) : 0, 3738
Flare Poller [candidate] (3.79 ms) : 0, 3790
ProfilingAgent [baseline] (99.675 ms) : 0, 99675
ProfilingAgent [candidate] (100.589 ms) : 0, 100589
Profiling [baseline] (100.24 ms) : 0, 100240
Profiling [candidate] (101.164 ms) : 0, 101164
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/servlet3-merge-ctx-with-dispatch
git_commit_date 1770571409 1770642128
git_commit_sha d10055d 54b3d90
release_version 1.60.0-SNAPSHOT~d10055d2a1 1.60.0-SNAPSHOT~54b3d90d45
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1770644500 1770644500
ci_job_id 1409442660 1409442660
ci_pipeline_id 95215973 95215973
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-kd8ur71h 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-kd8ur71h 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 2 performance regressions! Performance is the same for 15 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:petclinic:iast:high_load better
[-1426.749µs; -569.068µs] or [-7.784%; -3.105%]
better
[-1.987ms; -0.782ms] or [-6.698%; -2.636%]
unstable
[-11.010op/s; +38.197op/s] or [-4.404%; +15.281%]
17.332ms 28.285ms 263.562op/s 18.330ms 29.670ms 249.969op/s
scenario:load:petclinic:tracing:high_load worse
[+428.567µs; +947.121µs] or [+2.516%; +5.561%]
unsure
[+499.734µs; +1478.626µs] or [+1.782%; +5.274%]
unstable
[-34.753op/s; +15.128op/s] or [-12.980%; +5.650%]
17.718ms 29.025ms 257.938op/s 17.030ms 28.036ms 267.750op/s
scenario:load:petclinic:code_origins:high_load better
[-857.580µs; -474.219µs] or [-4.805%; -2.657%]
same
[-1043.870µs; +118.213µs] or [-3.607%; +0.408%]
unstable
[-16.219op/s; +33.156op/s] or [-6.320%; +12.920%]
17.183ms 28.478ms 265.094op/s 17.849ms 28.941ms 256.625op/s
scenario:load:petclinic:no_agent:high_load worse
[+0.513ms; +1.979ms] or [+3.098%; +11.946%]
unstable
[+0.657ms; +3.434ms] or [+2.375%; +12.414%]
unstable
[-43.781op/s; +11.844op/s] or [-16.033%; +4.337%]
17.809ms 29.709ms 257.094op/s 16.564ms 27.664ms 273.062op/s
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~54b3d90d45, baseline=1.60.0-SNAPSHOT~d10055d2a1
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.186 ms) : 1174, 1198
.   : milestone, 1186,
iast (3.032 ms) : 2992, 3072
.   : milestone, 3032,
iast_FULL (5.834 ms) : 5777, 5892
.   : milestone, 5834,
iast_GLOBAL (3.609 ms) : 3542, 3676
.   : milestone, 3609,
profiling (2.083 ms) : 2065, 2101
.   : milestone, 2083,
tracing (1.814 ms) : 1799, 1829
.   : milestone, 1814,
section candidate
no_agent (1.273 ms) : 1261, 1286
.   : milestone, 1273,
iast (2.982 ms) : 2946, 3017
.   : milestone, 2982,
iast_FULL (5.82 ms) : 5762, 5878
.   : milestone, 5820,
iast_GLOBAL (3.652 ms) : 3588, 3715
.   : milestone, 3652,
profiling (2.025 ms) : 2006, 2044
.   : milestone, 2025,
tracing (1.764 ms) : 1750, 1779
.   : milestone, 1764,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.186 ms [1.174 ms, 1.198 ms] -
iast 3.032 ms [2.992 ms, 3.072 ms] 1.846 ms (155.7%)
iast_FULL 5.834 ms [5.777 ms, 5.892 ms] 4.649 ms (392.1%)
iast_GLOBAL 3.609 ms [3.542 ms, 3.676 ms] 2.423 ms (204.4%)
profiling 2.083 ms [2.065 ms, 2.101 ms] 897.315 µs (75.7%)
tracing 1.814 ms [1.799 ms, 1.829 ms] 628.428 µs (53.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.273 ms [1.261 ms, 1.286 ms] -
iast 2.982 ms [2.946 ms, 3.017 ms] 1.708 ms (134.1%)
iast_FULL 5.82 ms [5.762 ms, 5.878 ms] 4.547 ms (357.1%)
iast_GLOBAL 3.652 ms [3.588 ms, 3.715 ms] 2.378 ms (186.8%)
profiling 2.025 ms [2.006 ms, 2.044 ms] 751.839 µs (59.0%)
tracing 1.764 ms [1.75 ms, 1.779 ms] 491.027 µs (38.6%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~54b3d90d45, baseline=1.60.0-SNAPSHOT~d10055d2a1
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.08 ms) : 16915, 17245
.   : milestone, 17080,
appsec (18.512 ms) : 18326, 18697
.   : milestone, 18512,
code_origins (18.182 ms) : 18004, 18360
.   : milestone, 18182,
iast (18.664 ms) : 18478, 18851
.   : milestone, 18664,
profiling (18.882 ms) : 18693, 19071
.   : milestone, 18882,
tracing (17.425 ms) : 17254, 17595
.   : milestone, 17425,
section candidate
no_agent (18.154 ms) : 17969, 18338
.   : milestone, 18154,
appsec (18.785 ms) : 18597, 18974
.   : milestone, 18785,
code_origins (17.598 ms) : 17425, 17772
.   : milestone, 17598,
iast (17.706 ms) : 17533, 17880
.   : milestone, 17706,
profiling (18.767 ms) : 18582, 18952
.   : milestone, 18767,
tracing (18.087 ms) : 17907, 18268
.   : milestone, 18087,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.08 ms [16.915 ms, 17.245 ms] -
appsec 18.512 ms [18.326 ms, 18.697 ms] 1.431 ms (8.4%)
code_origins 18.182 ms [18.004 ms, 18.36 ms] 1.102 ms (6.5%)
iast 18.664 ms [18.478 ms, 18.851 ms] 1.584 ms (9.3%)
profiling 18.882 ms [18.693 ms, 19.071 ms] 1.802 ms (10.5%)
tracing 17.425 ms [17.254 ms, 17.595 ms] 344.427 µs (2.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.154 ms [17.969 ms, 18.338 ms] -
appsec 18.785 ms [18.597 ms, 18.974 ms] 631.745 µs (3.5%)
code_origins 17.598 ms [17.425 ms, 17.772 ms] -555.343 µs (-3.1%)
iast 17.706 ms [17.533 ms, 17.88 ms] -447.235 µs (-2.5%)
profiling 18.767 ms [18.582 ms, 18.952 ms] 613.618 µs (3.4%)
tracing 18.087 ms [17.907 ms, 18.268 ms] -66.121 µs (-0.4%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/servlet3-merge-ctx-with-dispatch
git_commit_date 1770571409 1770642128
git_commit_sha d10055d 54b3d90
release_version 1.60.0-SNAPSHOT~d10055d2a1 1.60.0-SNAPSHOT~54b3d90d45
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1770644353 1770644353
ci_job_id 1409442661 1409442661
ci_pipeline_id 95215973 95215973
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-6r7m7ues 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-6r7m7ues 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~54b3d90d45, baseline=1.60.0-SNAPSHOT~d10055d2a1
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.477 ms) : 1465, 1488
.   : milestone, 1477,
appsec (2.524 ms) : 2468, 2579
.   : milestone, 2524,
iast (2.26 ms) : 2190, 2329
.   : milestone, 2260,
iast_GLOBAL (2.29 ms) : 2220, 2359
.   : milestone, 2290,
profiling (2.08 ms) : 2025, 2135
.   : milestone, 2080,
tracing (2.062 ms) : 2009, 2115
.   : milestone, 2062,
section candidate
no_agent (1.476 ms) : 1465, 1488
.   : milestone, 1476,
appsec (2.526 ms) : 2471, 2581
.   : milestone, 2526,
iast (2.26 ms) : 2191, 2330
.   : milestone, 2260,
iast_GLOBAL (2.301 ms) : 2231, 2370
.   : milestone, 2301,
profiling (2.092 ms) : 2035, 2148
.   : milestone, 2092,
tracing (2.067 ms) : 2013, 2121
.   : milestone, 2067,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.477 ms [1.465 ms, 1.488 ms] -
appsec 2.524 ms [2.468 ms, 2.579 ms] 1.047 ms (70.9%)
iast 2.26 ms [2.19 ms, 2.329 ms] 783.016 µs (53.0%)
iast_GLOBAL 2.29 ms [2.22 ms, 2.359 ms] 812.951 µs (55.1%)
profiling 2.08 ms [2.025 ms, 2.135 ms] 603.11 µs (40.8%)
tracing 2.062 ms [2.009 ms, 2.115 ms] 585.39 µs (39.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.465 ms, 1.488 ms] -
appsec 2.526 ms [2.471 ms, 2.581 ms] 1.05 ms (71.1%)
iast 2.26 ms [2.191 ms, 2.33 ms] 783.983 µs (53.1%)
iast_GLOBAL 2.301 ms [2.231 ms, 2.37 ms] 824.178 µs (55.8%)
profiling 2.092 ms [2.035 ms, 2.148 ms] 615.261 µs (41.7%)
tracing 2.067 ms [2.013 ms, 2.121 ms] 590.918 µs (40.0%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~54b3d90d45, baseline=1.60.0-SNAPSHOT~d10055d2a1
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.372 s) : 15372000, 15372000
.   : milestone, 15372000,
appsec (14.928 s) : 14928000, 14928000
.   : milestone, 14928000,
iast (18.983 s) : 18983000, 18983000
.   : milestone, 18983000,
iast_GLOBAL (17.773 s) : 17773000, 17773000
.   : milestone, 17773000,
profiling (15.563 s) : 15563000, 15563000
.   : milestone, 15563000,
tracing (15.059 s) : 15059000, 15059000
.   : milestone, 15059000,
section candidate
no_agent (15.039 s) : 15039000, 15039000
.   : milestone, 15039000,
appsec (14.944 s) : 14944000, 14944000
.   : milestone, 14944000,
iast (18.121 s) : 18121000, 18121000
.   : milestone, 18121000,
iast_GLOBAL (17.795 s) : 17795000, 17795000
.   : milestone, 17795000,
profiling (15.112 s) : 15112000, 15112000
.   : milestone, 15112000,
tracing (14.58 s) : 14580000, 14580000
.   : milestone, 14580000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.372 s [15.372 s, 15.372 s] -
appsec 14.928 s [14.928 s, 14.928 s] -444.0 ms (-2.9%)
iast 18.983 s [18.983 s, 18.983 s] 3.611 s (23.5%)
iast_GLOBAL 17.773 s [17.773 s, 17.773 s] 2.401 s (15.6%)
profiling 15.563 s [15.563 s, 15.563 s] 191.0 ms (1.2%)
tracing 15.059 s [15.059 s, 15.059 s] -313.0 ms (-2.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.039 s [15.039 s, 15.039 s] -
appsec 14.944 s [14.944 s, 14.944 s] -95.0 ms (-0.6%)
iast 18.121 s [18.121 s, 18.121 s] 3.082 s (20.5%)
iast_GLOBAL 17.795 s [17.795 s, 17.795 s] 2.756 s (18.3%)
profiling 15.112 s [15.112 s, 15.112 s] 73.0 ms (0.5%)
tracing 14.58 s [14.58 s, 14.58 s] -459.0 ms (-3.1%)