Home Original page

Implement OpenTelemetry meter storage and aggregations by mcculls · Pull Request #10534 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/otel-meter-storage
git_commit_date 1770332232 1770372678
git_commit_sha d8f2599 3f305b4
release_version 1.60.0-SNAPSHOT~d8f2599d6f 1.60.0-SNAPSHOT~3f305b4c07
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1770374341 1770374341
ci_job_id 1405797954 1405797954
ci_pipeline_id 94974658 94974658
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-5krpcs8u 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-5krpcs8u 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 64 metrics, 7 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~3f305b4c07, baseline=1.60.0-SNAPSHOT~d8f2599d6f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.064 s) : 0, 1063892
Total [baseline] (8.732 s) : 0, 8732374
Agent [candidate] (1.063 s) : 0, 1063211
Total [candidate] (8.756 s) : 0, 8755789
section iast
Agent [baseline] (1.229 s) : 0, 1229497
Total [baseline] (9.355 s) : 0, 9354520
Agent [candidate] (1.231 s) : 0, 1231223
Total [candidate] (9.377 s) : 0, 9377462
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.064 s -
Agent iast 1.229 s 165.605 ms (15.6%)
Total tracing 8.732 s -
Total iast 9.355 s 622.146 ms (7.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.063 s -
Agent iast 1.231 s 168.012 ms (15.8%)
Total tracing 8.756 s -
Total iast 9.377 s 621.674 ms (7.1%) 
gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~3f305b4c07, baseline=1.60.0-SNAPSHOT~d8f2599d6f

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.189 ms) : 0, 1189
crashtracking [candidate] (1.176 ms) : 0, 1176
BytebuddyAgent [baseline] (628.483 ms) : 0, 628483
BytebuddyAgent [candidate] (627.658 ms) : 0, 627658
AgentMeter [baseline] (28.953 ms) : 0, 28953
AgentMeter [candidate] (28.927 ms) : 0, 28927
GlobalTracer [baseline] (258.174 ms) : 0, 258174
GlobalTracer [candidate] (257.863 ms) : 0, 257863
AppSec [baseline] (32.807 ms) : 0, 32807
AppSec [candidate] (32.884 ms) : 0, 32884
Debugger [baseline] (61.468 ms) : 0, 61468
Debugger [candidate] (61.085 ms) : 0, 61085
Remote Config [baseline] (613.904 µs) : 0, 614
Remote Config [candidate] (612.52 µs) : 0, 613
Telemetry [baseline] (13.072 ms) : 0, 13072
Telemetry [candidate] (12.289 ms) : 0, 12289
Flare Poller [baseline] (3.79 ms) : 0, 3790
Flare Poller [candidate] (5.388 ms) : 0, 5388
section iast
crashtracking [baseline] (1.188 ms) : 0, 1188
crashtracking [candidate] (1.18 ms) : 0, 1180
BytebuddyAgent [baseline] (795.499 ms) : 0, 795499
BytebuddyAgent [candidate] (796.354 ms) : 0, 796354
AgentMeter [baseline] (11.254 ms) : 0, 11254
AgentMeter [candidate] (11.284 ms) : 0, 11284
GlobalTracer [baseline] (247.272 ms) : 0, 247272
GlobalTracer [candidate] (247.826 ms) : 0, 247826
AppSec [baseline] (34.661 ms) : 0, 34661
AppSec [candidate] (33.816 ms) : 0, 33816
Debugger [baseline] (64.618 ms) : 0, 64618
Debugger [candidate] (65.751 ms) : 0, 65751
Remote Config [baseline] (545.486 µs) : 0, 545
Remote Config [candidate] (534.801 µs) : 0, 535
Telemetry [baseline] (8.667 ms) : 0, 8667
Telemetry [candidate] (8.729 ms) : 0, 8729
Flare Poller [baseline] (3.497 ms) : 0, 3497
Flare Poller [candidate] (3.548 ms) : 0, 3548
IAST [baseline] (27.004 ms) : 0, 27004
IAST [candidate] (26.888 ms) : 0, 26888
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~3f305b4c07, baseline=1.60.0-SNAPSHOT~d8f2599d6f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.066 s) : 0, 1065622
Total [baseline] (10.848 s) : 0, 10847996
Agent [candidate] (1.072 s) : 0, 1071836
Total [candidate] (10.942 s) : 0, 10941924
section appsec
Agent [baseline] (1.235 s) : 0, 1235444
Total [baseline] (10.938 s) : 0, 10938209
Agent [candidate] (1.239 s) : 0, 1238726
Total [candidate] (11.069 s) : 0, 11068624
section iast
Agent [baseline] (1.242 s) : 0, 1242458
Total [baseline] (11.148 s) : 0, 11148381
Agent [candidate] (1.23 s) : 0, 1229778
Total [candidate] (11.238 s) : 0, 11238423
section profiling
Agent [baseline] (1.196 s) : 0, 1195595
Total [baseline] (10.967 s) : 0, 10966858
Agent [candidate] (1.19 s) : 0, 1190036
Total [candidate] (10.976 s) : 0, 10975526
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.066 s -
Agent appsec 1.235 s 169.822 ms (15.9%)
Agent iast 1.242 s 176.836 ms (16.6%)
Agent profiling 1.196 s 129.973 ms (12.2%)
Total tracing 10.848 s -
Total appsec 10.938 s 90.213 ms (0.8%)
Total iast 11.148 s 300.385 ms (2.8%)
Total profiling 10.967 s 118.862 ms (1.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.072 s -
Agent appsec 1.239 s 166.891 ms (15.6%)
Agent iast 1.23 s 157.943 ms (14.7%)
Agent profiling 1.19 s 118.201 ms (11.0%)
Total tracing 10.942 s -
Total appsec 11.069 s 126.7 ms (1.2%)
Total iast 11.238 s 296.499 ms (2.7%)
Total profiling 10.976 s 33.602 ms (0.3%) 
gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~3f305b4c07, baseline=1.60.0-SNAPSHOT~d8f2599d6f

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.182 ms) : 0, 1182
crashtracking [candidate] (1.185 ms) : 0, 1185
BytebuddyAgent [baseline] (628.002 ms) : 0, 628002
BytebuddyAgent [candidate] (633.515 ms) : 0, 633515
AgentMeter [baseline] (28.828 ms) : 0, 28828
AgentMeter [candidate] (29.114 ms) : 0, 29114
GlobalTracer [baseline] (257.572 ms) : 0, 257572
GlobalTracer [candidate] (259.092 ms) : 0, 259092
AppSec [baseline] (32.838 ms) : 0, 32838
AppSec [candidate] (32.925 ms) : 0, 32925
Debugger [baseline] (62.786 ms) : 0, 62786
Debugger [candidate] (62.305 ms) : 0, 62305
Remote Config [baseline] (626.895 µs) : 0, 627
Remote Config [candidate] (617.772 µs) : 0, 618
Telemetry [baseline] (12.338 ms) : 0, 12338
Telemetry [candidate] (11.482 ms) : 0, 11482
Flare Poller [baseline] (6.176 ms) : 0, 6176
Flare Poller [candidate] (6.047 ms) : 0, 6047
section appsec
crashtracking [baseline] (1.176 ms) : 0, 1176
crashtracking [candidate] (1.178 ms) : 0, 1178
BytebuddyAgent [baseline] (655.53 ms) : 0, 655530
BytebuddyAgent [candidate] (657.601 ms) : 0, 657601
AgentMeter [baseline] (11.851 ms) : 0, 11851
AgentMeter [candidate] (11.838 ms) : 0, 11838
GlobalTracer [baseline] (257.915 ms) : 0, 257915
GlobalTracer [candidate] (258.868 ms) : 0, 258868
IAST [baseline] (25.204 ms) : 0, 25204
IAST [candidate] (25.242 ms) : 0, 25242
AppSec [baseline] (168.12 ms) : 0, 168120
AppSec [candidate] (167.67 ms) : 0, 167670
Debugger [baseline] (67.112 ms) : 0, 67112
Debugger [candidate] (67.63 ms) : 0, 67630
Remote Config [baseline] (666.732 µs) : 0, 667
Remote Config [candidate] (669.069 µs) : 0, 669
Telemetry [baseline] (9.106 ms) : 0, 9106
Telemetry [candidate] (9.205 ms) : 0, 9205
Flare Poller [baseline] (3.603 ms) : 0, 3603
Flare Poller [candidate] (3.624 ms) : 0, 3624
section iast
crashtracking [baseline] (1.189 ms) : 0, 1189
crashtracking [candidate] (1.18 ms) : 0, 1180
BytebuddyAgent [baseline] (804.876 ms) : 0, 804876
BytebuddyAgent [candidate] (795.007 ms) : 0, 795007
AgentMeter [baseline] (11.354 ms) : 0, 11354
AgentMeter [candidate] (11.235 ms) : 0, 11235
GlobalTracer [baseline] (249.582 ms) : 0, 249582
GlobalTracer [candidate] (247.653 ms) : 0, 247653
IAST [baseline] (27.032 ms) : 0, 27032
IAST [candidate] (26.836 ms) : 0, 26836
AppSec [baseline] (32.992 ms) : 0, 32992
AppSec [candidate] (34.761 ms) : 0, 34761
Debugger [baseline] (67.368 ms) : 0, 67368
Debugger [candidate] (65.404 ms) : 0, 65404
Remote Config [baseline] (552.084 µs) : 0, 552
Remote Config [candidate] (543.433 µs) : 0, 543
Telemetry [baseline] (8.603 ms) : 0, 8603
Telemetry [candidate] (8.569 ms) : 0, 8569
Flare Poller [baseline] (3.478 ms) : 0, 3478
Flare Poller [candidate] (3.434 ms) : 0, 3434
section profiling
crashtracking [baseline] (1.216 ms) : 0, 1216
crashtracking [candidate] (1.215 ms) : 0, 1215
BytebuddyAgent [baseline] (684.484 ms) : 0, 684484
BytebuddyAgent [candidate] (682.705 ms) : 0, 682705
AgentMeter [baseline] (8.81 ms) : 0, 8810
AgentMeter [candidate] (8.7 ms) : 0, 8700
GlobalTracer [baseline] (217.368 ms) : 0, 217368
GlobalTracer [candidate] (215.788 ms) : 0, 215788
AppSec [baseline] (32.572 ms) : 0, 32572
AppSec [candidate] (32.33 ms) : 0, 32330
Debugger [baseline] (68.098 ms) : 0, 68098
Debugger [candidate] (67.329 ms) : 0, 67329
Remote Config [baseline] (618.196 µs) : 0, 618
Remote Config [candidate] (590.18 µs) : 0, 590
Telemetry [baseline] (9.019 ms) : 0, 9019
Telemetry [candidate] (8.76 ms) : 0, 8760
Flare Poller [baseline] (3.773 ms) : 0, 3773
Flare Poller [candidate] (3.791 ms) : 0, 3791
ProfilingAgent [baseline] (99.718 ms) : 0, 99718
ProfilingAgent [candidate] (98.851 ms) : 0, 98851
Profiling [baseline] (100.294 ms) : 0, 100294
Profiling [candidate] (99.428 ms) : 0, 99428
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/otel-meter-storage
git_commit_date 1770332232 1770372678
git_commit_sha d8f2599 3f305b4
release_version 1.60.0-SNAPSHOT~d8f2599d6f 1.60.0-SNAPSHOT~3f305b4c07
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1770374831 1770374831
ci_job_id 1405797955 1405797955
ci_pipeline_id 94974658 94974658
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-6avi3hmc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-6avi3hmc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 4 performance improvements and 1 performance regressions! Performance is the same for 13 metrics, 18 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:profiling:high_load better
[-227.024µs; -106.026µs] or [-12.667%; -5.916%]		 unstable
[-1323.803µs; -502.569µs] or [-23.934%; -9.086%]		 unstable
[+59.062op/s; +550.688op/s] or [+3.008%; +28.044%]		 1.626ms 4.618ms 2268.562op/s 1.792ms 5.531ms 1963.688op/s
scenario:load:insecure-bank:iast_FULL:high_load better
[-564.524µs; -226.802µs] or [-10.724%; -4.309%]		 better
[-1224.539µs; -403.718µs] or [-9.763%; -3.219%]		 unstable
[-30.159op/s; +135.721op/s] or [-3.850%; +17.325%]		 4.868ms 11.728ms 836.156op/s 5.264ms 12.542ms 783.375op/s
scenario:load:petclinic:profiling:high_load better
[-1.543ms; -0.648ms] or [-8.078%; -3.390%]		 unsure
[-2.056ms; -0.544ms] or [-6.681%; -1.767%]		 unstable
[-13.874op/s; +37.686op/s] or [-5.769%; +15.670%]		 18.011ms 29.476ms 252.406op/s 19.106ms 30.776ms 240.500op/s
scenario:load:petclinic:iast:high_load worse
[+427.789µs; +1117.200µs] or [+2.453%; +6.406%]		 unsure
[+65.657µs; +1442.461µs] or [+0.230%; +5.044%]		 unstable
[-38.249op/s; +16.374op/s] or [-14.563%; +6.234%]		 18.212ms 29.351ms 251.719op/s 17.440ms 28.597ms 262.656op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~3f305b4c07, baseline=1.60.0-SNAPSHOT~d8f2599d6f
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.03 ms) : 17844, 18215
.   : milestone, 18030,
appsec (18.715 ms) : 18524, 18905
.   : milestone, 18715,
code_origins (17.639 ms) : 17464, 17814
.   : milestone, 17639,
iast (17.772 ms) : 17595, 17949
.   : milestone, 17772,
profiling (19.409 ms) : 19214, 19604
.   : milestone, 19409,
tracing (17.647 ms) : 17473, 17821
.   : milestone, 17647,
section candidate
no_agent (17.906 ms) : 17725, 18087
.   : milestone, 17906,
appsec (18.313 ms) : 18128, 18497
.   : milestone, 18313,
code_origins (17.582 ms) : 17407, 17758
.   : milestone, 17582,
iast (18.537 ms) : 18351, 18723
.   : milestone, 18537,
profiling (18.489 ms) : 18306, 18672
.   : milestone, 18489,
tracing (17.783 ms) : 17609, 17957
.   : milestone, 17783,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.03 ms [17.844 ms, 18.215 ms] -
appsec 18.715 ms [18.524 ms, 18.905 ms] 685.371 µs (3.8%)
code_origins 17.639 ms [17.464 ms, 17.814 ms] -390.271 µs (-2.2%)
iast 17.772 ms [17.595 ms, 17.949 ms] -257.48 µs (-1.4%)
profiling 19.409 ms [19.214 ms, 19.604 ms] 1.38 ms (7.7%)
tracing 17.647 ms [17.473 ms, 17.821 ms] -382.968 µs (-2.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.906 ms [17.725 ms, 18.087 ms] -
appsec 18.313 ms [18.128 ms, 18.497 ms] 406.756 µs (2.3%)
code_origins 17.582 ms [17.407 ms, 17.758 ms] -323.346 µs (-1.8%)
iast 18.537 ms [18.351 ms, 18.723 ms] 631.512 µs (3.5%)
profiling 18.489 ms [18.306 ms, 18.672 ms] 583.206 µs (3.3%)
tracing 17.783 ms [17.609 ms, 17.957 ms] -123.177 µs (-0.7%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~3f305b4c07, baseline=1.60.0-SNAPSHOT~d8f2599d6f
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.172 ms) : 1160, 1183
.   : milestone, 1172,
iast (3.094 ms) : 3052, 3137
.   : milestone, 3094,
iast_FULL (5.904 ms) : 5845, 5963
.   : milestone, 5904,
iast_GLOBAL (3.451 ms) : 3399, 3503
.   : milestone, 3451,
profiling (2.31 ms) : 2288, 2332
.   : milestone, 2310,
tracing (1.795 ms) : 1779, 1810
.   : milestone, 1795,
section candidate
no_agent (1.184 ms) : 1172, 1195
.   : milestone, 1184,
iast (3.067 ms) : 3033, 3101
.   : milestone, 3067,
iast_FULL (5.527 ms) : 5473, 5581
.   : milestone, 5527,
iast_GLOBAL (3.587 ms) : 3531, 3643
.   : milestone, 3587,
profiling (1.99 ms) : 1971, 2009
.   : milestone, 1990,
tracing (1.841 ms) : 1823, 1858
.   : milestone, 1841,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.172 ms [1.16 ms, 1.183 ms] -
iast 3.094 ms [3.052 ms, 3.137 ms] 1.923 ms (164.1%)
iast_FULL 5.904 ms [5.845 ms, 5.963 ms] 4.732 ms (403.9%)
iast_GLOBAL 3.451 ms [3.399 ms, 3.503 ms] 2.28 ms (194.6%)
profiling 2.31 ms [2.288 ms, 2.332 ms] 1.138 ms (97.2%)
tracing 1.795 ms [1.779 ms, 1.81 ms] 622.94 µs (53.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.184 ms [1.172 ms, 1.195 ms] -
iast 3.067 ms [3.033 ms, 3.101 ms] 1.883 ms (159.1%)
iast_FULL 5.527 ms [5.473 ms, 5.581 ms] 4.343 ms (366.9%)
iast_GLOBAL 3.587 ms [3.531 ms, 3.643 ms] 2.403 ms (203.0%)
profiling 1.99 ms [1.971 ms, 2.009 ms] 805.86 µs (68.1%)
tracing 1.841 ms [1.823 ms, 1.858 ms] 656.888 µs (55.5%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/otel-meter-storage
git_commit_date 1770332232 1770372678
git_commit_sha d8f2599 3f305b4
release_version 1.60.0-SNAPSHOT~d8f2599d6f 1.60.0-SNAPSHOT~3f305b4c07
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1770374649 1770374649
ci_job_id 1405797956 1405797956
ci_pipeline_id 94974658 94974658
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-yoq8ywde 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-yoq8ywde 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~3f305b4c07, baseline=1.60.0-SNAPSHOT~d8f2599d6f
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.369 s) : 15369000, 15369000
.   : milestone, 15369000,
appsec (15.036 s) : 15036000, 15036000
.   : milestone, 15036000,
iast (18.174 s) : 18174000, 18174000
.   : milestone, 18174000,
iast_GLOBAL (17.768 s) : 17768000, 17768000
.   : milestone, 17768000,
profiling (15.473 s) : 15473000, 15473000
.   : milestone, 15473000,
tracing (14.782 s) : 14782000, 14782000
.   : milestone, 14782000,
section candidate
no_agent (14.88 s) : 14880000, 14880000
.   : milestone, 14880000,
appsec (14.792 s) : 14792000, 14792000
.   : milestone, 14792000,
iast (18.271 s) : 18271000, 18271000
.   : milestone, 18271000,
iast_GLOBAL (18.093 s) : 18093000, 18093000
.   : milestone, 18093000,
profiling (14.801 s) : 14801000, 14801000
.   : milestone, 14801000,
tracing (14.692 s) : 14692000, 14692000
.   : milestone, 14692000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.369 s [15.369 s, 15.369 s] -
appsec 15.036 s [15.036 s, 15.036 s] -333.0 ms (-2.2%)
iast 18.174 s [18.174 s, 18.174 s] 2.805 s (18.3%)
iast_GLOBAL 17.768 s [17.768 s, 17.768 s] 2.399 s (15.6%)
profiling 15.473 s [15.473 s, 15.473 s] 104.0 ms (0.7%)
tracing 14.782 s [14.782 s, 14.782 s] -587.0 ms (-3.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.88 s [14.88 s, 14.88 s] -
appsec 14.792 s [14.792 s, 14.792 s] -88.0 ms (-0.6%)
iast 18.271 s [18.271 s, 18.271 s] 3.391 s (22.8%)
iast_GLOBAL 18.093 s [18.093 s, 18.093 s] 3.213 s (21.6%)
profiling 14.801 s [14.801 s, 14.801 s] -79.0 ms (-0.5%)
tracing 14.692 s [14.692 s, 14.692 s] -188.0 ms (-1.3%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~3f305b4c07, baseline=1.60.0-SNAPSHOT~d8f2599d6f
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.47 ms) : 1459, 1482
.   : milestone, 1470,
appsec (3.754 ms) : 3534, 3974
.   : milestone, 3754,
iast (2.251 ms) : 2182, 2320
.   : milestone, 2251,
iast_GLOBAL (2.302 ms) : 2232, 2371
.   : milestone, 2302,
profiling (2.099 ms) : 2043, 2155
.   : milestone, 2099,
tracing (2.051 ms) : 1998, 2104
.   : milestone, 2051,
section candidate
no_agent (1.471 ms) : 1460, 1483
.   : milestone, 1471,
appsec (3.765 ms) : 3544, 3986
.   : milestone, 3765,
iast (2.262 ms) : 2193, 2331
.   : milestone, 2262,
iast_GLOBAL (2.295 ms) : 2226, 2364
.   : milestone, 2295,
profiling (2.073 ms) : 2019, 2127
.   : milestone, 2073,
tracing (2.069 ms) : 2015, 2122
.   : milestone, 2069,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.47 ms [1.459 ms, 1.482 ms] -
appsec 3.754 ms [3.534 ms, 3.974 ms] 2.284 ms (155.3%)
iast 2.251 ms [2.182 ms, 2.32 ms] 781.113 µs (53.1%)
iast_GLOBAL 2.302 ms [2.232 ms, 2.371 ms] 831.489 µs (56.6%)
profiling 2.099 ms [2.043 ms, 2.155 ms] 628.781 µs (42.8%)
tracing 2.051 ms [1.998 ms, 2.104 ms] 580.771 µs (39.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.471 ms [1.46 ms, 1.483 ms] -
appsec 3.765 ms [3.544 ms, 3.986 ms] 2.294 ms (155.9%)
iast 2.262 ms [2.193 ms, 2.331 ms] 790.635 µs (53.7%)
iast_GLOBAL 2.295 ms [2.226 ms, 2.364 ms] 823.944 µs (56.0%)
profiling 2.073 ms [2.019 ms, 2.127 ms] 602.08 µs (40.9%)
tracing 2.069 ms [2.015 ms, 2.122 ms] 597.523 µs (40.6%)