Home Original page

Fix Test Management telemetry by daniel-mohedano · Pull Request #10962 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/test-management-telemetry
git_commit_date 1774455067 1774457035
git_commit_sha fc26db7 477a16d
release_version 1.61.0-SNAPSHOT~fc26db76f4 1.61.0-SNAPSHOT~477a16dadc
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1774458827 1774458827
ci_job_id 1538291255 1538291255
ci_pipeline_id 104375486 104375486
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-0ygq2rm3 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-0ygq2rm3 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 62 metrics, 9 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.61.0-SNAPSHOT~477a16dadc, baseline=1.61.0-SNAPSHOT~fc26db76f4

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.052 s) : 0, 1052134
Total [baseline] (8.828 s) : 0, 8827617
Agent [candidate] (1.057 s) : 0, 1056556
Total [candidate] (8.827 s) : 0, 8826959
section iast
Agent [baseline] (1.227 s) : 0, 1226922
Total [baseline] (9.529 s) : 0, 9528734
Agent [candidate] (1.24 s) : 0, 1239630
Total [candidate] (9.582 s) : 0, 9581841
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.052 s -
Agent iast 1.227 s 174.788 ms (16.6%)
Total tracing 8.828 s -
Total iast 9.529 s 701.117 ms (7.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.057 s -
Agent iast 1.24 s 183.074 ms (17.3%)
Total tracing 8.827 s -
Total iast 9.582 s 754.882 ms (8.6%) 
gantt
    title insecure-bank - break down per module: candidate=1.61.0-SNAPSHOT~477a16dadc, baseline=1.61.0-SNAPSHOT~fc26db76f4

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.2 ms) : 0, 1200
crashtracking [candidate] (1.197 ms) : 0, 1197
BytebuddyAgent [baseline] (625.985 ms) : 0, 625985
BytebuddyAgent [candidate] (628.041 ms) : 0, 628041
AgentMeter [baseline] (29.367 ms) : 0, 29367
AgentMeter [candidate] (29.471 ms) : 0, 29471
GlobalTracer [baseline] (255.761 ms) : 0, 255761
GlobalTracer [candidate] (256.904 ms) : 0, 256904
AppSec [baseline] (31.605 ms) : 0, 31605
AppSec [candidate] (31.742 ms) : 0, 31742
Debugger [baseline] (59.367 ms) : 0, 59367
Debugger [candidate] (59.498 ms) : 0, 59498
Remote Config [baseline] (591.407 µs) : 0, 591
Remote Config [candidate] (610.606 µs) : 0, 611
Telemetry [baseline] (7.965 ms) : 0, 7965
Telemetry [candidate] (9.532 ms) : 0, 9532
Flare Poller [baseline] (4.249 ms) : 0, 4249
Flare Poller [candidate] (3.467 ms) : 0, 3467
section iast
crashtracking [baseline] (1.187 ms) : 0, 1187
crashtracking [candidate] (1.235 ms) : 0, 1235
BytebuddyAgent [baseline] (795.764 ms) : 0, 795764
BytebuddyAgent [candidate] (804.975 ms) : 0, 804975
AgentMeter [baseline] (11.408 ms) : 0, 11408
AgentMeter [candidate] (11.667 ms) : 0, 11667
GlobalTracer [baseline] (247.176 ms) : 0, 247176
GlobalTracer [candidate] (249.533 ms) : 0, 249533
IAST [baseline] (25.31 ms) : 0, 25310
IAST [candidate] (25.58 ms) : 0, 25580
AppSec [baseline] (26.575 ms) : 0, 26575
AppSec [candidate] (26.846 ms) : 0, 26846
Debugger [baseline] (68.95 ms) : 0, 68950
Debugger [candidate] (67.652 ms) : 0, 67652
Remote Config [baseline] (538.984 µs) : 0, 539
Remote Config [candidate] (528.534 µs) : 0, 529
Telemetry [baseline] (10.232 ms) : 0, 10232
Telemetry [candidate] (11.297 ms) : 0, 11297
Flare Poller [baseline] (3.7 ms) : 0, 3700
Flare Poller [candidate] (3.973 ms) : 0, 3973
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.61.0-SNAPSHOT~477a16dadc, baseline=1.61.0-SNAPSHOT~fc26db76f4

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.059 s) : 0, 1059462
Total [baseline] (11.005 s) : 0, 11005333
Agent [candidate] (1.065 s) : 0, 1065437
Total [candidate] (11.112 s) : 0, 11111599
section appsec
Agent [baseline] (1.245 s) : 0, 1245435
Total [baseline] (11.116 s) : 0, 11116043
Agent [candidate] (1.245 s) : 0, 1244705
Total [candidate] (11.12 s) : 0, 11119636
section iast
Agent [baseline] (1.237 s) : 0, 1236593
Total [baseline] (11.363 s) : 0, 11362665
Agent [candidate] (1.23 s) : 0, 1230154
Total [candidate] (11.234 s) : 0, 11234316
section profiling
Agent [baseline] (1.181 s) : 0, 1181153
Total [baseline] (10.938 s) : 0, 10937991
Agent [candidate] (1.183 s) : 0, 1182636
Total [candidate] (10.991 s) : 0, 10991228
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.059 s -
Agent appsec 1.245 s 185.973 ms (17.6%)
Agent iast 1.237 s 177.131 ms (16.7%)
Agent profiling 1.181 s 121.69 ms (11.5%)
Total tracing 11.005 s -
Total appsec 11.116 s 110.71 ms (1.0%)
Total iast 11.363 s 357.333 ms (3.2%)
Total profiling 10.938 s -67.342 ms (-0.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.065 s -
Agent appsec 1.245 s 179.268 ms (16.8%)
Agent iast 1.23 s 164.717 ms (15.5%)
Agent profiling 1.183 s 117.199 ms (11.0%)
Total tracing 11.112 s -
Total appsec 11.12 s 8.037 ms (0.1%)
Total iast 11.234 s 122.717 ms (1.1%)
Total profiling 10.991 s -120.371 ms (-1.1%) 
gantt
    title petclinic - break down per module: candidate=1.61.0-SNAPSHOT~477a16dadc, baseline=1.61.0-SNAPSHOT~fc26db76f4

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.196 ms) : 0, 1196
crashtracking [candidate] (1.199 ms) : 0, 1199
BytebuddyAgent [baseline] (630.418 ms) : 0, 630418
BytebuddyAgent [candidate] (633.565 ms) : 0, 633565
AgentMeter [baseline] (29.41 ms) : 0, 29410
AgentMeter [candidate] (29.725 ms) : 0, 29725
GlobalTracer [baseline] (256.776 ms) : 0, 256776
GlobalTracer [candidate] (258.398 ms) : 0, 258398
AppSec [baseline] (31.699 ms) : 0, 31699
AppSec [candidate] (31.966 ms) : 0, 31966
Debugger [baseline] (60.213 ms) : 0, 60213
Debugger [candidate] (60.665 ms) : 0, 60665
Remote Config [baseline] (594.184 µs) : 0, 594
Remote Config [candidate] (588.225 µs) : 0, 588
Telemetry [baseline] (8.024 ms) : 0, 8024
Telemetry [candidate] (8.793 ms) : 0, 8793
Flare Poller [baseline] (5.038 ms) : 0, 5038
Flare Poller [candidate] (4.295 ms) : 0, 4295
section appsec
crashtracking [baseline] (1.19 ms) : 0, 1190
crashtracking [candidate] (1.2 ms) : 0, 1200
BytebuddyAgent [baseline] (657.158 ms) : 0, 657158
BytebuddyAgent [candidate] (657.508 ms) : 0, 657508
AgentMeter [baseline] (12.138 ms) : 0, 12138
AgentMeter [candidate] (12.031 ms) : 0, 12031
GlobalTracer [baseline] (257.839 ms) : 0, 257839
GlobalTracer [candidate] (257.158 ms) : 0, 257158
IAST [baseline] (24.171 ms) : 0, 24171
IAST [candidate] (24.142 ms) : 0, 24142
AppSec [baseline] (177.722 ms) : 0, 177722
AppSec [candidate] (177.56 ms) : 0, 177560
Debugger [baseline] (66.359 ms) : 0, 66359
Debugger [candidate] (66.292 ms) : 0, 66292
Remote Config [baseline] (637.681 µs) : 0, 638
Remote Config [candidate] (639.413 µs) : 0, 639
Telemetry [baseline] (8.36 ms) : 0, 8360
Telemetry [candidate] (8.366 ms) : 0, 8366
Flare Poller [baseline] (3.575 ms) : 0, 3575
Flare Poller [candidate] (3.576 ms) : 0, 3576
section iast
crashtracking [baseline] (1.205 ms) : 0, 1205
crashtracking [candidate] (1.198 ms) : 0, 1198
BytebuddyAgent [baseline] (802.976 ms) : 0, 802976
BytebuddyAgent [candidate] (797.988 ms) : 0, 797988
AgentMeter [baseline] (11.514 ms) : 0, 11514
AgentMeter [candidate] (11.449 ms) : 0, 11449
GlobalTracer [baseline] (248.581 ms) : 0, 248581
GlobalTracer [candidate] (248.253 ms) : 0, 248253
IAST [baseline] (25.508 ms) : 0, 25508
IAST [candidate] (25.314 ms) : 0, 25314
AppSec [baseline] (26.782 ms) : 0, 26782
AppSec [candidate] (26.564 ms) : 0, 26564
Debugger [baseline] (70.431 ms) : 0, 70431
Debugger [candidate] (70.227 ms) : 0, 70227
Remote Config [baseline] (524.065 µs) : 0, 524
Remote Config [candidate] (522.314 µs) : 0, 522
Telemetry [baseline] (9.243 ms) : 0, 9243
Telemetry [candidate] (9.045 ms) : 0, 9045
Flare Poller [baseline] (3.38 ms) : 0, 3380
Flare Poller [candidate] (3.304 ms) : 0, 3304
section profiling
crashtracking [baseline] (1.171 ms) : 0, 1171
crashtracking [candidate] (1.168 ms) : 0, 1168
BytebuddyAgent [baseline] (682.184 ms) : 0, 682184
BytebuddyAgent [candidate] (682.792 ms) : 0, 682792
AgentMeter [baseline] (8.993 ms) : 0, 8993
AgentMeter [candidate] (9.037 ms) : 0, 9037
GlobalTracer [baseline] (214.62 ms) : 0, 214620
GlobalTracer [candidate] (215.067 ms) : 0, 215067
AppSec [baseline] (32.221 ms) : 0, 32221
AppSec [candidate] (32.235 ms) : 0, 32235
Debugger [baseline] (65.826 ms) : 0, 65826
Debugger [candidate] (64.36 ms) : 0, 64360
Remote Config [baseline] (556.798 µs) : 0, 557
Remote Config [candidate] (568.036 µs) : 0, 568
Telemetry [baseline] (7.668 ms) : 0, 7668
Telemetry [candidate] (9.272 ms) : 0, 9272
Flare Poller [baseline] (3.468 ms) : 0, 3468
Flare Poller [candidate] (3.484 ms) : 0, 3484
ProfilingAgent [baseline] (93.514 ms) : 0, 93514
ProfilingAgent [candidate] (93.738 ms) : 0, 93738
Profiling [baseline] (94.072 ms) : 0, 94072
Profiling [candidate] (94.294 ms) : 0, 94294
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/test-management-telemetry
git_commit_date 1774455067 1774457035
git_commit_sha fc26db7 477a16d
release_version 1.61.0-SNAPSHOT~fc26db76f4 1.61.0-SNAPSHOT~477a16dadc
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1774459290 1774459290
ci_job_id 1538291257 1538291257
ci_pipeline_id 104375486 104375486
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-uumsp0ca 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-uumsp0ca 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 1 performance regressions! Performance is the same for 16 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:profiling:high_load worse
[+88.140µs; +221.334µs] or [+5.516%; +13.851%]		 unstable
[+409.521µs; +1383.750µs] or [+9.288%; +31.384%]		 unstable
[-535.277op/s; +20.590op/s] or [-23.150%; +0.890%]		 1.753ms 5.306ms 2054.906op/s 1.598ms 4.409ms 2312.250op/s
scenario:load:insecure-bank:iast_GLOBAL:high_load better
[-182.799µs; -62.445µs] or [-6.369%; -2.176%]		 same
[-321.321µs; +75.611µs] or [-4.008%; +0.943%]		 unstable
[-110.128op/s; +181.941op/s] or [-8.764%; +14.480%]		 2.748ms 7.893ms 1292.438op/s 2.870ms 8.016ms 1256.531op/s
scenario:load:petclinic:code_origins:high_load better
[-1.397ms; -0.603ms] or [-7.599%; -3.279%]		 better
[-2.637ms; -0.798ms] or [-8.762%; -2.651%]		 unstable
[-15.845op/s; +40.970op/s] or [-6.351%; +16.421%]		 17.388ms 28.374ms 262.062op/s 18.388ms 30.091ms 249.500op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~477a16dadc, baseline=1.61.0-SNAPSHOT~fc26db76f4
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.376 ms) : 17200, 17552
.   : milestone, 17376,
appsec (18.86 ms) : 18671, 19049
.   : milestone, 18860,
code_origins (18.703 ms) : 18514, 18893
.   : milestone, 18703,
iast (18.551 ms) : 18365, 18736
.   : milestone, 18551,
profiling (18.955 ms) : 18765, 19146
.   : milestone, 18955,
tracing (17.716 ms) : 17539, 17892
.   : milestone, 17716,
section candidate
no_agent (17.895 ms) : 17713, 18077
.   : milestone, 17895,
appsec (18.82 ms) : 18628, 19012
.   : milestone, 18820,
code_origins (17.802 ms) : 17626, 17977
.   : milestone, 17802,
iast (18.045 ms) : 17867, 18223
.   : milestone, 18045,
profiling (19.665 ms) : 19465, 19865
.   : milestone, 19665,
tracing (17.969 ms) : 17791, 18147
.   : milestone, 17969,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.376 ms [17.2 ms, 17.552 ms] -
appsec 18.86 ms [18.671 ms, 19.049 ms] 1.484 ms (8.5%)
code_origins 18.703 ms [18.514 ms, 18.893 ms] 1.328 ms (7.6%)
iast 18.551 ms [18.365 ms, 18.736 ms] 1.175 ms (6.8%)
profiling 18.955 ms [18.765 ms, 19.146 ms] 1.579 ms (9.1%)
tracing 17.716 ms [17.539 ms, 17.892 ms] 340.103 µs (2.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.895 ms [17.713 ms, 18.077 ms] -
appsec 18.82 ms [18.628 ms, 19.012 ms] 924.936 µs (5.2%)
code_origins 17.802 ms [17.626 ms, 17.977 ms] -93.639 µs (-0.5%)
iast 18.045 ms [17.867 ms, 18.223 ms] 149.456 µs (0.8%)
profiling 19.665 ms [19.465 ms, 19.865 ms] 1.77 ms (9.9%)
tracing 17.969 ms [17.791 ms, 18.147 ms] 73.969 µs (0.4%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~477a16dadc, baseline=1.61.0-SNAPSHOT~fc26db76f4
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.191 ms) : 1179, 1203
.   : milestone, 1191,
iast (3.119 ms) : 3081, 3157
.   : milestone, 3119,
iast_FULL (5.749 ms) : 5692, 5806
.   : milestone, 5749,
iast_GLOBAL (3.651 ms) : 3591, 3711
.   : milestone, 3651,
profiling (1.951 ms) : 1931, 1970
.   : milestone, 1951,
tracing (1.776 ms) : 1761, 1791
.   : milestone, 1776,
section candidate
no_agent (1.174 ms) : 1162, 1185
.   : milestone, 1174,
iast (3.137 ms) : 3098, 3177
.   : milestone, 3137,
iast_FULL (5.728 ms) : 5672, 5785
.   : milestone, 5728,
iast_GLOBAL (3.548 ms) : 3487, 3608
.   : milestone, 3548,
profiling (2.203 ms) : 2184, 2223
.   : milestone, 2203,
tracing (1.829 ms) : 1813, 1845
.   : milestone, 1829,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.191 ms [1.179 ms, 1.203 ms] -
iast 3.119 ms [3.081 ms, 3.157 ms] 1.928 ms (161.9%)
iast_FULL 5.749 ms [5.692 ms, 5.806 ms] 4.558 ms (382.7%)
iast_GLOBAL 3.651 ms [3.591 ms, 3.711 ms] 2.46 ms (206.5%)
profiling 1.951 ms [1.931 ms, 1.97 ms] 759.568 µs (63.8%)
tracing 1.776 ms [1.761 ms, 1.791 ms] 584.824 µs (49.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.174 ms [1.162 ms, 1.185 ms] -
iast 3.137 ms [3.098 ms, 3.177 ms] 1.964 ms (167.3%)
iast_FULL 5.728 ms [5.672 ms, 5.785 ms] 4.555 ms (388.1%)
iast_GLOBAL 3.548 ms [3.487 ms, 3.608 ms] 2.374 ms (202.3%)
profiling 2.203 ms [2.184 ms, 2.223 ms] 1.03 ms (87.7%)
tracing 1.829 ms [1.813 ms, 1.845 ms] 655.6 µs (55.9%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/test-management-telemetry
git_commit_date 1774455067 1774457035
git_commit_sha fc26db7 477a16d
release_version 1.61.0-SNAPSHOT~fc26db76f4 1.61.0-SNAPSHOT~477a16dadc
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1774459017 1774459017
ci_job_id 1538291260 1538291260
ci_pipeline_id 104375486 104375486
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-4oxb9i33 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-4oxb9i33 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~477a16dadc, baseline=1.61.0-SNAPSHOT~fc26db76f4
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.802 s) : 14802000, 14802000
.   : milestone, 14802000,
appsec (14.873 s) : 14873000, 14873000
.   : milestone, 14873000,
iast (17.995 s) : 17995000, 17995000
.   : milestone, 17995000,
iast_GLOBAL (17.832 s) : 17832000, 17832000
.   : milestone, 17832000,
profiling (14.834 s) : 14834000, 14834000
.   : milestone, 14834000,
tracing (14.842 s) : 14842000, 14842000
.   : milestone, 14842000,
section candidate
no_agent (15.554 s) : 15554000, 15554000
.   : milestone, 15554000,
appsec (14.751 s) : 14751000, 14751000
.   : milestone, 14751000,
iast (18.428 s) : 18428000, 18428000
.   : milestone, 18428000,
iast_GLOBAL (18.004 s) : 18004000, 18004000
.   : milestone, 18004000,
profiling (15.049 s) : 15049000, 15049000
.   : milestone, 15049000,
tracing (14.926 s) : 14926000, 14926000
.   : milestone, 14926000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.802 s [14.802 s, 14.802 s] -
appsec 14.873 s [14.873 s, 14.873 s] 71.0 ms (0.5%)
iast 17.995 s [17.995 s, 17.995 s] 3.193 s (21.6%)
iast_GLOBAL 17.832 s [17.832 s, 17.832 s] 3.03 s (20.5%)
profiling 14.834 s [14.834 s, 14.834 s] 32.0 ms (0.2%)
tracing 14.842 s [14.842 s, 14.842 s] 40.0 ms (0.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.554 s [15.554 s, 15.554 s] -
appsec 14.751 s [14.751 s, 14.751 s] -803.0 ms (-5.2%)
iast 18.428 s [18.428 s, 18.428 s] 2.874 s (18.5%)
iast_GLOBAL 18.004 s [18.004 s, 18.004 s] 2.45 s (15.8%)
profiling 15.049 s [15.049 s, 15.049 s] -505.0 ms (-3.2%)
tracing 14.926 s [14.926 s, 14.926 s] -628.0 ms (-4.0%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~477a16dadc, baseline=1.61.0-SNAPSHOT~fc26db76f4
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.47 ms) : 1459, 1482
.   : milestone, 1470,
appsec (2.508 ms) : 2453, 2563
.   : milestone, 2508,
iast (2.24 ms) : 2171, 2309
.   : milestone, 2240,
iast_GLOBAL (2.28 ms) : 2211, 2349
.   : milestone, 2280,
profiling (2.061 ms) : 2007, 2116
.   : milestone, 2061,
tracing (2.043 ms) : 1989, 2096
.   : milestone, 2043,
section candidate
no_agent (1.472 ms) : 1460, 1483
.   : milestone, 1472,
appsec (3.779 ms) : 3558, 4000
.   : milestone, 3779,
iast (2.235 ms) : 2166, 2303
.   : milestone, 2235,
iast_GLOBAL (2.28 ms) : 2212, 2349
.   : milestone, 2280,
profiling (2.493 ms) : 2326, 2661
.   : milestone, 2493,
tracing (2.046 ms) : 1993, 2100
.   : milestone, 2046,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.47 ms [1.459 ms, 1.482 ms] -
appsec 2.508 ms [2.453 ms, 2.563 ms] 1.038 ms (70.6%)
iast 2.24 ms [2.171 ms, 2.309 ms] 769.726 µs (52.4%)
iast_GLOBAL 2.28 ms [2.211 ms, 2.349 ms] 809.968 µs (55.1%)
profiling 2.061 ms [2.007 ms, 2.116 ms] 591.227 µs (40.2%)
tracing 2.043 ms [1.989 ms, 2.096 ms] 572.359 µs (38.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.472 ms [1.46 ms, 1.483 ms] -
appsec 3.779 ms [3.558 ms, 4.0 ms] 2.308 ms (156.8%)
iast 2.235 ms [2.166 ms, 2.303 ms] 763.16 µs (51.9%)
iast_GLOBAL 2.28 ms [2.212 ms, 2.349 ms] 808.886 µs (55.0%)
profiling 2.493 ms [2.326 ms, 2.661 ms] 1.022 ms (69.4%)
tracing 2.046 ms [1.993 ms, 2.1 ms] 574.867 µs (39.1%)