Home Original page

Force manual keep of traces for AI Guard by smola · Pull Request #10625 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/ai-guard-root-span-keep
git_commit_date 1771441202 1771489469
git_commit_sha 2fa3c0c ea830f9
release_version 1.60.0-SNAPSHOT~2fa3c0c243 1.60.0-SNAPSHOT~ea830f9f46
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1771491556 1771491556
ci_job_id 1438275794 1438275794
ci_pipeline_id 97477747 97477747
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-zukq9p87 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-zukq9p87 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 63 metrics, 8 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~ea830f9f46, baseline=1.60.0-SNAPSHOT~2fa3c0c243

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.068 s) : 0, 1067727
Total [baseline] (10.816 s) : 0, 10816255
Agent [candidate] (1.065 s) : 0, 1064984
Total [candidate] (10.854 s) : 0, 10853963
section appsec
Agent [baseline] (1.237 s) : 0, 1237466
Total [baseline] (11.035 s) : 0, 11034937
Agent [candidate] (1.243 s) : 0, 1243314
Total [candidate] (11.131 s) : 0, 11130577
section iast
Agent [baseline] (1.238 s) : 0, 1237776
Total [baseline] (11.154 s) : 0, 11153768
Agent [candidate] (1.232 s) : 0, 1231770
Total [candidate] (11.294 s) : 0, 11293563
section profiling
Agent [baseline] (1.19 s) : 0, 1189859
Total [baseline] (10.945 s) : 0, 10944627
Agent [candidate] (1.193 s) : 0, 1193444
Total [candidate] (11.047 s) : 0, 11047183
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.068 s -
Agent appsec 1.237 s 169.739 ms (15.9%)
Agent iast 1.238 s 170.049 ms (15.9%)
Agent profiling 1.19 s 122.132 ms (11.4%)
Total tracing 10.816 s -
Total appsec 11.035 s 218.682 ms (2.0%)
Total iast 11.154 s 337.513 ms (3.1%)
Total profiling 10.945 s 128.372 ms (1.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.065 s -
Agent appsec 1.243 s 178.33 ms (16.7%)
Agent iast 1.232 s 166.786 ms (15.7%)
Agent profiling 1.193 s 128.46 ms (12.1%)
Total tracing 10.854 s -
Total appsec 11.131 s 276.614 ms (2.5%)
Total iast 11.294 s 439.601 ms (4.1%)
Total profiling 11.047 s 193.22 ms (1.8%) 
gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~ea830f9f46, baseline=1.60.0-SNAPSHOT~2fa3c0c243

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.207 ms) : 0, 1207
crashtracking [candidate] (1.183 ms) : 0, 1183
BytebuddyAgent [baseline] (630.822 ms) : 0, 630822
BytebuddyAgent [candidate] (628.009 ms) : 0, 628009
AgentMeter [baseline] (29.232 ms) : 0, 29232
AgentMeter [candidate] (29.098 ms) : 0, 29098
GlobalTracer [baseline] (257.88 ms) : 0, 257880
GlobalTracer [candidate] (257.387 ms) : 0, 257387
AppSec [baseline] (32.737 ms) : 0, 32737
AppSec [candidate] (32.986 ms) : 0, 32986
Debugger [baseline] (64.06 ms) : 0, 64060
Debugger [candidate] (63.672 ms) : 0, 63672
Remote Config [baseline] (600.042 µs) : 0, 600
Remote Config [candidate] (608.878 µs) : 0, 609
Telemetry [baseline] (11.326 ms) : 0, 11326
Telemetry [candidate] (12.187 ms) : 0, 12187
Flare Poller [baseline] (3.762 ms) : 0, 3762
Flare Poller [candidate] (3.777 ms) : 0, 3777
section appsec
crashtracking [baseline] (1.183 ms) : 0, 1183
crashtracking [candidate] (1.184 ms) : 0, 1184
BytebuddyAgent [baseline] (656.478 ms) : 0, 656478
BytebuddyAgent [candidate] (658.609 ms) : 0, 658609
AgentMeter [baseline] (11.977 ms) : 0, 11977
AgentMeter [candidate] (11.951 ms) : 0, 11951
GlobalTracer [baseline] (257.888 ms) : 0, 257888
GlobalTracer [candidate] (259.726 ms) : 0, 259726
AppSec [baseline] (167.832 ms) : 0, 167832
AppSec [candidate] (168.605 ms) : 0, 168605
Debugger [baseline] (66.923 ms) : 0, 66923
Debugger [candidate] (67.403 ms) : 0, 67403
Remote Config [baseline] (639.137 µs) : 0, 639
Remote Config [candidate] (659.771 µs) : 0, 660
Telemetry [baseline] (9.434 ms) : 0, 9434
Telemetry [candidate] (9.609 ms) : 0, 9609
Flare Poller [baseline] (3.737 ms) : 0, 3737
Flare Poller [candidate] (3.791 ms) : 0, 3791
IAST [baseline] (25.373 ms) : 0, 25373
IAST [candidate] (25.715 ms) : 0, 25715
section iast
crashtracking [baseline] (1.197 ms) : 0, 1197
crashtracking [candidate] (1.186 ms) : 0, 1186
BytebuddyAgent [baseline] (800.955 ms) : 0, 800955
BytebuddyAgent [candidate] (795.742 ms) : 0, 795742
AgentMeter [baseline] (11.567 ms) : 0, 11567
AgentMeter [candidate] (11.282 ms) : 0, 11282
GlobalTracer [baseline] (248.078 ms) : 0, 248078
GlobalTracer [candidate] (248.029 ms) : 0, 248029
AppSec [baseline] (34.836 ms) : 0, 34836
AppSec [candidate] (34.714 ms) : 0, 34714
Debugger [baseline] (65.278 ms) : 0, 65278
Debugger [candidate] (65.542 ms) : 0, 65542
Remote Config [baseline] (550.284 µs) : 0, 550
Remote Config [candidate] (533.087 µs) : 0, 533
Telemetry [baseline] (8.656 ms) : 0, 8656
Telemetry [candidate] (8.568 ms) : 0, 8568
Flare Poller [baseline] (3.453 ms) : 0, 3453
Flare Poller [candidate] (3.394 ms) : 0, 3394
IAST [baseline] (27.129 ms) : 0, 27129
IAST [candidate] (26.885 ms) : 0, 26885
section profiling
ProfilingAgent [baseline] (99.086 ms) : 0, 99086
ProfilingAgent [candidate] (99.526 ms) : 0, 99526
crashtracking [baseline] (1.199 ms) : 0, 1199
crashtracking [candidate] (1.19 ms) : 0, 1190
BytebuddyAgent [baseline] (681.73 ms) : 0, 681730
BytebuddyAgent [candidate] (683.677 ms) : 0, 683677
AgentMeter [baseline] (8.557 ms) : 0, 8557
AgentMeter [candidate] (8.563 ms) : 0, 8563
GlobalTracer [baseline] (215.608 ms) : 0, 215608
GlobalTracer [candidate] (216.468 ms) : 0, 216468
AppSec [baseline] (32.519 ms) : 0, 32519
AppSec [candidate] (32.75 ms) : 0, 32750
Debugger [baseline] (67.12 ms) : 0, 67120
Debugger [candidate] (66.938 ms) : 0, 66938
Remote Config [baseline] (632.247 µs) : 0, 632
Remote Config [candidate] (627.089 µs) : 0, 627
Telemetry [baseline] (9.079 ms) : 0, 9079
Telemetry [candidate] (9.138 ms) : 0, 9138
Flare Poller [baseline] (3.744 ms) : 0, 3744
Flare Poller [candidate] (3.809 ms) : 0, 3809
Profiling [baseline] (99.667 ms) : 0, 99667
Profiling [candidate] (100.106 ms) : 0, 100106
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~ea830f9f46, baseline=1.60.0-SNAPSHOT~2fa3c0c243

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.067 s) : 0, 1066597
Total [baseline] (8.745 s) : 0, 8745376
Agent [candidate] (1.065 s) : 0, 1065463
Total [candidate] (8.733 s) : 0, 8733233
section iast
Agent [baseline] (1.229 s) : 0, 1229149
Total [baseline] (9.387 s) : 0, 9386767
Agent [candidate] (1.23 s) : 0, 1230003
Total [candidate] (9.383 s) : 0, 9382680
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.067 s -
Agent iast 1.229 s 162.552 ms (15.2%)
Total tracing 8.745 s -
Total iast 9.387 s 641.391 ms (7.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.065 s -
Agent iast 1.23 s 164.54 ms (15.4%)
Total tracing 8.733 s -
Total iast 9.383 s 649.446 ms (7.4%) 
gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~ea830f9f46, baseline=1.60.0-SNAPSHOT~2fa3c0c243

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.194 ms) : 0, 1194
crashtracking [candidate] (1.197 ms) : 0, 1197
BytebuddyAgent [baseline] (627.896 ms) : 0, 627896
BytebuddyAgent [candidate] (628.874 ms) : 0, 628874
AgentMeter [baseline] (29.156 ms) : 0, 29156
AgentMeter [candidate] (29.15 ms) : 0, 29150
GlobalTracer [baseline] (257.919 ms) : 0, 257919
GlobalTracer [candidate] (257.754 ms) : 0, 257754
AppSec [baseline] (33.284 ms) : 0, 33284
AppSec [candidate] (32.941 ms) : 0, 32941
Debugger [baseline] (62.071 ms) : 0, 62071
Debugger [candidate] (62.083 ms) : 0, 62083
Remote Config [baseline] (615.761 µs) : 0, 616
Remote Config [candidate] (616.624 µs) : 0, 617
Telemetry [baseline] (13.09 ms) : 0, 13090
Telemetry [candidate] (9.85 ms) : 0, 9850
Flare Poller [baseline] (5.275 ms) : 0, 5275
Flare Poller [candidate] (6.876 ms) : 0, 6876
section iast
crashtracking [baseline] (1.223 ms) : 0, 1223
crashtracking [candidate] (1.205 ms) : 0, 1205
BytebuddyAgent [baseline] (794.516 ms) : 0, 794516
BytebuddyAgent [candidate] (794.53 ms) : 0, 794530
AgentMeter [baseline] (11.308 ms) : 0, 11308
AgentMeter [candidate] (11.281 ms) : 0, 11281
GlobalTracer [baseline] (247.437 ms) : 0, 247437
GlobalTracer [candidate] (248.166 ms) : 0, 248166
IAST [baseline] (26.925 ms) : 0, 26925
IAST [candidate] (26.968 ms) : 0, 26968
AppSec [baseline] (32.236 ms) : 0, 32236
AppSec [candidate] (33.674 ms) : 0, 33674
Debugger [baseline] (67.011 ms) : 0, 67011
Debugger [candidate] (65.538 ms) : 0, 65538
Remote Config [baseline] (521.835 µs) : 0, 522
Remote Config [candidate] (535.106 µs) : 0, 535
Telemetry [baseline] (8.607 ms) : 0, 8607
Telemetry [candidate] (8.635 ms) : 0, 8635
Flare Poller [baseline] (3.404 ms) : 0, 3404
Flare Poller [candidate] (3.497 ms) : 0, 3497
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/ai-guard-root-span-keep
git_commit_date 1771441202 1771489469
git_commit_sha 2fa3c0c ea830f9
release_version 1.60.0-SNAPSHOT~2fa3c0c243 1.60.0-SNAPSHOT~ea830f9f46
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1771492195 1771492195
ci_job_id 1438275795 1438275795
ci_pipeline_id 97477747 97477747
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-3yfu4ly4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-3yfu4ly4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 4 performance regressions! Performance is the same for 15 metrics, 15 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:profiling:high_load worse
[+60.025µs; +187.840µs] or [+3.731%; +11.675%]		 unstable
[+235.932µs; +1094.747µs] or [+5.185%; +24.060%]		 unstable
[-496.644op/s; +3.706op/s] or [-21.573%; +0.161%]		 1.733ms 5.215ms 2055.656op/s 1.609ms 4.550ms 2302.125op/s
scenario:load:insecure-bank:iast:high_load better
[-181.538µs; -87.973µs] or [-7.133%; -3.457%]		 unsure
[-483.503µs; -78.874µs] or [-6.450%; -1.052%]		 unstable
[-84.972op/s; +210.034op/s] or [-6.072%; +15.008%]		 2.410ms 7.215ms 1462.031op/s 2.545ms 7.496ms 1399.500op/s
scenario:load:petclinic:no_agent:high_load worse
[+1.847ms; +3.042ms] or [+11.207%; +18.459%]		 worse
[+1.989ms; +4.530ms] or [+7.091%; +16.144%]		 unstable
[-60.925op/s; -4.075op/s] or [-22.335%; -1.494%]		 18.926ms 31.317ms 240.281op/s 16.481ms 28.058ms 272.781op/s
scenario:load:petclinic:profiling:high_load worse
[+0.467ms; +1.604ms] or [+2.523%; +8.666%]		 unsure
[+0.232ms; +2.616ms] or [+0.767%; +8.644%]		 unstable
[-37.686op/s; +14.186op/s] or [-15.322%; +5.767%]		 19.546ms 31.695ms 234.219op/s 18.510ms 30.271ms 245.969op/s
scenario:load:petclinic:iast:high_load better
[-1254.490µs; -361.558µs] or [-6.951%; -2.003%]		 unsure
[-1.866ms; -0.283ms] or [-6.362%; -0.964%]		 unstable
[-19.337op/s; +36.275op/s] or [-7.588%; +14.234%]		 17.240ms 28.260ms 263.312op/s 18.048ms 29.334ms 254.844op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~ea830f9f46, baseline=1.60.0-SNAPSHOT~2fa3c0c243
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.207 ms) : 1195, 1219
.   : milestone, 1207,
iast (3.276 ms) : 3235, 3316
.   : milestone, 3276,
iast_FULL (5.864 ms) : 5806, 5922
.   : milestone, 5864,
iast_GLOBAL (3.68 ms) : 3618, 3741
.   : milestone, 3680,
profiling (1.959 ms) : 1942, 1975
.   : milestone, 1959,
tracing (1.775 ms) : 1761, 1789
.   : milestone, 1775,
section candidate
no_agent (1.175 ms) : 1164, 1187
.   : milestone, 1175,
iast (3.128 ms) : 3086, 3169
.   : milestone, 3128,
iast_FULL (5.838 ms) : 5780, 5897
.   : milestone, 5838,
iast_GLOBAL (3.592 ms) : 3527, 3658
.   : milestone, 3592,
profiling (2.203 ms) : 2184, 2223
.   : milestone, 2203,
tracing (1.778 ms) : 1763, 1794
.   : milestone, 1778,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.207 ms [1.195 ms, 1.219 ms] -
iast 3.276 ms [3.235 ms, 3.316 ms] 2.068 ms (171.3%)
iast_FULL 5.864 ms [5.806 ms, 5.922 ms] 4.657 ms (385.7%)
iast_GLOBAL 3.68 ms [3.618 ms, 3.741 ms] 2.472 ms (204.8%)
profiling 1.959 ms [1.942 ms, 1.975 ms] 751.26 µs (62.2%)
tracing 1.775 ms [1.761 ms, 1.789 ms] 567.671 µs (47.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.175 ms [1.164 ms, 1.187 ms] -
iast 3.128 ms [3.086 ms, 3.169 ms] 1.952 ms (166.1%)
iast_FULL 5.838 ms [5.78 ms, 5.897 ms] 4.663 ms (396.7%)
iast_GLOBAL 3.592 ms [3.527 ms, 3.658 ms] 2.417 ms (205.6%)
profiling 2.203 ms [2.184 ms, 2.223 ms] 1.028 ms (87.4%)
tracing 1.778 ms [1.763 ms, 1.794 ms] 602.836 µs (51.3%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~ea830f9f46, baseline=1.60.0-SNAPSHOT~2fa3c0c243
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.102 ms) : 16934, 17269
.   : milestone, 17102,
appsec (19.193 ms) : 18998, 19388
.   : milestone, 19193,
code_origins (18.582 ms) : 18397, 18766
.   : milestone, 18582,
iast (18.315 ms) : 18129, 18500
.   : milestone, 18315,
profiling (18.971 ms) : 18783, 19159
.   : milestone, 18971,
tracing (17.496 ms) : 17322, 17671
.   : milestone, 17496,
section candidate
no_agent (19.427 ms) : 19227, 19626
.   : milestone, 19427,
appsec (18.706 ms) : 18519, 18894
.   : milestone, 18706,
code_origins (18.841 ms) : 18652, 19031
.   : milestone, 18841,
iast (17.722 ms) : 17546, 17898
.   : milestone, 17722,
profiling (19.934 ms) : 19728, 20139
.   : milestone, 19934,
tracing (17.75 ms) : 17575, 17926
.   : milestone, 17750,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.102 ms [16.934 ms, 17.269 ms] -
appsec 19.193 ms [18.998 ms, 19.388 ms] 2.091 ms (12.2%)
code_origins 18.582 ms [18.397 ms, 18.766 ms] 1.48 ms (8.7%)
iast 18.315 ms [18.129 ms, 18.5 ms] 1.213 ms (7.1%)
profiling 18.971 ms [18.783 ms, 19.159 ms] 1.869 ms (10.9%)
tracing 17.496 ms [17.322 ms, 17.671 ms] 394.898 µs (2.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.427 ms [19.227 ms, 19.626 ms] -
appsec 18.706 ms [18.519 ms, 18.894 ms] -720.632 µs (-3.7%)
code_origins 18.841 ms [18.652 ms, 19.031 ms] -585.42 µs (-3.0%)
iast 17.722 ms [17.546 ms, 17.898 ms] -1.704 ms (-8.8%)
profiling 19.934 ms [19.728 ms, 20.139 ms] 507.149 µs (2.6%)
tracing 17.75 ms [17.575 ms, 17.926 ms] -1.676 ms (-8.6%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/ai-guard-root-span-keep
git_commit_date 1771441202 1771489469
git_commit_sha 2fa3c0c ea830f9
release_version 1.60.0-SNAPSHOT~2fa3c0c243 1.60.0-SNAPSHOT~ea830f9f46
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1771491916 1771491916
ci_job_id 1438275796 1438275796
ci_pipeline_id 97477747 97477747
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-250q2nne 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-250q2nne 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~ea830f9f46, baseline=1.60.0-SNAPSHOT~2fa3c0c243
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.853 s) : 14853000, 14853000
.   : milestone, 14853000,
appsec (14.975 s) : 14975000, 14975000
.   : milestone, 14975000,
iast (17.57 s) : 17570000, 17570000
.   : milestone, 17570000,
iast_GLOBAL (17.79 s) : 17790000, 17790000
.   : milestone, 17790000,
profiling (14.87 s) : 14870000, 14870000
.   : milestone, 14870000,
tracing (14.603 s) : 14603000, 14603000
.   : milestone, 14603000,
section candidate
no_agent (15.039 s) : 15039000, 15039000
.   : milestone, 15039000,
appsec (14.828 s) : 14828000, 14828000
.   : milestone, 14828000,
iast (18.258 s) : 18258000, 18258000
.   : milestone, 18258000,
iast_GLOBAL (17.943 s) : 17943000, 17943000
.   : milestone, 17943000,
profiling (14.891 s) : 14891000, 14891000
.   : milestone, 14891000,
tracing (14.991 s) : 14991000, 14991000
.   : milestone, 14991000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.853 s [14.853 s, 14.853 s] -
appsec 14.975 s [14.975 s, 14.975 s] 122.0 ms (0.8%)
iast 17.57 s [17.57 s, 17.57 s] 2.717 s (18.3%)
iast_GLOBAL 17.79 s [17.79 s, 17.79 s] 2.937 s (19.8%)
profiling 14.87 s [14.87 s, 14.87 s] 17.0 ms (0.1%)
tracing 14.603 s [14.603 s, 14.603 s] -250.0 ms (-1.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.039 s [15.039 s, 15.039 s] -
appsec 14.828 s [14.828 s, 14.828 s] -211.0 ms (-1.4%)
iast 18.258 s [18.258 s, 18.258 s] 3.219 s (21.4%)
iast_GLOBAL 17.943 s [17.943 s, 17.943 s] 2.904 s (19.3%)
profiling 14.891 s [14.891 s, 14.891 s] -148.0 ms (-1.0%)
tracing 14.991 s [14.991 s, 14.991 s] -48.0 ms (-0.3%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~ea830f9f46, baseline=1.60.0-SNAPSHOT~2fa3c0c243
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.482 ms) : 1470, 1493
.   : milestone, 1482,
appsec (3.809 ms) : 3587, 4031
.   : milestone, 3809,
iast (2.263 ms) : 2193, 2332
.   : milestone, 2263,
iast_GLOBAL (2.298 ms) : 2229, 2368
.   : milestone, 2298,
profiling (2.079 ms) : 2025, 2134
.   : milestone, 2079,
tracing (2.068 ms) : 2014, 2122
.   : milestone, 2068,
section candidate
no_agent (1.47 ms) : 1458, 1481
.   : milestone, 1470,
appsec (3.803 ms) : 3581, 4024
.   : milestone, 3803,
iast (2.274 ms) : 2204, 2343
.   : milestone, 2274,
iast_GLOBAL (2.311 ms) : 2241, 2381
.   : milestone, 2311,
profiling (2.502 ms) : 2339, 2666
.   : milestone, 2502,
tracing (2.082 ms) : 2028, 2137
.   : milestone, 2082,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.482 ms [1.47 ms, 1.493 ms] -
appsec 3.809 ms [3.587 ms, 4.031 ms] 2.327 ms (157.1%)
iast 2.263 ms [2.193 ms, 2.332 ms] 781.163 µs (52.7%)
iast_GLOBAL 2.298 ms [2.229 ms, 2.368 ms] 816.639 µs (55.1%)
profiling 2.079 ms [2.025 ms, 2.134 ms] 597.573 µs (40.3%)
tracing 2.068 ms [2.014 ms, 2.122 ms] 586.246 µs (39.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.47 ms [1.458 ms, 1.481 ms] -
appsec 3.803 ms [3.581 ms, 4.024 ms] 2.333 ms (158.7%)
iast 2.274 ms [2.204 ms, 2.343 ms] 803.86 µs (54.7%)
iast_GLOBAL 2.311 ms [2.241 ms, 2.381 ms] 841.504 µs (57.3%)
profiling 2.502 ms [2.339 ms, 2.666 ms] 1.033 ms (70.3%)
tracing 2.082 ms [2.028 ms, 2.137 ms] 612.817 µs (41.7%)