Write base hash to current span when injected in DBM comment by vandonr · Pull Request #10450 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master vandonr/fix
git_commit_date 1770814715 1770822201
git_commit_sha 326cc38 fdd5cdd
release_version 1.60.0-SNAPSHOT~326cc3877f 1.59.0-SNAPSHOT~fdd5cdd7df
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1770824079 1770824079
ci_job_id 1417581940 1417581940
ci_pipeline_id 95831400 95831400
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-xhhc7sow 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-xhhc7sow 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 64 metrics, 7 unstable metrics.

Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.59.0-SNAPSHOT~fdd5cdd7df, baseline=1.60.0-SNAPSHOT~326cc3877f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.066 s) : 0, 1065697
Total [baseline] (10.96 s) : 0, 10960245
Agent [candidate] (1.066 s) : 0, 1066469
Total [candidate] (10.944 s) : 0, 10944460
section appsec
Agent [baseline] (1.239 s) : 0, 1238730
Total [baseline] (11.019 s) : 0, 11018884
Agent [candidate] (1.247 s) : 0, 1246936
Total [candidate] (11.026 s) : 0, 11026444
section iast
Agent [baseline] (1.235 s) : 0, 1234509
Total [baseline] (11.222 s) : 0, 11221962
Agent [candidate] (1.236 s) : 0, 1236020
Total [candidate] (11.237 s) : 0, 11237344
section profiling
Agent [baseline] (1.192 s) : 0, 1191513
Total [baseline] (10.989 s) : 0, 10989129
Agent [candidate] (1.199 s) : 0, 1198670
Total [candidate] (10.918 s) : 0, 10918277
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.066 s -
Agent appsec 1.239 s 173.033 ms (16.2%)
Agent iast 1.235 s 168.812 ms (15.8%)
Agent profiling 1.192 s 125.816 ms (11.8%)
Total tracing 10.96 s -
Total appsec 11.019 s 58.639 ms (0.5%)
Total iast 11.222 s 261.717 ms (2.4%)
Total profiling 10.989 s 28.884 ms (0.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.066 s -
Agent appsec 1.247 s 180.467 ms (16.9%)
Agent iast 1.236 s 169.551 ms (15.9%)
Agent profiling 1.199 s 132.201 ms (12.4%)
Total tracing 10.944 s -
Total appsec 11.026 s 81.984 ms (0.7%)
Total iast 11.237 s 292.883 ms (2.7%)
Total profiling 10.918 s -26.183 ms (-0.2%)
gantt
    title petclinic - break down per module: candidate=1.59.0-SNAPSHOT~fdd5cdd7df, baseline=1.60.0-SNAPSHOT~326cc3877f

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.207 ms) : 0, 1207
crashtracking [candidate] (1.188 ms) : 0, 1188
BytebuddyAgent [baseline] (629.071 ms) : 0, 629071
BytebuddyAgent [candidate] (630.699 ms) : 0, 630699
AgentMeter [baseline] (28.958 ms) : 0, 28958
AgentMeter [candidate] (28.957 ms) : 0, 28957
GlobalTracer [baseline] (257.577 ms) : 0, 257577
GlobalTracer [candidate] (258.604 ms) : 0, 258604
AppSec [baseline] (32.719 ms) : 0, 32719
AppSec [candidate] (32.84 ms) : 0, 32840
Debugger [baseline] (61.875 ms) : 0, 61875
Debugger [candidate] (61.48 ms) : 0, 61480
Remote Config [baseline] (625.339 µs) : 0, 625
Remote Config [candidate] (640.438 µs) : 0, 640
Telemetry [baseline] (12.23 ms) : 0, 12230
Telemetry [candidate] (10.713 ms) : 0, 10713
Flare Poller [baseline] (6.118 ms) : 0, 6118
Flare Poller [candidate] (6.072 ms) : 0, 6072
section appsec
crashtracking [baseline] (1.181 ms) : 0, 1181
crashtracking [candidate] (1.187 ms) : 0, 1187
BytebuddyAgent [baseline] (658.773 ms) : 0, 658773
BytebuddyAgent [candidate] (662.488 ms) : 0, 662488
AgentMeter [baseline] (11.959 ms) : 0, 11959
AgentMeter [candidate] (12.059 ms) : 0, 12059
GlobalTracer [baseline] (258.102 ms) : 0, 258102
GlobalTracer [candidate] (259.893 ms) : 0, 259893
AppSec [baseline] (167.455 ms) : 0, 167455
AppSec [candidate] (168.594 ms) : 0, 168594
Debugger [baseline] (67.097 ms) : 0, 67097
Debugger [candidate] (67.58 ms) : 0, 67580
Remote Config [baseline] (650.177 µs) : 0, 650
Remote Config [candidate] (650.425 µs) : 0, 650
Telemetry [baseline] (9.402 ms) : 0, 9402
Telemetry [candidate] (9.747 ms) : 0, 9747
Flare Poller [baseline] (3.653 ms) : 0, 3653
Flare Poller [candidate] (3.771 ms) : 0, 3771
IAST [baseline] (25.073 ms) : 0, 25073
IAST [candidate] (25.423 ms) : 0, 25423
section iast
crashtracking [baseline] (1.18 ms) : 0, 1180
crashtracking [candidate] (1.201 ms) : 0, 1201
BytebuddyAgent [baseline] (796.874 ms) : 0, 796874
BytebuddyAgent [candidate] (798.616 ms) : 0, 798616
AgentMeter [baseline] (11.266 ms) : 0, 11266
AgentMeter [candidate] (11.255 ms) : 0, 11255
GlobalTracer [baseline] (248.816 ms) : 0, 248816
GlobalTracer [candidate] (249.708 ms) : 0, 249708
AppSec [baseline] (33.265 ms) : 0, 33265
AppSec [candidate] (33.111 ms) : 0, 33111
Debugger [baseline] (68.127 ms) : 0, 68127
Debugger [candidate] (67.425 ms) : 0, 67425
Remote Config [baseline] (539.942 µs) : 0, 540
Remote Config [candidate] (552.774 µs) : 0, 553
Telemetry [baseline] (8.653 ms) : 0, 8653
Telemetry [candidate] (8.555 ms) : 0, 8555
Flare Poller [baseline] (3.535 ms) : 0, 3535
Flare Poller [candidate] (3.499 ms) : 0, 3499
IAST [baseline] (26.965 ms) : 0, 26965
IAST [candidate] (26.853 ms) : 0, 26853
section profiling
ProfilingAgent [baseline] (99.279 ms) : 0, 99279
ProfilingAgent [candidate] (98.903 ms) : 0, 98903
crashtracking [baseline] (1.235 ms) : 0, 1235
crashtracking [candidate] (1.216 ms) : 0, 1216
BytebuddyAgent [baseline] (682.925 ms) : 0, 682925
BytebuddyAgent [candidate] (688.324 ms) : 0, 688324
AgentMeter [baseline] (8.629 ms) : 0, 8629
AgentMeter [candidate] (8.634 ms) : 0, 8634
GlobalTracer [baseline] (216.265 ms) : 0, 216265
GlobalTracer [candidate] (217.106 ms) : 0, 217106
AppSec [baseline] (32.44 ms) : 0, 32440
AppSec [candidate] (33.008 ms) : 0, 33008
Debugger [baseline] (67.39 ms) : 0, 67390
Debugger [candidate] (67.963 ms) : 0, 67963
Remote Config [baseline] (625.294 µs) : 0, 625
Remote Config [candidate] (642.394 µs) : 0, 642
Telemetry [baseline] (8.944 ms) : 0, 8944
Telemetry [candidate] (8.921 ms) : 0, 8921
Flare Poller [baseline] (3.726 ms) : 0, 3726
Flare Poller [candidate] (3.737 ms) : 0, 3737
Profiling [baseline] (99.848 ms) : 0, 99848
Profiling [candidate] (99.475 ms) : 0, 99475
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.59.0-SNAPSHOT~fdd5cdd7df, baseline=1.60.0-SNAPSHOT~326cc3877f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.072 s) : 0, 1071723
Total [baseline] (8.768 s) : 0, 8768188
Agent [candidate] (1.066 s) : 0, 1065775
Total [candidate] (8.754 s) : 0, 8753917
section iast
Agent [baseline] (1.231 s) : 0, 1231446
Total [baseline] (9.338 s) : 0, 9337882
Agent [candidate] (1.234 s) : 0, 1234079
Total [candidate] (9.395 s) : 0, 9394728
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.072 s -
Agent iast 1.231 s 159.723 ms (14.9%)
Total tracing 8.768 s -
Total iast 9.338 s 569.694 ms (6.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.066 s -
Agent iast 1.234 s 168.304 ms (15.8%)
Total tracing 8.754 s -
Total iast 9.395 s 640.81 ms (7.3%)
gantt
    title insecure-bank - break down per module: candidate=1.59.0-SNAPSHOT~fdd5cdd7df, baseline=1.60.0-SNAPSHOT~326cc3877f

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.187 ms) : 0, 1187
crashtracking [candidate] (1.186 ms) : 0, 1186
BytebuddyAgent [baseline] (631.019 ms) : 0, 631019
BytebuddyAgent [candidate] (630.602 ms) : 0, 630602
AgentMeter [baseline] (29.428 ms) : 0, 29428
AgentMeter [candidate] (28.96 ms) : 0, 28960
GlobalTracer [baseline] (259.482 ms) : 0, 259482
GlobalTracer [candidate] (258.104 ms) : 0, 258104
AppSec [baseline] (33.26 ms) : 0, 33260
AppSec [candidate] (32.948 ms) : 0, 32948
Debugger [baseline] (62.663 ms) : 0, 62663
Debugger [candidate] (59.684 ms) : 0, 59684
Remote Config [baseline] (623.528 µs) : 0, 624
Remote Config [candidate] (626.387 µs) : 0, 626
Telemetry [baseline] (11.647 ms) : 0, 11647
Telemetry [candidate] (10.647 ms) : 0, 10647
Flare Poller [baseline] (6.924 ms) : 0, 6924
Flare Poller [candidate] (7.697 ms) : 0, 7697
section iast
crashtracking [baseline] (1.179 ms) : 0, 1179
crashtracking [candidate] (1.189 ms) : 0, 1189
BytebuddyAgent [baseline] (796.028 ms) : 0, 796028
BytebuddyAgent [candidate] (797.382 ms) : 0, 797382
AgentMeter [baseline] (11.227 ms) : 0, 11227
AgentMeter [candidate] (11.254 ms) : 0, 11254
GlobalTracer [baseline] (247.729 ms) : 0, 247729
GlobalTracer [candidate] (248.667 ms) : 0, 248667
AppSec [baseline] (33.194 ms) : 0, 33194
AppSec [candidate] (34.874 ms) : 0, 34874
Debugger [baseline] (67.065 ms) : 0, 67065
Debugger [candidate] (65.874 ms) : 0, 65874
Remote Config [baseline] (544.76 µs) : 0, 545
Remote Config [candidate] (538.871 µs) : 0, 539
Telemetry [baseline] (8.705 ms) : 0, 8705
Telemetry [candidate] (8.607 ms) : 0, 8607
Flare Poller [baseline] (3.538 ms) : 0, 3538
Flare Poller [candidate] (3.47 ms) : 0, 3470
IAST [baseline] (26.897 ms) : 0, 26897
IAST [candidate] (27.002 ms) : 0, 27002
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master vandonr/fix
git_commit_date 1770814715 1770822201
git_commit_sha 326cc38 fdd5cdd
release_version 1.60.0-SNAPSHOT~326cc3877f 1.59.0-SNAPSHOT~fdd5cdd7df
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1770824504 1770824504
ci_job_id 1417581942 1417581942
ci_pipeline_id 95831400 95831400
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-ais98yur 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-ais98yur 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 2 performance regressions! Performance is the same for 16 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast:high_load worse
[+137.562µs; +231.290µs] or [+5.856%; +9.847%]
unsure
[+124.102µs; +672.619µs] or [+1.736%; +9.411%]
unstable
[-261.371op/s; +66.746op/s] or [-17.507%; +4.471%]
2.533ms 7.545ms 1395.656op/s 2.349ms 7.147ms 1492.969op/s
scenario:load:insecure-bank:iast_FULL:high_load worse
[+158.411µs; +467.375µs] or [+3.265%; +9.633%]
unsure
[+147.498µs; +858.805µs] or [+1.252%; +7.291%]
unstable
[-116.697op/s; +52.947op/s] or [-14.051%; +6.375%]
5.165ms 12.283ms 798.656op/s 4.852ms 11.780ms 830.531op/s
scenario:load:petclinic:tracing:high_load better
[-1.553ms; -0.622ms] or [-8.561%; -3.428%]
same
[-1200.065µs; +73.753µs] or [-4.127%; +0.254%]
unstable
[-19.800op/s; +42.988op/s] or [-7.772%; +16.872%]
17.053ms 28.516ms 266.375op/s 18.141ms 29.079ms 254.781op/s
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~fdd5cdd7df, baseline=1.60.0-SNAPSHOT~326cc3877f
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.206 ms) : 1195, 1218
.   : milestone, 1206,
iast (3.061 ms) : 3020, 3102
.   : milestone, 3061,
iast_FULL (5.561 ms) : 5507, 5616
.   : milestone, 5561,
iast_GLOBAL (3.546 ms) : 3491, 3601
.   : milestone, 3546,
profiling (1.955 ms) : 1939, 1972
.   : milestone, 1955,
tracing (1.801 ms) : 1785, 1817
.   : milestone, 1801,
section candidate
no_agent (1.163 ms) : 1152, 1174
.   : milestone, 1163,
iast (3.28 ms) : 3235, 3325
.   : milestone, 3280,
iast_FULL (5.789 ms) : 5731, 5847
.   : milestone, 5789,
iast_GLOBAL (3.584 ms) : 3533, 3636
.   : milestone, 3584,
profiling (2.139 ms) : 2118, 2160
.   : milestone, 2139,
tracing (1.782 ms) : 1766, 1798
.   : milestone, 1782,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.206 ms [1.195 ms, 1.218 ms] -
iast 3.061 ms [3.02 ms, 3.102 ms] 1.855 ms (153.7%)
iast_FULL 5.561 ms [5.507 ms, 5.616 ms] 4.355 ms (361.0%)
iast_GLOBAL 3.546 ms [3.491 ms, 3.601 ms] 2.34 ms (193.9%)
profiling 1.955 ms [1.939 ms, 1.972 ms] 749.067 µs (62.1%)
tracing 1.801 ms [1.785 ms, 1.817 ms] 594.788 µs (49.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.163 ms [1.152 ms, 1.174 ms] -
iast 3.28 ms [3.235 ms, 3.325 ms] 2.117 ms (182.0%)
iast_FULL 5.789 ms [5.731 ms, 5.847 ms] 4.626 ms (397.7%)
iast_GLOBAL 3.584 ms [3.533 ms, 3.636 ms] 2.421 ms (208.2%)
profiling 2.139 ms [2.118 ms, 2.16 ms] 975.839 µs (83.9%)
tracing 1.782 ms [1.766 ms, 1.798 ms] 618.841 µs (53.2%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~fdd5cdd7df, baseline=1.60.0-SNAPSHOT~326cc3877f
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.86 ms) : 18665, 19054
.   : milestone, 18860,
appsec (18.365 ms) : 18178, 18551
.   : milestone, 18365,
code_origins (17.749 ms) : 17572, 17927
.   : milestone, 17749,
iast (17.693 ms) : 17518, 17868
.   : milestone, 17693,
profiling (19.143 ms) : 18949, 19337
.   : milestone, 19143,
tracing (18.314 ms) : 18132, 18496
.   : milestone, 18314,
section candidate
no_agent (19.481 ms) : 19280, 19682
.   : milestone, 19481,
appsec (18.325 ms) : 18140, 18511
.   : milestone, 18325,
code_origins (17.365 ms) : 17194, 17536
.   : milestone, 17365,
iast (17.537 ms) : 17366, 17709
.   : milestone, 17537,
profiling (19.097 ms) : 18899, 19295
.   : milestone, 19097,
tracing (17.512 ms) : 17337, 17687
.   : milestone, 17512,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.86 ms [18.665 ms, 19.054 ms] -
appsec 18.365 ms [18.178 ms, 18.551 ms] -494.989 µs (-2.6%)
code_origins 17.749 ms [17.572 ms, 17.927 ms] -1.111 ms (-5.9%)
iast 17.693 ms [17.518 ms, 17.868 ms] -1.167 ms (-6.2%)
profiling 19.143 ms [18.949 ms, 19.337 ms] 282.978 µs (1.5%)
tracing 18.314 ms [18.132 ms, 18.496 ms] -545.902 µs (-2.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.481 ms [19.28 ms, 19.682 ms] -
appsec 18.325 ms [18.14 ms, 18.511 ms] -1.155 ms (-5.9%)
code_origins 17.365 ms [17.194 ms, 17.536 ms] -2.116 ms (-10.9%)
iast 17.537 ms [17.366 ms, 17.709 ms] -1.943 ms (-10.0%)
profiling 19.097 ms [18.899 ms, 19.295 ms] -383.918 µs (-2.0%)
tracing 17.512 ms [17.337 ms, 17.687 ms] -1.969 ms (-10.1%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master vandonr/fix
git_commit_date 1770814715 1770822201
git_commit_sha 326cc38 fdd5cdd
release_version 1.60.0-SNAPSHOT~326cc3877f 1.59.0-SNAPSHOT~fdd5cdd7df
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1770824232 1770824232
ci_job_id 1417581943 1417581943
ci_pipeline_id 95831400 95831400
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-vto8ysrz 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-vto8ysrz 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~fdd5cdd7df, baseline=1.60.0-SNAPSHOT~326cc3877f
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.968 s) : 14968000, 14968000
.   : milestone, 14968000,
appsec (14.954 s) : 14954000, 14954000
.   : milestone, 14954000,
iast (18.182 s) : 18182000, 18182000
.   : milestone, 18182000,
iast_GLOBAL (17.993 s) : 17993000, 17993000
.   : milestone, 17993000,
profiling (14.886 s) : 14886000, 14886000
.   : milestone, 14886000,
tracing (15.032 s) : 15032000, 15032000
.   : milestone, 15032000,
section candidate
no_agent (15.69 s) : 15690000, 15690000
.   : milestone, 15690000,
appsec (14.863 s) : 14863000, 14863000
.   : milestone, 14863000,
iast (18.202 s) : 18202000, 18202000
.   : milestone, 18202000,
iast_GLOBAL (17.892 s) : 17892000, 17892000
.   : milestone, 17892000,
profiling (14.963 s) : 14963000, 14963000
.   : milestone, 14963000,
tracing (15.018 s) : 15018000, 15018000
.   : milestone, 15018000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.968 s [14.968 s, 14.968 s] -
appsec 14.954 s [14.954 s, 14.954 s] -14.0 ms (-0.1%)
iast 18.182 s [18.182 s, 18.182 s] 3.214 s (21.5%)
iast_GLOBAL 17.993 s [17.993 s, 17.993 s] 3.025 s (20.2%)
profiling 14.886 s [14.886 s, 14.886 s] -82.0 ms (-0.5%)
tracing 15.032 s [15.032 s, 15.032 s] 64.0 ms (0.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.69 s [15.69 s, 15.69 s] -
appsec 14.863 s [14.863 s, 14.863 s] -827.0 ms (-5.3%)
iast 18.202 s [18.202 s, 18.202 s] 2.512 s (16.0%)
iast_GLOBAL 17.892 s [17.892 s, 17.892 s] 2.202 s (14.0%)
profiling 14.963 s [14.963 s, 14.963 s] -727.0 ms (-4.6%)
tracing 15.018 s [15.018 s, 15.018 s] -672.0 ms (-4.3%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~fdd5cdd7df, baseline=1.60.0-SNAPSHOT~326cc3877f
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.476 ms) : 1465, 1488
.   : milestone, 1476,
appsec (3.766 ms) : 3544, 3987
.   : milestone, 3766,
iast (2.264 ms) : 2195, 2333
.   : milestone, 2264,
iast_GLOBAL (2.307 ms) : 2237, 2377
.   : milestone, 2307,
profiling (2.085 ms) : 2031, 2140
.   : milestone, 2085,
tracing (2.065 ms) : 2012, 2119
.   : milestone, 2065,
section candidate
no_agent (1.473 ms) : 1462, 1485
.   : milestone, 1473,
appsec (3.806 ms) : 3584, 4029
.   : milestone, 3806,
iast (2.254 ms) : 2185, 2324
.   : milestone, 2254,
iast_GLOBAL (2.298 ms) : 2228, 2367
.   : milestone, 2298,
profiling (2.076 ms) : 2022, 2131
.   : milestone, 2076,
tracing (2.066 ms) : 2012, 2119
.   : milestone, 2066,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.465 ms, 1.488 ms] -
appsec 3.766 ms [3.544 ms, 3.987 ms] 2.289 ms (155.1%)
iast 2.264 ms [2.195 ms, 2.333 ms] 787.567 µs (53.3%)
iast_GLOBAL 2.307 ms [2.237 ms, 2.377 ms] 830.713 µs (56.3%)
profiling 2.085 ms [2.031 ms, 2.14 ms] 609.06 µs (41.3%)
tracing 2.065 ms [2.012 ms, 2.119 ms] 589.013 µs (39.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.473 ms [1.462 ms, 1.485 ms] -
appsec 3.806 ms [3.584 ms, 4.029 ms] 2.333 ms (158.4%)
iast 2.254 ms [2.185 ms, 2.324 ms] 781.251 µs (53.0%)
iast_GLOBAL 2.298 ms [2.228 ms, 2.367 ms] 824.438 µs (56.0%)
profiling 2.076 ms [2.022 ms, 2.131 ms] 603.01 µs (40.9%)
tracing 2.066 ms [2.012 ms, 2.119 ms] 592.49 µs (40.2%)