Home Original page

Add support for `otel.java.metrics.cardinality.limit` system property by mcculls · Pull Request #10541 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/otel-metrics-cardinality-limit
git_commit_date 1770378849 1770392663
git_commit_sha cffe9c6 81424cb
release_version 1.60.0-SNAPSHOT~cffe9c6085 1.60.0-SNAPSHOT~81424cbc4b
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1770394438 1770394438
ci_job_id 1406621506 1406621506
ci_pipeline_id 95014524 95014524
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-34i2fzsz 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-34i2fzsz 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 61 metrics, 10 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~81424cbc4b, baseline=1.60.0-SNAPSHOT~cffe9c6085

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.069 s) : 0, 1068666
Total [baseline] (10.952 s) : 0, 10951528
Agent [candidate] (1.069 s) : 0, 1069168
Total [candidate] (10.915 s) : 0, 10915452
section appsec
Agent [baseline] (1.241 s) : 0, 1240926
Total [baseline] (11.035 s) : 0, 11034785
Agent [candidate] (1.244 s) : 0, 1244331
Total [candidate] (11.052 s) : 0, 11052026
section iast
Agent [baseline] (1.24 s) : 0, 1240096
Total [baseline] (11.233 s) : 0, 11233012
Agent [candidate] (1.229 s) : 0, 1229072
Total [candidate] (11.17 s) : 0, 11170171
section profiling
Agent [baseline] (1.205 s) : 0, 1204775
Total [baseline] (10.973 s) : 0, 10972617
Agent [candidate] (1.197 s) : 0, 1196595
Total [candidate] (10.946 s) : 0, 10946106
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.069 s -
Agent appsec 1.241 s 172.26 ms (16.1%)
Agent iast 1.24 s 171.43 ms (16.0%)
Agent profiling 1.205 s 136.108 ms (12.7%)
Total tracing 10.952 s -
Total appsec 11.035 s 83.257 ms (0.8%)
Total iast 11.233 s 281.484 ms (2.6%)
Total profiling 10.973 s 21.089 ms (0.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.069 s -
Agent appsec 1.244 s 175.162 ms (16.4%)
Agent iast 1.229 s 159.904 ms (15.0%)
Agent profiling 1.197 s 127.427 ms (11.9%)
Total tracing 10.915 s -
Total appsec 11.052 s 136.574 ms (1.3%)
Total iast 11.17 s 254.719 ms (2.3%)
Total profiling 10.946 s 30.653 ms (0.3%) 
gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~81424cbc4b, baseline=1.60.0-SNAPSHOT~cffe9c6085

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.179 ms) : 0, 1179
crashtracking [candidate] (1.186 ms) : 0, 1186
BytebuddyAgent [baseline] (630.75 ms) : 0, 630750
BytebuddyAgent [candidate] (629.817 ms) : 0, 629817
AgentMeter [baseline] (29.017 ms) : 0, 29017
AgentMeter [candidate] (29.215 ms) : 0, 29215
GlobalTracer [baseline] (258.783 ms) : 0, 258783
GlobalTracer [candidate] (259.117 ms) : 0, 259117
AppSec [baseline] (32.94 ms) : 0, 32940
AppSec [candidate] (33.175 ms) : 0, 33175
Debugger [baseline] (63.801 ms) : 0, 63801
Debugger [candidate] (62.342 ms) : 0, 62342
Remote Config [baseline] (610.245 µs) : 0, 610
Remote Config [candidate] (625.209 µs) : 0, 625
Telemetry [baseline] (10.779 ms) : 0, 10779
Telemetry [candidate] (12.233 ms) : 0, 12233
Flare Poller [baseline] (5.418 ms) : 0, 5418
Flare Poller [candidate] (6.129 ms) : 0, 6129
section appsec
crashtracking [baseline] (1.182 ms) : 0, 1182
crashtracking [candidate] (1.194 ms) : 0, 1194
BytebuddyAgent [baseline] (659.642 ms) : 0, 659642
BytebuddyAgent [candidate] (660.759 ms) : 0, 660759
AgentMeter [baseline] (11.984 ms) : 0, 11984
AgentMeter [candidate] (12.025 ms) : 0, 12025
GlobalTracer [baseline] (259.443 ms) : 0, 259443
GlobalTracer [candidate] (259.805 ms) : 0, 259805
AppSec [baseline] (167.764 ms) : 0, 167764
AppSec [candidate] (168.401 ms) : 0, 168401
Debugger [baseline] (67.075 ms) : 0, 67075
Debugger [candidate] (67.749 ms) : 0, 67749
Remote Config [baseline] (652.159 µs) : 0, 652
Remote Config [candidate] (672.034 µs) : 0, 672
Telemetry [baseline] (9.048 ms) : 0, 9048
Telemetry [candidate] (9.294 ms) : 0, 9294
Flare Poller [baseline] (3.602 ms) : 0, 3602
Flare Poller [candidate] (3.659 ms) : 0, 3659
IAST [baseline] (25.238 ms) : 0, 25238
IAST [candidate] (25.379 ms) : 0, 25379
section iast
crashtracking [baseline] (1.204 ms) : 0, 1204
crashtracking [candidate] (1.176 ms) : 0, 1176
BytebuddyAgent [baseline] (800.525 ms) : 0, 800525
BytebuddyAgent [candidate] (793.318 ms) : 0, 793318
AgentMeter [baseline] (11.368 ms) : 0, 11368
AgentMeter [candidate] (11.25 ms) : 0, 11250
GlobalTracer [baseline] (250.242 ms) : 0, 250242
GlobalTracer [candidate] (247.714 ms) : 0, 247714
AppSec [baseline] (33.324 ms) : 0, 33324
AppSec [candidate] (33.149 ms) : 0, 33149
Debugger [baseline] (67.872 ms) : 0, 67872
Debugger [candidate] (67.719 ms) : 0, 67719
Remote Config [baseline] (539.375 µs) : 0, 539
Remote Config [candidate] (550.79 µs) : 0, 551
Telemetry [baseline] (8.743 ms) : 0, 8743
Telemetry [candidate] (8.686 ms) : 0, 8686
Flare Poller [baseline] (3.573 ms) : 0, 3573
Flare Poller [candidate] (3.51 ms) : 0, 3510
IAST [baseline] (27.245 ms) : 0, 27245
IAST [candidate] (26.844 ms) : 0, 26844
section profiling
ProfilingAgent [baseline] (100.193 ms) : 0, 100193
ProfilingAgent [candidate] (99.408 ms) : 0, 99408
crashtracking [baseline] (1.226 ms) : 0, 1226
crashtracking [candidate] (1.246 ms) : 0, 1246
BytebuddyAgent [baseline] (690.714 ms) : 0, 690714
BytebuddyAgent [candidate] (685.625 ms) : 0, 685625
AgentMeter [baseline] (8.884 ms) : 0, 8884
AgentMeter [candidate] (8.825 ms) : 0, 8825
GlobalTracer [baseline] (218.314 ms) : 0, 218314
GlobalTracer [candidate] (216.922 ms) : 0, 216922
AppSec [baseline] (33.133 ms) : 0, 33133
AppSec [candidate] (32.658 ms) : 0, 32658
Debugger [baseline] (68.231 ms) : 0, 68231
Debugger [candidate] (68.362 ms) : 0, 68362
Remote Config [baseline] (617.23 µs) : 0, 617
Remote Config [candidate] (609.318 µs) : 0, 609
Telemetry [baseline] (9.011 ms) : 0, 9011
Telemetry [candidate] (8.901 ms) : 0, 8901
Flare Poller [baseline] (3.849 ms) : 0, 3849
Flare Poller [candidate] (3.761 ms) : 0, 3761
Profiling [baseline] (100.765 ms) : 0, 100765
Profiling [candidate] (99.984 ms) : 0, 99984
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~81424cbc4b, baseline=1.60.0-SNAPSHOT~cffe9c6085

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.067 s) : 0, 1066631
Total [baseline] (8.745 s) : 0, 8744829
Agent [candidate] (1.069 s) : 0, 1068597
Total [candidate] (8.795 s) : 0, 8795494
section iast
Agent [baseline] (1.245 s) : 0, 1244580
Total [baseline] (9.479 s) : 0, 9479099
Agent [candidate] (1.231 s) : 0, 1231352
Total [candidate] (9.355 s) : 0, 9355077
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.067 s -
Agent iast 1.245 s 177.948 ms (16.7%)
Total tracing 8.745 s -
Total iast 9.479 s 734.271 ms (8.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.069 s -
Agent iast 1.231 s 162.755 ms (15.2%)
Total tracing 8.795 s -
Total iast 9.355 s 559.583 ms (6.4%) 
gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~81424cbc4b, baseline=1.60.0-SNAPSHOT~cffe9c6085

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.187 ms) : 0, 1187
crashtracking [candidate] (1.195 ms) : 0, 1195
BytebuddyAgent [baseline] (629.938 ms) : 0, 629938
BytebuddyAgent [candidate] (629.94 ms) : 0, 629940
AgentMeter [baseline] (28.966 ms) : 0, 28966
AgentMeter [candidate] (29.3 ms) : 0, 29300
GlobalTracer [baseline] (257.923 ms) : 0, 257923
GlobalTracer [candidate] (259.684 ms) : 0, 259684
AppSec [baseline] (32.812 ms) : 0, 32812
AppSec [candidate] (33.054 ms) : 0, 33054
Debugger [baseline] (63.19 ms) : 0, 63190
Debugger [candidate] (62.326 ms) : 0, 62326
Remote Config [baseline] (615.63 µs) : 0, 616
Remote Config [candidate] (630.117 µs) : 0, 630
Telemetry [baseline] (11.359 ms) : 0, 11359
Telemetry [candidate] (12.317 ms) : 0, 12317
Flare Poller [baseline] (5.273 ms) : 0, 5273
Flare Poller [candidate] (4.689 ms) : 0, 4689
section iast
crashtracking [baseline] (1.192 ms) : 0, 1192
crashtracking [candidate] (1.178 ms) : 0, 1178
BytebuddyAgent [baseline] (804.586 ms) : 0, 804586
BytebuddyAgent [candidate] (795.101 ms) : 0, 795101
AgentMeter [baseline] (11.551 ms) : 0, 11551
AgentMeter [candidate] (11.285 ms) : 0, 11285
GlobalTracer [baseline] (250.994 ms) : 0, 250994
GlobalTracer [candidate] (248.645 ms) : 0, 248645
IAST [baseline] (27.506 ms) : 0, 27506
IAST [candidate] (27.109 ms) : 0, 27109
AppSec [baseline] (31.849 ms) : 0, 31849
AppSec [candidate] (35.629 ms) : 0, 35629
Debugger [baseline] (68.474 ms) : 0, 68474
Debugger [candidate] (64.336 ms) : 0, 64336
Remote Config [baseline] (570.424 µs) : 0, 570
Remote Config [candidate] (562.209 µs) : 0, 562
Telemetry [baseline] (8.847 ms) : 0, 8847
Telemetry [candidate] (8.749 ms) : 0, 8749
Flare Poller [baseline] (3.568 ms) : 0, 3568
Flare Poller [candidate] (3.519 ms) : 0, 3519
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/otel-metrics-cardinality-limit
git_commit_date 1770378849 1770392663
git_commit_sha cffe9c6 81424cb
release_version 1.60.0-SNAPSHOT~cffe9c6085 1.60.0-SNAPSHOT~81424cbc4b
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1770394842 1770394842
ci_job_id 1406621507 1406621507
ci_pipeline_id 95014524 95014524
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-3-z80zfoz4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-3-z80zfoz4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 2 performance regressions! Performance is the same for 16 metrics, 15 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:profiling:high_load better
[-223.565µs; -86.762µs] or [-12.654%; -4.911%]		 unstable
[-1381.267µs; -458.182µs] or [-25.092%; -8.323%]		 unstable
[+28.153op/s; +558.535op/s] or [+1.424%; +28.260%]		 1.612ms 4.585ms 2269.781op/s 1.767ms 5.505ms 1976.438op/s
scenario:load:insecure-bank:iast_GLOBAL:high_load worse
[+272.154µs; +373.002µs] or [+10.121%; +13.871%]		 worse
[+412.678µs; +880.462µs] or [+5.317%; +11.343%]		 unstable
[-251.821op/s; +33.758op/s] or [-19.077%; +2.557%]		 3.012ms 8.409ms 1210.969op/s 2.689ms 7.762ms 1320.000op/s
scenario:load:petclinic:no_agent:high_load better
[-2.302ms; -1.110ms] or [-12.473%; -6.015%]		 better
[-3.996ms; -1.178ms] or [-12.978%; -3.827%]		 unstable
[-3.314op/s; +51.814op/s] or [-1.347%; +21.052%]		 16.753ms 28.205ms 270.375op/s 18.460ms 30.793ms 246.125op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~81424cbc4b, baseline=1.60.0-SNAPSHOT~cffe9c6085
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.966 ms) : 18770, 19162
.   : milestone, 18966,
appsec (18.55 ms) : 18361, 18739
.   : milestone, 18550,
code_origins (17.96 ms) : 17780, 18140
.   : milestone, 17960,
iast (17.914 ms) : 17737, 18091
.   : milestone, 17914,
profiling (18.53 ms) : 18347, 18714
.   : milestone, 18530,
tracing (17.537 ms) : 17364, 17710
.   : milestone, 17537,
section candidate
no_agent (17.252 ms) : 17082, 17423
.   : milestone, 17252,
appsec (18.838 ms) : 18645, 19032
.   : milestone, 18838,
code_origins (17.857 ms) : 17678, 18037
.   : milestone, 17857,
iast (17.892 ms) : 17715, 18068
.   : milestone, 17892,
profiling (18.78 ms) : 18595, 18965
.   : milestone, 18780,
tracing (17.541 ms) : 17368, 17714
.   : milestone, 17541,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.966 ms [18.77 ms, 19.162 ms] -
appsec 18.55 ms [18.361 ms, 18.739 ms] -415.978 µs (-2.2%)
code_origins 17.96 ms [17.78 ms, 18.14 ms] -1.006 ms (-5.3%)
iast 17.914 ms [17.737 ms, 18.091 ms] -1.052 ms (-5.5%)
profiling 18.53 ms [18.347 ms, 18.714 ms] -435.792 µs (-2.3%)
tracing 17.537 ms [17.364 ms, 17.71 ms] -1.429 ms (-7.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.252 ms [17.082 ms, 17.423 ms] -
appsec 18.838 ms [18.645 ms, 19.032 ms] 1.586 ms (9.2%)
code_origins 17.857 ms [17.678 ms, 18.037 ms] 605.063 µs (3.5%)
iast 17.892 ms [17.715 ms, 18.068 ms] 639.319 µs (3.7%)
profiling 18.78 ms [18.595 ms, 18.965 ms] 1.528 ms (8.9%)
tracing 17.541 ms [17.368 ms, 17.714 ms] 288.43 µs (1.7%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~81424cbc4b, baseline=1.60.0-SNAPSHOT~cffe9c6085
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.28 ms) : 1265, 1294
.   : milestone, 1280,
iast (3.154 ms) : 3112, 3196
.   : milestone, 3154,
iast_FULL (5.98 ms) : 5919, 6041
.   : milestone, 5980,
iast_GLOBAL (3.472 ms) : 3412, 3532
.   : milestone, 3472,
profiling (2.294 ms) : 2268, 2320
.   : milestone, 2294,
tracing (1.795 ms) : 1781, 1810
.   : milestone, 1795,
section candidate
no_agent (1.29 ms) : 1275, 1305
.   : milestone, 1290,
iast (3.126 ms) : 3091, 3162
.   : milestone, 3126,
iast_FULL (5.92 ms) : 5860, 5980
.   : milestone, 5920,
iast_GLOBAL (3.791 ms) : 3730, 3852
.   : milestone, 3791,
profiling (1.988 ms) : 1969, 2007
.   : milestone, 1988,
tracing (1.828 ms) : 1812, 1844
.   : milestone, 1828,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.28 ms [1.265 ms, 1.294 ms] -
iast 3.154 ms [3.112 ms, 3.196 ms] 1.874 ms (146.5%)
iast_FULL 5.98 ms [5.919 ms, 6.041 ms] 4.7 ms (367.3%)
iast_GLOBAL 3.472 ms [3.412 ms, 3.532 ms] 2.193 ms (171.3%)
profiling 2.294 ms [2.268 ms, 2.32 ms] 1.014 ms (79.3%)
tracing 1.795 ms [1.781 ms, 1.81 ms] 515.638 µs (40.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.29 ms [1.275 ms, 1.305 ms] -
iast 3.126 ms [3.091 ms, 3.162 ms] 1.836 ms (142.3%)
iast_FULL 5.92 ms [5.86 ms, 5.98 ms] 4.63 ms (358.9%)
iast_GLOBAL 3.791 ms [3.73 ms, 3.852 ms] 2.501 ms (193.8%)
profiling 1.988 ms [1.969 ms, 2.007 ms] 697.586 µs (54.1%)
tracing 1.828 ms [1.812 ms, 1.844 ms] 537.87 µs (41.7%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/otel-metrics-cardinality-limit
git_commit_date 1770378849 1770392663
git_commit_sha cffe9c6 81424cb
release_version 1.60.0-SNAPSHOT~cffe9c6085 1.60.0-SNAPSHOT~81424cbc4b
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1770394584 1770394584
ci_job_id 1406621508 1406621508
ci_pipeline_id 95014524 95014524
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-4-xoseg1qn 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-4-xoseg1qn 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~81424cbc4b, baseline=1.60.0-SNAPSHOT~cffe9c6085
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.507 s) : 15507000, 15507000
.   : milestone, 15507000,
appsec (15.008 s) : 15008000, 15008000
.   : milestone, 15008000,
iast (18.204 s) : 18204000, 18204000
.   : milestone, 18204000,
iast_GLOBAL (17.971 s) : 17971000, 17971000
.   : milestone, 17971000,
profiling (15.049 s) : 15049000, 15049000
.   : milestone, 15049000,
tracing (14.705 s) : 14705000, 14705000
.   : milestone, 14705000,
section candidate
no_agent (15.25 s) : 15250000, 15250000
.   : milestone, 15250000,
appsec (14.855 s) : 14855000, 14855000
.   : milestone, 14855000,
iast (17.762 s) : 17762000, 17762000
.   : milestone, 17762000,
iast_GLOBAL (17.871 s) : 17871000, 17871000
.   : milestone, 17871000,
profiling (15.298 s) : 15298000, 15298000
.   : milestone, 15298000,
tracing (14.548 s) : 14548000, 14548000
.   : milestone, 14548000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.507 s [15.507 s, 15.507 s] -
appsec 15.008 s [15.008 s, 15.008 s] -499.0 ms (-3.2%)
iast 18.204 s [18.204 s, 18.204 s] 2.697 s (17.4%)
iast_GLOBAL 17.971 s [17.971 s, 17.971 s] 2.464 s (15.9%)
profiling 15.049 s [15.049 s, 15.049 s] -458.0 ms (-3.0%)
tracing 14.705 s [14.705 s, 14.705 s] -802.0 ms (-5.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.25 s [15.25 s, 15.25 s] -
appsec 14.855 s [14.855 s, 14.855 s] -395.0 ms (-2.6%)
iast 17.762 s [17.762 s, 17.762 s] 2.512 s (16.5%)
iast_GLOBAL 17.871 s [17.871 s, 17.871 s] 2.621 s (17.2%)
profiling 15.298 s [15.298 s, 15.298 s] 48.0 ms (0.3%)
tracing 14.548 s [14.548 s, 14.548 s] -702.0 ms (-4.6%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~81424cbc4b, baseline=1.60.0-SNAPSHOT~cffe9c6085
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.474 ms) : 1463, 1486
.   : milestone, 1474,
appsec (2.559 ms) : 2501, 2617
.   : milestone, 2559,
iast (2.255 ms) : 2185, 2324
.   : milestone, 2255,
iast_GLOBAL (2.295 ms) : 2225, 2365
.   : milestone, 2295,
profiling (2.075 ms) : 2021, 2130
.   : milestone, 2075,
tracing (2.062 ms) : 2008, 2116
.   : milestone, 2062,
section candidate
no_agent (1.473 ms) : 1461, 1484
.   : milestone, 1473,
appsec (3.775 ms) : 3552, 3998
.   : milestone, 3775,
iast (2.257 ms) : 2187, 2327
.   : milestone, 2257,
iast_GLOBAL (2.313 ms) : 2242, 2384
.   : milestone, 2313,
profiling (2.104 ms) : 2046, 2161
.   : milestone, 2104,
tracing (2.062 ms) : 2008, 2116
.   : milestone, 2062,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.463 ms, 1.486 ms] -
appsec 2.559 ms [2.501 ms, 2.617 ms] 1.085 ms (73.6%)
iast 2.255 ms [2.185 ms, 2.324 ms] 780.493 µs (52.9%)
iast_GLOBAL 2.295 ms [2.225 ms, 2.365 ms] 820.678 µs (55.7%)
profiling 2.075 ms [2.021 ms, 2.13 ms] 601.239 µs (40.8%)
tracing 2.062 ms [2.008 ms, 2.116 ms] 587.675 µs (39.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.473 ms [1.461 ms, 1.484 ms] -
appsec 3.775 ms [3.552 ms, 3.998 ms] 2.302 ms (156.3%)
iast 2.257 ms [2.187 ms, 2.327 ms] 784.671 µs (53.3%)
iast_GLOBAL 2.313 ms [2.242 ms, 2.384 ms] 840.489 µs (57.1%)
profiling 2.104 ms [2.046 ms, 2.161 ms] 630.955 µs (42.8%)
tracing 2.062 ms [2.008 ms, 2.116 ms] 589.188 µs (40.0%)