Home Original page

Add display name as parameter in JUnit5 dynamic tests by daniel-mohedano · Pull Request #10649 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/junit-dynamic-tests
git_commit_date 1771808874 1771843497
git_commit_sha d7515c8 1efe6a6
release_version 1.60.0-SNAPSHOT~d7515c8b3c 1.60.0-SNAPSHOT~1efe6a6641
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1771845173 1771845173
ci_job_id 1446913138 1446913138
ci_pipeline_id 98187086 98187086
cpu_model Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-tuokzocu 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-tuokzocu 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 63 metrics, 8 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~1efe6a6641, baseline=1.60.0-SNAPSHOT~d7515c8b3c

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.093 s) : 0, 1093069
Total [baseline] (11.252 s) : 0, 11251601
Agent [candidate] (1.101 s) : 0, 1101196
Total [candidate] (11.31 s) : 0, 11309791
section appsec
Agent [baseline] (1.267 s) : 0, 1267327
Total [baseline] (11.308 s) : 0, 11307870
Agent [candidate] (1.27 s) : 0, 1270031
Total [candidate] (11.288 s) : 0, 11287675
section iast
Agent [baseline] (1.265 s) : 0, 1265207
Total [baseline] (11.464 s) : 0, 11464397
Agent [candidate] (1.275 s) : 0, 1274532
Total [candidate] (11.479 s) : 0, 11478734
section profiling
Agent [baseline] (1.226 s) : 0, 1225968
Total [baseline] (11.278 s) : 0, 11278112
Agent [candidate] (1.22 s) : 0, 1219631
Total [candidate] (11.446 s) : 0, 11445748
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.093 s -
Agent appsec 1.267 s 174.259 ms (15.9%)
Agent iast 1.265 s 172.138 ms (15.7%)
Agent profiling 1.226 s 132.9 ms (12.2%)
Total tracing 11.252 s -
Total appsec 11.308 s 56.268 ms (0.5%)
Total iast 11.464 s 212.795 ms (1.9%)
Total profiling 11.278 s 26.511 ms (0.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.101 s -
Agent appsec 1.27 s 168.835 ms (15.3%)
Agent iast 1.275 s 173.336 ms (15.7%)
Agent profiling 1.22 s 118.435 ms (10.8%)
Total tracing 11.31 s -
Total appsec 11.288 s -22.116 ms (-0.2%)
Total iast 11.479 s 168.944 ms (1.5%)
Total profiling 11.446 s 135.957 ms (1.2%) 
gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~1efe6a6641, baseline=1.60.0-SNAPSHOT~d7515c8b3c

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.276 ms) : 0, 1276
crashtracking [candidate] (1.249 ms) : 0, 1249
BytebuddyAgent [baseline] (641.988 ms) : 0, 641988
BytebuddyAgent [candidate] (644.475 ms) : 0, 644475
AgentMeter [baseline] (29.765 ms) : 0, 29765
AgentMeter [candidate] (30.175 ms) : 0, 30175
GlobalTracer [baseline] (265.393 ms) : 0, 265393
GlobalTracer [candidate] (268.476 ms) : 0, 268476
AppSec [baseline] (34.057 ms) : 0, 34057
AppSec [candidate] (34.633 ms) : 0, 34633
Debugger [baseline] (67.955 ms) : 0, 67955
Debugger [candidate] (68.601 ms) : 0, 68601
Remote Config [baseline] (660.405 µs) : 0, 660
Remote Config [candidate] (671.902 µs) : 0, 672
Telemetry [baseline] (10.398 ms) : 0, 10398
Telemetry [candidate] (10.505 ms) : 0, 10505
Flare Poller [baseline] (4.729 ms) : 0, 4729
Flare Poller [candidate] (5.644 ms) : 0, 5644
section appsec
crashtracking [baseline] (1.25 ms) : 0, 1250
crashtracking [candidate] (1.243 ms) : 0, 1243
BytebuddyAgent [baseline] (669.837 ms) : 0, 669837
BytebuddyAgent [candidate] (671.786 ms) : 0, 671786
AgentMeter [baseline] (12.337 ms) : 0, 12337
AgentMeter [candidate] (12.348 ms) : 0, 12348
GlobalTracer [baseline] (265.005 ms) : 0, 265005
GlobalTracer [candidate] (265.881 ms) : 0, 265881
IAST [baseline] (26.276 ms) : 0, 26276
IAST [candidate] (26.206 ms) : 0, 26206
AppSec [baseline] (173.245 ms) : 0, 173245
AppSec [candidate] (174.045 ms) : 0, 174045
Debugger [baseline] (68.781 ms) : 0, 68781
Debugger [candidate] (67.871 ms) : 0, 67871
Remote Config [baseline] (665.185 µs) : 0, 665
Remote Config [candidate] (671.87 µs) : 0, 672
Telemetry [baseline] (9.677 ms) : 0, 9677
Telemetry [candidate] (9.643 ms) : 0, 9643
Flare Poller [baseline] (3.629 ms) : 0, 3629
Flare Poller [candidate] (3.68 ms) : 0, 3680
section iast
crashtracking [baseline] (1.26 ms) : 0, 1260
crashtracking [candidate] (1.253 ms) : 0, 1253
BytebuddyAgent [baseline] (813.536 ms) : 0, 813536
BytebuddyAgent [candidate] (820.843 ms) : 0, 820843
AgentMeter [baseline] (11.639 ms) : 0, 11639
AgentMeter [candidate] (11.741 ms) : 0, 11741
GlobalTracer [baseline] (256.43 ms) : 0, 256430
GlobalTracer [candidate] (257.449 ms) : 0, 257449
IAST [baseline] (28.328 ms) : 0, 28328
IAST [candidate] (28.842 ms) : 0, 28842
AppSec [baseline] (35.643 ms) : 0, 35643
AppSec [candidate] (35.294 ms) : 0, 35294
Debugger [baseline] (68.526 ms) : 0, 68526
Debugger [candidate] (69.294 ms) : 0, 69294
Remote Config [baseline] (581.308 µs) : 0, 581
Remote Config [candidate] (572.349 µs) : 0, 572
Telemetry [baseline] (8.917 ms) : 0, 8917
Telemetry [candidate] (8.919 ms) : 0, 8919
Flare Poller [baseline] (3.61 ms) : 0, 3610
Flare Poller [candidate] (3.593 ms) : 0, 3593
section profiling
crashtracking [baseline] (1.253 ms) : 0, 1253
crashtracking [candidate] (1.244 ms) : 0, 1244
BytebuddyAgent [baseline] (700.181 ms) : 0, 700181
BytebuddyAgent [candidate] (697.045 ms) : 0, 697045
AgentMeter [baseline] (8.889 ms) : 0, 8889
AgentMeter [candidate] (8.813 ms) : 0, 8813
GlobalTracer [baseline] (225.067 ms) : 0, 225067
GlobalTracer [candidate] (224.44 ms) : 0, 224440
AppSec [baseline] (34.067 ms) : 0, 34067
AppSec [candidate] (33.698 ms) : 0, 33698
Debugger [baseline] (70.429 ms) : 0, 70429
Debugger [candidate] (69.299 ms) : 0, 69299
Remote Config [baseline] (680.668 µs) : 0, 681
Remote Config [candidate] (677.516 µs) : 0, 678
Telemetry [baseline] (9.389 ms) : 0, 9389
Telemetry [candidate] (9.248 ms) : 0, 9248
Flare Poller [baseline] (3.946 ms) : 0, 3946
Flare Poller [candidate] (3.778 ms) : 0, 3778
ProfilingAgent [baseline] (100.156 ms) : 0, 100156
ProfilingAgent [candidate] (99.758 ms) : 0, 99758
Profiling [baseline] (100.749 ms) : 0, 100749
Profiling [candidate] (100.352 ms) : 0, 100352
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~1efe6a6641, baseline=1.60.0-SNAPSHOT~d7515c8b3c

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.088 s) : 0, 1087942
Total [baseline] (9.322 s) : 0, 9322456
Agent [candidate] (1.091 s) : 0, 1091396
Total [candidate] (9.38 s) : 0, 9380166
section iast
Agent [baseline] (1.26 s) : 0, 1259535
Total [baseline] (9.988 s) : 0, 9987766
Agent [candidate] (1.268 s) : 0, 1267533
Total [candidate] (9.951 s) : 0, 9950775
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.088 s -
Agent iast 1.26 s 171.593 ms (15.8%)
Total tracing 9.322 s -
Total iast 9.988 s 665.31 ms (7.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.091 s -
Agent iast 1.268 s 176.137 ms (16.1%)
Total tracing 9.38 s -
Total iast 9.951 s 570.609 ms (6.1%) 
gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~1efe6a6641, baseline=1.60.0-SNAPSHOT~d7515c8b3c

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.237 ms) : 0, 1237
crashtracking [candidate] (1.25 ms) : 0, 1250
BytebuddyAgent [baseline] (639.375 ms) : 0, 639375
BytebuddyAgent [candidate] (640.828 ms) : 0, 640828
AgentMeter [baseline] (29.58 ms) : 0, 29580
AgentMeter [candidate] (29.655 ms) : 0, 29655
GlobalTracer [baseline] (264.614 ms) : 0, 264614
GlobalTracer [candidate] (265.155 ms) : 0, 265155
AppSec [baseline] (33.572 ms) : 0, 33572
AppSec [candidate] (33.698 ms) : 0, 33698
Debugger [baseline] (66.641 ms) : 0, 66641
Debugger [candidate] (69.064 ms) : 0, 69064
Remote Config [baseline] (638.501 µs) : 0, 639
Remote Config [candidate] (635.237 µs) : 0, 635
Telemetry [baseline] (10.2 ms) : 0, 10200
Telemetry [candidate] (9.561 ms) : 0, 9561
Flare Poller [baseline] (5.502 ms) : 0, 5502
Flare Poller [candidate] (4.745 ms) : 0, 4745
section iast
crashtracking [baseline] (1.245 ms) : 0, 1245
crashtracking [candidate] (1.255 ms) : 0, 1255
BytebuddyAgent [baseline] (811.448 ms) : 0, 811448
BytebuddyAgent [candidate] (817.439 ms) : 0, 817439
AgentMeter [baseline] (11.59 ms) : 0, 11590
AgentMeter [candidate] (11.684 ms) : 0, 11684
GlobalTracer [baseline] (255.289 ms) : 0, 255289
GlobalTracer [candidate] (256.57 ms) : 0, 256570
IAST [baseline] (28.216 ms) : 0, 28216
IAST [candidate] (28.607 ms) : 0, 28607
AppSec [baseline] (37.101 ms) : 0, 37101
AppSec [candidate] (35.286 ms) : 0, 35286
Debugger [baseline] (65.165 ms) : 0, 65165
Debugger [candidate] (67.197 ms) : 0, 67197
Remote Config [baseline] (574.336 µs) : 0, 574
Remote Config [candidate] (556.501 µs) : 0, 557
Telemetry [baseline] (8.923 ms) : 0, 8923
Telemetry [candidate] (8.816 ms) : 0, 8816
Flare Poller [baseline] (3.592 ms) : 0, 3592
Flare Poller [candidate] (3.519 ms) : 0, 3519
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/junit-dynamic-tests
git_commit_date 1771808874 1771843497
git_commit_sha d7515c8 1efe6a6
release_version 1.60.0-SNAPSHOT~d7515c8b3c 1.60.0-SNAPSHOT~1efe6a6641
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1771845699 1771845699
ci_job_id 1446913139 1446913139
ci_pipeline_id 98187086 98187086
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-ehl532d8 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-ehl532d8 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 6 performance improvements and 1 performance regressions! Performance is the same for 12 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load better
[-311.917µs; -216.709µs] or [-10.749%; -7.468%]		 better
[-670.581µs; -320.214µs] or [-8.323%; -3.974%]		 unstable
[-31.690op/s; +233.440op/s] or [-2.520%; +18.564%]		 2.637ms 7.562ms 1358.344op/s 2.902ms 8.057ms 1257.469op/s
scenario:load:insecure-bank:no_agent:high_load better
[-50.952µs; -20.392µs] or [-5.113%; -2.046%]		 unstable
[-338.970µs; +194.903µs] or [-12.381%; +7.119%]		 unstable
[-258.591op/s; +523.528op/s] or [-7.095%; +14.365%]		 960.879µs 2.666ms 3776.906op/s 996.551µs 2.738ms 3644.438op/s
scenario:load:insecure-bank:iast_FULL:high_load better
[-342.142µs; -108.480µs] or [-6.528%; -2.070%]		 unsure
[-853.838µs; -168.136µs] or [-6.858%; -1.351%]		 unstable
[-45.057op/s; +105.432op/s] or [-5.730%; +13.409%]		 5.016ms 11.939ms 816.469op/s 5.241ms 12.450ms 786.281op/s
scenario:load:petclinic:code_origins:high_load worse
[+388.509µs; +1213.164µs] or [+2.251%; +7.029%]		 same
[-9.820µs; +1593.650µs] or [-0.034%; +5.593%]		 unstable
[-35.113op/s; +14.488op/s] or [-13.269%; +5.475%]		 18.061ms 29.286ms 254.312op/s 17.260ms 28.494ms 264.625op/s
scenario:load:petclinic:tracing:high_load better
[-1.653ms; -0.819ms] or [-9.019%; -4.468%]		 better
[-2.303ms; -0.827ms] or [-7.730%; -2.777%]		 unstable
[-8.794op/s; +40.107op/s] or [-3.505%; +15.987%]		 17.088ms 28.229ms 266.531op/s 18.324ms 29.794ms 250.875op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~1efe6a6641, baseline=1.60.0-SNAPSHOT~d7515c8b3c
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.086 ms) : 18890, 19282
.   : milestone, 19086,
appsec (18.269 ms) : 18085, 18453
.   : milestone, 18269,
code_origins (17.631 ms) : 17459, 17803
.   : milestone, 17631,
iast (17.61 ms) : 17435, 17785
.   : milestone, 17610,
profiling (18.824 ms) : 18637, 19012
.   : milestone, 18824,
tracing (18.606 ms) : 18420, 18791
.   : milestone, 18606,
section candidate
no_agent (19.032 ms) : 18835, 19228
.   : milestone, 19032,
appsec (18.708 ms) : 18521, 18895
.   : milestone, 18708,
code_origins (18.354 ms) : 18169, 18540
.   : milestone, 18354,
iast (17.416 ms) : 17242, 17589
.   : milestone, 17416,
profiling (18.632 ms) : 18447, 18818
.   : milestone, 18632,
tracing (17.505 ms) : 17333, 17677
.   : milestone, 17505,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.086 ms [18.89 ms, 19.282 ms] -
appsec 18.269 ms [18.085 ms, 18.453 ms] -816.621 µs (-4.3%)
code_origins 17.631 ms [17.459 ms, 17.803 ms] -1.455 ms (-7.6%)
iast 17.61 ms [17.435 ms, 17.785 ms] -1.476 ms (-7.7%)
profiling 18.824 ms [18.637 ms, 19.012 ms] -261.809 µs (-1.4%)
tracing 18.606 ms [18.42 ms, 18.791 ms] -480.427 µs (-2.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.032 ms [18.835 ms, 19.228 ms] -
appsec 18.708 ms [18.521 ms, 18.895 ms] -323.589 µs (-1.7%)
code_origins 18.354 ms [18.169 ms, 18.54 ms] -677.329 µs (-3.6%)
iast 17.416 ms [17.242 ms, 17.589 ms] -1.616 ms (-8.5%)
profiling 18.632 ms [18.447 ms, 18.818 ms] -399.154 µs (-2.1%)
tracing 17.505 ms [17.333 ms, 17.677 ms] -1.527 ms (-8.0%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~1efe6a6641, baseline=1.60.0-SNAPSHOT~d7515c8b3c
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.21 ms) : 1198, 1222
.   : milestone, 1210,
iast (3.139 ms) : 3101, 3177
.   : milestone, 3139,
iast_FULL (5.882 ms) : 5823, 5941
.   : milestone, 5882,
iast_GLOBAL (3.649 ms) : 3593, 3705
.   : milestone, 3649,
profiling (2.175 ms) : 2154, 2195
.   : milestone, 2175,
tracing (1.842 ms) : 1826, 1857
.   : milestone, 1842,
section candidate
no_agent (1.166 ms) : 1155, 1177
.   : milestone, 1166,
iast (3.173 ms) : 3126, 3220
.   : milestone, 3173,
iast_FULL (5.661 ms) : 5606, 5717
.   : milestone, 5661,
iast_GLOBAL (3.371 ms) : 3322, 3420
.   : milestone, 3371,
profiling (2.093 ms) : 2074, 2112
.   : milestone, 2093,
tracing (1.806 ms) : 1791, 1821
.   : milestone, 1806,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.21 ms [1.198 ms, 1.222 ms] -
iast 3.139 ms [3.101 ms, 3.177 ms] 1.929 ms (159.4%)
iast_FULL 5.882 ms [5.823 ms, 5.941 ms] 4.672 ms (386.1%)
iast_GLOBAL 3.649 ms [3.593 ms, 3.705 ms] 2.439 ms (201.6%)
profiling 2.175 ms [2.154 ms, 2.195 ms] 964.579 µs (79.7%)
tracing 1.842 ms [1.826 ms, 1.857 ms] 631.607 µs (52.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.166 ms [1.155 ms, 1.177 ms] -
iast 3.173 ms [3.126 ms, 3.22 ms] 2.007 ms (172.2%)
iast_FULL 5.661 ms [5.606 ms, 5.717 ms] 4.495 ms (385.6%)
iast_GLOBAL 3.371 ms [3.322 ms, 3.42 ms] 2.205 ms (189.2%)
profiling 2.093 ms [2.074 ms, 2.112 ms] 927.107 µs (79.5%)
tracing 1.806 ms [1.791 ms, 1.821 ms] 640.107 µs (54.9%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/junit-dynamic-tests
git_commit_date 1771808874 1771843497
git_commit_sha d7515c8 1efe6a6
release_version 1.60.0-SNAPSHOT~d7515c8b3c 1.60.0-SNAPSHOT~1efe6a6641
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1771845293 1771845293
ci_job_id 1446913140 1446913140
ci_pipeline_id 98187086 98187086
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-730241s8 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-730241s8 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~1efe6a6641, baseline=1.60.0-SNAPSHOT~d7515c8b3c
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.847 s) : 14847000, 14847000
.   : milestone, 14847000,
appsec (14.889 s) : 14889000, 14889000
.   : milestone, 14889000,
iast (18.306 s) : 18306000, 18306000
.   : milestone, 18306000,
iast_GLOBAL (18.032 s) : 18032000, 18032000
.   : milestone, 18032000,
profiling (14.878 s) : 14878000, 14878000
.   : milestone, 14878000,
tracing (14.56 s) : 14560000, 14560000
.   : milestone, 14560000,
section candidate
no_agent (15.316 s) : 15316000, 15316000
.   : milestone, 15316000,
appsec (14.87 s) : 14870000, 14870000
.   : milestone, 14870000,
iast (18.258 s) : 18258000, 18258000
.   : milestone, 18258000,
iast_GLOBAL (17.702 s) : 17702000, 17702000
.   : milestone, 17702000,
profiling (14.843 s) : 14843000, 14843000
.   : milestone, 14843000,
tracing (14.75 s) : 14750000, 14750000
.   : milestone, 14750000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.847 s [14.847 s, 14.847 s] -
appsec 14.889 s [14.889 s, 14.889 s] 42.0 ms (0.3%)
iast 18.306 s [18.306 s, 18.306 s] 3.459 s (23.3%)
iast_GLOBAL 18.032 s [18.032 s, 18.032 s] 3.185 s (21.5%)
profiling 14.878 s [14.878 s, 14.878 s] 31.0 ms (0.2%)
tracing 14.56 s [14.56 s, 14.56 s] -287.0 ms (-1.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.316 s [15.316 s, 15.316 s] -
appsec 14.87 s [14.87 s, 14.87 s] -446.0 ms (-2.9%)
iast 18.258 s [18.258 s, 18.258 s] 2.942 s (19.2%)
iast_GLOBAL 17.702 s [17.702 s, 17.702 s] 2.386 s (15.6%)
profiling 14.843 s [14.843 s, 14.843 s] -473.0 ms (-3.1%)
tracing 14.75 s [14.75 s, 14.75 s] -566.0 ms (-3.7%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~1efe6a6641, baseline=1.60.0-SNAPSHOT~d7515c8b3c
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.469 ms) : 1458, 1481
.   : milestone, 1469,
appsec (2.5 ms) : 2445, 2554
.   : milestone, 2500,
iast (2.241 ms) : 2172, 2310
.   : milestone, 2241,
iast_GLOBAL (2.284 ms) : 2215, 2353
.   : milestone, 2284,
profiling (2.066 ms) : 2011, 2120
.   : milestone, 2066,
tracing (2.045 ms) : 1993, 2098
.   : milestone, 2045,
section candidate
no_agent (1.47 ms) : 1459, 1482
.   : milestone, 1470,
appsec (3.753 ms) : 3532, 3973
.   : milestone, 3753,
iast (2.246 ms) : 2178, 2315
.   : milestone, 2246,
iast_GLOBAL (2.288 ms) : 2218, 2357
.   : milestone, 2288,
profiling (2.099 ms) : 2043, 2155
.   : milestone, 2099,
tracing (2.052 ms) : 1999, 2105
.   : milestone, 2052,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.469 ms [1.458 ms, 1.481 ms] -
appsec 2.5 ms [2.445 ms, 2.554 ms] 1.031 ms (70.2%)
iast 2.241 ms [2.172 ms, 2.31 ms] 771.984 µs (52.5%)
iast_GLOBAL 2.284 ms [2.215 ms, 2.353 ms] 814.84 µs (55.5%)
profiling 2.066 ms [2.011 ms, 2.12 ms] 596.421 µs (40.6%)
tracing 2.045 ms [1.993 ms, 2.098 ms] 576.152 µs (39.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.47 ms [1.459 ms, 1.482 ms] -
appsec 3.753 ms [3.532 ms, 3.973 ms] 2.282 ms (155.2%)
iast 2.246 ms [2.178 ms, 2.315 ms] 776.163 µs (52.8%)
iast_GLOBAL 2.288 ms [2.218 ms, 2.357 ms] 817.281 µs (55.6%)
profiling 2.099 ms [2.043 ms, 2.155 ms] 628.95 µs (42.8%)
tracing 2.052 ms [1.999 ms, 2.105 ms] 581.729 µs (39.6%)