fix method reference in comment by andreimatei · Pull Request #10101 · DataDog/dd-trace-java
Benchmarks
⚠️ Warning: Baseline build not found for merge-base commit. Comparing against the latest commit on master instead.
Startup
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | andrei/fix-spell |
| git_commit_date | 1765198263 | 1764624331 |
| git_commit_sha | 5c5592a | 94e80c9 |
| release_version | 1.57.0-SNAPSHOT~5c5592a6f6 | 1.57.0-SNAPSHOT~94e80c98fc |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | insecure-bank | insecure-bank |
| ci_job_date | 1765217308 | 1765217308 |
| ci_job_id | 1276693538 | 1276693538 |
| ci_pipeline_id | 85351972 | 85351972 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-0-eysbcq7f 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-0-eysbcq7f 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
| module | Agent | Agent |
| parent | None | None |
Summary
Found 15 performance improvements and 16 performance regressions! Performance is the same for 20 metrics, 14 unstable metrics.
| scenario | Δ mean execution_time | candidate mean execution_time | baseline mean execution_time |
|---|---|---|---|
| scenario:startup:insecure-bank:iast:crashtracking | worse [+267.803µs; +295.976µs] or [+22.413%; +24.771%] |
1.477ms | 1.195ms |
| scenario:startup:insecure-bank:iast:BytebuddyAgent | worse [+39.658ms; +46.459ms] or [+5.024%; +5.886%] |
832.403ms | 789.345ms |
| scenario:startup:insecure-bank:iast:GlobalTracer | better [-17.593ms; -15.785ms] or [-6.896%; -6.187%] |
238.441ms | 255.130ms |
| scenario:startup:insecure-bank:iast:Debugger | better [-59.085ms; -58.183ms] or [-91.331%; -89.937%] |
6.059ms | 64.693ms |
| scenario:startup:insecure-bank:iast:Telemetry | better [-547.598µs; -260.309µs] or [-6.503%; -3.091%] |
8.017ms | 8.421ms |
| scenario:startup:insecure-bank:tracing:crashtracking | worse [+230.540µs; +302.220µs] or [+18.930%; +24.816%] |
1.484ms | 1.218ms |
| scenario:startup:insecure-bank:tracing:BytebuddyAgent | worse [+48.372ms; +72.415ms] or [+7.439%; +11.137%] |
710.616ms | 650.222ms |
| scenario:startup:insecure-bank:tracing:GlobalTracer | better [-34.170ms; -27.265ms] or [-12.164%; -9.706%] |
250.188ms | 280.905ms |
| scenario:startup:insecure-bank:tracing:Debugger | better [-61.387ms; -60.183ms] or [-91.312%; -89.521%] |
6.443ms | 67.228ms |
| scenario:startup:petclinic:appsec:Agent.start | better [-39.299ms; -30.278ms] or [-3.111%; -2.397%] |
1.228s | 1.263s |
| scenario:startup:petclinic:appsec:crashtracking | worse [+258.953µs; +292.615µs] or [+21.695%; +24.515%] |
1.469ms | 1.194ms |
| scenario:startup:petclinic:appsec:BytebuddyAgent | worse [+40.668ms; +46.021ms] or [+5.908%; +6.686%] |
731.720ms | 688.375ms |
| scenario:startup:petclinic:appsec:GlobalTracer | better [-18.704ms; -16.485ms] or [-7.216%; -6.360%] |
241.598ms | 259.193ms |
| scenario:startup:petclinic:appsec:Debugger | better [-59.996ms; -59.330ms] or [-90.986%; -89.975%] |
6.277ms | 65.940ms |
| scenario:startup:petclinic:appsec:Telemetry | better [-1.171ms; -0.832ms] or [-12.986%; -9.220%] |
8.018ms | 9.020ms |
| scenario:startup:petclinic:iast:crashtracking | worse [+268.217µs; +334.253µs] or [+22.417%; +27.937%] |
1.498ms | 1.196ms |
| scenario:startup:petclinic:iast:BytebuddyAgent | worse [+37.438ms; +63.069ms] or [+4.735%; +7.977%] |
840.932ms | 790.679ms |
| scenario:startup:petclinic:iast:GlobalTracer | better [-17.244ms; -13.210ms] or [-6.754%; -5.174%] |
240.092ms | 255.319ms |
| scenario:startup:petclinic:iast:Debugger | better [-60.152ms; -59.003ms] or [-91.693%; -89.940%] |
6.025ms | 65.602ms |
| scenario:startup:petclinic:iast:Telemetry | better [-662.818µs; -410.850µs] or [-7.841%; -4.860%] |
7.916ms | 8.453ms |
| scenario:startup:petclinic:iast:Flare Poller | worse [+7.011ms; +7.291ms] or [+200.925%; +208.959%] |
10.641ms | 3.489ms |
| scenario:startup:petclinic:profiling:ProfilingAgent | worse [+12.861ms; +14.188ms] or [+13.243%; +14.609%] |
110.642ms | 97.117ms |
| scenario:startup:petclinic:profiling:crashtracking | worse [+238.611µs; +276.022µs] or [+20.242%; +23.416%] |
1.436ms | 1.179ms |
| scenario:startup:petclinic:profiling:BytebuddyAgent | worse [+31.460ms; +36.423ms] or [+4.482%; +5.189%] |
735.818ms | 701.876ms |
| scenario:startup:petclinic:profiling:Debugger | better [-61.966ms; -58.805ms] or [-91.124%; -86.476%] |
7.616ms | 68.002ms |
| scenario:startup:petclinic:profiling:Flare Poller | worse [+206.623µs; +475.611µs] or [+5.412%; +12.457%] |
4.159ms | 3.818ms |
| scenario:startup:petclinic:profiling:Profiling | worse [+12.922ms; +14.268ms] or [+13.227%; +14.605%] |
111.290ms | 97.695ms |
| scenario:startup:petclinic:tracing:crashtracking | worse [+276.915µs; +331.270µs] or [+23.268%; +27.836%] |
1.494ms | 1.190ms |
| scenario:startup:petclinic:tracing:BytebuddyAgent | worse [+56.086ms; +75.669ms] or [+8.656%; +11.679%] |
713.794ms | 647.916ms |
| scenario:startup:petclinic:tracing:GlobalTracer | better [-33.530ms; -26.969ms] or [-11.890%; -9.563%] |
251.758ms | 282.007ms |
| scenario:startup:petclinic:tracing:Debugger | better [-63.001ms; -61.384ms] or [-91.729%; -89.374%] |
6.489ms | 68.682ms |
Startup time reports for insecure-bank
gantt
title insecure-bank - global startup overhead: candidate=1.57.0-SNAPSHOT~94e80c98fc, baseline=1.57.0-SNAPSHOT~5c5592a6f6
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.081 s) : 0, 1080821
Total [baseline] (8.734 s) : 0, 8733717
Agent [candidate] (1.057 s) : 0, 1056643
Total [candidate] (8.663 s) : 0, 8663362
section iast
Agent [baseline] (1.221 s) : 0, 1220671
Total [baseline] (9.511 s) : 0, 9511421
Agent [candidate] (1.194 s) : 0, 1193819
Total [candidate] (9.35 s) : 0, 9350404
- baseline results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.081 s | - |
| Agent | iast | 1.221 s | 139.85 ms (12.9%) |
| Total | tracing | 8.734 s | - |
| Total | iast | 9.511 s | 777.704 ms (8.9%) |
- candidate results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.057 s | - |
| Agent | iast | 1.194 s | 137.176 ms (13.0%) |
| Total | tracing | 8.663 s | - |
| Total | iast | 9.35 s | 687.042 ms (7.9%) |
gantt
title insecure-bank - break down per module: candidate=1.57.0-SNAPSHOT~94e80c98fc, baseline=1.57.0-SNAPSHOT~5c5592a6f6
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.218 ms) : 0, 1218
crashtracking [candidate] (1.484 ms) : 0, 1484
BytebuddyAgent [baseline] (650.222 ms) : 0, 650222
BytebuddyAgent [candidate] (710.616 ms) : 0, 710616
GlobalTracer [baseline] (280.905 ms) : 0, 280905
GlobalTracer [candidate] (250.188 ms) : 0, 250188
AppSec [baseline] (32.261 ms) : 0, 32261
AppSec [candidate] (32.089 ms) : 0, 32089
Debugger [baseline] (67.228 ms) : 0, 67228
Debugger [candidate] (6.443 ms) : 0, 6443
Remote Config [baseline] (632.187 µs) : 0, 632
Remote Config [candidate] (673.991 µs) : 0, 674
Telemetry [baseline] (8.947 ms) : 0, 8947
Telemetry [candidate] (15.353 ms) : 0, 15353
Flare Poller [baseline] (3.773 ms) : 0, 3773
Flare Poller [candidate] (4.894 ms) : 0, 4894
section iast
crashtracking [baseline] (1.195 ms) : 0, 1195
crashtracking [candidate] (1.477 ms) : 0, 1477
BytebuddyAgent [baseline] (789.345 ms) : 0, 789345
BytebuddyAgent [candidate] (832.403 ms) : 0, 832403
GlobalTracer [baseline] (255.13 ms) : 0, 255130
GlobalTracer [candidate] (238.441 ms) : 0, 238441
IAST [baseline] (26.847 ms) : 0, 26847
IAST [candidate] (32.641 ms) : 0, 32641
AppSec [baseline] (35.635 ms) : 0, 35635
AppSec [candidate] (28.74 ms) : 0, 28740
Debugger [baseline] (64.693 ms) : 0, 64693
Debugger [candidate] (6.059 ms) : 0, 6059
Remote Config [baseline] (597.567 µs) : 0, 598
Remote Config [candidate] (602.657 µs) : 0, 603
Telemetry [baseline] (8.421 ms) : 0, 8421
Telemetry [candidate] (8.017 ms) : 0, 8017
Flare Poller [baseline] (3.464 ms) : 0, 3464
Flare Poller [candidate] (10.659 ms) : 0, 10659
Startup time reports for petclinic
gantt
title petclinic - global startup overhead: candidate=1.57.0-SNAPSHOT~94e80c98fc, baseline=1.57.0-SNAPSHOT~5c5592a6f6
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.081 s) : 0, 1080944
Total [baseline] (10.784 s) : 0, 10784323
Agent [candidate] (1.062 s) : 0, 1061858
Total [candidate] (10.867 s) : 0, 10867025
section appsec
Agent [baseline] (1.263 s) : 0, 1263260
Total [baseline] (11.198 s) : 0, 11198028
Agent [candidate] (1.228 s) : 0, 1228472
Total [candidate] (10.895 s) : 0, 10894896
section iast
Agent [baseline] (1.223 s) : 0, 1222983
Total [baseline] (11.101 s) : 0, 11101041
Agent [candidate] (1.204 s) : 0, 1204092
Total [candidate] (11.113 s) : 0, 11112917
section profiling
Agent [baseline] (1.205 s) : 0, 1204505
Total [baseline] (10.986 s) : 0, 10985704
Agent [candidate] (1.201 s) : 0, 1200917
Total [candidate] (10.889 s) : 0, 10888625
- baseline results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.081 s | - |
| Agent | appsec | 1.263 s | 182.316 ms (16.9%) |
| Agent | iast | 1.223 s | 142.039 ms (13.1%) |
| Agent | profiling | 1.205 s | 123.561 ms (11.4%) |
| Total | tracing | 10.784 s | - |
| Total | appsec | 11.198 s | 413.705 ms (3.8%) |
| Total | iast | 11.101 s | 316.718 ms (2.9%) |
| Total | profiling | 10.986 s | 201.381 ms (1.9%) |
- candidate results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.062 s | - |
| Agent | appsec | 1.228 s | 166.613 ms (15.7%) |
| Agent | iast | 1.204 s | 142.233 ms (13.4%) |
| Agent | profiling | 1.201 s | 139.058 ms (13.1%) |
| Total | tracing | 10.867 s | - |
| Total | appsec | 10.895 s | 27.871 ms (0.3%) |
| Total | iast | 11.113 s | 245.892 ms (2.3%) |
| Total | profiling | 10.889 s | 21.6 ms (0.2%) |
gantt
title petclinic - break down per module: candidate=1.57.0-SNAPSHOT~94e80c98fc, baseline=1.57.0-SNAPSHOT~5c5592a6f6
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.19 ms) : 0, 1190
crashtracking [candidate] (1.494 ms) : 0, 1494
BytebuddyAgent [baseline] (647.916 ms) : 0, 647916
BytebuddyAgent [candidate] (713.794 ms) : 0, 713794
GlobalTracer [baseline] (282.007 ms) : 0, 282007
GlobalTracer [candidate] (251.758 ms) : 0, 251758
AppSec [baseline] (32.368 ms) : 0, 32368
AppSec [candidate] (32.345 ms) : 0, 32345
Debugger [baseline] (68.682 ms) : 0, 68682
Debugger [candidate] (6.489 ms) : 0, 6489
Remote Config [baseline] (643.708 µs) : 0, 644
Remote Config [candidate] (672.297 µs) : 0, 672
Telemetry [baseline] (9.01 ms) : 0, 9010
Telemetry [candidate] (14.786 ms) : 0, 14786
Flare Poller [baseline] (3.727 ms) : 0, 3727
Flare Poller [candidate] (5.625 ms) : 0, 5625
section appsec
crashtracking [baseline] (1.194 ms) : 0, 1194
crashtracking [candidate] (1.469 ms) : 0, 1469
BytebuddyAgent [baseline] (688.375 ms) : 0, 688375
BytebuddyAgent [candidate] (731.72 ms) : 0, 731720
GlobalTracer [baseline] (259.193 ms) : 0, 259193
GlobalTracer [candidate] (241.598 ms) : 0, 241598
AppSec [baseline] (174.856 ms) : 0, 174856
AppSec [candidate] (175.084 ms) : 0, 175084
Debugger [baseline] (65.94 ms) : 0, 65940
Debugger [candidate] (6.277 ms) : 0, 6277
Remote Config [baseline] (718.938 µs) : 0, 719
Remote Config [candidate] (679.38 µs) : 0, 679
Telemetry [baseline] (9.02 ms) : 0, 9020
Telemetry [candidate] (8.018 ms) : 0, 8018
Flare Poller [baseline] (3.881 ms) : 0, 3881
Flare Poller [candidate] (3.923 ms) : 0, 3923
IAST [baseline] (24.596 ms) : 0, 24596
IAST [candidate] (24.794 ms) : 0, 24794
section iast
crashtracking [baseline] (1.196 ms) : 0, 1196
crashtracking [candidate] (1.498 ms) : 0, 1498
BytebuddyAgent [baseline] (790.679 ms) : 0, 790679
BytebuddyAgent [candidate] (840.932 ms) : 0, 840932
GlobalTracer [baseline] (255.319 ms) : 0, 255319
GlobalTracer [candidate] (240.092 ms) : 0, 240092
AppSec [baseline] (35.184 ms) : 0, 35184
AppSec [candidate] (26.789 ms) : 0, 26789
Debugger [baseline] (65.602 ms) : 0, 65602
Debugger [candidate] (6.025 ms) : 0, 6025
Remote Config [baseline] (588.417 µs) : 0, 588
Remote Config [candidate] (598.862 µs) : 0, 599
Telemetry [baseline] (8.453 ms) : 0, 8453
Telemetry [candidate] (7.916 ms) : 0, 7916
Flare Poller [baseline] (3.489 ms) : 0, 3489
Flare Poller [candidate] (10.641 ms) : 0, 10641
IAST [baseline] (26.975 ms) : 0, 26975
IAST [candidate] (34.709 ms) : 0, 34709
section profiling
ProfilingAgent [baseline] (97.117 ms) : 0, 97117
ProfilingAgent [candidate] (110.642 ms) : 0, 110642
crashtracking [baseline] (1.179 ms) : 0, 1179
crashtracking [candidate] (1.436 ms) : 0, 1436
BytebuddyAgent [baseline] (701.876 ms) : 0, 701876
BytebuddyAgent [candidate] (735.818 ms) : 0, 735818
GlobalTracer [baseline] (220.944 ms) : 0, 220944
GlobalTracer [candidate] (223.148 ms) : 0, 223148
AppSec [baseline] (32.323 ms) : 0, 32323
AppSec [candidate] (32.411 ms) : 0, 32411
Debugger [baseline] (68.002 ms) : 0, 68002
Debugger [candidate] (7.616 ms) : 0, 7616
Remote Config [baseline] (625.609 µs) : 0, 626
Remote Config [candidate] (711.167 µs) : 0, 711
Telemetry [baseline] (9.136 ms) : 0, 9136
Telemetry [candidate] (15.738 ms) : 0, 15738
Flare Poller [baseline] (3.818 ms) : 0, 3818
Flare Poller [candidate] (4.159 ms) : 0, 4159
Profiling [baseline] (97.695 ms) : 0, 97695
Profiling [candidate] (111.29 ms) : 0, 111290
Load
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | andrei/fix-spell |
| git_commit_date | 1765198263 | 1764624331 |
| git_commit_sha | 5c5592a | 94e80c9 |
| release_version | 1.57.0-SNAPSHOT~5c5592a6f6 | 1.57.0-SNAPSHOT~94e80c98fc |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | insecure-bank | insecure-bank |
| ci_job_date | 1765217884 | 1765217884 |
| ci_job_id | 1276693539 | 1276693539 |
| ci_pipeline_id | 85351972 | 85351972 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-0-0smt7tbp 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-0-0smt7tbp 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
Summary
Found 1 performance improvements and 3 performance regressions! Performance is the same for 16 metrics, 16 unstable metrics.
| scenario | Δ mean agg_http_req_duration_p50 | Δ mean agg_http_req_duration_p95 | Δ mean throughput | candidate mean agg_http_req_duration_p50 | candidate mean agg_http_req_duration_p95 | candidate mean throughput | baseline mean agg_http_req_duration_p50 | baseline mean agg_http_req_duration_p95 | baseline mean throughput |
|---|---|---|---|---|---|---|---|---|---|
| scenario:load:insecure-bank:iast_GLOBAL:high_load | better [-162.235µs; -79.185µs] or [-5.653%; -2.759%] |
same [-278.815µs; +62.124µs] or [-3.517%; +0.784%] |
unstable [-98.024op/s; +166.086op/s] or [-7.684%; +13.020%] |
2.749ms | 7.819ms | 1309.688op/s | 2.870ms | 7.928ms | 1275.656op/s |
| scenario:load:insecure-bank:iast_FULL:high_load | unsure [+82.833µs; +324.695µs] or [+1.666%; +6.531%] |
worse [+414.766µs; +997.981µs] or [+3.498%; +8.416%] |
unstable [-124.156op/s; +37.343op/s] or [-14.996%; +4.511%] |
5.175ms | 12.565ms | 784.500op/s | 4.972ms | 11.858ms | 827.906op/s |
| scenario:load:petclinic:iast:high_load | worse [+1.344ms; +1.992ms] or [+7.878%; +11.682%] |
worse [+1.439ms; +2.706ms] or [+5.085%; +9.563%] |
unstable [-46.036op/s; +6.974op/s] or [-17.315%; +2.623%] |
18.722ms | 30.369ms | 246.344op/s | 17.054ms | 28.296ms | 265.875op/s |
Request duration reports for insecure-bank
gantt
title insecure-bank - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~94e80c98fc, baseline=1.57.0-SNAPSHOT~5c5592a6f6
dateFormat X
axisFormat %s
section baseline
no_agent (1.191 ms) : 1179, 1203
. : milestone, 1191,
iast (3.205 ms) : 3158, 3252
. : milestone, 3205,
iast_FULL (5.58 ms) : 5525, 5635
. : milestone, 5580,
iast_GLOBAL (3.595 ms) : 3542, 3648
. : milestone, 3595,
profiling (2.046 ms) : 2028, 2064
. : milestone, 2046,
tracing (1.835 ms) : 1819, 1851
. : milestone, 1835,
section candidate
no_agent (1.224 ms) : 1212, 1236
. : milestone, 1224,
iast (3.262 ms) : 3220, 3303
. : milestone, 3262,
iast_FULL (5.894 ms) : 5833, 5954
. : milestone, 5894,
iast_GLOBAL (3.499 ms) : 3450, 3548
. : milestone, 3499,
profiling (1.951 ms) : 1933, 1968
. : milestone, 1951,
tracing (1.829 ms) : 1814, 1845
. : milestone, 1829,
- baseline results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.191 ms [1.179 ms, 1.203 ms] | - |
| iast | 3.205 ms [3.158 ms, 3.252 ms] | 2.014 ms (169.1%) |
| iast_FULL | 5.58 ms [5.525 ms, 5.635 ms] | 4.389 ms (368.6%) |
| iast_GLOBAL | 3.595 ms [3.542 ms, 3.648 ms] | 2.404 ms (201.9%) |
| profiling | 2.046 ms [2.028 ms, 2.064 ms] | 855.108 µs (71.8%) |
| tracing | 1.835 ms [1.819 ms, 1.851 ms] | 643.718 µs (54.1%) |
- candidate results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.224 ms [1.212 ms, 1.236 ms] | - |
| iast | 3.262 ms [3.22 ms, 3.303 ms] | 2.038 ms (166.5%) |
| iast_FULL | 5.894 ms [5.833 ms, 5.954 ms] | 4.67 ms (381.6%) |
| iast_GLOBAL | 3.499 ms [3.45 ms, 3.548 ms] | 2.275 ms (185.9%) |
| profiling | 1.951 ms [1.933 ms, 1.968 ms] | 726.769 µs (59.4%) |
| tracing | 1.829 ms [1.814 ms, 1.845 ms] | 605.518 µs (49.5%) |
Request duration reports for petclinic
gantt
title petclinic - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~94e80c98fc, baseline=1.57.0-SNAPSHOT~5c5592a6f6
dateFormat X
axisFormat %s
section baseline
no_agent (19.272 ms) : 19070, 19474
. : milestone, 19272,
appsec (18.647 ms) : 18457, 18837
. : milestone, 18647,
code_origins (18.042 ms) : 17862, 18222
. : milestone, 18042,
iast (17.547 ms) : 17374, 17720
. : milestone, 17547,
profiling (18.718 ms) : 18526, 18910
. : milestone, 18718,
tracing (17.621 ms) : 17446, 17796
. : milestone, 17621,
section candidate
no_agent (18.957 ms) : 18763, 19150
. : milestone, 18957,
appsec (18.474 ms) : 18288, 18659
. : milestone, 18474,
code_origins (17.756 ms) : 17579, 17932
. : milestone, 17756,
iast (18.944 ms) : 18752, 19136
. : milestone, 18944,
profiling (18.789 ms) : 18598, 18980
. : milestone, 18789,
tracing (17.528 ms) : 17350, 17706
. : milestone, 17528,
- baseline results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 19.272 ms [19.07 ms, 19.474 ms] | - |
| appsec | 18.647 ms [18.457 ms, 18.837 ms] | -625.324 µs (-3.2%) |
| code_origins | 18.042 ms [17.862 ms, 18.222 ms] | -1.231 ms (-6.4%) |
| iast | 17.547 ms [17.374 ms, 17.72 ms] | -1.725 ms (-9.0%) |
| profiling | 18.718 ms [18.526 ms, 18.91 ms] | -554.25 µs (-2.9%) |
| tracing | 17.621 ms [17.446 ms, 17.796 ms] | -1.651 ms (-8.6%) |
- candidate results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 18.957 ms [18.763 ms, 19.15 ms] | - |
| appsec | 18.474 ms [18.288 ms, 18.659 ms] | -482.855 µs (-2.5%) |
| code_origins | 17.756 ms [17.579 ms, 17.932 ms] | -1.201 ms (-6.3%) |
| iast | 18.944 ms [18.752 ms, 19.136 ms] | -12.421 µs (-0.1%) |
| profiling | 18.789 ms [18.598 ms, 18.98 ms] | -167.528 µs (-0.9%) |
| tracing | 17.528 ms [17.35 ms, 17.706 ms] | -1.428 ms (-7.5%) |
Dacapo
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | andrei/fix-spell |
| git_commit_date | 1765198263 | 1764624331 |
| git_commit_sha | 5c5592a | 94e80c9 |
| release_version | 1.57.0-SNAPSHOT~5c5592a6f6 | 1.57.0-SNAPSHOT~94e80c98fc |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | biojava | biojava |
| ci_job_date | 1765217579 | 1765217579 |
| ci_job_id | 1276693540 | 1276693540 |
| ci_pipeline_id | 85351972 | 85351972 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-1-2q6b4089 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-1-2q6b4089 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
Summary
Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.
Execution time for biojava
gantt
title biojava - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~94e80c98fc, baseline=1.57.0-SNAPSHOT~5c5592a6f6
dateFormat X
axisFormat %s
section baseline
no_agent (15.371 s) : 15371000, 15371000
. : milestone, 15371000,
appsec (14.679 s) : 14679000, 14679000
. : milestone, 14679000,
iast (18.396 s) : 18396000, 18396000
. : milestone, 18396000,
iast_GLOBAL (18.026 s) : 18026000, 18026000
. : milestone, 18026000,
profiling (14.811 s) : 14811000, 14811000
. : milestone, 14811000,
tracing (14.767 s) : 14767000, 14767000
. : milestone, 14767000,
section candidate
no_agent (15.069 s) : 15069000, 15069000
. : milestone, 15069000,
appsec (15.029 s) : 15029000, 15029000
. : milestone, 15029000,
iast (18.594 s) : 18594000, 18594000
. : milestone, 18594000,
iast_GLOBAL (17.868 s) : 17868000, 17868000
. : milestone, 17868000,
profiling (14.355 s) : 14355000, 14355000
. : milestone, 14355000,
tracing (14.742 s) : 14742000, 14742000
. : milestone, 14742000,
- baseline results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 15.371 s [15.371 s, 15.371 s] | - |
| appsec | 14.679 s [14.679 s, 14.679 s] | -692.0 ms (-4.5%) |
| iast | 18.396 s [18.396 s, 18.396 s] | 3.025 s (19.7%) |
| iast_GLOBAL | 18.026 s [18.026 s, 18.026 s] | 2.655 s (17.3%) |
| profiling | 14.811 s [14.811 s, 14.811 s] | -560.0 ms (-3.6%) |
| tracing | 14.767 s [14.767 s, 14.767 s] | -604.0 ms (-3.9%) |
- candidate results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 15.069 s [15.069 s, 15.069 s] | - |
| appsec | 15.029 s [15.029 s, 15.029 s] | -40.0 ms (-0.3%) |
| iast | 18.594 s [18.594 s, 18.594 s] | 3.525 s (23.4%) |
| iast_GLOBAL | 17.868 s [17.868 s, 17.868 s] | 2.799 s (18.6%) |
| profiling | 14.355 s [14.355 s, 14.355 s] | -714.0 ms (-4.7%) |
| tracing | 14.742 s [14.742 s, 14.742 s] | -327.0 ms (-2.2%) |
Execution time for tomcat
gantt
title tomcat - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~94e80c98fc, baseline=1.57.0-SNAPSHOT~5c5592a6f6
dateFormat X
axisFormat %s
section baseline
no_agent (1.474 ms) : 1463, 1486
. : milestone, 1474,
appsec (3.572 ms) : 3363, 3781
. : milestone, 3572,
iast (2.204 ms) : 2140, 2268
. : milestone, 2204,
iast_GLOBAL (2.249 ms) : 2185, 2314
. : milestone, 2249,
profiling (2.091 ms) : 2037, 2145
. : milestone, 2091,
tracing (2.037 ms) : 1986, 2088
. : milestone, 2037,
section candidate
no_agent (1.47 ms) : 1459, 1482
. : milestone, 1470,
appsec (3.68 ms) : 3464, 3896
. : milestone, 3680,
iast (2.21 ms) : 2146, 2275
. : milestone, 2210,
iast_GLOBAL (2.248 ms) : 2183, 2312
. : milestone, 2248,
profiling (2.086 ms) : 2032, 2140
. : milestone, 2086,
tracing (2.037 ms) : 1986, 2087
. : milestone, 2037,
- baseline results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.474 ms [1.463 ms, 1.486 ms] | - |
| appsec | 3.572 ms [3.363 ms, 3.781 ms] | 2.098 ms (142.3%) |
| iast | 2.204 ms [2.14 ms, 2.268 ms] | 729.636 µs (49.5%) |
| iast_GLOBAL | 2.249 ms [2.185 ms, 2.314 ms] | 775.102 µs (52.6%) |
| profiling | 2.091 ms [2.037 ms, 2.145 ms] | 616.75 µs (41.8%) |
| tracing | 2.037 ms [1.986 ms, 2.088 ms] | 562.694 µs (38.2%) |
- candidate results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.47 ms [1.459 ms, 1.482 ms] | - |
| appsec | 3.68 ms [3.464 ms, 3.896 ms] | 2.21 ms (150.3%) |
| iast | 2.21 ms [2.146 ms, 2.275 ms] | 740.207 µs (50.3%) |
| iast_GLOBAL | 2.248 ms [2.183 ms, 2.312 ms] | 777.55 µs (52.9%) |
| profiling | 2.086 ms [2.032 ms, 2.14 ms] | 615.923 µs (41.9%) |
| tracing | 2.037 ms [1.986 ms, 2.087 ms] | 566.357 µs (38.5%) |