🍒 10097 - Bump ddprof-java to 1.34.4 by jbachorik · Pull Request #10153 · DataDog/dd-trace-java
Benchmarks
Startup
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | jaroslav.bachorik/backport-pr-10097 |
| git_commit_date | 1763637994 | 1765444742 |
| git_commit_sha | c05874d | 16d122d |
| release_version | 1.56.0~c05874d84e | 1.57.0-SNAPSHOT~16d122dfb1 |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | insecure-bank | insecure-bank |
| ci_job_date | 1765446680 | 1765446680 |
| ci_job_id | 1286568391 | 1286568391 |
| ci_pipeline_id | 86160995 | 86160995 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-0-hnp6sx7f 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-0-hnp6sx7f 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
| module | Agent | Agent |
| parent | None | None |
Summary
Found 13 performance improvements and 6 performance regressions! Performance is the same for 33 metrics, 13 unstable metrics.
| scenario | Δ mean execution_time | candidate mean execution_time | baseline mean execution_time |
|---|---|---|---|
| scenario:startup:insecure-bank:iast:Agent.start | better [-73.307ms; -28.967ms] or [-5.858%; -2.315%] |
1.200s | 1.251s |
| scenario:startup:insecure-bank:iast:Debugger | better [-55.160ms; -53.111ms] or [-91.589%; -88.188%] |
6.089ms | 60.225ms |
| scenario:startup:insecure-bank:tracing:Agent | better [-404.424ms; -188.601ms] or [-4.505%; -2.101%] |
8.681s | 8.977s |
| scenario:startup:insecure-bank:tracing:Agent.start | better [-72.781ms; -31.504ms] or [-6.539%; -2.830%] |
1.061s | 1.113s |
| scenario:startup:insecure-bank:tracing:Debugger | better [-58.214ms; -56.897ms] or [-90.913%; -88.856%] |
6.477ms | 64.033ms |
| scenario:startup:petclinic:appsec:Agent.start | better [-61.932ms; -50.782ms] or [-4.813%; -3.946%] |
1.231s | 1.287s |
| scenario:startup:petclinic:appsec:Debugger | better [-57.373ms; -55.055ms] or [-91.798%; -88.089%] |
6.285ms | 62.499ms |
| scenario:startup:petclinic:iast:Agent.start | better [-73.198ms; -39.911ms] or [-5.853%; -3.191%] |
1.194s | 1.251s |
| scenario:startup:petclinic:iast:Debugger | better [-55.536ms; -54.247ms] or [-91.011%; -88.899%] |
6.129ms | 61.021ms |
| scenario:startup:petclinic:iast:Telemetry | worse [+339.093µs; +912.471µs] or [+4.454%; +11.984%] |
8.240ms | 7.614ms |
| scenario:startup:petclinic:iast:Flare Poller | worse [+7.190ms; +7.510ms] or [+205.050%; +214.179%] |
10.857ms | 3.507ms |
| scenario:startup:petclinic:profiling:Agent.start | better [-42.451ms; -33.806ms] or [-3.429%; -2.731%] |
1.200s | 1.238s |
| scenario:startup:petclinic:profiling:ProfilingAgent | worse [+12.841ms; +14.660ms] or [+13.150%; +15.013%] |
111.400ms | 97.650ms |
| scenario:startup:petclinic:profiling:Debugger | better [-57.171ms; -56.293ms] or [-89.990%; -88.608%] |
6.798ms | 63.530ms |
| scenario:startup:petclinic:profiling:Telemetry | worse [+8.335ms; +8.898ms] or [+103.706%; +110.701%] |
16.654ms | 8.038ms |
| scenario:startup:petclinic:profiling:Flare Poller | worse [+168.942µs; +418.782µs] or [+4.443%; +11.014%] |
4.096ms | 3.802ms |
| scenario:startup:petclinic:profiling:Profiling | worse [+12.895ms; +14.690ms] or [+13.125%; +14.952%] |
112.039ms | 98.247ms |
| scenario:startup:petclinic:tracing:Agent.start | better [-67.534ms; -44.692ms] or [-6.081%; -4.024%] |
1.055s | 1.111s |
| scenario:startup:petclinic:tracing:Debugger | better [-58.613ms; -57.136ms] or [-91.230%; -88.931%] |
6.373ms | 64.248ms |
Startup time reports for petclinic
gantt
title petclinic - global startup overhead: candidate=1.57.0-SNAPSHOT~16d122dfb1, baseline=1.56.0~c05874d84e
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.111 s) : 0, 1110659
Total [baseline] (10.845 s) : 0, 10845163
Agent [candidate] (1.055 s) : 0, 1054546
Total [candidate] (10.857 s) : 0, 10857268
section appsec
Agent [baseline] (1.287 s) : 0, 1286895
Total [baseline] (11.118 s) : 0, 11117747
Agent [candidate] (1.231 s) : 0, 1230538
Total [candidate] (10.976 s) : 0, 10976359
section iast
Agent [baseline] (1.251 s) : 0, 1250615
Total [baseline] (11.321 s) : 0, 11321012
Agent [candidate] (1.194 s) : 0, 1194061
Total [candidate] (11.254 s) : 0, 11253565
section profiling
Agent [baseline] (1.238 s) : 0, 1237811
Total [baseline] (11.088 s) : 0, 11087982
Agent [candidate] (1.2 s) : 0, 1199683
Total [candidate] (10.903 s) : 0, 10903325
- baseline results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.111 s | - |
| Agent | appsec | 1.287 s | 176.235 ms (15.9%) |
| Agent | iast | 1.251 s | 139.956 ms (12.6%) |
| Agent | profiling | 1.238 s | 127.152 ms (11.4%) |
| Total | tracing | 10.845 s | - |
| Total | appsec | 11.118 s | 272.584 ms (2.5%) |
| Total | iast | 11.321 s | 475.849 ms (4.4%) |
| Total | profiling | 11.088 s | 242.819 ms (2.2%) |
- candidate results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.055 s | - |
| Agent | appsec | 1.231 s | 175.991 ms (16.7%) |
| Agent | iast | 1.194 s | 139.514 ms (13.2%) |
| Agent | profiling | 1.2 s | 145.137 ms (13.8%) |
| Total | tracing | 10.857 s | - |
| Total | appsec | 10.976 s | 119.09 ms (1.1%) |
| Total | iast | 11.254 s | 396.297 ms (3.7%) |
| Total | profiling | 10.903 s | 46.057 ms (0.4%) |
gantt
title petclinic - break down per module: candidate=1.57.0-SNAPSHOT~16d122dfb1, baseline=1.56.0~c05874d84e
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.467 ms) : 0, 1467
crashtracking [candidate] (1.454 ms) : 0, 1454
BytebuddyAgent [baseline] (713.197 ms) : 0, 713197
BytebuddyAgent [candidate] (708.734 ms) : 0, 708734
GlobalTracer [baseline] (251.521 ms) : 0, 251521
GlobalTracer [candidate] (250.073 ms) : 0, 250073
AppSec [baseline] (32.399 ms) : 0, 32399
AppSec [candidate] (32.143 ms) : 0, 32143
Debugger [baseline] (64.248 ms) : 0, 64248
Debugger [candidate] (6.373 ms) : 0, 6373
Remote Config [baseline] (630.281 µs) : 0, 630
Remote Config [candidate] (691.835 µs) : 0, 692
Telemetry [baseline] (8.32 ms) : 0, 8320
Telemetry [candidate] (13.836 ms) : 0, 13836
Flare Poller [baseline] (3.675 ms) : 0, 3675
Flare Poller [candidate] (6.348 ms) : 0, 6348
section appsec
crashtracking [baseline] (1.461 ms) : 0, 1461
crashtracking [candidate] (1.451 ms) : 0, 1451
BytebuddyAgent [baseline] (733.127 ms) : 0, 733127
BytebuddyAgent [candidate] (732.829 ms) : 0, 732829
GlobalTracer [baseline] (241.4 ms) : 0, 241400
GlobalTracer [candidate] (241.583 ms) : 0, 241583
AppSec [baseline] (175.384 ms) : 0, 175384
AppSec [candidate] (175.425 ms) : 0, 175425
Debugger [baseline] (62.499 ms) : 0, 62499
Debugger [candidate] (6.285 ms) : 0, 6285
Remote Config [baseline] (675.03 µs) : 0, 675
Remote Config [candidate] (681.798 µs) : 0, 682
Telemetry [baseline] (8.212 ms) : 0, 8212
Telemetry [candidate] (8.202 ms) : 0, 8202
Flare Poller [baseline] (3.999 ms) : 0, 3999
Flare Poller [candidate] (4.006 ms) : 0, 4006
IAST [baseline] (25.0 ms) : 0, 25000
IAST [candidate] (24.975 ms) : 0, 24975
section iast
crashtracking [baseline] (1.478 ms) : 0, 1478
crashtracking [candidate] (1.461 ms) : 0, 1461
BytebuddyAgent [baseline] (839.864 ms) : 0, 839864
BytebuddyAgent [candidate] (832.839 ms) : 0, 832839
GlobalTracer [baseline] (239.345 ms) : 0, 239345
GlobalTracer [candidate] (237.268 ms) : 0, 237268
AppSec [baseline] (34.976 ms) : 0, 34976
AppSec [candidate] (33.322 ms) : 0, 33322
Debugger [baseline] (61.021 ms) : 0, 61021
Debugger [candidate] (6.129 ms) : 0, 6129
Remote Config [baseline] (546.7 µs) : 0, 547
Remote Config [candidate] (631.299 µs) : 0, 631
Telemetry [baseline] (7.614 ms) : 0, 7614
Telemetry [candidate] (8.24 ms) : 0, 8240
Flare Poller [baseline] (3.507 ms) : 0, 3507
Flare Poller [candidate] (10.857 ms) : 0, 10857
IAST [baseline] (27.003 ms) : 0, 27003
IAST [candidate] (28.313 ms) : 0, 28313
section profiling
ProfilingAgent [baseline] (97.65 ms) : 0, 97650
ProfilingAgent [candidate] (111.4 ms) : 0, 111400
crashtracking [baseline] (1.443 ms) : 0, 1443
crashtracking [candidate] (1.441 ms) : 0, 1441
BytebuddyAgent [baseline] (737.075 ms) : 0, 737075
BytebuddyAgent [candidate] (733.885 ms) : 0, 733885
GlobalTracer [baseline] (223.402 ms) : 0, 223402
GlobalTracer [candidate] (222.948 ms) : 0, 222948
AppSec [baseline] (32.286 ms) : 0, 32286
AppSec [candidate] (32.014 ms) : 0, 32014
Debugger [baseline] (63.53 ms) : 0, 63530
Debugger [candidate] (6.798 ms) : 0, 6798
Remote Config [baseline] (674.046 µs) : 0, 674
Remote Config [candidate] (680.295 µs) : 0, 680
Telemetry [baseline] (8.038 ms) : 0, 8038
Telemetry [candidate] (16.654 ms) : 0, 16654
Flare Poller [baseline] (3.802 ms) : 0, 3802
Flare Poller [candidate] (4.096 ms) : 0, 4096
Profiling [baseline] (98.247 ms) : 0, 98247
Profiling [candidate] (112.039 ms) : 0, 112039
Startup time reports for insecure-bank
gantt
title insecure-bank - global startup overhead: candidate=1.57.0-SNAPSHOT~16d122dfb1, baseline=1.56.0~c05874d84e
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.113 s) : 0, 1113073
Total [baseline] (8.977 s) : 0, 8977361
Agent [candidate] (1.061 s) : 0, 1060930
Total [candidate] (8.681 s) : 0, 8680848
section iast
Agent [baseline] (1.251 s) : 0, 1251465
Total [baseline] (9.632 s) : 0, 9631736
Agent [candidate] (1.2 s) : 0, 1200328
Total [candidate] (9.39 s) : 0, 9389521
- baseline results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.113 s | - |
| Agent | iast | 1.251 s | 138.392 ms (12.4%) |
| Total | tracing | 8.977 s | - |
| Total | iast | 9.632 s | 654.375 ms (7.3%) |
- candidate results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.061 s | - |
| Agent | iast | 1.2 s | 139.398 ms (13.1%) |
| Total | tracing | 8.681 s | - |
| Total | iast | 9.39 s | 708.673 ms (8.2%) |
gantt
title insecure-bank - break down per module: candidate=1.57.0-SNAPSHOT~16d122dfb1, baseline=1.56.0~c05874d84e
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.479 ms) : 0, 1479
crashtracking [candidate] (1.47 ms) : 0, 1470
BytebuddyAgent [baseline] (715.535 ms) : 0, 715535
BytebuddyAgent [candidate] (712.839 ms) : 0, 712839
GlobalTracer [baseline] (251.719 ms) : 0, 251719
GlobalTracer [candidate] (251.533 ms) : 0, 251533
AppSec [baseline] (32.389 ms) : 0, 32389
AppSec [candidate] (32.36 ms) : 0, 32360
Debugger [baseline] (64.033 ms) : 0, 64033
Debugger [candidate] (6.477 ms) : 0, 6477
Remote Config [baseline] (646.122 µs) : 0, 646
Remote Config [candidate] (679.625 µs) : 0, 680
Telemetry [baseline] (8.294 ms) : 0, 8294
Telemetry [candidate] (13.348 ms) : 0, 13348
Flare Poller [baseline] (3.717 ms) : 0, 3717
Flare Poller [candidate] (6.356 ms) : 0, 6356
section iast
crashtracking [baseline] (1.471 ms) : 0, 1471
crashtracking [candidate] (1.492 ms) : 0, 1492
BytebuddyAgent [baseline] (840.665 ms) : 0, 840665
BytebuddyAgent [candidate] (837.768 ms) : 0, 837768
GlobalTracer [baseline] (239.654 ms) : 0, 239654
GlobalTracer [candidate] (238.742 ms) : 0, 238742
IAST [baseline] (29.827 ms) : 0, 29827
IAST [candidate] (30.151 ms) : 0, 30151
AppSec [baseline] (32.558 ms) : 0, 32558
AppSec [candidate] (31.478 ms) : 0, 31478
Debugger [baseline] (60.225 ms) : 0, 60225
Debugger [candidate] (6.089 ms) : 0, 6089
Remote Config [baseline] (549.467 µs) : 0, 549
Remote Config [candidate] (623.726 µs) : 0, 624
Telemetry [baseline] (7.737 ms) : 0, 7737
Telemetry [candidate] (7.96 ms) : 0, 7960
Flare Poller [baseline] (3.548 ms) : 0, 3548
Flare Poller [candidate] (10.909 ms) : 0, 10909
Load
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | jaroslav.bachorik/backport-pr-10097 |
| git_commit_date | 1763637994 | 1765444742 |
| git_commit_sha | c05874d | 16d122d |
| release_version | 1.56.0~c05874d84e | 1.57.0-SNAPSHOT~16d122dfb1 |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | insecure-bank | insecure-bank |
| ci_job_date | 1765447166 | 1765447166 |
| ci_job_id | 1286568393 | 1286568393 |
| ci_pipeline_id | 86160995 | 86160995 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-0-se6n1u73 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-0-se6n1u73 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
Summary
Found 0 performance improvements and 2 performance regressions! Performance is the same for 18 metrics, 16 unstable metrics.
| scenario | Δ mean agg_http_req_duration_p50 | Δ mean agg_http_req_duration_p95 | Δ mean throughput | candidate mean agg_http_req_duration_p50 | candidate mean agg_http_req_duration_p95 | candidate mean throughput | baseline mean agg_http_req_duration_p50 | baseline mean agg_http_req_duration_p95 | baseline mean throughput |
|---|---|---|---|---|---|---|---|---|---|
| scenario:load:petclinic:tracing:high_load | worse [+522.651µs; +1306.338µs] or [+3.043%; +7.605%] |
unsure [+0.547ms; +1.617ms] or [+1.931%; +5.702%] |
unstable [-38.078op/s; +14.515op/s] or [-14.382%; +5.483%] |
18.093ms | 29.437ms | 252.969op/s | 17.178ms | 28.354ms | 264.750op/s |
| scenario:load:petclinic:code_origins:high_load | worse [+0.663ms; +1.553ms] or [+3.806%; +8.917%] |
unsure [+0.422ms; +1.869ms] or [+1.482%; +6.570%] |
unstable [-39.326op/s; +12.826op/s] or [-14.985%; +4.887%] |
18.525ms | 29.594ms | 249.188op/s | 17.417ms | 28.449ms | 262.438op/s |
Request duration reports for petclinic
gantt
title petclinic - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~16d122dfb1, baseline=1.56.0~c05874d84e
dateFormat X
axisFormat %s
section baseline
no_agent (17.959 ms) : 17775, 18142
. : milestone, 17959,
appsec (18.634 ms) : 18447, 18821
. : milestone, 18634,
code_origins (17.779 ms) : 17603, 17955
. : milestone, 17779,
iast (17.452 ms) : 17279, 17625
. : milestone, 17452,
profiling (18.878 ms) : 18686, 19071
. : milestone, 18878,
tracing (17.621 ms) : 17447, 17796
. : milestone, 17621,
section candidate
no_agent (18.2 ms) : 18014, 18386
. : milestone, 18200,
appsec (18.465 ms) : 18276, 18654
. : milestone, 18465,
code_origins (18.725 ms) : 18540, 18911
. : milestone, 18725,
iast (17.656 ms) : 17477, 17835
. : milestone, 17656,
profiling (18.678 ms) : 18495, 18861
. : milestone, 18678,
tracing (18.445 ms) : 18260, 18631
. : milestone, 18445,
- baseline results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 17.959 ms [17.775 ms, 18.142 ms] | - |
| appsec | 18.634 ms [18.447 ms, 18.821 ms] | 675.354 µs (3.8%) |
| code_origins | 17.779 ms [17.603 ms, 17.955 ms] | -179.495 µs (-1.0%) |
| iast | 17.452 ms [17.279 ms, 17.625 ms] | -506.311 µs (-2.8%) |
| profiling | 18.878 ms [18.686 ms, 19.071 ms] | 919.876 µs (5.1%) |
| tracing | 17.621 ms [17.447 ms, 17.796 ms] | -337.187 µs (-1.9%) |
- candidate results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 18.2 ms [18.014 ms, 18.386 ms] | - |
| appsec | 18.465 ms [18.276 ms, 18.654 ms] | 265.221 µs (1.5%) |
| code_origins | 18.725 ms [18.54 ms, 18.911 ms] | 525.242 µs (2.9%) |
| iast | 17.656 ms [17.477 ms, 17.835 ms] | -544.143 µs (-3.0%) |
| profiling | 18.678 ms [18.495 ms, 18.861 ms] | 478.019 µs (2.6%) |
| tracing | 18.445 ms [18.26 ms, 18.631 ms] | 245.297 µs (1.3%) |
Request duration reports for insecure-bank
gantt
title insecure-bank - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~16d122dfb1, baseline=1.56.0~c05874d84e
dateFormat X
axisFormat %s
section baseline
no_agent (1.286 ms) : 1271, 1301
. : milestone, 1286,
iast (3.169 ms) : 3125, 3213
. : milestone, 3169,
iast_FULL (5.859 ms) : 5801, 5917
. : milestone, 5859,
iast_GLOBAL (3.535 ms) : 3481, 3589
. : milestone, 3535,
profiling (2.195 ms) : 2174, 2216
. : milestone, 2195,
tracing (1.799 ms) : 1784, 1814
. : milestone, 1799,
section candidate
no_agent (1.204 ms) : 1193, 1216
. : milestone, 1204,
iast (3.23 ms) : 3190, 3271
. : milestone, 3230,
iast_FULL (5.904 ms) : 5844, 5964
. : milestone, 5904,
iast_GLOBAL (3.625 ms) : 3570, 3680
. : milestone, 3625,
profiling (2.03 ms) : 2013, 2048
. : milestone, 2030,
tracing (1.817 ms) : 1802, 1832
. : milestone, 1817,
- baseline results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.286 ms [1.271 ms, 1.301 ms] | - |
| iast | 3.169 ms [3.125 ms, 3.213 ms] | 1.883 ms (146.4%) |
| iast_FULL | 5.859 ms [5.801 ms, 5.917 ms] | 4.573 ms (355.6%) |
| iast_GLOBAL | 3.535 ms [3.481 ms, 3.589 ms] | 2.249 ms (174.8%) |
| profiling | 2.195 ms [2.174 ms, 2.216 ms] | 908.905 µs (70.7%) |
| tracing | 1.799 ms [1.784 ms, 1.814 ms] | 512.871 µs (39.9%) |
- candidate results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.204 ms [1.193 ms, 1.216 ms] | - |
| iast | 3.23 ms [3.19 ms, 3.271 ms] | 2.026 ms (168.2%) |
| iast_FULL | 5.904 ms [5.844 ms, 5.964 ms] | 4.699 ms (390.2%) |
| iast_GLOBAL | 3.625 ms [3.57 ms, 3.68 ms] | 2.42 ms (200.9%) |
| profiling | 2.03 ms [2.013 ms, 2.048 ms] | 826.03 µs (68.6%) |
| tracing | 1.817 ms [1.802 ms, 1.832 ms] | 612.719 µs (50.9%) |
Dacapo
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | jaroslav.bachorik/backport-pr-10097 |
| git_commit_date | 1763637994 | 1765444742 |
| git_commit_sha | c05874d | 16d122d |
| release_version | 1.56.0~c05874d84e | 1.57.0-SNAPSHOT~16d122dfb1 |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | biojava | biojava |
| ci_job_date | 1765446889 | 1765446889 |
| ci_job_id | 1286568395 | 1286568395 |
| ci_pipeline_id | 86160995 | 86160995 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-0-p79cj5xu 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-0-p79cj5xu 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
Summary
Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics.
Execution time for biojava
gantt
title biojava - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~16d122dfb1, baseline=1.56.0~c05874d84e
dateFormat X
axisFormat %s
section baseline
no_agent (15.377 s) : 15377000, 15377000
. : milestone, 15377000,
appsec (14.682 s) : 14682000, 14682000
. : milestone, 14682000,
iast (18.37 s) : 18370000, 18370000
. : milestone, 18370000,
iast_GLOBAL (18.239 s) : 18239000, 18239000
. : milestone, 18239000,
profiling (14.711 s) : 14711000, 14711000
. : milestone, 14711000,
tracing (14.91 s) : 14910000, 14910000
. : milestone, 14910000,
section candidate
no_agent (15.296 s) : 15296000, 15296000
. : milestone, 15296000,
appsec (14.798 s) : 14798000, 14798000
. : milestone, 14798000,
iast (18.247 s) : 18247000, 18247000
. : milestone, 18247000,
iast_GLOBAL (17.81 s) : 17810000, 17810000
. : milestone, 17810000,
profiling (14.557 s) : 14557000, 14557000
. : milestone, 14557000,
tracing (14.923 s) : 14923000, 14923000
. : milestone, 14923000,
- baseline results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 15.377 s [15.377 s, 15.377 s] | - |
| appsec | 14.682 s [14.682 s, 14.682 s] | -695.0 ms (-4.5%) |
| iast | 18.37 s [18.37 s, 18.37 s] | 2.993 s (19.5%) |
| iast_GLOBAL | 18.239 s [18.239 s, 18.239 s] | 2.862 s (18.6%) |
| profiling | 14.711 s [14.711 s, 14.711 s] | -666.0 ms (-4.3%) |
| tracing | 14.91 s [14.91 s, 14.91 s] | -467.0 ms (-3.0%) |
- candidate results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 15.296 s [15.296 s, 15.296 s] | - |
| appsec | 14.798 s [14.798 s, 14.798 s] | -498.0 ms (-3.3%) |
| iast | 18.247 s [18.247 s, 18.247 s] | 2.951 s (19.3%) |
| iast_GLOBAL | 17.81 s [17.81 s, 17.81 s] | 2.514 s (16.4%) |
| profiling | 14.557 s [14.557 s, 14.557 s] | -739.0 ms (-4.8%) |
| tracing | 14.923 s [14.923 s, 14.923 s] | -373.0 ms (-2.4%) |
Execution time for tomcat
gantt
title tomcat - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~16d122dfb1, baseline=1.56.0~c05874d84e
dateFormat X
axisFormat %s
section baseline
no_agent (1.474 ms) : 1463, 1486
. : milestone, 1474,
appsec (3.676 ms) : 3461, 3891
. : milestone, 3676,
iast (2.211 ms) : 2147, 2276
. : milestone, 2211,
iast_GLOBAL (2.248 ms) : 2183, 2312
. : milestone, 2248,
profiling (2.08 ms) : 2026, 2133
. : milestone, 2080,
tracing (2.056 ms) : 2005, 2107
. : milestone, 2056,
section candidate
no_agent (1.48 ms) : 1469, 1492
. : milestone, 1480,
appsec (3.712 ms) : 3494, 3929
. : milestone, 3712,
iast (2.203 ms) : 2139, 2267
. : milestone, 2203,
iast_GLOBAL (2.264 ms) : 2199, 2330
. : milestone, 2264,
profiling (2.483 ms) : 2318, 2648
. : milestone, 2483,
tracing (2.048 ms) : 1997, 2099
. : milestone, 2048,
- baseline results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.474 ms [1.463 ms, 1.486 ms] | - |
| appsec | 3.676 ms [3.461 ms, 3.891 ms] | 2.201 ms (149.3%) |
| iast | 2.211 ms [2.147 ms, 2.276 ms] | 736.956 µs (50.0%) |
| iast_GLOBAL | 2.248 ms [2.183 ms, 2.312 ms] | 773.165 µs (52.4%) |
| profiling | 2.08 ms [2.026 ms, 2.133 ms] | 605.146 µs (41.0%) |
| tracing | 2.056 ms [2.005 ms, 2.107 ms] | 581.533 µs (39.4%) |
- candidate results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.48 ms [1.469 ms, 1.492 ms] | - |
| appsec | 3.712 ms [3.494 ms, 3.929 ms] | 2.231 ms (150.8%) |
| iast | 2.203 ms [2.139 ms, 2.267 ms] | 722.835 µs (48.8%) |
| iast_GLOBAL | 2.264 ms [2.199 ms, 2.33 ms] | 784.277 µs (53.0%) |
| profiling | 2.483 ms [2.318 ms, 2.648 ms] | 1.003 ms (67.8%) |
| tracing | 2.048 ms [1.997 ms, 2.099 ms] | 567.703 µs (38.4%) |