🍒 9774 - Add a feature flag to disable extra calls to the DB in JDBC instrumentation by sarahchen6 · Pull Request #10161 · DataDog/dd-trace-java
Benchmarks
Startup
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | sarah.chen/backport-pr-9774 |
| git_commit_date | 1763637994 | 1765395097 |
| git_commit_sha | c05874d | 181e889 |
| release_version | 1.56.0~c05874d84e | 1.57.0-SNAPSHOT~181e8892a9 |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | insecure-bank | insecure-bank |
| ci_job_date | 1765396985 | 1765396985 |
| ci_job_id | 1285221711 | 1285221711 |
| ci_pipeline_id | 86043316 | 86043316 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-0-jplcljra 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-0-jplcljra 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
| module | Agent | Agent |
| parent | None | None |
Summary
Found 10 performance improvements and 10 performance regressions! Performance is the same for 35 metrics, 10 unstable metrics.
| scenario | Δ mean execution_time | candidate mean execution_time | baseline mean execution_time |
|---|---|---|---|
| scenario:startup:insecure-bank:iast:Agent | better [-293.937ms; -231.071ms] or [-3.073%; -2.416%] |
9.302s | 9.565s |
| scenario:startup:insecure-bank:iast:Debugger | better [-54.122ms; -53.146ms] or [-90.484%; -88.852%] |
6.180ms | 59.814ms |
| scenario:startup:insecure-bank:iast:Remote Config | worse [+46.999µs; +96.529µs] or [+8.563%; +17.586%] |
620.646µs | 548.882µs |
| scenario:startup:insecure-bank:iast:Telemetry | worse [+347.715µs; +842.800µs] or [+4.562%; +11.057%] |
8.218ms | 7.622ms |
| scenario:startup:insecure-bank:tracing:Agent.start | better [-82.908ms; -42.343ms] or [-7.419%; -3.789%] |
1.055s | 1.117s |
| scenario:startup:insecure-bank:tracing:Debugger | better [-58.573ms; -56.535ms] or [-91.593%; -88.405%] |
6.395ms | 63.949ms |
| scenario:startup:petclinic:appsec:Agent.start | better [-58.467ms; -46.926ms] or [-4.558%; -3.658%] |
1.230s | 1.283s |
| scenario:startup:petclinic:appsec:Debugger | better [-56.138ms; -54.652ms] or [-91.002%; -88.593%] |
6.294ms | 61.689ms |
| scenario:startup:petclinic:iast:Debugger | better [-55.361ms; -54.210ms] or [-90.873%; -88.984%] |
6.136ms | 60.922ms |
| scenario:startup:petclinic:iast:Remote Config | worse [+40.636µs; +90.026µs] or [+7.381%; +16.351%] |
615.913µs | 550.582µs |
| scenario:startup:petclinic:iast:Telemetry | worse [+181.073µs; +657.178µs] or [+2.388%; +8.666%] |
8.003ms | 7.584ms |
| scenario:startup:petclinic:profiling:ProfilingAgent | worse [+11.201ms; +15.913ms] or [+11.470%; +16.295%] |
111.210ms | 97.653ms |
| scenario:startup:petclinic:profiling:Debugger | better [-57.265ms; -53.912ms] or [-90.504%; -85.205%] |
7.685ms | 63.273ms |
| scenario:startup:petclinic:profiling:Flare Poller | worse [+242.822µs; +444.884µs] or [+6.450%; +11.817%] |
4.109ms | 3.765ms |
| scenario:startup:petclinic:profiling:Profiling | worse [+11.254ms; +16.003ms] or [+11.455%; +16.288%] |
111.877ms | 98.248ms |
| scenario:startup:petclinic:tracing:Agent.start | better [-73.954ms; -46.241ms] or [-6.644%; -4.154%] |
1.053s | 1.113s |
| scenario:startup:petclinic:tracing:Debugger | better [-58.808ms; -57.378ms] or [-91.155%; -88.938%] |
6.421ms | 64.514ms |
| scenario:startup:petclinic:tracing:Remote Config | worse [+19.522µs; +52.281µs] or [+3.048%; +8.162%] |
676.430µs | 640.528µs |
| scenario:startup:petclinic:tracing:Telemetry | worse [+7.526ms; +8.259ms] or [+89.538%; +98.252%] |
16.299ms | 8.406ms |
| scenario:startup:petclinic:tracing:Flare Poller | worse [+180.794µs; +371.952µs] or [+4.727%; +9.725%] |
4.101ms | 3.825ms |
Startup time reports for petclinic
gantt
title petclinic - global startup overhead: candidate=1.57.0-SNAPSHOT~181e8892a9, baseline=1.56.0~c05874d84e
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.113 s) : 0, 1113078
Total [baseline] (10.772 s) : 0, 10771907
Agent [candidate] (1.053 s) : 0, 1052981
Total [candidate] (10.834 s) : 0, 10833676
section appsec
Agent [baseline] (1.283 s) : 0, 1282814
Total [baseline] (11.008 s) : 0, 11008137
Agent [candidate] (1.23 s) : 0, 1230118
Total [candidate] (10.979 s) : 0, 10978951
section iast
Agent [baseline] (1.24 s) : 0, 1240253
Total [baseline] (11.19 s) : 0, 11189533
Agent [candidate] (1.2 s) : 0, 1200388
Total [candidate] (11.231 s) : 0, 11231406
section profiling
Agent [baseline] (1.236 s) : 0, 1236092
Total [baseline] (11.097 s) : 0, 11096542
Agent [candidate] (1.204 s) : 0, 1204009
Total [candidate] (10.916 s) : 0, 10916368
- baseline results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.113 s | - |
| Agent | appsec | 1.283 s | 169.736 ms (15.2%) |
| Agent | iast | 1.24 s | 127.175 ms (11.4%) |
| Agent | profiling | 1.236 s | 123.014 ms (11.1%) |
| Total | tracing | 10.772 s | - |
| Total | appsec | 11.008 s | 236.229 ms (2.2%) |
| Total | iast | 11.19 s | 417.625 ms (3.9%) |
| Total | profiling | 11.097 s | 324.635 ms (3.0%) |
- candidate results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.053 s | - |
| Agent | appsec | 1.23 s | 177.137 ms (16.8%) |
| Agent | iast | 1.2 s | 147.408 ms (14.0%) |
| Agent | profiling | 1.204 s | 151.028 ms (14.3%) |
| Total | tracing | 10.834 s | - |
| Total | appsec | 10.979 s | 145.275 ms (1.3%) |
| Total | iast | 11.231 s | 397.73 ms (3.7%) |
| Total | profiling | 10.916 s | 82.692 ms (0.8%) |
gantt
title petclinic - break down per module: candidate=1.57.0-SNAPSHOT~181e8892a9, baseline=1.56.0~c05874d84e
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.491 ms) : 0, 1491
crashtracking [candidate] (1.475 ms) : 0, 1475
BytebuddyAgent [baseline] (714.948 ms) : 0, 714948
BytebuddyAgent [candidate] (707.105 ms) : 0, 707105
GlobalTracer [baseline] (251.707 ms) : 0, 251707
GlobalTracer [candidate] (249.868 ms) : 0, 249868
AppSec [baseline] (32.372 ms) : 0, 32372
AppSec [candidate] (32.192 ms) : 0, 32192
Debugger [baseline] (64.514 ms) : 0, 64514
Debugger [candidate] (6.421 ms) : 0, 6421
Remote Config [baseline] (640.528 µs) : 0, 641
Remote Config [candidate] (676.43 µs) : 0, 676
Telemetry [baseline] (8.406 ms) : 0, 8406
Telemetry [candidate] (16.299 ms) : 0, 16299
Flare Poller [baseline] (3.825 ms) : 0, 3825
Flare Poller [candidate] (4.101 ms) : 0, 4101
section appsec
crashtracking [baseline] (1.458 ms) : 0, 1458
crashtracking [candidate] (1.445 ms) : 0, 1445
BytebuddyAgent [baseline] (732.095 ms) : 0, 732095
BytebuddyAgent [candidate] (733.673 ms) : 0, 733673
GlobalTracer [baseline] (240.607 ms) : 0, 240607
GlobalTracer [candidate] (241.03 ms) : 0, 241030
IAST [baseline] (24.502 ms) : 0, 24502
IAST [candidate] (24.814 ms) : 0, 24814
AppSec [baseline] (174.688 ms) : 0, 174688
AppSec [candidate] (174.857 ms) : 0, 174857
Debugger [baseline] (61.689 ms) : 0, 61689
Debugger [candidate] (6.294 ms) : 0, 6294
Remote Config [baseline] (677.321 µs) : 0, 677
Remote Config [candidate] (702.869 µs) : 0, 703
Telemetry [baseline] (8.229 ms) : 0, 8229
Telemetry [candidate] (8.212 ms) : 0, 8212
Flare Poller [baseline] (3.93 ms) : 0, 3930
Flare Poller [candidate] (3.999 ms) : 0, 3999
section iast
crashtracking [baseline] (1.449 ms) : 0, 1449
crashtracking [candidate] (1.464 ms) : 0, 1464
BytebuddyAgent [baseline] (832.032 ms) : 0, 832032
BytebuddyAgent [candidate] (837.663 ms) : 0, 837663
GlobalTracer [baseline] (237.811 ms) : 0, 237811
GlobalTracer [candidate] (238.928 ms) : 0, 238928
IAST [baseline] (27.604 ms) : 0, 27604
IAST [candidate] (31.44 ms) : 0, 31440
AppSec [baseline] (33.884 ms) : 0, 33884
AppSec [candidate] (30.185 ms) : 0, 30185
Debugger [baseline] (60.922 ms) : 0, 60922
Debugger [candidate] (6.136 ms) : 0, 6136
Remote Config [baseline] (550.581 µs) : 0, 551
Remote Config [candidate] (615.913 µs) : 0, 616
Telemetry [baseline] (7.584 ms) : 0, 7584
Telemetry [candidate] (8.003 ms) : 0, 8003
Flare Poller [baseline] (3.48 ms) : 0, 3480
Flare Poller [candidate] (10.804 ms) : 0, 10804
section profiling
crashtracking [baseline] (1.437 ms) : 0, 1437
crashtracking [candidate] (1.46 ms) : 0, 1460
BytebuddyAgent [baseline] (735.99 ms) : 0, 735990
BytebuddyAgent [candidate] (737.57 ms) : 0, 737570
GlobalTracer [baseline] (223.281 ms) : 0, 223281
GlobalTracer [candidate] (223.466 ms) : 0, 223466
AppSec [baseline] (32.259 ms) : 0, 32259
AppSec [candidate] (32.242 ms) : 0, 32242
Debugger [baseline] (63.273 ms) : 0, 63273
Debugger [candidate] (7.685 ms) : 0, 7685
Remote Config [baseline] (661.187 µs) : 0, 661
Remote Config [candidate] (698.399 µs) : 0, 698
Telemetry [baseline] (7.97 ms) : 0, 7970
Telemetry [candidate] (15.48 ms) : 0, 15480
Flare Poller [baseline] (3.765 ms) : 0, 3765
Flare Poller [candidate] (4.109 ms) : 0, 4109
ProfilingAgent [baseline] (97.653 ms) : 0, 97653
ProfilingAgent [candidate] (111.21 ms) : 0, 111210
Profiling [baseline] (98.248 ms) : 0, 98248
Profiling [candidate] (111.877 ms) : 0, 111877
Startup time reports for insecure-bank
gantt
title insecure-bank - global startup overhead: candidate=1.57.0-SNAPSHOT~181e8892a9, baseline=1.56.0~c05874d84e
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.117 s) : 0, 1117462
Total [baseline] (8.849 s) : 0, 8849324
Agent [candidate] (1.055 s) : 0, 1054836
Total [candidate] (8.649 s) : 0, 8648760
section iast
Agent [baseline] (1.241 s) : 0, 1241046
Total [baseline] (9.565 s) : 0, 9564702
Agent [candidate] (1.201 s) : 0, 1200851
Total [candidate] (9.302 s) : 0, 9302198
- baseline results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.117 s | - |
| Agent | iast | 1.241 s | 123.584 ms (11.1%) |
| Total | tracing | 8.849 s | - |
| Total | iast | 9.565 s | 715.378 ms (8.1%) |
- candidate results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.055 s | - |
| Agent | iast | 1.201 s | 146.015 ms (13.8%) |
| Total | tracing | 8.649 s | - |
| Total | iast | 9.302 s | 653.438 ms (7.6%) |
gantt
title insecure-bank - break down per module: candidate=1.57.0-SNAPSHOT~181e8892a9, baseline=1.56.0~c05874d84e
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.486 ms) : 0, 1486
crashtracking [candidate] (1.454 ms) : 0, 1454
BytebuddyAgent [baseline] (718.749 ms) : 0, 718749
BytebuddyAgent [candidate] (709.176 ms) : 0, 709176
GlobalTracer [baseline] (252.597 ms) : 0, 252597
GlobalTracer [candidate] (249.683 ms) : 0, 249683
AppSec [baseline] (32.643 ms) : 0, 32643
AppSec [candidate] (32.086 ms) : 0, 32086
Debugger [baseline] (63.949 ms) : 0, 63949
Debugger [candidate] (6.395 ms) : 0, 6395
Remote Config [baseline] (644.848 µs) : 0, 645
Remote Config [candidate] (669.334 µs) : 0, 669
Telemetry [baseline] (8.457 ms) : 0, 8457
Telemetry [candidate] (14.792 ms) : 0, 14792
Flare Poller [baseline] (3.846 ms) : 0, 3846
Flare Poller [candidate] (4.989 ms) : 0, 4989
section iast
crashtracking [baseline] (1.453 ms) : 0, 1453
crashtracking [candidate] (1.474 ms) : 0, 1474
BytebuddyAgent [baseline] (833.738 ms) : 0, 833738
BytebuddyAgent [candidate] (838.064 ms) : 0, 838064
GlobalTracer [baseline] (237.595 ms) : 0, 237595
GlobalTracer [candidate] (238.245 ms) : 0, 238245
AppSec [baseline] (34.169 ms) : 0, 34169
AppSec [candidate] (33.32 ms) : 0, 33320
Debugger [baseline] (59.814 ms) : 0, 59814
Debugger [candidate] (6.18 ms) : 0, 6180
Remote Config [baseline] (548.882 µs) : 0, 549
Remote Config [candidate] (620.646 µs) : 0, 621
Telemetry [baseline] (7.622 ms) : 0, 7622
Telemetry [candidate] (8.218 ms) : 0, 8218
Flare Poller [baseline] (3.437 ms) : 0, 3437
Flare Poller [candidate] (10.986 ms) : 0, 10986
IAST [baseline] (27.672 ms) : 0, 27672
IAST [candidate] (28.652 ms) : 0, 28652
Load
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | sarah.chen/backport-pr-9774 |
| git_commit_date | 1763637994 | 1765395097 |
| git_commit_sha | c05874d | 181e889 |
| release_version | 1.56.0~c05874d84e | 1.57.0-SNAPSHOT~181e8892a9 |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | insecure-bank | insecure-bank |
| ci_job_date | 1765397562 | 1765397562 |
| ci_job_id | 1285221715 | 1285221715 |
| ci_pipeline_id | 86043316 | 86043316 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-0-m58gfmcp 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-0-m58gfmcp 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
Summary
Found 5 performance improvements and 3 performance regressions! Performance is the same for 13 metrics, 15 unstable metrics.
| scenario | Δ mean agg_http_req_duration_p50 | Δ mean agg_http_req_duration_p95 | Δ mean throughput | candidate mean agg_http_req_duration_p50 | candidate mean agg_http_req_duration_p95 | candidate mean throughput | baseline mean agg_http_req_duration_p50 | baseline mean agg_http_req_duration_p95 | baseline mean throughput |
|---|---|---|---|---|---|---|---|---|---|
| scenario:load:insecure-bank:iast_GLOBAL:high_load | worse [+89.577µs; +183.058µs] or [+3.297%; +6.737%] |
unsure [+147.038µs; +450.836µs] or [+1.902%; +5.833%] |
unstable [-195.515op/s; +72.327op/s] or [-14.744%; +5.454%] |
2.854ms | 8.028ms | 1264.500op/s | 2.717ms | 7.729ms | 1326.094op/s |
| scenario:load:petclinic:profiling:high_load | better [-2.544ms; -1.921ms] or [-12.337%; -9.313%] |
better [-3.396ms; -2.146ms] or [-10.498%; -6.633%] |
unstable [-0.348op/s; +51.535op/s] or [-0.155%; +22.920%] |
18.391ms | 29.579ms | 250.438op/s | 20.624ms | 32.350ms | 224.844op/s |
| scenario:load:petclinic:iast:high_load | worse [+0.729ms; +1.775ms] or [+4.183%; +10.188%] |
worse [+0.666ms; +2.541ms] or [+2.326%; +8.877%] |
unstable [-43.113op/s; +13.238op/s] or [-16.438%; +5.047%] |
18.670ms | 30.225ms | 247.344op/s | 17.419ms | 28.622ms | 262.281op/s |
| scenario:load:petclinic:appsec:high_load | better [-1.495ms; -0.572ms] or [-7.741%; -2.960%] |
unsure [-2.061ms; -0.397ms] or [-6.640%; -1.279%] |
unstable [-13.114op/s; +40.801op/s] or [-5.501%; +17.116%] |
18.282ms | 29.803ms | 252.219op/s | 19.316ms | 31.031ms | 238.375op/s |
| scenario:load:petclinic:no_agent:high_load | better [-3.024ms; -1.555ms] or [-15.993%; -8.225%] |
better [-4.635ms; -1.922ms] or [-14.836%; -6.153%] |
unstable [-1.231op/s; +57.606op/s] or [-0.505%; +23.618%] |
16.620ms | 27.962ms | 272.094op/s | 18.910ms | 31.241ms | 243.906op/s |
Request duration reports for insecure-bank
gantt
title insecure-bank - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~181e8892a9, baseline=1.56.0~c05874d84e
dateFormat X
axisFormat %s
section baseline
no_agent (1.205 ms) : 1194, 1216
. : milestone, 1205,
iast (3.381 ms) : 3335, 3426
. : milestone, 3381,
iast_FULL (5.89 ms) : 5830, 5949
. : milestone, 5890,
iast_GLOBAL (3.456 ms) : 3410, 3503
. : milestone, 3456,
profiling (2.101 ms) : 2083, 2119
. : milestone, 2101,
tracing (1.843 ms) : 1827, 1860
. : milestone, 1843,
section candidate
no_agent (1.215 ms) : 1203, 1227
. : milestone, 1215,
iast (3.361 ms) : 3315, 3406
. : milestone, 3361,
iast_FULL (5.865 ms) : 5805, 5924
. : milestone, 5865,
iast_GLOBAL (3.627 ms) : 3568, 3687
. : milestone, 3627,
profiling (2.133 ms) : 2113, 2152
. : milestone, 2133,
tracing (1.83 ms) : 1814, 1846
. : milestone, 1830,
- baseline results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.205 ms [1.194 ms, 1.216 ms] | - |
| iast | 3.381 ms [3.335 ms, 3.426 ms] | 2.176 ms (180.5%) |
| iast_FULL | 5.89 ms [5.83 ms, 5.949 ms] | 4.684 ms (388.7%) |
| iast_GLOBAL | 3.456 ms [3.41 ms, 3.503 ms] | 2.251 ms (186.8%) |
| profiling | 2.101 ms [2.083 ms, 2.119 ms] | 895.776 µs (74.3%) |
| tracing | 1.843 ms [1.827 ms, 1.86 ms] | 638.01 µs (52.9%) |
- candidate results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.215 ms [1.203 ms, 1.227 ms] | - |
| iast | 3.361 ms [3.315 ms, 3.406 ms] | 2.145 ms (176.6%) |
| iast_FULL | 5.865 ms [5.805 ms, 5.924 ms] | 4.649 ms (382.7%) |
| iast_GLOBAL | 3.627 ms [3.568 ms, 3.687 ms] | 2.412 ms (198.5%) |
| profiling | 2.133 ms [2.113 ms, 2.152 ms] | 917.737 µs (75.5%) |
| tracing | 1.83 ms [1.814 ms, 1.846 ms] | 614.746 µs (50.6%) |
Request duration reports for petclinic
gantt
title petclinic - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~181e8892a9, baseline=1.56.0~c05874d84e
dateFormat X
axisFormat %s
section baseline
no_agent (19.139 ms) : 18947, 19330
. : milestone, 19139,
appsec (19.581 ms) : 19381, 19781
. : milestone, 19581,
code_origins (17.895 ms) : 17721, 18070
. : milestone, 17895,
iast (17.788 ms) : 17611, 17964
. : milestone, 17788,
profiling (20.763 ms) : 20553, 20972
. : milestone, 20763,
tracing (17.726 ms) : 17547, 17905
. : milestone, 17726,
section candidate
no_agent (17.146 ms) : 16976, 17316
. : milestone, 17146,
appsec (18.503 ms) : 18313, 18692
. : milestone, 18503,
code_origins (18.102 ms) : 17922, 18281
. : milestone, 18102,
iast (18.869 ms) : 18676, 19063
. : milestone, 18869,
profiling (18.632 ms) : 18450, 18815
. : milestone, 18632,
tracing (17.697 ms) : 17522, 17873
. : milestone, 17697,
- baseline results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 19.139 ms [18.947 ms, 19.33 ms] | - |
| appsec | 19.581 ms [19.381 ms, 19.781 ms] | 442.572 µs (2.3%) |
| code_origins | 17.895 ms [17.721 ms, 18.07 ms] | -1.243 ms (-6.5%) |
| iast | 17.788 ms [17.611 ms, 17.964 ms] | -1.351 ms (-7.1%) |
| profiling | 20.763 ms [20.553 ms, 20.972 ms] | 1.624 ms (8.5%) |
| tracing | 17.726 ms [17.547 ms, 17.905 ms] | -1.413 ms (-7.4%) |
- candidate results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 17.146 ms [16.976 ms, 17.316 ms] | - |
| appsec | 18.503 ms [18.313 ms, 18.692 ms] | 1.357 ms (7.9%) |
| code_origins | 18.102 ms [17.922 ms, 18.281 ms] | 955.802 µs (5.6%) |
| iast | 18.869 ms [18.676 ms, 19.063 ms] | 1.723 ms (10.1%) |
| profiling | 18.632 ms [18.45 ms, 18.815 ms] | 1.487 ms (8.7%) |
| tracing | 17.697 ms [17.522 ms, 17.873 ms] | 551.537 µs (3.2%) |
Dacapo
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | sarah.chen/backport-pr-9774 |
| git_commit_date | 1763637994 | 1765395097 |
| git_commit_sha | c05874d | 181e889 |
| release_version | 1.56.0~c05874d84e | 1.57.0-SNAPSHOT~181e8892a9 |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | biojava | biojava |
| ci_job_date | 1765397294 | 1765397294 |
| ci_job_id | 1285221719 | 1285221719 |
| ci_pipeline_id | 86043316 | 86043316 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-0-7qgotx54 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-0-7qgotx54 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
Summary
Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.
Execution time for tomcat
gantt
title tomcat - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~181e8892a9, baseline=1.56.0~c05874d84e
dateFormat X
axisFormat %s
section baseline
no_agent (1.477 ms) : 1465, 1488
. : milestone, 1477,
appsec (3.709 ms) : 3490, 3928
. : milestone, 3709,
iast (2.213 ms) : 2148, 2278
. : milestone, 2213,
iast_GLOBAL (2.26 ms) : 2194, 2325
. : milestone, 2260,
profiling (2.073 ms) : 2020, 2127
. : milestone, 2073,
tracing (2.048 ms) : 1997, 2100
. : milestone, 2048,
section candidate
no_agent (1.475 ms) : 1464, 1487
. : milestone, 1475,
appsec (3.698 ms) : 3480, 3916
. : milestone, 3698,
iast (2.212 ms) : 2148, 2277
. : milestone, 2212,
iast_GLOBAL (2.251 ms) : 2186, 2316
. : milestone, 2251,
profiling (2.092 ms) : 2038, 2146
. : milestone, 2092,
tracing (2.04 ms) : 1989, 2091
. : milestone, 2040,
- baseline results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.477 ms [1.465 ms, 1.488 ms] | - |
| appsec | 3.709 ms [3.49 ms, 3.928 ms] | 2.232 ms (151.2%) |
| iast | 2.213 ms [2.148 ms, 2.278 ms] | 736.145 µs (49.9%) |
| iast_GLOBAL | 2.26 ms [2.194 ms, 2.325 ms] | 783.12 µs (53.0%) |
| profiling | 2.073 ms [2.02 ms, 2.127 ms] | 596.704 µs (40.4%) |
| tracing | 2.048 ms [1.997 ms, 2.1 ms] | 571.703 µs (38.7%) |
- candidate results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.475 ms [1.464 ms, 1.487 ms] | - |
| appsec | 3.698 ms [3.48 ms, 3.916 ms] | 2.222 ms (150.6%) |
| iast | 2.212 ms [2.148 ms, 2.277 ms] | 736.855 µs (49.9%) |
| iast_GLOBAL | 2.251 ms [2.186 ms, 2.316 ms] | 775.184 µs (52.5%) |
| profiling | 2.092 ms [2.038 ms, 2.146 ms] | 616.642 µs (41.8%) |
| tracing | 2.04 ms [1.989 ms, 2.091 ms] | 564.601 µs (38.3%) |
Execution time for biojava
gantt
title biojava - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~181e8892a9, baseline=1.56.0~c05874d84e
dateFormat X
axisFormat %s
section baseline
no_agent (14.921 s) : 14921000, 14921000
. : milestone, 14921000,
appsec (15.145 s) : 15145000, 15145000
. : milestone, 15145000,
iast (17.922 s) : 17922000, 17922000
. : milestone, 17922000,
iast_GLOBAL (17.97 s) : 17970000, 17970000
. : milestone, 17970000,
profiling (14.61 s) : 14610000, 14610000
. : milestone, 14610000,
tracing (14.739 s) : 14739000, 14739000
. : milestone, 14739000,
section candidate
no_agent (15.089 s) : 15089000, 15089000
. : milestone, 15089000,
appsec (15.138 s) : 15138000, 15138000
. : milestone, 15138000,
iast (18.573 s) : 18573000, 18573000
. : milestone, 18573000,
iast_GLOBAL (18.122 s) : 18122000, 18122000
. : milestone, 18122000,
profiling (14.701 s) : 14701000, 14701000
. : milestone, 14701000,
tracing (14.93 s) : 14930000, 14930000
. : milestone, 14930000,
- baseline results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 14.921 s [14.921 s, 14.921 s] | - |
| appsec | 15.145 s [15.145 s, 15.145 s] | 224.0 ms (1.5%) |
| iast | 17.922 s [17.922 s, 17.922 s] | 3.001 s (20.1%) |
| iast_GLOBAL | 17.97 s [17.97 s, 17.97 s] | 3.049 s (20.4%) |
| profiling | 14.61 s [14.61 s, 14.61 s] | -311.0 ms (-2.1%) |
| tracing | 14.739 s [14.739 s, 14.739 s] | -182.0 ms (-1.2%) |
- candidate results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 15.089 s [15.089 s, 15.089 s] | - |
| appsec | 15.138 s [15.138 s, 15.138 s] | 49.0 ms (0.3%) |
| iast | 18.573 s [18.573 s, 18.573 s] | 3.484 s (23.1%) |
| iast_GLOBAL | 18.122 s [18.122 s, 18.122 s] | 3.033 s (20.1%) |
| profiling | 14.701 s [14.701 s, 14.701 s] | -388.0 ms (-2.6%) |
| tracing | 14.93 s [14.93 s, 14.93 s] | -159.0 ms (-1.1%) |