Disable CodeOrigin by default by jpbempel · Pull Request #10027 · DataDog/dd-trace-java
Benchmarks
Startup
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | jpbempel/disable-code-origin |
| git_commit_date | 1763992896 | 1764063965 |
| git_commit_sha | c8bb444 | 353b02e |
| release_version | 1.57.0-SNAPSHOT~c8bb44440b | 1.57.0-SNAPSHOT~353b02e363 |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | insecure-bank | insecure-bank |
| ci_job_date | 1764074170 | 1764074170 |
| ci_job_id | 1255649177 | 1255649177 |
| ci_pipeline_id | 83915533 | 83915533 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-0-73kwnc8n 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-0-73kwnc8n 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
| module | Agent | Agent |
| parent | None | None |
Summary
Found 12 performance improvements and 8 performance regressions! Performance is the same for 33 metrics, 12 unstable metrics.
| scenario | Δ mean execution_time | candidate mean execution_time | baseline mean execution_time |
|---|---|---|---|
| scenario:startup:insecure-bank:iast:Agent | better [-262.628ms; -195.129ms] or [-2.759%; -2.050%] |
9.291s | 9.520s |
| scenario:startup:insecure-bank:iast:Agent.start | better [-51.958ms; -41.625ms] or [-4.197%; -3.362%] |
1.191s | 1.238s |
| scenario:startup:insecure-bank:iast:Debugger | better [-54.356ms; -53.138ms] or [-91.004%; -88.964%] |
5.982ms | 59.729ms |
| scenario:startup:insecure-bank:iast:Remote Config | worse [+51.646µs; +80.967µs] or [+9.575%; +15.011%] |
605.685µs | 539.378µs |
| scenario:startup:insecure-bank:iast:Telemetry | worse [+167.043µs; +405.658µs] or [+2.203%; +5.350%] |
7.868ms | 7.582ms |
| scenario:startup:insecure-bank:iast:Flare Poller | worse [+7.282ms; +7.583ms] or [+213.340%; +222.149%] |
10.846ms | 3.414ms |
| scenario:startup:insecure-bank:tracing:Agent.start | better [-56.366ms; -47.378ms] or [-5.115%; -4.300%] |
1.050s | 1.102s |
| scenario:startup:insecure-bank:tracing:Debugger | better [-57.578ms; -56.938ms] or [-90.481%; -89.475%] |
6.377ms | 63.635ms |
| scenario:startup:petclinic:appsec:Agent.start | better [-61.614ms; -27.087ms] or [-4.799%; -2.110%] |
1.239s | 1.284s |
| scenario:startup:petclinic:appsec:Debugger | better [-56.817ms; -54.513ms] or [-91.764%; -88.043%] |
6.251ms | 61.916ms |
| scenario:startup:petclinic:iast:Agent.start | better [-87.538ms; -42.957ms] or [-6.954%; -3.413%] |
1.194s | 1.259s |
| scenario:startup:petclinic:iast:Debugger | better [-56.329ms; -54.171ms] or [-91.905%; -88.383%] |
6.041ms | 61.291ms |
| scenario:startup:petclinic:iast:Remote Config | worse [+24.697µs; +72.301µs] or [+4.431%; +12.971%] |
605.907µs | 557.408µs |
| scenario:startup:petclinic:profiling:ProfilingAgent | worse [+12.656ms; +15.495ms] or [+13.055%; +15.983%] |
111.019ms | 96.943ms |
| scenario:startup:petclinic:profiling:Debugger | better [-57.193ms; -53.759ms] or [-90.425%; -84.996%] |
7.773ms | 63.248ms |
| scenario:startup:petclinic:profiling:Flare Poller | worse [+369.814µs; +543.483µs] or [+9.922%; +14.582%] |
4.184ms | 3.727ms |
| scenario:startup:petclinic:profiling:Profiling | worse [+12.701ms; +15.554ms] or [+13.022%; +15.947%] |
111.660ms | 97.532ms |
| scenario:startup:petclinic:tracing:Agent.start | better [-50.022ms; -43.539ms] or [-4.543%; -3.954%] |
1.054s | 1.101s |
| scenario:startup:petclinic:tracing:Debugger | better [-58.638ms; -57.254ms] or [-91.133%; -88.983%] |
6.397ms | 64.343ms |
| scenario:startup:petclinic:tracing:Remote Config | worse [+34.173µs; +65.085µs] or [+5.414%; +10.311%] |
680.847µs | 631.218µs |
Startup time reports for petclinic
gantt
title petclinic - global startup overhead: candidate=1.57.0-SNAPSHOT~353b02e363, baseline=1.57.0-SNAPSHOT~c8bb44440b
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.101 s) : 0, 1101093
Total [baseline] (10.802 s) : 0, 10801780
Agent [candidate] (1.054 s) : 0, 1054313
Total [candidate] (10.908 s) : 0, 10907998
section appsec
Agent [baseline] (1.284 s) : 0, 1283814
Total [baseline] (11.041 s) : 0, 11041041
Agent [candidate] (1.239 s) : 0, 1239464
Total [candidate] (11.0 s) : 0, 11000180
section iast
Agent [baseline] (1.259 s) : 0, 1258781
Total [baseline] (11.341 s) : 0, 11341228
Agent [candidate] (1.194 s) : 0, 1193533
Total [candidate] (11.232 s) : 0, 11231877
section profiling
Agent [baseline] (1.24 s) : 0, 1240045
Total [baseline] (11.173 s) : 0, 11173012
Agent [candidate] (1.204 s) : 0, 1204478
Total [candidate] (10.963 s) : 0, 10962809
- baseline results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.101 s | - |
| Agent | appsec | 1.284 s | 182.721 ms (16.6%) |
| Agent | iast | 1.259 s | 157.687 ms (14.3%) |
| Agent | profiling | 1.24 s | 138.951 ms (12.6%) |
| Total | tracing | 10.802 s | - |
| Total | appsec | 11.041 s | 239.261 ms (2.2%) |
| Total | iast | 11.341 s | 539.448 ms (5.0%) |
| Total | profiling | 11.173 s | 371.232 ms (3.4%) |
- candidate results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.054 s | - |
| Agent | appsec | 1.239 s | 185.151 ms (17.6%) |
| Agent | iast | 1.194 s | 139.22 ms (13.2%) |
| Agent | profiling | 1.204 s | 150.165 ms (14.2%) |
| Total | tracing | 10.908 s | - |
| Total | appsec | 11.0 s | 92.182 ms (0.8%) |
| Total | iast | 11.232 s | 323.879 ms (3.0%) |
| Total | profiling | 10.963 s | 54.811 ms (0.5%) |
gantt
title petclinic - break down per module: candidate=1.57.0-SNAPSHOT~353b02e363, baseline=1.57.0-SNAPSHOT~c8bb44440b
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.478 ms) : 0, 1478
crashtracking [candidate] (1.488 ms) : 0, 1488
BytebuddyAgent [baseline] (707.074 ms) : 0, 707074
BytebuddyAgent [candidate] (709.1 ms) : 0, 709100
GlobalTracer [baseline] (248.947 ms) : 0, 248947
GlobalTracer [candidate] (249.442 ms) : 0, 249442
AppSec [baseline] (32.061 ms) : 0, 32061
AppSec [candidate] (32.151 ms) : 0, 32151
Debugger [baseline] (64.343 ms) : 0, 64343
Debugger [candidate] (6.397 ms) : 0, 6397
Remote Config [baseline] (631.218 µs) : 0, 631
Remote Config [candidate] (680.847 µs) : 0, 681
Telemetry [baseline] (8.185 ms) : 0, 8185
Telemetry [candidate] (14.731 ms) : 0, 14731
Flare Poller [baseline] (3.69 ms) : 0, 3690
Flare Poller [candidate] (5.544 ms) : 0, 5544
section appsec
crashtracking [baseline] (1.488 ms) : 0, 1488
crashtracking [candidate] (1.506 ms) : 0, 1506
BytebuddyAgent [baseline] (732.415 ms) : 0, 732415
BytebuddyAgent [candidate] (739.982 ms) : 0, 739982
GlobalTracer [baseline] (241.006 ms) : 0, 241006
GlobalTracer [candidate] (243.445 ms) : 0, 243445
IAST [baseline] (24.762 ms) : 0, 24762
IAST [candidate] (25.455 ms) : 0, 25455
AppSec [baseline] (174.091 ms) : 0, 174091
AppSec [candidate] (174.807 ms) : 0, 174807
Debugger [baseline] (61.916 ms) : 0, 61916
Debugger [candidate] (6.251 ms) : 0, 6251
Remote Config [baseline] (690.611 µs) : 0, 691
Remote Config [candidate] (685.795 µs) : 0, 686
Telemetry [baseline] (8.425 ms) : 0, 8425
Telemetry [candidate] (8.117 ms) : 0, 8117
Flare Poller [baseline] (3.996 ms) : 0, 3996
Flare Poller [candidate] (3.981 ms) : 0, 3981
section iast
crashtracking [baseline] (1.509 ms) : 0, 1509
crashtracking [candidate] (1.487 ms) : 0, 1487
BytebuddyAgent [baseline] (847.062 ms) : 0, 847062
BytebuddyAgent [candidate] (832.378 ms) : 0, 832378
GlobalTracer [baseline] (239.598 ms) : 0, 239598
GlobalTracer [candidate] (238.052 ms) : 0, 238052
IAST [baseline] (27.906 ms) : 0, 27906
IAST [candidate] (31.686 ms) : 0, 31686
AppSec [baseline] (34.362 ms) : 0, 34362
AppSec [candidate] (29.762 ms) : 0, 29762
Debugger [baseline] (61.291 ms) : 0, 61291
Debugger [candidate] (6.041 ms) : 0, 6041
Remote Config [baseline] (557.408 µs) : 0, 557
Remote Config [candidate] (605.907 µs) : 0, 606
Telemetry [baseline] (7.667 ms) : 0, 7667
Telemetry [candidate] (7.938 ms) : 0, 7938
Flare Poller [baseline] (3.551 ms) : 0, 3551
Flare Poller [candidate] (10.789 ms) : 0, 10789
section profiling
crashtracking [baseline] (1.468 ms) : 0, 1468
crashtracking [candidate] (1.439 ms) : 0, 1439
BytebuddyAgent [baseline] (739.937 ms) : 0, 739937
BytebuddyAgent [candidate] (737.995 ms) : 0, 737995
GlobalTracer [baseline] (223.944 ms) : 0, 223944
GlobalTracer [candidate] (223.825 ms) : 0, 223825
AppSec [baseline] (32.633 ms) : 0, 32633
AppSec [candidate] (32.529 ms) : 0, 32529
Debugger [baseline] (63.248 ms) : 0, 63248
Debugger [candidate] (7.773 ms) : 0, 7773
Remote Config [baseline] (671.942 µs) : 0, 672
Remote Config [candidate] (746.428 µs) : 0, 746
Telemetry [baseline] (8.013 ms) : 0, 8013
Telemetry [candidate] (15.496 ms) : 0, 15496
Flare Poller [baseline] (3.727 ms) : 0, 3727
Flare Poller [candidate] (4.184 ms) : 0, 4184
ProfilingAgent [baseline] (96.943 ms) : 0, 96943
ProfilingAgent [candidate] (111.019 ms) : 0, 111019
Profiling [baseline] (97.532 ms) : 0, 97532
Profiling [candidate] (111.66 ms) : 0, 111660
Startup time reports for insecure-bank
gantt
title insecure-bank - global startup overhead: candidate=1.57.0-SNAPSHOT~353b02e363, baseline=1.57.0-SNAPSHOT~c8bb44440b
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.102 s) : 0, 1101893
Total [baseline] (8.878 s) : 0, 8878267
Agent [candidate] (1.05 s) : 0, 1050021
Total [candidate] (8.644 s) : 0, 8643956
section iast
Agent [baseline] (1.238 s) : 0, 1237954
Total [baseline] (9.52 s) : 0, 9519752
Agent [candidate] (1.191 s) : 0, 1191163
Total [candidate] (9.291 s) : 0, 9290874
- baseline results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.102 s | - |
| Agent | iast | 1.238 s | 136.061 ms (12.3%) |
| Total | tracing | 8.878 s | - |
| Total | iast | 9.52 s | 641.485 ms (7.2%) |
- candidate results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.05 s | - |
| Agent | iast | 1.191 s | 141.142 ms (13.4%) |
| Total | tracing | 8.644 s | - |
| Total | iast | 9.291 s | 646.918 ms (7.5%) |
gantt
title insecure-bank - break down per module: candidate=1.57.0-SNAPSHOT~353b02e363, baseline=1.57.0-SNAPSHOT~c8bb44440b
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.482 ms) : 0, 1482
crashtracking [candidate] (1.483 ms) : 0, 1483
BytebuddyAgent [baseline] (708.499 ms) : 0, 708499
BytebuddyAgent [candidate] (706.266 ms) : 0, 706266
GlobalTracer [baseline] (248.831 ms) : 0, 248831
GlobalTracer [candidate] (248.123 ms) : 0, 248123
AppSec [baseline] (32.036 ms) : 0, 32036
AppSec [candidate] (31.876 ms) : 0, 31876
Debugger [baseline] (63.635 ms) : 0, 63635
Debugger [candidate] (6.377 ms) : 0, 6377
Remote Config [baseline] (646.108 µs) : 0, 646
Remote Config [candidate] (677.409 µs) : 0, 677
Telemetry [baseline] (8.228 ms) : 0, 8228
Telemetry [candidate] (14.855 ms) : 0, 14855
Flare Poller [baseline] (3.693 ms) : 0, 3693
Flare Poller [candidate] (5.606 ms) : 0, 5606
section iast
crashtracking [baseline] (1.47 ms) : 0, 1470
crashtracking [candidate] (1.482 ms) : 0, 1482
BytebuddyAgent [baseline] (831.36 ms) : 0, 831360
BytebuddyAgent [candidate] (831.107 ms) : 0, 831107
GlobalTracer [baseline] (237.417 ms) : 0, 237417
GlobalTracer [candidate] (237.499 ms) : 0, 237499
AppSec [baseline] (33.103 ms) : 0, 33103
AppSec [candidate] (26.878 ms) : 0, 26878
Debugger [baseline] (59.729 ms) : 0, 59729
Debugger [candidate] (5.982 ms) : 0, 5982
Remote Config [baseline] (539.378 µs) : 0, 539
Remote Config [candidate] (605.685 µs) : 0, 606
Telemetry [baseline] (7.582 ms) : 0, 7582
Telemetry [candidate] (7.868 ms) : 0, 7868
Flare Poller [baseline] (3.414 ms) : 0, 3414
Flare Poller [candidate] (10.846 ms) : 0, 10846
IAST [baseline] (28.53 ms) : 0, 28530
IAST [candidate] (34.171 ms) : 0, 34171
Load
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | jpbempel/disable-code-origin |
| git_commit_date | 1763992896 | 1764063965 |
| git_commit_sha | c8bb444 | 353b02e |
| release_version | 1.57.0-SNAPSHOT~c8bb44440b | 1.57.0-SNAPSHOT~353b02e363 |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | insecure-bank | insecure-bank |
| ci_job_date | 1764066291 | 1764066291 |
| ci_job_id | 1255346203 | 1255346203 |
| ci_pipeline_id | 83915533 | 83915533 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-1-d4b56g9t 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-1-d4b56g9t 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
Summary
Found 3 performance improvements and 2 performance regressions! Performance is the same for 14 metrics, 17 unstable metrics.
| scenario | Δ mean agg_http_req_duration_p50 | Δ mean agg_http_req_duration_p95 | Δ mean throughput | candidate mean agg_http_req_duration_p50 | candidate mean agg_http_req_duration_p95 | candidate mean throughput | baseline mean agg_http_req_duration_p50 | baseline mean agg_http_req_duration_p95 | baseline mean throughput |
|---|---|---|---|---|---|---|---|---|---|
| scenario:load:insecure-bank:iast_GLOBAL:high_load | better [-197.162µs; -88.663µs] or [-6.798%; -3.057%] |
unsure [-543.537µs; -116.866µs] or [-6.662%; -1.432%] |
unstable [-90.019op/s; +192.957op/s] or [-7.166%; +15.361%] |
2.757ms | 7.829ms | 1307.625op/s | 2.900ms | 8.159ms | 1256.156op/s |
| scenario:load:insecure-bank:iast:high_load | better [-127.126µs; -59.145µs] or [-5.087%; -2.367%] |
unsure [-394.953µs; -122.226µs] or [-5.403%; -1.672%] |
unstable [-118.261op/s; +196.261op/s] or [-8.287%; +13.753%] |
2.406ms | 7.052ms | 1466.062op/s | 2.499ms | 7.310ms | 1427.062op/s |
| scenario:load:petclinic:code_origins:high_load | worse [+1.150ms; +1.909ms] or [+6.718%; +11.151%] |
worse [+0.774ms; +2.417ms] or [+2.714%; +8.471%] |
unstable [-49.459op/s; +9.021op/s] or [-18.578%; +3.389%] |
18.647ms | 30.124ms | 246.000op/s | 17.118ms | 28.529ms | 266.219op/s |
| scenario:load:petclinic:no_agent:high_load | better [-2.377ms; -0.642ms] or [-13.093%; -3.536%] |
unstable [-3.675ms; -0.182ms] or [-12.223%; -0.605%] |
unstable [-10.565op/s; +52.628op/s] or [-4.182%; +20.832%] |
16.645ms | 28.136ms | 273.656op/s | 18.155ms | 30.065ms | 252.625op/s |
Request duration reports for insecure-bank
gantt
title insecure-bank - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~353b02e363, baseline=1.57.0-SNAPSHOT~c8bb44440b
dateFormat X
axisFormat %s
section baseline
no_agent (1.21 ms) : 1198, 1222
. : milestone, 1210,
iast (3.204 ms) : 3160, 3249
. : milestone, 3204,
iast_FULL (5.773 ms) : 5715, 5831
. : milestone, 5773,
iast_GLOBAL (3.653 ms) : 3600, 3707
. : milestone, 3653,
profiling (2.016 ms) : 1998, 2035
. : milestone, 2016,
tracing (1.872 ms) : 1856, 1888
. : milestone, 1872,
section candidate
no_agent (1.201 ms) : 1189, 1213
. : milestone, 1201,
iast (3.12 ms) : 3077, 3163
. : milestone, 3120,
iast_FULL (5.694 ms) : 5638, 5751
. : milestone, 5694,
iast_GLOBAL (3.506 ms) : 3455, 3558
. : milestone, 3506,
profiling (2.001 ms) : 1983, 2019
. : milestone, 2001,
tracing (1.778 ms) : 1762, 1793
. : milestone, 1778,
- baseline results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.21 ms [1.198 ms, 1.222 ms] | - |
| iast | 3.204 ms [3.16 ms, 3.249 ms] | 1.995 ms (164.9%) |
| iast_FULL | 5.773 ms [5.715 ms, 5.831 ms] | 4.563 ms (377.2%) |
| iast_GLOBAL | 3.653 ms [3.6 ms, 3.707 ms] | 2.444 ms (202.0%) |
| profiling | 2.016 ms [1.998 ms, 2.035 ms] | 806.624 µs (66.7%) |
| tracing | 1.872 ms [1.856 ms, 1.888 ms] | 662.19 µs (54.7%) |
- candidate results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.201 ms [1.189 ms, 1.213 ms] | - |
| iast | 3.12 ms [3.077 ms, 3.163 ms] | 1.919 ms (159.7%) |
| iast_FULL | 5.694 ms [5.638 ms, 5.751 ms] | 4.493 ms (374.1%) |
| iast_GLOBAL | 3.506 ms [3.455 ms, 3.558 ms] | 2.305 ms (191.9%) |
| profiling | 2.001 ms [1.983 ms, 2.019 ms] | 799.962 µs (66.6%) |
| tracing | 1.778 ms [1.762 ms, 1.793 ms] | 576.745 µs (48.0%) |
Request duration reports for petclinic
gantt
title petclinic - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~353b02e363, baseline=1.57.0-SNAPSHOT~c8bb44440b
dateFormat X
axisFormat %s
section baseline
no_agent (18.474 ms) : 18285, 18663
. : milestone, 18474,
appsec (18.591 ms) : 18405, 18778
. : milestone, 18591,
code_origins (17.525 ms) : 17350, 17700
. : milestone, 17525,
iast (17.688 ms) : 17511, 17866
. : milestone, 17688,
profiling (18.756 ms) : 18568, 18944
. : milestone, 18756,
tracing (17.567 ms) : 17391, 17744
. : milestone, 17567,
section candidate
no_agent (17.043 ms) : 16872, 17213
. : milestone, 17043,
appsec (18.728 ms) : 18536, 18921
. : milestone, 18728,
code_origins (18.97 ms) : 18781, 19160
. : milestone, 18970,
iast (17.737 ms) : 17559, 17916
. : milestone, 17737,
profiling (18.509 ms) : 18325, 18692
. : milestone, 18509,
tracing (17.445 ms) : 17273, 17618
. : milestone, 17445,
- baseline results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 18.474 ms [18.285 ms, 18.663 ms] | - |
| appsec | 18.591 ms [18.405 ms, 18.778 ms] | 117.29 µs (0.6%) |
| code_origins | 17.525 ms [17.35 ms, 17.7 ms] | -949.167 µs (-5.1%) |
| iast | 17.688 ms [17.511 ms, 17.866 ms] | -785.55 µs (-4.3%) |
| profiling | 18.756 ms [18.568 ms, 18.944 ms] | 281.84 µs (1.5%) |
| tracing | 17.567 ms [17.391 ms, 17.744 ms] | -906.638 µs (-4.9%) |
- candidate results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 17.043 ms [16.872 ms, 17.213 ms] | - |
| appsec | 18.728 ms [18.536 ms, 18.921 ms] | 1.686 ms (9.9%) |
| code_origins | 18.97 ms [18.781 ms, 19.16 ms] | 1.928 ms (11.3%) |
| iast | 17.737 ms [17.559 ms, 17.916 ms] | 694.856 µs (4.1%) |
| profiling | 18.509 ms [18.325 ms, 18.692 ms] | 1.466 ms (8.6%) |
| tracing | 17.445 ms [17.273 ms, 17.618 ms] | 402.707 µs (2.4%) |
Dacapo
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | jpbempel/disable-code-origin |
| git_commit_date | 1763992896 | 1764063965 |
| git_commit_sha | c8bb444 | 353b02e |
| release_version | 1.57.0-SNAPSHOT~c8bb44440b | 1.57.0-SNAPSHOT~353b02e363 |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | biojava | biojava |
| ci_job_date | 1764065999 | 1764065999 |
| ci_job_id | 1255346205 | 1255346205 |
| ci_pipeline_id | 83915533 | 83915533 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-2-7jhcj4fn 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-2-7jhcj4fn 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
Summary
Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.
Execution time for tomcat
gantt
title tomcat - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~353b02e363, baseline=1.57.0-SNAPSHOT~c8bb44440b
dateFormat X
axisFormat %s
section baseline
no_agent (1.473 ms) : 1462, 1485
. : milestone, 1473,
appsec (2.461 ms) : 2409, 2514
. : milestone, 2461,
iast (2.217 ms) : 2151, 2282
. : milestone, 2217,
iast_GLOBAL (2.258 ms) : 2193, 2324
. : milestone, 2258,
profiling (2.076 ms) : 2023, 2129
. : milestone, 2076,
tracing (2.042 ms) : 1991, 2093
. : milestone, 2042,
section candidate
no_agent (1.482 ms) : 1470, 1493
. : milestone, 1482,
appsec (2.462 ms) : 2410, 2514
. : milestone, 2462,
iast (2.214 ms) : 2149, 2278
. : milestone, 2214,
iast_GLOBAL (2.262 ms) : 2196, 2328
. : milestone, 2262,
profiling (2.098 ms) : 2043, 2152
. : milestone, 2098,
tracing (2.058 ms) : 2007, 2109
. : milestone, 2058,
- baseline results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.473 ms [1.462 ms, 1.485 ms] | - |
| appsec | 2.461 ms [2.409 ms, 2.514 ms] | 987.938 µs (67.1%) |
| iast | 2.217 ms [2.151 ms, 2.282 ms] | 743.156 µs (50.4%) |
| iast_GLOBAL | 2.258 ms [2.193 ms, 2.324 ms] | 784.757 µs (53.3%) |
| profiling | 2.076 ms [2.023 ms, 2.129 ms] | 602.901 µs (40.9%) |
| tracing | 2.042 ms [1.991 ms, 2.093 ms] | 568.4 µs (38.6%) |
- candidate results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.482 ms [1.47 ms, 1.493 ms] | - |
| appsec | 2.462 ms [2.41 ms, 2.514 ms] | 980.611 µs (66.2%) |
| iast | 2.214 ms [2.149 ms, 2.278 ms] | 731.907 µs (49.4%) |
| iast_GLOBAL | 2.262 ms [2.196 ms, 2.328 ms] | 780.407 µs (52.7%) |
| profiling | 2.098 ms [2.043 ms, 2.152 ms] | 615.942 µs (41.6%) |
| tracing | 2.058 ms [2.007 ms, 2.109 ms] | 576.63 µs (38.9%) |
Execution time for biojava
gantt
title biojava - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~353b02e363, baseline=1.57.0-SNAPSHOT~c8bb44440b
dateFormat X
axisFormat %s
section baseline
no_agent (15.477 s) : 15477000, 15477000
. : milestone, 15477000,
appsec (14.802 s) : 14802000, 14802000
. : milestone, 14802000,
iast (18.832 s) : 18832000, 18832000
. : milestone, 18832000,
iast_GLOBAL (17.898 s) : 17898000, 17898000
. : milestone, 17898000,
profiling (14.867 s) : 14867000, 14867000
. : milestone, 14867000,
tracing (14.793 s) : 14793000, 14793000
. : milestone, 14793000,
section candidate
no_agent (14.868 s) : 14868000, 14868000
. : milestone, 14868000,
appsec (15.114 s) : 15114000, 15114000
. : milestone, 15114000,
iast (18.576 s) : 18576000, 18576000
. : milestone, 18576000,
iast_GLOBAL (17.912 s) : 17912000, 17912000
. : milestone, 17912000,
profiling (15.154 s) : 15154000, 15154000
. : milestone, 15154000,
tracing (14.916 s) : 14916000, 14916000
. : milestone, 14916000,
- baseline results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 15.477 s [15.477 s, 15.477 s] | - |
| appsec | 14.802 s [14.802 s, 14.802 s] | -675.0 ms (-4.4%) |
| iast | 18.832 s [18.832 s, 18.832 s] | 3.355 s (21.7%) |
| iast_GLOBAL | 17.898 s [17.898 s, 17.898 s] | 2.421 s (15.6%) |
| profiling | 14.867 s [14.867 s, 14.867 s] | -610.0 ms (-3.9%) |
| tracing | 14.793 s [14.793 s, 14.793 s] | -684.0 ms (-4.4%) |
- candidate results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 14.868 s [14.868 s, 14.868 s] | - |
| appsec | 15.114 s [15.114 s, 15.114 s] | 246.0 ms (1.7%) |
| iast | 18.576 s [18.576 s, 18.576 s] | 3.708 s (24.9%) |
| iast_GLOBAL | 17.912 s [17.912 s, 17.912 s] | 3.044 s (20.5%) |
| profiling | 15.154 s [15.154 s, 15.154 s] | 286.0 ms (1.9%) |
| tracing | 14.916 s [14.916 s, 14.916 s] | 48.0 ms (0.3%) |