Ledger.reset should reset containsRemoval status by dougqh · Pull Request #10338 · DataDog/dd-trace-java
Benchmarks
Startup
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | dougqh/tagmap-reset-and-remove-fix |
| git_commit_date | 1768240143 | 1768241595 |
| git_commit_sha | c072939 | d08c29d |
| release_version | 1.59.0-SNAPSHOT~c072939fa1 | 1.59.0-SNAPSHOT~d08c29d98a |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | insecure-bank | insecure-bank |
| ci_job_date | 1768243498 | 1768243498 |
| ci_job_id | 1344081453 | 1344081453 |
| ci_pipeline_id | 90265191 | 90265191 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-0-6j38112u 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-0-6j38112u 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
| module | Agent | Agent |
| parent | None | None |
Summary
Found 0 performance improvements and 0 performance regressions! Performance is the same for 56 metrics, 9 unstable metrics.
Startup time reports for insecure-bank
gantt
title insecure-bank - global startup overhead: candidate=1.59.0-SNAPSHOT~d08c29d98a, baseline=1.59.0-SNAPSHOT~c072939fa1
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.084 s) : 0, 1083559
Total [baseline] (8.793 s) : 0, 8792736
Agent [candidate] (1.09 s) : 0, 1089658
Total [candidate] (8.767 s) : 0, 8767417
section iast
Agent [baseline] (1.231 s) : 0, 1230979
Total [baseline] (9.343 s) : 0, 9342986
Agent [candidate] (1.224 s) : 0, 1223657
Total [candidate] (9.338 s) : 0, 9338115
- baseline results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.084 s | - |
| Agent | iast | 1.231 s | 147.42 ms (13.6%) |
| Total | tracing | 8.793 s | - |
| Total | iast | 9.343 s | 550.25 ms (6.3%) |
- candidate results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.09 s | - |
| Agent | iast | 1.224 s | 133.999 ms (12.3%) |
| Total | tracing | 8.767 s | - |
| Total | iast | 9.338 s | 570.698 ms (6.5%) |
gantt
title insecure-bank - break down per module: candidate=1.59.0-SNAPSHOT~d08c29d98a, baseline=1.59.0-SNAPSHOT~c072939fa1
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.198 ms) : 0, 1198
crashtracking [candidate] (1.197 ms) : 0, 1197
BytebuddyAgent [baseline] (651.184 ms) : 0, 651184
BytebuddyAgent [candidate] (654.604 ms) : 0, 654604
GlobalTracer [baseline] (282.363 ms) : 0, 282363
GlobalTracer [candidate] (284.079 ms) : 0, 284079
AppSec [baseline] (32.712 ms) : 0, 32712
AppSec [candidate] (32.71 ms) : 0, 32710
Debugger [baseline] (67.025 ms) : 0, 67025
Debugger [candidate] (67.772 ms) : 0, 67772
Remote Config [baseline] (638.2 µs) : 0, 638
Remote Config [candidate] (652.892 µs) : 0, 653
Telemetry [baseline] (8.985 ms) : 0, 8985
Telemetry [candidate] (9.015 ms) : 0, 9015
Flare Poller [baseline] (3.771 ms) : 0, 3771
Flare Poller [candidate] (3.725 ms) : 0, 3725
section iast
crashtracking [baseline] (1.193 ms) : 0, 1193
crashtracking [candidate] (1.187 ms) : 0, 1187
BytebuddyAgent [baseline] (797.555 ms) : 0, 797555
BytebuddyAgent [candidate] (790.726 ms) : 0, 790726
GlobalTracer [baseline] (257.92 ms) : 0, 257920
GlobalTracer [candidate] (256.412 ms) : 0, 256412
AppSec [baseline] (33.67 ms) : 0, 33670
AppSec [candidate] (32.772 ms) : 0, 32772
Debugger [baseline] (65.422 ms) : 0, 65422
Debugger [candidate] (67.09 ms) : 0, 67090
Remote Config [baseline] (566.327 µs) : 0, 566
Remote Config [candidate] (571.733 µs) : 0, 572
Telemetry [baseline] (8.45 ms) : 0, 8450
Telemetry [candidate] (8.62 ms) : 0, 8620
Flare Poller [baseline] (3.587 ms) : 0, 3587
Flare Poller [candidate] (3.578 ms) : 0, 3578
IAST [baseline] (26.913 ms) : 0, 26913
IAST [candidate] (26.985 ms) : 0, 26985
Startup time reports for petclinic
gantt
title petclinic - global startup overhead: candidate=1.59.0-SNAPSHOT~d08c29d98a, baseline=1.59.0-SNAPSHOT~c072939fa1
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.085 s) : 0, 1085312
Total [baseline] (10.766 s) : 0, 10766004
Agent [candidate] (1.085 s) : 0, 1084879
Total [candidate] (10.698 s) : 0, 10697851
section appsec
Agent [baseline] (1.267 s) : 0, 1267219
Total [baseline] (11.083 s) : 0, 11082835
Agent [candidate] (1.269 s) : 0, 1268630
Total [candidate] (11.025 s) : 0, 11025351
section iast
Agent [baseline] (1.226 s) : 0, 1225596
Total [baseline] (11.182 s) : 0, 11181532
Agent [candidate] (1.235 s) : 0, 1235092
Total [candidate] (11.167 s) : 0, 11166978
section profiling
Agent [baseline] (1.22 s) : 0, 1220281
Total [baseline] (10.876 s) : 0, 10876064
Agent [candidate] (1.207 s) : 0, 1206532
Total [candidate] (11.06 s) : 0, 11060494
- baseline results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.085 s | - |
| Agent | appsec | 1.267 s | 181.907 ms (16.8%) |
| Agent | iast | 1.226 s | 140.284 ms (12.9%) |
| Agent | profiling | 1.22 s | 134.97 ms (12.4%) |
| Total | tracing | 10.766 s | - |
| Total | appsec | 11.083 s | 316.831 ms (2.9%) |
| Total | iast | 11.182 s | 415.528 ms (3.9%) |
| Total | profiling | 10.876 s | 110.059 ms (1.0%) |
- candidate results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.085 s | - |
| Agent | appsec | 1.269 s | 183.752 ms (16.9%) |
| Agent | iast | 1.235 s | 150.213 ms (13.8%) |
| Agent | profiling | 1.207 s | 121.653 ms (11.2%) |
| Total | tracing | 10.698 s | - |
| Total | appsec | 11.025 s | 327.5 ms (3.1%) |
| Total | iast | 11.167 s | 469.127 ms (4.4%) |
| Total | profiling | 11.06 s | 362.642 ms (3.4%) |
gantt
title petclinic - break down per module: candidate=1.59.0-SNAPSHOT~d08c29d98a, baseline=1.59.0-SNAPSHOT~c072939fa1
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.198 ms) : 0, 1198
crashtracking [candidate] (1.177 ms) : 0, 1177
BytebuddyAgent [baseline] (651.652 ms) : 0, 651652
BytebuddyAgent [candidate] (651.368 ms) : 0, 651368
GlobalTracer [baseline] (283.336 ms) : 0, 283336
GlobalTracer [candidate] (283.077 ms) : 0, 283077
AppSec [baseline] (32.698 ms) : 0, 32698
AppSec [candidate] (32.585 ms) : 0, 32585
Debugger [baseline] (67.29 ms) : 0, 67290
Debugger [candidate] (67.67 ms) : 0, 67670
Remote Config [baseline] (681.238 µs) : 0, 681
Remote Config [candidate] (657.829 µs) : 0, 658
Telemetry [baseline] (9.002 ms) : 0, 9002
Telemetry [candidate] (8.963 ms) : 0, 8963
Flare Poller [baseline] (3.793 ms) : 0, 3793
Flare Poller [candidate] (3.744 ms) : 0, 3744
section appsec
crashtracking [baseline] (1.191 ms) : 0, 1191
crashtracking [candidate] (1.183 ms) : 0, 1183
BytebuddyAgent [baseline] (690.543 ms) : 0, 690543
BytebuddyAgent [candidate] (690.984 ms) : 0, 690984
GlobalTracer [baseline] (259.065 ms) : 0, 259065
GlobalTracer [candidate] (259.58 ms) : 0, 259580
IAST [baseline] (24.43 ms) : 0, 24430
IAST [candidate] (24.553 ms) : 0, 24553
AppSec [baseline] (173.605 ms) : 0, 173605
AppSec [candidate] (174.542 ms) : 0, 174542
Debugger [baseline] (68.874 ms) : 0, 68874
Debugger [candidate] (68.261 ms) : 0, 68261
Remote Config [baseline] (787.192 µs) : 0, 787
Remote Config [candidate] (782.929 µs) : 0, 783
Telemetry [baseline] (9.494 ms) : 0, 9494
Telemetry [candidate] (9.481 ms) : 0, 9481
Flare Poller [baseline] (3.735 ms) : 0, 3735
Flare Poller [candidate] (3.797 ms) : 0, 3797
section iast
crashtracking [baseline] (1.19 ms) : 0, 1190
crashtracking [candidate] (1.195 ms) : 0, 1195
BytebuddyAgent [baseline] (791.779 ms) : 0, 791779
BytebuddyAgent [candidate] (799.388 ms) : 0, 799388
GlobalTracer [baseline] (256.628 ms) : 0, 256628
GlobalTracer [candidate] (258.615 ms) : 0, 258615
IAST [baseline] (26.995 ms) : 0, 26995
IAST [candidate] (27.397 ms) : 0, 27397
AppSec [baseline] (32.966 ms) : 0, 32966
AppSec [candidate] (33.665 ms) : 0, 33665
Debugger [baseline] (67.969 ms) : 0, 67969
Debugger [candidate] (66.428 ms) : 0, 66428
Remote Config [baseline] (566.141 µs) : 0, 566
Remote Config [candidate] (607.266 µs) : 0, 607
Telemetry [baseline] (8.403 ms) : 0, 8403
Telemetry [candidate] (8.507 ms) : 0, 8507
Flare Poller [baseline] (3.55 ms) : 0, 3550
Flare Poller [candidate] (3.616 ms) : 0, 3616
section profiling
crashtracking [baseline] (1.261 ms) : 0, 1261
crashtracking [candidate] (1.219 ms) : 0, 1219
BytebuddyAgent [baseline] (712.592 ms) : 0, 712592
BytebuddyAgent [candidate] (702.207 ms) : 0, 702207
GlobalTracer [baseline] (222.523 ms) : 0, 222523
GlobalTracer [candidate] (221.604 ms) : 0, 221604
AppSec [baseline] (32.558 ms) : 0, 32558
AppSec [candidate] (32.035 ms) : 0, 32035
Debugger [baseline] (68.558 ms) : 0, 68558
Debugger [candidate] (68.066 ms) : 0, 68066
Remote Config [baseline] (623.057 µs) : 0, 623
Remote Config [candidate] (638.91 µs) : 0, 639
Telemetry [baseline] (8.88 ms) : 0, 8880
Telemetry [candidate] (9.049 ms) : 0, 9049
Flare Poller [baseline] (3.721 ms) : 0, 3721
Flare Poller [candidate] (3.764 ms) : 0, 3764
ProfilingAgent [baseline] (98.713 ms) : 0, 98713
ProfilingAgent [candidate] (97.905 ms) : 0, 97905
Profiling [baseline] (99.298 ms) : 0, 99298
Profiling [candidate] (98.489 ms) : 0, 98489
Load
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | dougqh/tagmap-reset-and-remove-fix |
| git_commit_date | 1768240143 | 1768241595 |
| git_commit_sha | c072939 | d08c29d |
| release_version | 1.59.0-SNAPSHOT~c072939fa1 | 1.59.0-SNAPSHOT~d08c29d98a |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | insecure-bank | insecure-bank |
| ci_job_date | 1768243889 | 1768243889 |
| ci_job_id | 1344081454 | 1344081454 |
| ci_pipeline_id | 90265191 | 90265191 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-1-pazirbzk 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-1-pazirbzk 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
Summary
Found 3 performance improvements and 4 performance regressions! Performance is the same for 14 metrics, 15 unstable metrics.
| scenario | Δ mean agg_http_req_duration_p50 | Δ mean agg_http_req_duration_p95 | Δ mean throughput | candidate mean agg_http_req_duration_p50 | candidate mean agg_http_req_duration_p95 | candidate mean throughput | baseline mean agg_http_req_duration_p50 | baseline mean agg_http_req_duration_p95 | baseline mean throughput |
|---|---|---|---|---|---|---|---|---|---|
| scenario:load:insecure-bank:profiling:high_load | worse [+40.209µs; +156.645µs] or [+2.527%; +9.845%] |
unstable [+146.102µs; +1034.268µs] or [+3.298%; +23.346%] |
unstable [-457.045op/s; +86.545op/s] or [-19.663%; +3.723%] |
1.690ms | 5.020ms | 2139.094op/s | 1.591ms | 4.430ms | 2324.344op/s |
| scenario:load:insecure-bank:iast_GLOBAL:high_load | worse [+127.341µs; +233.473µs] or [+4.753%; +8.714%] |
worse [+249.551µs; +645.602µs] or [+3.284%; +8.496%] |
unstable [-225.137op/s; +66.887op/s] or [-16.823%; +4.998%] |
2.860ms | 8.047ms | 1259.156op/s | 2.679ms | 7.599ms | 1338.281op/s |
| scenario:load:petclinic:profiling:high_load | unsure [+261.719µs; +1269.789µs] or [+1.404%; +6.811%] |
worse [+0.616ms; +2.280ms] or [+2.034%; +7.530%] |
unstable [-34.930op/s; +13.867op/s] or [-14.210%; +5.641%] |
19.408ms | 31.721ms | 235.281op/s | 18.642ms | 30.274ms | 245.812op/s |
| scenario:load:petclinic:appsec:high_load | better [-1386.568µs; -391.409µs] or [-7.133%; -2.013%] |
better [-2.445ms; -0.663ms] or [-7.685%; -2.085%] |
unstable [-12.861op/s; +35.736op/s] or [-5.466%; +15.189%] |
18.551ms | 30.254ms | 246.719op/s | 19.440ms | 31.808ms | 235.281op/s |
| scenario:load:petclinic:no_agent:high_load | better [-2.182ms; -0.740ms] or [-11.383%; -3.857%] |
same [-2.345ms; +0.246ms] or [-7.576%; +0.795%] |
unstable [-8.929op/s; +43.054op/s] or [-3.739%; +18.031%] |
17.711ms | 29.907ms | 255.844op/s | 19.172ms | 30.956ms | 238.781op/s |
Request duration reports for insecure-bank
gantt
title insecure-bank - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~d08c29d98a, baseline=1.59.0-SNAPSHOT~c072939fa1
dateFormat X
axisFormat %s
section baseline
no_agent (1.2 ms) : 1188, 1211
. : milestone, 1200,
iast (3.251 ms) : 3205, 3296
. : milestone, 3251,
iast_FULL (5.893 ms) : 5834, 5953
. : milestone, 5893,
iast_GLOBAL (3.423 ms) : 3372, 3475
. : milestone, 3423,
profiling (1.939 ms) : 1923, 1956
. : milestone, 1939,
tracing (1.79 ms) : 1773, 1807
. : milestone, 1790,
section candidate
no_agent (1.172 ms) : 1161, 1184
. : milestone, 1172,
iast (3.237 ms) : 3192, 3281
. : milestone, 3237,
iast_FULL (5.786 ms) : 5728, 5843
. : milestone, 5786,
iast_GLOBAL (3.643 ms) : 3583, 3703
. : milestone, 3643,
profiling (2.113 ms) : 2092, 2133
. : milestone, 2113,
tracing (1.778 ms) : 1763, 1792
. : milestone, 1778,
- baseline results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.2 ms [1.188 ms, 1.211 ms] | - |
| iast | 3.251 ms [3.205 ms, 3.296 ms] | 2.051 ms (171.0%) |
| iast_FULL | 5.893 ms [5.834 ms, 5.953 ms] | 4.694 ms (391.2%) |
| iast_GLOBAL | 3.423 ms [3.372 ms, 3.475 ms] | 2.224 ms (185.4%) |
| profiling | 1.939 ms [1.923 ms, 1.956 ms] | 739.711 µs (61.7%) |
| tracing | 1.79 ms [1.773 ms, 1.807 ms] | 590.325 µs (49.2%) |
- candidate results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.172 ms [1.161 ms, 1.184 ms] | - |
| iast | 3.237 ms [3.192 ms, 3.281 ms] | 2.064 ms (176.1%) |
| iast_FULL | 5.786 ms [5.728 ms, 5.843 ms] | 4.613 ms (393.6%) |
| iast_GLOBAL | 3.643 ms [3.583 ms, 3.703 ms] | 2.471 ms (210.8%) |
| profiling | 2.113 ms [2.092 ms, 2.133 ms] | 940.638 µs (80.2%) |
| tracing | 1.778 ms [1.763 ms, 1.792 ms] | 605.471 µs (51.7%) |
Request duration reports for petclinic
gantt
title petclinic - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~d08c29d98a, baseline=1.59.0-SNAPSHOT~c072939fa1
dateFormat X
axisFormat %s
section baseline
no_agent (19.553 ms) : 19357, 19749
. : milestone, 19553,
appsec (19.842 ms) : 19631, 20053
. : milestone, 19842,
code_origins (17.961 ms) : 17782, 18141
. : milestone, 17961,
iast (17.757 ms) : 17581, 17933
. : milestone, 17757,
profiling (18.993 ms) : 18799, 19187
. : milestone, 18993,
tracing (17.644 ms) : 17470, 17819
. : milestone, 17644,
section candidate
no_agent (18.238 ms) : 18050, 18427
. : milestone, 18238,
appsec (18.916 ms) : 18722, 19111
. : milestone, 18916,
code_origins (17.655 ms) : 17481, 17829
. : milestone, 17655,
iast (17.795 ms) : 17618, 17972
. : milestone, 17795,
profiling (19.84 ms) : 19632, 20048
. : milestone, 19840,
tracing (17.972 ms) : 17791, 18153
. : milestone, 17972,
- baseline results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 19.553 ms [19.357 ms, 19.749 ms] | - |
| appsec | 19.842 ms [19.631 ms, 20.053 ms] | 288.446 µs (1.5%) |
| code_origins | 17.961 ms [17.782 ms, 18.141 ms] | -1.592 ms (-8.1%) |
| iast | 17.757 ms [17.581 ms, 17.933 ms] | -1.796 ms (-9.2%) |
| profiling | 18.993 ms [18.799 ms, 19.187 ms] | -560.36 µs (-2.9%) |
| tracing | 17.644 ms [17.47 ms, 17.819 ms] | -1.909 ms (-9.8%) |
- candidate results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 18.238 ms [18.05 ms, 18.427 ms] | - |
| appsec | 18.916 ms [18.722 ms, 19.111 ms] | 677.898 µs (3.7%) |
| code_origins | 17.655 ms [17.481 ms, 17.829 ms] | -583.232 µs (-3.2%) |
| iast | 17.795 ms [17.618 ms, 17.972 ms] | -443.592 µs (-2.4%) |
| profiling | 19.84 ms [19.632 ms, 20.048 ms] | 1.601 ms (8.8%) |
| tracing | 17.972 ms [17.791 ms, 18.153 ms] | -266.507 µs (-1.5%) |
Dacapo
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | dougqh/tagmap-reset-and-remove-fix |
| git_commit_date | 1768240143 | 1768241595 |
| git_commit_sha | c072939 | d08c29d |
| release_version | 1.59.0-SNAPSHOT~c072939fa1 | 1.59.0-SNAPSHOT~d08c29d98a |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | biojava | biojava |
| ci_job_date | 1768243820 | 1768243820 |
| ci_job_id | 1344081455 | 1344081455 |
| ci_pipeline_id | 90265191 | 90265191 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-0-770w489r 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-0-770w489r 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
Summary
Found 1 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 1 unstable metrics.
| scenario | Δ mean execution_time | candidate mean execution_time | baseline mean execution_time |
|---|---|---|---|
| scenario:dacapo:tomcat:appsec | better [-1.442ms; -1.094ms] or [-38.636%; -29.314%] |
2.464ms | 3.732ms |
Execution time for tomcat
gantt
title tomcat - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~d08c29d98a, baseline=1.59.0-SNAPSHOT~c072939fa1
dateFormat X
axisFormat %s
section baseline
no_agent (1.478 ms) : 1466, 1489
. : milestone, 1478,
appsec (3.732 ms) : 3509, 3954
. : milestone, 3732,
iast (2.213 ms) : 2147, 2278
. : milestone, 2213,
iast_GLOBAL (2.252 ms) : 2186, 2317
. : milestone, 2252,
profiling (2.087 ms) : 2031, 2142
. : milestone, 2087,
tracing (2.042 ms) : 1990, 2094
. : milestone, 2042,
section candidate
no_agent (1.471 ms) : 1459, 1482
. : milestone, 1471,
appsec (2.464 ms) : 2411, 2516
. : milestone, 2464,
iast (2.219 ms) : 2154, 2285
. : milestone, 2219,
iast_GLOBAL (2.254 ms) : 2189, 2320
. : milestone, 2254,
profiling (2.469 ms) : 2309, 2629
. : milestone, 2469,
tracing (2.042 ms) : 1990, 2093
. : milestone, 2042,
- baseline results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.478 ms [1.466 ms, 1.489 ms] | - |
| appsec | 3.732 ms [3.509 ms, 3.954 ms] | 2.254 ms (152.5%) |
| iast | 2.213 ms [2.147 ms, 2.278 ms] | 734.798 µs (49.7%) |
| iast_GLOBAL | 2.252 ms [2.186 ms, 2.317 ms] | 773.793 µs (52.4%) |
| profiling | 2.087 ms [2.031 ms, 2.142 ms] | 608.836 µs (41.2%) |
| tracing | 2.042 ms [1.99 ms, 2.094 ms] | 564.335 µs (38.2%) |
- candidate results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.471 ms [1.459 ms, 1.482 ms] | - |
| appsec | 2.464 ms [2.411 ms, 2.516 ms] | 992.792 µs (67.5%) |
| iast | 2.219 ms [2.154 ms, 2.285 ms] | 748.225 µs (50.9%) |
| iast_GLOBAL | 2.254 ms [2.189 ms, 2.32 ms] | 783.489 µs (53.3%) |
| profiling | 2.469 ms [2.309 ms, 2.629 ms] | 998.28 µs (67.9%) |
| tracing | 2.042 ms [1.99 ms, 2.093 ms] | 570.825 µs (38.8%) |
Execution time for biojava
gantt
title biojava - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~d08c29d98a, baseline=1.59.0-SNAPSHOT~c072939fa1
dateFormat X
axisFormat %s
section baseline
no_agent (15.42 s) : 15420000, 15420000
. : milestone, 15420000,
appsec (15.157 s) : 15157000, 15157000
. : milestone, 15157000,
iast (18.002 s) : 18002000, 18002000
. : milestone, 18002000,
iast_GLOBAL (17.719 s) : 17719000, 17719000
. : milestone, 17719000,
profiling (14.849 s) : 14849000, 14849000
. : milestone, 14849000,
tracing (14.777 s) : 14777000, 14777000
. : milestone, 14777000,
section candidate
no_agent (14.995 s) : 14995000, 14995000
. : milestone, 14995000,
appsec (14.766 s) : 14766000, 14766000
. : milestone, 14766000,
iast (17.944 s) : 17944000, 17944000
. : milestone, 17944000,
iast_GLOBAL (17.651 s) : 17651000, 17651000
. : milestone, 17651000,
profiling (15.457 s) : 15457000, 15457000
. : milestone, 15457000,
tracing (14.621 s) : 14621000, 14621000
. : milestone, 14621000,
- baseline results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 15.42 s [15.42 s, 15.42 s] | - |
| appsec | 15.157 s [15.157 s, 15.157 s] | -263.0 ms (-1.7%) |
| iast | 18.002 s [18.002 s, 18.002 s] | 2.582 s (16.7%) |
| iast_GLOBAL | 17.719 s [17.719 s, 17.719 s] | 2.299 s (14.9%) |
| profiling | 14.849 s [14.849 s, 14.849 s] | -571.0 ms (-3.7%) |
| tracing | 14.777 s [14.777 s, 14.777 s] | -643.0 ms (-4.2%) |
- candidate results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 14.995 s [14.995 s, 14.995 s] | - |
| appsec | 14.766 s [14.766 s, 14.766 s] | -229.0 ms (-1.5%) |
| iast | 17.944 s [17.944 s, 17.944 s] | 2.949 s (19.7%) |
| iast_GLOBAL | 17.651 s [17.651 s, 17.651 s] | 2.656 s (17.7%) |
| profiling | 15.457 s [15.457 s, 15.457 s] | 462.0 ms (3.1%) |
| tracing | 14.621 s [14.621 s, 14.621 s] | -374.0 ms (-2.5%) |