Fix SymDB when processing corrupted jars by jpbempel · Pull Request #10453 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/symdb-exceptions
git_commit_date 1769522615 1769537633
git_commit_sha c5c0d11 69adb23
release_version 1.59.0-SNAPSHOT~c5c0d11f32 1.59.0-SNAPSHOT~69adb231b4
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1769539597 1769539597
ci_job_id 1381054596 1381054596
ci_pipeline_id 93114974 93114974
cpu_model Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-nsjzohqy 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-nsjzohqy 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 62 metrics, 9 unstable metrics.

Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.59.0-SNAPSHOT~69adb231b4, baseline=1.59.0-SNAPSHOT~c5c0d11f32

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.087 s) : 0, 1087306
Total [baseline] (9.256 s) : 0, 9256387
Agent [candidate] (1.099 s) : 0, 1099035
Total [candidate] (9.288 s) : 0, 9287827
section iast
Agent [baseline] (1.261 s) : 0, 1260994
Total [baseline] (9.987 s) : 0, 9987405
Agent [candidate] (1.264 s) : 0, 1264012
Total [candidate] (10.007 s) : 0, 10006535
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.087 s -
Agent iast 1.261 s 173.688 ms (16.0%)
Total tracing 9.256 s -
Total iast 9.987 s 731.018 ms (7.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.099 s -
Agent iast 1.264 s 164.977 ms (15.0%)
Total tracing 9.288 s -
Total iast 10.007 s 718.708 ms (7.7%)
gantt
    title insecure-bank - break down per module: candidate=1.59.0-SNAPSHOT~69adb231b4, baseline=1.59.0-SNAPSHOT~c5c0d11f32

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.232 ms) : 0, 1232
crashtracking [candidate] (1.253 ms) : 0, 1253
BytebuddyAgent [baseline] (637.375 ms) : 0, 637375
BytebuddyAgent [candidate] (644.608 ms) : 0, 644608
AgentMeter [baseline] (29.556 ms) : 0, 29556
AgentMeter [candidate] (30.179 ms) : 0, 30179
GlobalTracer [baseline] (265.123 ms) : 0, 265123
GlobalTracer [candidate] (268.903 ms) : 0, 268903
AppSec [baseline] (34.074 ms) : 0, 34074
AppSec [candidate] (34.624 ms) : 0, 34624
Debugger [baseline] (63.248 ms) : 0, 63248
Debugger [candidate] (64.905 ms) : 0, 64905
Remote Config [baseline] (657.68 µs) : 0, 658
Remote Config [candidate] (657.17 µs) : 0, 657
Telemetry [baseline] (11.966 ms) : 0, 11966
Telemetry [candidate] (10.388 ms) : 0, 10388
Flare Poller [baseline] (8.041 ms) : 0, 8041
Flare Poller [candidate] (7.28 ms) : 0, 7280
section iast
crashtracking [baseline] (1.232 ms) : 0, 1232
crashtracking [candidate] (1.238 ms) : 0, 1238
BytebuddyAgent [baseline] (811.875 ms) : 0, 811875
BytebuddyAgent [candidate] (813.601 ms) : 0, 813601
AgentMeter [baseline] (11.557 ms) : 0, 11557
AgentMeter [candidate] (11.609 ms) : 0, 11609
GlobalTracer [baseline] (256.717 ms) : 0, 256717
GlobalTracer [candidate] (257.883 ms) : 0, 257883
AppSec [baseline] (34.985 ms) : 0, 34985
AppSec [candidate] (32.545 ms) : 0, 32545
Debugger [baseline] (67.937 ms) : 0, 67937
Debugger [candidate] (70.296 ms) : 0, 70296
Remote Config [baseline] (580.04 µs) : 0, 580
Remote Config [candidate] (563.701 µs) : 0, 564
Telemetry [baseline] (8.645 ms) : 0, 8645
Telemetry [candidate] (8.653 ms) : 0, 8653
Flare Poller [baseline] (3.482 ms) : 0, 3482
Flare Poller [candidate] (3.499 ms) : 0, 3499
IAST [baseline] (27.947 ms) : 0, 27947
IAST [candidate] (28.066 ms) : 0, 28066
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.59.0-SNAPSHOT~69adb231b4, baseline=1.59.0-SNAPSHOT~c5c0d11f32

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.096 s) : 0, 1096036
Total [baseline] (11.265 s) : 0, 11265370
Agent [candidate] (1.085 s) : 0, 1085021
Total [candidate] (11.368 s) : 0, 11367697
section appsec
Agent [baseline] (1.261 s) : 0, 1260964
Total [baseline] (11.202 s) : 0, 11201920
Agent [candidate] (1.261 s) : 0, 1260836
Total [candidate] (11.362 s) : 0, 11361960
section iast
Agent [baseline] (1.254 s) : 0, 1253836
Total [baseline] (11.338 s) : 0, 11338418
Agent [candidate] (1.255 s) : 0, 1254675
Total [candidate] (11.352 s) : 0, 11352372
section profiling
Agent [baseline] (1.213 s) : 0, 1212951
Total [baseline] (11.424 s) : 0, 11423879
Agent [candidate] (1.208 s) : 0, 1208199
Total [candidate] (11.283 s) : 0, 11282620
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.096 s -
Agent appsec 1.261 s 164.928 ms (15.0%)
Agent iast 1.254 s 157.8 ms (14.4%)
Agent profiling 1.213 s 116.915 ms (10.7%)
Total tracing 11.265 s -
Total appsec 11.202 s -63.45 ms (-0.6%)
Total iast 11.338 s 73.048 ms (0.6%)
Total profiling 11.424 s 158.509 ms (1.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.085 s -
Agent appsec 1.261 s 175.815 ms (16.2%)
Agent iast 1.255 s 169.654 ms (15.6%)
Agent profiling 1.208 s 123.178 ms (11.4%)
Total tracing 11.368 s -
Total appsec 11.362 s -5.737 ms (-0.1%)
Total iast 11.352 s -15.325 ms (-0.1%)
Total profiling 11.283 s -85.077 ms (-0.7%)
gantt
    title petclinic - break down per module: candidate=1.59.0-SNAPSHOT~69adb231b4, baseline=1.59.0-SNAPSHOT~c5c0d11f32

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.239 ms) : 0, 1239
crashtracking [candidate] (1.236 ms) : 0, 1236
BytebuddyAgent [baseline] (642.045 ms) : 0, 642045
BytebuddyAgent [candidate] (635.961 ms) : 0, 635961
AgentMeter [baseline] (30.031 ms) : 0, 30031
AgentMeter [candidate] (29.478 ms) : 0, 29478
GlobalTracer [baseline] (266.877 ms) : 0, 266877
GlobalTracer [candidate] (265.05 ms) : 0, 265050
AppSec [baseline] (34.269 ms) : 0, 34269
AppSec [candidate] (33.754 ms) : 0, 33754
Debugger [baseline] (64.458 ms) : 0, 64458
Debugger [candidate] (63.541 ms) : 0, 63541
Remote Config [baseline] (676.996 µs) : 0, 677
Remote Config [candidate] (655.448 µs) : 0, 655
Telemetry [baseline] (11.331 ms) : 0, 11331
Telemetry [candidate] (10.167 ms) : 0, 10167
Flare Poller [baseline] (9.031 ms) : 0, 9031
Flare Poller [candidate] (9.058 ms) : 0, 9058
section appsec
crashtracking [baseline] (1.232 ms) : 0, 1232
crashtracking [candidate] (1.233 ms) : 0, 1233
BytebuddyAgent [baseline] (664.877 ms) : 0, 664877
BytebuddyAgent [candidate] (664.456 ms) : 0, 664456
AgentMeter [baseline] (12.189 ms) : 0, 12189
AgentMeter [candidate] (12.196 ms) : 0, 12196
GlobalTracer [baseline] (264.53 ms) : 0, 264530
GlobalTracer [candidate] (264.407 ms) : 0, 264407
AppSec [baseline] (172.002 ms) : 0, 172002
AppSec [candidate] (172.028 ms) : 0, 172028
Debugger [baseline] (69.935 ms) : 0, 69935
Debugger [candidate] (69.889 ms) : 0, 69889
Remote Config [baseline] (686.196 µs) : 0, 686
Remote Config [candidate] (696.122 µs) : 0, 696
Telemetry [baseline] (9.521 ms) : 0, 9521
Telemetry [candidate] (9.818 ms) : 0, 9818
Flare Poller [baseline] (3.692 ms) : 0, 3692
Flare Poller [candidate] (3.866 ms) : 0, 3866
IAST [baseline] (26.425 ms) : 0, 26425
IAST [candidate] (26.36 ms) : 0, 26360
section iast
crashtracking [baseline] (1.235 ms) : 0, 1235
crashtracking [candidate] (1.238 ms) : 0, 1238
BytebuddyAgent [baseline] (804.397 ms) : 0, 804397
BytebuddyAgent [candidate] (805.903 ms) : 0, 805903
AgentMeter [baseline] (11.476 ms) : 0, 11476
AgentMeter [candidate] (11.522 ms) : 0, 11522
GlobalTracer [baseline] (256.217 ms) : 0, 256217
GlobalTracer [candidate] (256.671 ms) : 0, 256671
AppSec [baseline] (33.519 ms) : 0, 33519
AppSec [candidate] (34.842 ms) : 0, 34842
Debugger [baseline] (70.676 ms) : 0, 70676
Debugger [candidate] (68.163 ms) : 0, 68163
Remote Config [baseline] (577.628 µs) : 0, 578
Remote Config [candidate] (570.692 µs) : 0, 571
Telemetry [baseline] (8.622 ms) : 0, 8622
Telemetry [candidate] (8.652 ms) : 0, 8652
Flare Poller [baseline] (3.472 ms) : 0, 3472
Flare Poller [candidate] (3.518 ms) : 0, 3518
IAST [baseline] (27.735 ms) : 0, 27735
IAST [candidate] (27.593 ms) : 0, 27593
section profiling
crashtracking [baseline] (1.262 ms) : 0, 1262
crashtracking [candidate] (1.264 ms) : 0, 1264
BytebuddyAgent [baseline] (690.813 ms) : 0, 690813
BytebuddyAgent [candidate] (688.457 ms) : 0, 688457
AgentMeter [baseline] (8.939 ms) : 0, 8939
AgentMeter [candidate] (8.903 ms) : 0, 8903
GlobalTracer [baseline] (223.904 ms) : 0, 223904
GlobalTracer [candidate] (222.446 ms) : 0, 222446
AppSec [baseline] (33.508 ms) : 0, 33508
AppSec [candidate] (33.294 ms) : 0, 33294
Debugger [baseline] (70.334 ms) : 0, 70334
Debugger [candidate] (70.402 ms) : 0, 70402
Remote Config [baseline] (606.482 µs) : 0, 606
Remote Config [candidate] (620.755 µs) : 0, 621
Telemetry [baseline] (8.908 ms) : 0, 8908
Telemetry [candidate] (9.122 ms) : 0, 9122
Flare Poller [baseline] (3.821 ms) : 0, 3821
Flare Poller [candidate] (3.822 ms) : 0, 3822
ProfilingAgent [baseline] (100.112 ms) : 0, 100112
ProfilingAgent [candidate] (99.215 ms) : 0, 99215
Profiling [baseline] (100.71 ms) : 0, 100710
Profiling [candidate] (99.8 ms) : 0, 99800
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/symdb-exceptions
git_commit_date 1769522615 1769537633
git_commit_sha c5c0d11 69adb23
release_version 1.59.0-SNAPSHOT~c5c0d11f32 1.59.0-SNAPSHOT~69adb231b4
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1769540040 1769540040
ci_job_id 1381054598 1381054598
ci_pipeline_id 93114974 93114974
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-wgln73j7 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-wgln73j7 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 1 performance regressions! Performance is the same for 16 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load better
[-254.501µs; -106.005µs] or [-9.057%; -3.773%]
unsure
[-505.937µs; -112.973µs] or [-6.439%; -1.438%]
unstable
[-66.720op/s; +197.220op/s] or [-5.171%; +15.286%]
2.630ms 7.548ms 1355.438op/s 2.810ms 7.858ms 1290.188op/s
scenario:load:petclinic:iast:high_load better
[-1356.572µs; -480.505µs] or [-7.465%; -2.644%]
better
[-2.141ms; -0.628ms] or [-7.193%; -2.110%]
unstable
[-11.413op/s; +37.226op/s] or [-4.544%; +14.822%]
17.255ms 28.378ms 264.062op/s 18.173ms 29.763ms 251.156op/s
scenario:load:petclinic:tracing:high_load worse
[+533.891µs; +997.056µs] or [+3.163%; +5.908%]
unsure
[+399.308µs; +1324.562µs] or [+1.409%; +4.674%]
unstable
[-33.360op/s; +15.672op/s] or [-12.464%; +5.855%]
17.643ms 29.199ms 258.812op/s 16.877ms 28.337ms 267.656op/s
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~69adb231b4, baseline=1.59.0-SNAPSHOT~c5c0d11f32
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.952 ms) : 17769, 18136
.   : milestone, 17952,
appsec (18.43 ms) : 18241, 18619
.   : milestone, 18430,
code_origins (17.47 ms) : 17300, 17640
.   : milestone, 17470,
iast (18.583 ms) : 18393, 18774
.   : milestone, 18583,
profiling (18.513 ms) : 18332, 18694
.   : milestone, 18513,
tracing (17.431 ms) : 17258, 17605
.   : milestone, 17431,
section candidate
no_agent (17.974 ms) : 17793, 18155
.   : milestone, 17974,
appsec (18.281 ms) : 18100, 18462
.   : milestone, 18281,
code_origins (17.638 ms) : 17466, 17810
.   : milestone, 17638,
iast (17.669 ms) : 17495, 17842
.   : milestone, 17669,
profiling (18.501 ms) : 18320, 18682
.   : milestone, 18501,
tracing (18.033 ms) : 17853, 18213
.   : milestone, 18033,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.952 ms [17.769 ms, 18.136 ms] -
appsec 18.43 ms [18.241 ms, 18.619 ms] 477.879 µs (2.7%)
code_origins 17.47 ms [17.3 ms, 17.64 ms] -482.096 µs (-2.7%)
iast 18.583 ms [18.393 ms, 18.774 ms] 631.015 µs (3.5%)
profiling 18.513 ms [18.332 ms, 18.694 ms] 560.398 µs (3.1%)
tracing 17.431 ms [17.258 ms, 17.605 ms] -520.901 µs (-2.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.974 ms [17.793 ms, 18.155 ms] -
appsec 18.281 ms [18.1 ms, 18.462 ms] 307.767 µs (1.7%)
code_origins 17.638 ms [17.466 ms, 17.81 ms] -335.639 µs (-1.9%)
iast 17.669 ms [17.495 ms, 17.842 ms] -304.95 µs (-1.7%)
profiling 18.501 ms [18.32 ms, 18.682 ms] 527.323 µs (2.9%)
tracing 18.033 ms [17.853 ms, 18.213 ms] 59.752 µs (0.3%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~69adb231b4, baseline=1.59.0-SNAPSHOT~c5c0d11f32
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.269 ms) : 1255, 1283
.   : milestone, 1269,
iast (3.203 ms) : 3158, 3248
.   : milestone, 3203,
iast_FULL (5.913 ms) : 5854, 5972
.   : milestone, 5913,
iast_GLOBAL (3.553 ms) : 3499, 3607
.   : milestone, 3553,
profiling (2.021 ms) : 2003, 2038
.   : milestone, 2021,
tracing (1.791 ms) : 1776, 1806
.   : milestone, 1791,
section candidate
no_agent (1.185 ms) : 1174, 1197
.   : milestone, 1185,
iast (3.123 ms) : 3081, 3165
.   : milestone, 3123,
iast_FULL (5.981 ms) : 5920, 6043
.   : milestone, 5981,
iast_GLOBAL (3.38 ms) : 3328, 3433
.   : milestone, 3380,
profiling (1.976 ms) : 1960, 1993
.   : milestone, 1976,
tracing (1.852 ms) : 1835, 1869
.   : milestone, 1852,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.269 ms [1.255 ms, 1.283 ms] -
iast 3.203 ms [3.158 ms, 3.248 ms] 1.934 ms (152.4%)
iast_FULL 5.913 ms [5.854 ms, 5.972 ms] 4.644 ms (365.9%)
iast_GLOBAL 3.553 ms [3.499 ms, 3.607 ms] 2.284 ms (180.0%)
profiling 2.021 ms [2.003 ms, 2.038 ms] 751.523 µs (59.2%)
tracing 1.791 ms [1.776 ms, 1.806 ms] 521.83 µs (41.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.185 ms [1.174 ms, 1.197 ms] -
iast 3.123 ms [3.081 ms, 3.165 ms] 1.938 ms (163.4%)
iast_FULL 5.981 ms [5.92 ms, 6.043 ms] 4.796 ms (404.6%)
iast_GLOBAL 3.38 ms [3.328 ms, 3.433 ms] 2.195 ms (185.2%)
profiling 1.976 ms [1.96 ms, 1.993 ms] 791.086 µs (66.7%)
tracing 1.852 ms [1.835 ms, 1.869 ms] 666.321 µs (56.2%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/symdb-exceptions
git_commit_date 1769522615 1769537633
git_commit_sha c5c0d11 69adb23
release_version 1.59.0-SNAPSHOT~c5c0d11f32 1.59.0-SNAPSHOT~69adb231b4
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1769539723 1769539723
ci_job_id 1381054599 1381054599
ci_pipeline_id 93114974 93114974
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-wwfpbl17 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-wwfpbl17 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~69adb231b4, baseline=1.59.0-SNAPSHOT~c5c0d11f32
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.99 s) : 14990000, 14990000
.   : milestone, 14990000,
appsec (15.019 s) : 15019000, 15019000
.   : milestone, 15019000,
iast (17.965 s) : 17965000, 17965000
.   : milestone, 17965000,
iast_GLOBAL (17.954 s) : 17954000, 17954000
.   : milestone, 17954000,
profiling (14.594 s) : 14594000, 14594000
.   : milestone, 14594000,
tracing (14.585 s) : 14585000, 14585000
.   : milestone, 14585000,
section candidate
no_agent (15.437 s) : 15437000, 15437000
.   : milestone, 15437000,
appsec (15.0 s) : 15000000, 15000000
.   : milestone, 15000000,
iast (17.824 s) : 17824000, 17824000
.   : milestone, 17824000,
iast_GLOBAL (17.928 s) : 17928000, 17928000
.   : milestone, 17928000,
profiling (15.042 s) : 15042000, 15042000
.   : milestone, 15042000,
tracing (14.833 s) : 14833000, 14833000
.   : milestone, 14833000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.99 s [14.99 s, 14.99 s] -
appsec 15.019 s [15.019 s, 15.019 s] 29.0 ms (0.2%)
iast 17.965 s [17.965 s, 17.965 s] 2.975 s (19.8%)
iast_GLOBAL 17.954 s [17.954 s, 17.954 s] 2.964 s (19.8%)
profiling 14.594 s [14.594 s, 14.594 s] -396.0 ms (-2.6%)
tracing 14.585 s [14.585 s, 14.585 s] -405.0 ms (-2.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.437 s [15.437 s, 15.437 s] -
appsec 15.0 s [15.0 s, 15.0 s] -437.0 ms (-2.8%)
iast 17.824 s [17.824 s, 17.824 s] 2.387 s (15.5%)
iast_GLOBAL 17.928 s [17.928 s, 17.928 s] 2.491 s (16.1%)
profiling 15.042 s [15.042 s, 15.042 s] -395.0 ms (-2.6%)
tracing 14.833 s [14.833 s, 14.833 s] -604.0 ms (-3.9%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~69adb231b4, baseline=1.59.0-SNAPSHOT~c5c0d11f32
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.477 ms) : 1465, 1488
.   : milestone, 1477,
appsec (3.699 ms) : 3480, 3917
.   : milestone, 3699,
iast (2.256 ms) : 2187, 2326
.   : milestone, 2256,
iast_GLOBAL (2.3 ms) : 2230, 2369
.   : milestone, 2300,
profiling (2.103 ms) : 2047, 2159
.   : milestone, 2103,
tracing (2.054 ms) : 2001, 2107
.   : milestone, 2054,
section candidate
no_agent (1.479 ms) : 1467, 1490
.   : milestone, 1479,
appsec (3.76 ms) : 3538, 3982
.   : milestone, 3760,
iast (2.258 ms) : 2189, 2327
.   : milestone, 2258,
iast_GLOBAL (2.299 ms) : 2229, 2368
.   : milestone, 2299,
profiling (2.082 ms) : 2028, 2136
.   : milestone, 2082,
tracing (2.058 ms) : 2005, 2111
.   : milestone, 2058,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.477 ms [1.465 ms, 1.488 ms] -
appsec 3.699 ms [3.48 ms, 3.917 ms] 2.222 ms (150.5%)
iast 2.256 ms [2.187 ms, 2.326 ms] 779.827 µs (52.8%)
iast_GLOBAL 2.3 ms [2.23 ms, 2.369 ms] 823.054 µs (55.7%)
profiling 2.103 ms [2.047 ms, 2.159 ms] 626.808 µs (42.5%)
tracing 2.054 ms [2.001 ms, 2.107 ms] 577.418 µs (39.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.479 ms [1.467 ms, 1.49 ms] -
appsec 3.76 ms [3.538 ms, 3.982 ms] 2.281 ms (154.2%)
iast 2.258 ms [2.189 ms, 2.327 ms] 779.039 µs (52.7%)
iast_GLOBAL 2.299 ms [2.229 ms, 2.368 ms] 820.063 µs (55.5%)
profiling 2.082 ms [2.028 ms, 2.136 ms] 603.201 µs (40.8%)
tracing 2.058 ms [2.005 ms, 2.111 ms] 578.952 µs (39.1%)