Home Original page

Avoid NPE when setting resource with null path by amarziali · Pull Request #10180 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/npe
git_commit_date 1765529699 1765537502
git_commit_sha 552ae2b 0521eba
release_version 1.57.0-SNAPSHOT~552ae2be7d 1.57.0-SNAPSHOT~0521eba6a1
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1765539365 1765539365
ci_job_id 1290253784 1290253784
ci_pipeline_id 86441177 86441177
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-guplm8ft 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-guplm8ft 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 7 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.57.0-SNAPSHOT~0521eba6a1, baseline=1.57.0-SNAPSHOT~552ae2be7d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.079 s) : 0, 1079449
Total [baseline] (10.872 s) : 0, 10872091
Agent [candidate] (1.087 s) : 0, 1087469
Total [candidate] (10.818 s) : 0, 10817598
section appsec
Agent [baseline] (1.261 s) : 0, 1261294
Total [baseline] (10.973 s) : 0, 10973254
Agent [candidate] (1.269 s) : 0, 1269020
Total [candidate] (10.967 s) : 0, 10967297
section iast
Agent [baseline] (1.223 s) : 0, 1222691
Total [baseline] (11.203 s) : 0, 11203388
Agent [candidate] (1.223 s) : 0, 1222857
Total [candidate] (11.203 s) : 0, 11203113
section profiling
Agent [baseline] (1.205 s) : 0, 1204592
Total [baseline] (10.914 s) : 0, 10914491
Agent [candidate] (1.203 s) : 0, 1202986
Total [candidate] (10.956 s) : 0, 10956201
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.079 s -
Agent appsec 1.261 s 181.845 ms (16.8%)
Agent iast 1.223 s 143.242 ms (13.3%)
Agent profiling 1.205 s 125.142 ms (11.6%)
Total tracing 10.872 s -
Total appsec 10.973 s 101.162 ms (0.9%)
Total iast 11.203 s 331.296 ms (3.0%)
Total profiling 10.914 s 42.399 ms (0.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.087 s -
Agent appsec 1.269 s 181.551 ms (16.7%)
Agent iast 1.223 s 135.388 ms (12.4%)
Agent profiling 1.203 s 115.517 ms (10.6%)
Total tracing 10.818 s -
Total appsec 10.967 s 149.698 ms (1.4%)
Total iast 11.203 s 385.515 ms (3.6%)
Total profiling 10.956 s 138.603 ms (1.3%) 
gantt
    title petclinic - break down per module: candidate=1.57.0-SNAPSHOT~0521eba6a1, baseline=1.57.0-SNAPSHOT~552ae2be7d

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.181 ms) : 0, 1181
crashtracking [candidate] (1.194 ms) : 0, 1194
BytebuddyAgent [baseline] (647.978 ms) : 0, 647978
BytebuddyAgent [candidate] (652.797 ms) : 0, 652797
GlobalTracer [baseline] (281.17 ms) : 0, 281170
GlobalTracer [candidate] (283.125 ms) : 0, 283125
AppSec [baseline] (32.225 ms) : 0, 32225
AppSec [candidate] (32.566 ms) : 0, 32566
Debugger [baseline] (68.118 ms) : 0, 68118
Debugger [candidate] (68.557 ms) : 0, 68557
Remote Config [baseline] (630.092 µs) : 0, 630
Remote Config [candidate] (662.529 µs) : 0, 663
Telemetry [baseline] (9.014 ms) : 0, 9014
Telemetry [candidate] (9.177 ms) : 0, 9177
Flare Poller [baseline] (3.725 ms) : 0, 3725
Flare Poller [candidate] (3.787 ms) : 0, 3787
section appsec
crashtracking [baseline] (1.177 ms) : 0, 1177
crashtracking [candidate] (1.186 ms) : 0, 1186
BytebuddyAgent [baseline] (687.742 ms) : 0, 687742
BytebuddyAgent [candidate] (693.48 ms) : 0, 693480
GlobalTracer [baseline] (257.954 ms) : 0, 257954
GlobalTracer [candidate] (259.205 ms) : 0, 259205
AppSec [baseline] (174.525 ms) : 0, 174525
AppSec [candidate] (174.284 ms) : 0, 174284
Debugger [baseline] (66.497 ms) : 0, 66497
Debugger [candidate] (66.974 ms) : 0, 66974
Remote Config [baseline] (699.287 µs) : 0, 699
Remote Config [candidate] (740.678 µs) : 0, 741
Telemetry [baseline] (8.951 ms) : 0, 8951
Telemetry [candidate] (9.18 ms) : 0, 9180
Flare Poller [baseline] (3.766 ms) : 0, 3766
Flare Poller [candidate] (3.932 ms) : 0, 3932
IAST [baseline] (24.497 ms) : 0, 24497
IAST [candidate] (24.468 ms) : 0, 24468
section iast
crashtracking [baseline] (1.181 ms) : 0, 1181
crashtracking [candidate] (1.182 ms) : 0, 1182
BytebuddyAgent [baseline] (791.193 ms) : 0, 791193
BytebuddyAgent [candidate] (791.19 ms) : 0, 791190
GlobalTracer [baseline] (255.42 ms) : 0, 255420
GlobalTracer [candidate] (255.759 ms) : 0, 255759
AppSec [baseline] (35.039 ms) : 0, 35039
AppSec [candidate] (34.987 ms) : 0, 34987
Debugger [baseline] (65.167 ms) : 0, 65167
Debugger [candidate] (65.09 ms) : 0, 65090
Remote Config [baseline] (558.117 µs) : 0, 558
Remote Config [candidate] (545.653 µs) : 0, 546
Telemetry [baseline] (8.414 ms) : 0, 8414
Telemetry [candidate] (8.385 ms) : 0, 8385
Flare Poller [baseline] (3.502 ms) : 0, 3502
Flare Poller [candidate] (3.477 ms) : 0, 3477
IAST [baseline] (26.945 ms) : 0, 26945
IAST [candidate] (26.849 ms) : 0, 26849
section profiling
crashtracking [baseline] (1.176 ms) : 0, 1176
crashtracking [candidate] (1.176 ms) : 0, 1176
BytebuddyAgent [baseline] (701.619 ms) : 0, 701619
BytebuddyAgent [candidate] (700.643 ms) : 0, 700643
GlobalTracer [baseline] (221.293 ms) : 0, 221293
GlobalTracer [candidate] (220.758 ms) : 0, 220758
AppSec [baseline] (32.198 ms) : 0, 32198
AppSec [candidate] (31.904 ms) : 0, 31904
Debugger [baseline] (68.205 ms) : 0, 68205
Debugger [candidate] (68.656 ms) : 0, 68656
Remote Config [baseline] (644.787 µs) : 0, 645
Remote Config [candidate] (633.293 µs) : 0, 633
Telemetry [baseline] (9.141 ms) : 0, 9141
Telemetry [candidate] (8.974 ms) : 0, 8974
Flare Poller [baseline] (3.805 ms) : 0, 3805
Flare Poller [candidate] (3.717 ms) : 0, 3717
ProfilingAgent [baseline] (96.563 ms) : 0, 96563
ProfilingAgent [candidate] (96.77 ms) : 0, 96770
Profiling [baseline] (97.141 ms) : 0, 97141
Profiling [candidate] (97.355 ms) : 0, 97355
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.57.0-SNAPSHOT~0521eba6a1, baseline=1.57.0-SNAPSHOT~552ae2be7d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.079 s) : 0, 1078659
Total [baseline] (8.722 s) : 0, 8721974
Agent [candidate] (1.079 s) : 0, 1078530
Total [candidate] (8.747 s) : 0, 8746593
section iast
Agent [baseline] (1.218 s) : 0, 1217690
Total [baseline] (9.343 s) : 0, 9342510
Agent [candidate] (1.229 s) : 0, 1228736
Total [candidate] (9.376 s) : 0, 9376031
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.079 s -
Agent iast 1.218 s 139.03 ms (12.9%)
Total tracing 8.722 s -
Total iast 9.343 s 620.536 ms (7.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.079 s -
Agent iast 1.229 s 150.206 ms (13.9%)
Total tracing 8.747 s -
Total iast 9.376 s 629.438 ms (7.2%) 
gantt
    title insecure-bank - break down per module: candidate=1.57.0-SNAPSHOT~0521eba6a1, baseline=1.57.0-SNAPSHOT~552ae2be7d

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.186 ms) : 0, 1186
crashtracking [candidate] (1.176 ms) : 0, 1176
BytebuddyAgent [baseline] (648.426 ms) : 0, 648426
BytebuddyAgent [candidate] (647.475 ms) : 0, 647475
GlobalTracer [baseline] (281.054 ms) : 0, 281054
GlobalTracer [candidate] (281.329 ms) : 0, 281329
AppSec [baseline] (32.272 ms) : 0, 32272
AppSec [candidate] (32.391 ms) : 0, 32391
Debugger [baseline] (66.952 ms) : 0, 66952
Debugger [candidate] (67.169 ms) : 0, 67169
Remote Config [baseline] (629.701 µs) : 0, 630
Remote Config [candidate] (644.208 µs) : 0, 644
Telemetry [baseline] (8.954 ms) : 0, 8954
Telemetry [candidate] (9.011 ms) : 0, 9011
Flare Poller [baseline] (3.745 ms) : 0, 3745
Flare Poller [candidate] (3.792 ms) : 0, 3792
section iast
crashtracking [baseline] (1.179 ms) : 0, 1179
crashtracking [candidate] (1.193 ms) : 0, 1193
BytebuddyAgent [baseline] (788.3 ms) : 0, 788300
BytebuddyAgent [candidate] (796.81 ms) : 0, 796810
GlobalTracer [baseline] (254.784 ms) : 0, 254784
GlobalTracer [candidate] (256.804 ms) : 0, 256804
AppSec [baseline] (34.923 ms) : 0, 34923
AppSec [candidate] (34.183 ms) : 0, 34183
Debugger [baseline] (63.908 ms) : 0, 63908
Debugger [candidate] (64.937 ms) : 0, 64937
Remote Config [baseline] (556.896 µs) : 0, 557
Remote Config [candidate] (542.492 µs) : 0, 542
Telemetry [baseline] (8.372 ms) : 0, 8372
Telemetry [candidate] (8.41 ms) : 0, 8410
Flare Poller [baseline] (3.456 ms) : 0, 3456
Flare Poller [candidate] (3.495 ms) : 0, 3495
IAST [baseline] (26.909 ms) : 0, 26909
IAST [candidate] (26.812 ms) : 0, 26812
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/npe
git_commit_date 1765529699 1765537502
git_commit_sha 552ae2b 0521eba
release_version 1.57.0-SNAPSHOT~552ae2be7d 1.57.0-SNAPSHOT~0521eba6a1
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1765539862 1765539862
ci_job_id 1290253785 1290253785
ci_pipeline_id 86441177 86441177
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-h3c8lq67 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-h3c8lq67 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 4 performance improvements and 2 performance regressions! Performance is the same for 15 metrics, 15 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast:high_load better
[-178.363µs; -105.542µs] or [-6.973%; -4.126%]		 better
[-472.829µs; -179.194µs] or [-6.383%; -2.419%]		 unstable
[-57.456op/s; +211.018op/s] or [-4.112%; +15.100%]		 2.416ms 7.082ms 1474.219op/s 2.558ms 7.408ms 1397.438op/s
scenario:load:petclinic:tracing:high_load better
[-1342.299µs; -614.018µs] or [-7.345%; -3.360%]		 same
[-1630.163µs; +76.957µs] or [-5.528%; +0.261%]		 unstable
[-13.429op/s; +40.804op/s] or [-5.382%; +16.352%]		 17.297ms 28.713ms 263.219op/s 18.275ms 29.490ms 249.531op/s
scenario:load:petclinic:profiling:high_load worse
[+1.390ms; +1.963ms] or [+7.635%; +10.785%]		 worse
[+1.812ms; +3.411ms] or [+6.194%; +11.662%]		 unstable
[-45.472op/s; +6.160op/s] or [-18.105%; +2.453%]		 19.875ms 31.864ms 231.500op/s 18.199ms 29.252ms 251.156op/s
scenario:load:petclinic:appsec:high_load better
[-1149.227µs; -429.677µs] or [-5.852%; -2.188%]		 same
[-1337.250µs; +351.724µs] or [-4.340%; +1.141%]		 unstable
[-17.505op/s; +33.380op/s] or [-7.447%; +14.200%]		 18.849ms 30.323ms 243.000op/s 19.639ms 30.816ms 235.062op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~0521eba6a1, baseline=1.57.0-SNAPSHOT~552ae2be7d
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.191 ms) : 1179, 1202
.   : milestone, 1191,
iast (3.275 ms) : 3230, 3321
.   : milestone, 3275,
iast_FULL (5.815 ms) : 5756, 5874
.   : milestone, 5815,
iast_GLOBAL (3.556 ms) : 3500, 3612
.   : milestone, 3556,
profiling (2.2 ms) : 2180, 2221
.   : milestone, 2200,
tracing (1.805 ms) : 1790, 1821
.   : milestone, 1805,
section candidate
no_agent (1.195 ms) : 1184, 1206
.   : milestone, 1195,
iast (3.101 ms) : 3062, 3139
.   : milestone, 3101,
iast_FULL (5.859 ms) : 5800, 5918
.   : milestone, 5859,
iast_GLOBAL (3.625 ms) : 3572, 3677
.   : milestone, 3625,
profiling (2.026 ms) : 2009, 2043
.   : milestone, 2026,
tracing (1.85 ms) : 1833, 1868
.   : milestone, 1850,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.191 ms [1.179 ms, 1.202 ms] -
iast 3.275 ms [3.23 ms, 3.321 ms] 2.085 ms (175.1%)
iast_FULL 5.815 ms [5.756 ms, 5.874 ms] 4.624 ms (388.4%)
iast_GLOBAL 3.556 ms [3.5 ms, 3.612 ms] 2.366 ms (198.7%)
profiling 2.2 ms [2.18 ms, 2.221 ms] 1.01 ms (84.8%)
tracing 1.805 ms [1.79 ms, 1.821 ms] 614.766 µs (51.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.195 ms [1.184 ms, 1.206 ms] -
iast 3.101 ms [3.062 ms, 3.139 ms] 1.906 ms (159.5%)
iast_FULL 5.859 ms [5.8 ms, 5.918 ms] 4.664 ms (390.3%)
iast_GLOBAL 3.625 ms [3.572 ms, 3.677 ms] 2.43 ms (203.3%)
profiling 2.026 ms [2.009 ms, 2.043 ms] 830.961 µs (69.5%)
tracing 1.85 ms [1.833 ms, 1.868 ms] 655.445 µs (54.9%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~0521eba6a1, baseline=1.57.0-SNAPSHOT~552ae2be7d
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.534 ms) : 19332, 19735
.   : milestone, 19534,
appsec (19.858 ms) : 19656, 20061
.   : milestone, 19858,
code_origins (17.572 ms) : 17394, 17751
.   : milestone, 17572,
iast (17.459 ms) : 17286, 17632
.   : milestone, 17459,
profiling (18.583 ms) : 18398, 18767
.   : milestone, 18583,
tracing (18.705 ms) : 18518, 18893
.   : milestone, 18705,
section candidate
no_agent (19.166 ms) : 18968, 19364
.   : milestone, 19166,
appsec (19.209 ms) : 19017, 19401
.   : milestone, 19209,
code_origins (18.075 ms) : 17889, 18262
.   : milestone, 18075,
iast (17.535 ms) : 17363, 17708
.   : milestone, 17535,
profiling (20.169 ms) : 19964, 20374
.   : milestone, 20169,
tracing (17.728 ms) : 17552, 17904
.   : milestone, 17728,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.534 ms [19.332 ms, 19.735 ms] -
appsec 19.858 ms [19.656 ms, 20.061 ms] 324.699 µs (1.7%)
code_origins 17.572 ms [17.394 ms, 17.751 ms] -1.961 ms (-10.0%)
iast 17.459 ms [17.286 ms, 17.632 ms] -2.074 ms (-10.6%)
profiling 18.583 ms [18.398 ms, 18.767 ms] -950.891 µs (-4.9%)
tracing 18.705 ms [18.518 ms, 18.893 ms] -828.341 µs (-4.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.166 ms [18.968 ms, 19.364 ms] -
appsec 19.209 ms [19.017 ms, 19.401 ms] 43.017 µs (0.2%)
code_origins 18.075 ms [17.889 ms, 18.262 ms] -1.091 ms (-5.7%)
iast 17.535 ms [17.363 ms, 17.708 ms] -1.63 ms (-8.5%)
profiling 20.169 ms [19.964 ms, 20.374 ms] 1.003 ms (5.2%)
tracing 17.728 ms [17.552 ms, 17.904 ms] -1.438 ms (-7.5%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/npe
git_commit_date 1765529699 1765537502
git_commit_sha 552ae2b 0521eba
release_version 1.57.0-SNAPSHOT~552ae2be7d 1.57.0-SNAPSHOT~0521eba6a1
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1765539691 1765539691
ci_job_id 1290253786 1290253786
ci_pipeline_id 86441177 86441177
cpu_model Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-pvov82c4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-pvov82c4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~0521eba6a1, baseline=1.57.0-SNAPSHOT~552ae2be7d
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.486 ms) : 1475, 1498
.   : milestone, 1486,
appsec (2.796 ms) : 2712, 2880
.   : milestone, 2796,
iast (2.588 ms) : 2486, 2690
.   : milestone, 2588,
iast_GLOBAL (2.631 ms) : 2529, 2733
.   : milestone, 2631,
profiling (2.446 ms) : 2358, 2534
.   : milestone, 2446,
tracing (2.384 ms) : 2301, 2467
.   : milestone, 2384,
section candidate
no_agent (1.496 ms) : 1485, 1508
.   : milestone, 1496,
appsec (4.166 ms) : 3912, 4421
.   : milestone, 4166,
iast (2.585 ms) : 2483, 2686
.   : milestone, 2585,
iast_GLOBAL (2.623 ms) : 2521, 2724
.   : milestone, 2623,
profiling (2.393 ms) : 2307, 2478
.   : milestone, 2393,
tracing (2.376 ms) : 2292, 2459
.   : milestone, 2376,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.486 ms [1.475 ms, 1.498 ms] -
appsec 2.796 ms [2.712 ms, 2.88 ms] 1.309 ms (88.1%)
iast 2.588 ms [2.486 ms, 2.69 ms] 1.101 ms (74.1%)
iast_GLOBAL 2.631 ms [2.529 ms, 2.733 ms] 1.145 ms (77.0%)
profiling 2.446 ms [2.358 ms, 2.534 ms] 959.118 µs (64.5%)
tracing 2.384 ms [2.301 ms, 2.467 ms] 897.451 µs (60.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.496 ms [1.485 ms, 1.508 ms] -
appsec 4.166 ms [3.912 ms, 4.421 ms] 2.67 ms (178.4%)
iast 2.585 ms [2.483 ms, 2.686 ms] 1.088 ms (72.7%)
iast_GLOBAL 2.623 ms [2.521 ms, 2.724 ms] 1.126 ms (75.3%)
profiling 2.393 ms [2.307 ms, 2.478 ms] 896.247 µs (59.9%)
tracing 2.376 ms [2.292 ms, 2.459 ms] 879.306 µs (58.8%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~0521eba6a1, baseline=1.57.0-SNAPSHOT~552ae2be7d
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.224 s) : 15224000, 15224000
.   : milestone, 15224000,
appsec (14.344 s) : 14344000, 14344000
.   : milestone, 14344000,
iast (17.338 s) : 17338000, 17338000
.   : milestone, 17338000,
iast_GLOBAL (17.043 s) : 17043000, 17043000
.   : milestone, 17043000,
profiling (14.754 s) : 14754000, 14754000
.   : milestone, 14754000,
tracing (14.109 s) : 14109000, 14109000
.   : milestone, 14109000,
section candidate
no_agent (15.115 s) : 15115000, 15115000
.   : milestone, 15115000,
appsec (14.592 s) : 14592000, 14592000
.   : milestone, 14592000,
iast (17.663 s) : 17663000, 17663000
.   : milestone, 17663000,
iast_GLOBAL (17.058 s) : 17058000, 17058000
.   : milestone, 17058000,
profiling (14.25 s) : 14250000, 14250000
.   : milestone, 14250000,
tracing (14.259 s) : 14259000, 14259000
.   : milestone, 14259000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.224 s [15.224 s, 15.224 s] -
appsec 14.344 s [14.344 s, 14.344 s] -880.0 ms (-5.8%)
iast 17.338 s [17.338 s, 17.338 s] 2.114 s (13.9%)
iast_GLOBAL 17.043 s [17.043 s, 17.043 s] 1.819 s (11.9%)
profiling 14.754 s [14.754 s, 14.754 s] -470.0 ms (-3.1%)
tracing 14.109 s [14.109 s, 14.109 s] -1.115 s (-7.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.115 s [15.115 s, 15.115 s] -
appsec 14.592 s [14.592 s, 14.592 s] -523.0 ms (-3.5%)
iast 17.663 s [17.663 s, 17.663 s] 2.548 s (16.9%)
iast_GLOBAL 17.058 s [17.058 s, 17.058 s] 1.943 s (12.9%)
profiling 14.25 s [14.25 s, 14.25 s] -865.0 ms (-5.7%)
tracing 14.259 s [14.259 s, 14.259 s] -856.0 ms (-5.7%)