Home Original page

Avoid NPE when enumerating servlet headers by amarziali · Pull Request #10213 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/headernames
git_commit_date 1765641521 1765795895
git_commit_sha fef9d16 d1f7dd1
release_version 1.57.0-SNAPSHOT~fef9d162d8 1.57.0-SNAPSHOT~d1f7dd18c1
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1765797626 1765797626
ci_job_id 1294739761 1294739761
ci_pipeline_id 86737706 86737706
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-4-ouroj2c2 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-4-ouroj2c2 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 57 metrics, 8 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.57.0-SNAPSHOT~d1f7dd18c1, baseline=1.57.0-SNAPSHOT~fef9d162d8

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.078 s) : 0, 1078438
Total [baseline] (8.737 s) : 0, 8737184
Agent [candidate] (1.089 s) : 0, 1088524
Total [candidate] (8.741 s) : 0, 8740850
section iast
Agent [baseline] (1.226 s) : 0, 1225970
Total [baseline] (9.353 s) : 0, 9353234
Agent [candidate] (1.237 s) : 0, 1237159
Total [candidate] (9.407 s) : 0, 9407226
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.078 s -
Agent iast 1.226 s 147.532 ms (13.7%)
Total tracing 8.737 s -
Total iast 9.353 s 616.05 ms (7.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.089 s -
Agent iast 1.237 s 148.635 ms (13.7%)
Total tracing 8.741 s -
Total iast 9.407 s 666.376 ms (7.6%) 
gantt
    title insecure-bank - break down per module: candidate=1.57.0-SNAPSHOT~d1f7dd18c1, baseline=1.57.0-SNAPSHOT~fef9d162d8

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.181 ms) : 0, 1181
crashtracking [candidate] (1.202 ms) : 0, 1202
BytebuddyAgent [baseline] (647.892 ms) : 0, 647892
BytebuddyAgent [candidate] (653.888 ms) : 0, 653888
GlobalTracer [baseline] (281.392 ms) : 0, 281392
GlobalTracer [candidate] (283.584 ms) : 0, 283584
AppSec [baseline] (32.247 ms) : 0, 32247
AppSec [candidate] (32.57 ms) : 0, 32570
Debugger [baseline] (66.961 ms) : 0, 66961
Debugger [candidate] (67.993 ms) : 0, 67993
Remote Config [baseline] (629.584 µs) : 0, 630
Remote Config [candidate] (647.511 µs) : 0, 648
Telemetry [baseline] (8.957 ms) : 0, 8957
Telemetry [candidate] (9.026 ms) : 0, 9026
Flare Poller [baseline] (3.666 ms) : 0, 3666
Flare Poller [candidate] (3.785 ms) : 0, 3785
section iast
crashtracking [baseline] (1.19 ms) : 0, 1190
crashtracking [candidate] (1.195 ms) : 0, 1195
BytebuddyAgent [baseline] (794.566 ms) : 0, 794566
BytebuddyAgent [candidate] (802.253 ms) : 0, 802253
GlobalTracer [baseline] (255.657 ms) : 0, 255657
GlobalTracer [candidate] (259.04 ms) : 0, 259040
AppSec [baseline] (34.431 ms) : 0, 34431
AppSec [candidate] (33.943 ms) : 0, 33943
Debugger [baseline] (65.101 ms) : 0, 65101
Debugger [candidate] (65.327 ms) : 0, 65327
Remote Config [baseline] (540.709 µs) : 0, 541
Remote Config [candidate] (557.115 µs) : 0, 557
Telemetry [baseline] (8.443 ms) : 0, 8443
Telemetry [candidate] (8.335 ms) : 0, 8335
Flare Poller [baseline] (3.496 ms) : 0, 3496
Flare Poller [candidate] (3.466 ms) : 0, 3466
IAST [baseline] (26.963 ms) : 0, 26963
IAST [candidate] (27.287 ms) : 0, 27287
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.57.0-SNAPSHOT~d1f7dd18c1, baseline=1.57.0-SNAPSHOT~fef9d162d8

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.079 s) : 0, 1078645
Total [baseline] (10.845 s) : 0, 10845162
Agent [candidate] (1.082 s) : 0, 1082410
Total [candidate] (10.859 s) : 0, 10858686
section appsec
Agent [baseline] (1.26 s) : 0, 1260218
Total [baseline] (10.977 s) : 0, 10977221
Agent [candidate] (1.265 s) : 0, 1264664
Total [candidate] (11.05 s) : 0, 11049872
section iast
Agent [baseline] (1.229 s) : 0, 1229434
Total [baseline] (11.262 s) : 0, 11262337
Agent [candidate] (1.23 s) : 0, 1229510
Total [candidate] (11.224 s) : 0, 11224304
section profiling
Agent [baseline] (1.213 s) : 0, 1212759
Total [baseline] (10.999 s) : 0, 10998946
Agent [candidate] (1.213 s) : 0, 1212788
Total [candidate] (10.975 s) : 0, 10975234
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.079 s -
Agent appsec 1.26 s 181.573 ms (16.8%)
Agent iast 1.229 s 150.789 ms (14.0%)
Agent profiling 1.213 s 134.113 ms (12.4%)
Total tracing 10.845 s -
Total appsec 10.977 s 132.059 ms (1.2%)
Total iast 11.262 s 417.175 ms (3.8%)
Total profiling 10.999 s 153.783 ms (1.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.082 s -
Agent appsec 1.265 s 182.253 ms (16.8%)
Agent iast 1.23 s 147.1 ms (13.6%)
Agent profiling 1.213 s 130.378 ms (12.0%)
Total tracing 10.859 s -
Total appsec 11.05 s 191.186 ms (1.8%)
Total iast 11.224 s 365.618 ms (3.4%)
Total profiling 10.975 s 116.548 ms (1.1%) 
gantt
    title petclinic - break down per module: candidate=1.57.0-SNAPSHOT~d1f7dd18c1, baseline=1.57.0-SNAPSHOT~fef9d162d8

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.177 ms) : 0, 1177
crashtracking [candidate] (1.191 ms) : 0, 1191
BytebuddyAgent [baseline] (647.759 ms) : 0, 647759
BytebuddyAgent [candidate] (649.926 ms) : 0, 649926
GlobalTracer [baseline] (281.19 ms) : 0, 281190
GlobalTracer [candidate] (282.023 ms) : 0, 282023
AppSec [baseline] (32.214 ms) : 0, 32214
AppSec [candidate] (32.178 ms) : 0, 32178
Debugger [baseline] (67.619 ms) : 0, 67619
Debugger [candidate] (68.123 ms) : 0, 68123
Remote Config [baseline] (652.934 µs) : 0, 653
Remote Config [candidate] (630.682 µs) : 0, 631
Telemetry [baseline] (8.929 ms) : 0, 8929
Telemetry [candidate] (9.089 ms) : 0, 9089
Flare Poller [baseline] (3.738 ms) : 0, 3738
Flare Poller [candidate] (3.782 ms) : 0, 3782
section appsec
crashtracking [baseline] (1.173 ms) : 0, 1173
crashtracking [candidate] (1.178 ms) : 0, 1178
BytebuddyAgent [baseline] (686.969 ms) : 0, 686969
BytebuddyAgent [candidate] (689.331 ms) : 0, 689331
GlobalTracer [baseline] (257.825 ms) : 0, 257825
GlobalTracer [candidate] (258.265 ms) : 0, 258265
AppSec [baseline] (174.652 ms) : 0, 174652
AppSec [candidate] (174.882 ms) : 0, 174882
Debugger [baseline] (66.277 ms) : 0, 66277
Debugger [candidate] (67.196 ms) : 0, 67196
Remote Config [baseline] (711.684 µs) : 0, 712
Remote Config [candidate] (692.012 µs) : 0, 692
Telemetry [baseline] (9.027 ms) : 0, 9027
Telemetry [candidate] (9.134 ms) : 0, 9134
Flare Poller [baseline] (3.756 ms) : 0, 3756
Flare Poller [candidate] (3.942 ms) : 0, 3942
IAST [baseline] (24.339 ms) : 0, 24339
IAST [candidate] (24.508 ms) : 0, 24508
section iast
crashtracking [baseline] (1.181 ms) : 0, 1181
crashtracking [candidate] (1.181 ms) : 0, 1181
BytebuddyAgent [baseline] (795.366 ms) : 0, 795366
BytebuddyAgent [candidate] (796.374 ms) : 0, 796374
GlobalTracer [baseline] (256.874 ms) : 0, 256874
GlobalTracer [candidate] (256.999 ms) : 0, 256999
AppSec [baseline] (35.029 ms) : 0, 35029
AppSec [candidate] (34.343 ms) : 0, 34343
Debugger [baseline] (65.844 ms) : 0, 65844
Debugger [candidate] (65.701 ms) : 0, 65701
Remote Config [baseline] (576.154 µs) : 0, 576
Remote Config [candidate] (544.107 µs) : 0, 544
Telemetry [baseline] (8.478 ms) : 0, 8478
Telemetry [candidate] (8.388 ms) : 0, 8388
Flare Poller [baseline] (3.46 ms) : 0, 3460
Flare Poller [candidate] (3.521 ms) : 0, 3521
IAST [baseline] (27.075 ms) : 0, 27075
IAST [candidate] (27.035 ms) : 0, 27035
section profiling
crashtracking [baseline] (1.22 ms) : 0, 1220
crashtracking [candidate] (1.207 ms) : 0, 1207
BytebuddyAgent [baseline] (706.936 ms) : 0, 706936
BytebuddyAgent [candidate] (707.446 ms) : 0, 707446
GlobalTracer [baseline] (222.16 ms) : 0, 222160
GlobalTracer [candidate] (222.499 ms) : 0, 222499
AppSec [baseline] (32.437 ms) : 0, 32437
AppSec [candidate] (32.286 ms) : 0, 32286
Debugger [baseline] (68.47 ms) : 0, 68470
Debugger [candidate] (68.742 ms) : 0, 68742
Remote Config [baseline] (651.711 µs) : 0, 652
Remote Config [candidate] (658.612 µs) : 0, 659
Telemetry [baseline] (9.068 ms) : 0, 9068
Telemetry [candidate] (9.026 ms) : 0, 9026
Flare Poller [baseline] (3.734 ms) : 0, 3734
Flare Poller [candidate] (3.765 ms) : 0, 3765
ProfilingAgent [baseline] (97.745 ms) : 0, 97745
ProfilingAgent [candidate] (96.852 ms) : 0, 96852
Profiling [baseline] (98.332 ms) : 0, 98332
Profiling [candidate] (97.423 ms) : 0, 97423
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/headernames
git_commit_date 1765641521 1765795895
git_commit_sha fef9d16 d1f7dd1
release_version 1.57.0-SNAPSHOT~fef9d162d8 1.57.0-SNAPSHOT~d1f7dd18c1
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1765798199 1765798199
ci_job_id 1294739763 1294739763
ci_pipeline_id 86737706 86737706
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-5-vnv7xpfr 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-5-vnv7xpfr 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 1 performance regressions! Performance is the same for 18 metrics, 15 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:petclinic:tracing:high_load worse
[+0.822ms; +1.782ms] or [+4.775%; +10.353%]		 unsure
[+0.529ms; +2.133ms] or [+1.864%; +7.514%]		 unstable
[-42.843op/s; +12.030op/s] or [-16.186%; +4.545%]		 18.511ms 29.711ms 249.281op/s 17.209ms 28.380ms 264.688op/s
scenario:load:petclinic:profiling:high_load better
[-1.931ms; -1.026ms] or [-9.798%; -5.208%]		 better
[-2.637ms; -1.269ms] or [-8.369%; -4.027%]		 unstable
[-7.975op/s; +43.163op/s] or [-3.417%; +18.495%]		 18.226ms 29.561ms 250.969op/s 19.704ms 31.515ms 233.375op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~d1f7dd18c1, baseline=1.57.0-SNAPSHOT~fef9d162d8
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.203 ms) : 1191, 1214
.   : milestone, 1203,
iast (3.362 ms) : 3316, 3408
.   : milestone, 3362,
iast_FULL (5.675 ms) : 5619, 5732
.   : milestone, 5675,
iast_GLOBAL (3.651 ms) : 3594, 3709
.   : milestone, 3651,
profiling (2.081 ms) : 2062, 2100
.   : milestone, 2081,
tracing (1.858 ms) : 1841, 1875
.   : milestone, 1858,
section candidate
no_agent (1.199 ms) : 1188, 1211
.   : milestone, 1199,
iast (3.291 ms) : 3246, 3337
.   : milestone, 3291,
iast_FULL (5.779 ms) : 5723, 5836
.   : milestone, 5779,
iast_GLOBAL (3.64 ms) : 3588, 3693
.   : milestone, 3640,
profiling (1.979 ms) : 1961, 1997
.   : milestone, 1979,
tracing (1.823 ms) : 1807, 1838
.   : milestone, 1823,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.203 ms [1.191 ms, 1.214 ms] -
iast 3.362 ms [3.316 ms, 3.408 ms] 2.159 ms (179.5%)
iast_FULL 5.675 ms [5.619 ms, 5.732 ms] 4.473 ms (371.9%)
iast_GLOBAL 3.651 ms [3.594 ms, 3.709 ms] 2.449 ms (203.6%)
profiling 2.081 ms [2.062 ms, 2.1 ms] 878.224 µs (73.0%)
tracing 1.858 ms [1.841 ms, 1.875 ms] 655.496 µs (54.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.199 ms [1.188 ms, 1.211 ms] -
iast 3.291 ms [3.246 ms, 3.337 ms] 2.092 ms (174.4%)
iast_FULL 5.779 ms [5.723 ms, 5.836 ms] 4.58 ms (381.8%)
iast_GLOBAL 3.64 ms [3.588 ms, 3.693 ms] 2.441 ms (203.5%)
profiling 1.979 ms [1.961 ms, 1.997 ms] 779.747 µs (65.0%)
tracing 1.823 ms [1.807 ms, 1.838 ms] 623.388 µs (52.0%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~d1f7dd18c1, baseline=1.57.0-SNAPSHOT~fef9d162d8
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.141 ms) : 16968, 17314
.   : milestone, 17141,
appsec (19.586 ms) : 19387, 19786
.   : milestone, 19586,
code_origins (17.83 ms) : 17654, 18006
.   : milestone, 17830,
iast (17.582 ms) : 17408, 17756
.   : milestone, 17582,
profiling (20.005 ms) : 19804, 20207
.   : milestone, 20005,
tracing (17.624 ms) : 17450, 17799
.   : milestone, 17624,
section candidate
no_agent (17.147 ms) : 16976, 17319
.   : milestone, 17147,
appsec (18.845 ms) : 18652, 19037
.   : milestone, 18845,
code_origins (17.774 ms) : 17599, 17949
.   : milestone, 17774,
iast (17.6 ms) : 17427, 17772
.   : milestone, 17600,
profiling (18.594 ms) : 18408, 18780
.   : milestone, 18594,
tracing (18.724 ms) : 18534, 18913
.   : milestone, 18724,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.141 ms [16.968 ms, 17.314 ms] -
appsec 19.586 ms [19.387 ms, 19.786 ms] 2.446 ms (14.3%)
code_origins 17.83 ms [17.654 ms, 18.006 ms] 689.122 µs (4.0%)
iast 17.582 ms [17.408 ms, 17.756 ms] 441.185 µs (2.6%)
profiling 20.005 ms [19.804 ms, 20.207 ms] 2.865 ms (16.7%)
tracing 17.624 ms [17.45 ms, 17.799 ms] 483.855 µs (2.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.147 ms [16.976 ms, 17.319 ms] -
appsec 18.845 ms [18.652 ms, 19.037 ms] 1.698 ms (9.9%)
code_origins 17.774 ms [17.599 ms, 17.949 ms] 626.417 µs (3.7%)
iast 17.6 ms [17.427 ms, 17.772 ms] 452.233 µs (2.6%)
profiling 18.594 ms [18.408 ms, 18.78 ms] 1.447 ms (8.4%)
tracing 18.724 ms [18.534 ms, 18.913 ms] 1.577 ms (9.2%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/headernames
git_commit_date 1765641521 1765795895
git_commit_sha fef9d16 d1f7dd1
release_version 1.57.0-SNAPSHOT~fef9d162d8 1.57.0-SNAPSHOT~d1f7dd18c1
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1765797912 1765797912
ci_job_id 1294739765 1294739765
ci_pipeline_id 86737706 86737706
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-4-hmokzdqd 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-4-hmokzdqd 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:dacapo:tomcat:appsec better
[-1.368ms; -1.030ms] or [-37.271%; -28.072%]		 2.471ms 3.670ms
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~d1f7dd18c1, baseline=1.57.0-SNAPSHOT~fef9d162d8
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.475 ms) : 1464, 1487
.   : milestone, 1475,
appsec (3.67 ms) : 3454, 3885
.   : milestone, 3670,
iast (2.217 ms) : 2153, 2281
.   : milestone, 2217,
iast_GLOBAL (2.265 ms) : 2200, 2330
.   : milestone, 2265,
profiling (2.065 ms) : 2013, 2117
.   : milestone, 2065,
tracing (2.045 ms) : 1994, 2095
.   : milestone, 2045,
section candidate
no_agent (1.472 ms) : 1461, 1484
.   : milestone, 1472,
appsec (2.471 ms) : 2419, 2523
.   : milestone, 2471,
iast (2.214 ms) : 2150, 2279
.   : milestone, 2214,
iast_GLOBAL (2.259 ms) : 2194, 2324
.   : milestone, 2259,
profiling (2.093 ms) : 2038, 2147
.   : milestone, 2093,
tracing (2.047 ms) : 1996, 2098
.   : milestone, 2047,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.475 ms [1.464 ms, 1.487 ms] -
appsec 3.67 ms [3.454 ms, 3.885 ms] 2.195 ms (148.8%)
iast 2.217 ms [2.153 ms, 2.281 ms] 741.779 µs (50.3%)
iast_GLOBAL 2.265 ms [2.2 ms, 2.33 ms] 789.72 µs (53.5%)
profiling 2.065 ms [2.013 ms, 2.117 ms] 589.635 µs (40.0%)
tracing 2.045 ms [1.994 ms, 2.095 ms] 569.471 µs (38.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.472 ms [1.461 ms, 1.484 ms] -
appsec 2.471 ms [2.419 ms, 2.523 ms] 998.431 µs (67.8%)
iast 2.214 ms [2.15 ms, 2.279 ms] 741.826 µs (50.4%)
iast_GLOBAL 2.259 ms [2.194 ms, 2.324 ms] 786.597 µs (53.4%)
profiling 2.093 ms [2.038 ms, 2.147 ms] 620.321 µs (42.1%)
tracing 2.047 ms [1.996 ms, 2.098 ms] 574.791 µs (39.0%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~d1f7dd18c1, baseline=1.57.0-SNAPSHOT~fef9d162d8
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.876 s) : 14876000, 14876000
.   : milestone, 14876000,
appsec (14.632 s) : 14632000, 14632000
.   : milestone, 14632000,
iast (17.937 s) : 17937000, 17937000
.   : milestone, 17937000,
iast_GLOBAL (17.717 s) : 17717000, 17717000
.   : milestone, 17717000,
profiling (14.68 s) : 14680000, 14680000
.   : milestone, 14680000,
tracing (14.587 s) : 14587000, 14587000
.   : milestone, 14587000,
section candidate
no_agent (14.743 s) : 14743000, 14743000
.   : milestone, 14743000,
appsec (14.928 s) : 14928000, 14928000
.   : milestone, 14928000,
iast (18.077 s) : 18077000, 18077000
.   : milestone, 18077000,
iast_GLOBAL (17.736 s) : 17736000, 17736000
.   : milestone, 17736000,
profiling (14.611 s) : 14611000, 14611000
.   : milestone, 14611000,
tracing (14.74 s) : 14740000, 14740000
.   : milestone, 14740000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.876 s [14.876 s, 14.876 s] -
appsec 14.632 s [14.632 s, 14.632 s] -244.0 ms (-1.6%)
iast 17.937 s [17.937 s, 17.937 s] 3.061 s (20.6%)
iast_GLOBAL 17.717 s [17.717 s, 17.717 s] 2.841 s (19.1%)
profiling 14.68 s [14.68 s, 14.68 s] -196.0 ms (-1.3%)
tracing 14.587 s [14.587 s, 14.587 s] -289.0 ms (-1.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.743 s [14.743 s, 14.743 s] -
appsec 14.928 s [14.928 s, 14.928 s] 185.0 ms (1.3%)
iast 18.077 s [18.077 s, 18.077 s] 3.334 s (22.6%)
iast_GLOBAL 17.736 s [17.736 s, 17.736 s] 2.993 s (20.3%)
profiling 14.611 s [14.611 s, 14.611 s] -132.0 ms (-0.9%)
tracing 14.74 s [14.74 s, 14.74 s] -3.0 ms (-0.0%)