Home Original page

Fix NullPointerException when scope failure by jpbempel · Pull Request #10333 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/fix-npe-symdb
git_commit_date 1768211823 1768214894
git_commit_sha d184301 cb6b12f
release_version 1.59.0-SNAPSHOT~d184301c7c 1.59.0-SNAPSHOT~cb6b12f992
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1768216727 1768216727
ci_job_id 1342421796 1342421796
ci_pipeline_id 90154734 90154734
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-va5uyfz5 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-va5uyfz5 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 61 metrics, 4 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.59.0-SNAPSHOT~cb6b12f992, baseline=1.59.0-SNAPSHOT~d184301c7c

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.081 s) : 0, 1080664
Total [baseline] (8.742 s) : 0, 8741811
Agent [candidate] (1.085 s) : 0, 1085308
Total [candidate] (8.713 s) : 0, 8712713
section iast
Agent [baseline] (1.221 s) : 0, 1221024
Total [baseline] (9.276 s) : 0, 9275584
Agent [candidate] (1.229 s) : 0, 1229074
Total [candidate] (9.305 s) : 0, 9304922
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.081 s -
Agent iast 1.221 s 140.361 ms (13.0%)
Total tracing 8.742 s -
Total iast 9.276 s 533.773 ms (6.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.085 s -
Agent iast 1.229 s 143.766 ms (13.2%)
Total tracing 8.713 s -
Total iast 9.305 s 592.209 ms (6.8%) 
gantt
    title insecure-bank - break down per module: candidate=1.59.0-SNAPSHOT~cb6b12f992, baseline=1.59.0-SNAPSHOT~d184301c7c

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.178 ms) : 0, 1178
crashtracking [candidate] (1.182 ms) : 0, 1182
BytebuddyAgent [baseline] (649.355 ms) : 0, 649355
BytebuddyAgent [candidate] (650.731 ms) : 0, 650731
GlobalTracer [baseline] (281.829 ms) : 0, 281829
GlobalTracer [candidate] (284.508 ms) : 0, 284508
AppSec [baseline] (32.418 ms) : 0, 32418
AppSec [candidate] (32.889 ms) : 0, 32889
Debugger [baseline] (67.081 ms) : 0, 67081
Debugger [candidate] (67.262 ms) : 0, 67262
Remote Config [baseline] (629.163 µs) : 0, 629
Remote Config [candidate] (607.172 µs) : 0, 607
Telemetry [baseline] (9.0 ms) : 0, 9000
Telemetry [candidate] (8.998 ms) : 0, 8998
Flare Poller [baseline] (3.712 ms) : 0, 3712
Flare Poller [candidate] (3.722 ms) : 0, 3722
section iast
crashtracking [baseline] (1.178 ms) : 0, 1178
crashtracking [candidate] (1.186 ms) : 0, 1186
BytebuddyAgent [baseline] (789.719 ms) : 0, 789719
BytebuddyAgent [candidate] (795.586 ms) : 0, 795586
GlobalTracer [baseline] (255.506 ms) : 0, 255506
GlobalTracer [candidate] (257.049 ms) : 0, 257049
AppSec [baseline] (35.296 ms) : 0, 35296
AppSec [candidate] (35.27 ms) : 0, 35270
Debugger [baseline] (64.08 ms) : 0, 64080
Debugger [candidate] (64.734 ms) : 0, 64734
Remote Config [baseline] (601.362 µs) : 0, 601
Remote Config [candidate] (627.386 µs) : 0, 627
Telemetry [baseline] (8.527 ms) : 0, 8527
Telemetry [candidate] (8.486 ms) : 0, 8486
Flare Poller [baseline] (3.567 ms) : 0, 3567
Flare Poller [candidate] (3.546 ms) : 0, 3546
IAST [baseline] (27.204 ms) : 0, 27204
IAST [candidate] (27.196 ms) : 0, 27196
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.59.0-SNAPSHOT~cb6b12f992, baseline=1.59.0-SNAPSHOT~d184301c7c

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.093 s) : 0, 1092629
Total [baseline] (10.9 s) : 0, 10899542
Agent [candidate] (1.091 s) : 0, 1090889
Total [candidate] (10.843 s) : 0, 10843307
section appsec
Agent [baseline] (1.265 s) : 0, 1264829
Total [baseline] (10.92 s) : 0, 10919749
Agent [candidate] (1.264 s) : 0, 1264034
Total [candidate] (11.009 s) : 0, 11009090
section iast
Agent [baseline] (1.225 s) : 0, 1224537
Total [baseline] (11.13 s) : 0, 11129979
Agent [candidate] (1.221 s) : 0, 1221014
Total [candidate] (11.217 s) : 0, 11217108
section profiling
Agent [baseline] (1.212 s) : 0, 1211782
Total [baseline] (10.919 s) : 0, 10919175
Agent [candidate] (1.212 s) : 0, 1211750
Total [candidate] (10.957 s) : 0, 10957129
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.093 s -
Agent appsec 1.265 s 172.2 ms (15.8%)
Agent iast 1.225 s 131.908 ms (12.1%)
Agent profiling 1.212 s 119.153 ms (10.9%)
Total tracing 10.9 s -
Total appsec 10.92 s 20.207 ms (0.2%)
Total iast 11.13 s 230.438 ms (2.1%)
Total profiling 10.919 s 19.633 ms (0.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.091 s -
Agent appsec 1.264 s 173.146 ms (15.9%)
Agent iast 1.221 s 130.125 ms (11.9%)
Agent profiling 1.212 s 120.861 ms (11.1%)
Total tracing 10.843 s -
Total appsec 11.009 s 165.783 ms (1.5%)
Total iast 11.217 s 373.8 ms (3.4%)
Total profiling 10.957 s 113.821 ms (1.0%) 
gantt
    title petclinic - break down per module: candidate=1.59.0-SNAPSHOT~cb6b12f992, baseline=1.59.0-SNAPSHOT~d184301c7c

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.188 ms) : 0, 1188
crashtracking [candidate] (1.182 ms) : 0, 1182
BytebuddyAgent [baseline] (655.822 ms) : 0, 655822
BytebuddyAgent [candidate] (654.691 ms) : 0, 654691
GlobalTracer [baseline] (284.676 ms) : 0, 284676
GlobalTracer [candidate] (283.975 ms) : 0, 283975
AppSec [baseline] (32.834 ms) : 0, 32834
AppSec [candidate] (33.038 ms) : 0, 33038
Debugger [baseline] (68.747 ms) : 0, 68747
Debugger [candidate] (68.899 ms) : 0, 68899
Remote Config [baseline] (648.402 µs) : 0, 648
Remote Config [candidate] (630.042 µs) : 0, 630
Telemetry [baseline] (9.207 ms) : 0, 9207
Telemetry [candidate] (9.127 ms) : 0, 9127
Flare Poller [baseline] (3.793 ms) : 0, 3793
Flare Poller [candidate] (3.783 ms) : 0, 3783
section appsec
crashtracking [baseline] (1.176 ms) : 0, 1176
crashtracking [candidate] (1.18 ms) : 0, 1180
BytebuddyAgent [baseline] (690.185 ms) : 0, 690185
BytebuddyAgent [candidate] (690.596 ms) : 0, 690596
GlobalTracer [baseline] (258.314 ms) : 0, 258314
GlobalTracer [candidate] (258.513 ms) : 0, 258513
AppSec [baseline] (173.644 ms) : 0, 173644
AppSec [candidate] (173.654 ms) : 0, 173654
Debugger [baseline] (67.342 ms) : 0, 67342
Debugger [candidate] (66.393 ms) : 0, 66393
Remote Config [baseline] (740.392 µs) : 0, 740
Remote Config [candidate] (769.953 µs) : 0, 770
Telemetry [baseline] (9.451 ms) : 0, 9451
Telemetry [candidate] (9.281 ms) : 0, 9281
Flare Poller [baseline] (3.839 ms) : 0, 3839
Flare Poller [candidate] (3.689 ms) : 0, 3689
IAST [baseline] (24.693 ms) : 0, 24693
IAST [candidate] (24.557 ms) : 0, 24557
section iast
crashtracking [baseline] (1.189 ms) : 0, 1189
crashtracking [candidate] (1.181 ms) : 0, 1181
BytebuddyAgent [baseline] (791.173 ms) : 0, 791173
BytebuddyAgent [candidate] (789.548 ms) : 0, 789548
GlobalTracer [baseline] (255.768 ms) : 0, 255768
GlobalTracer [candidate] (255.017 ms) : 0, 255017
AppSec [baseline] (33.767 ms) : 0, 33767
AppSec [candidate] (35.105 ms) : 0, 35105
Debugger [baseline] (67.394 ms) : 0, 67394
Debugger [candidate] (65.081 ms) : 0, 65081
Remote Config [baseline] (635.913 µs) : 0, 636
Remote Config [candidate] (630.714 µs) : 0, 631
Telemetry [baseline] (8.692 ms) : 0, 8692
Telemetry [candidate] (8.571 ms) : 0, 8571
Flare Poller [baseline] (3.588 ms) : 0, 3588
Flare Poller [candidate] (3.612 ms) : 0, 3612
IAST [baseline] (26.931 ms) : 0, 26931
IAST [candidate] (27.017 ms) : 0, 27017
section profiling
crashtracking [baseline] (1.219 ms) : 0, 1219
crashtracking [candidate] (1.221 ms) : 0, 1221
BytebuddyAgent [baseline] (706.525 ms) : 0, 706525
BytebuddyAgent [candidate] (707.24 ms) : 0, 707240
GlobalTracer [baseline] (222.018 ms) : 0, 222018
GlobalTracer [candidate] (221.826 ms) : 0, 221826
AppSec [baseline] (32.642 ms) : 0, 32642
AppSec [candidate] (32.529 ms) : 0, 32529
Debugger [baseline] (68.626 ms) : 0, 68626
Debugger [candidate] (68.513 ms) : 0, 68513
Remote Config [baseline] (660.229 µs) : 0, 660
Remote Config [candidate] (643.482 µs) : 0, 643
Telemetry [baseline] (8.919 ms) : 0, 8919
Telemetry [candidate] (8.775 ms) : 0, 8775
Flare Poller [baseline] (3.747 ms) : 0, 3747
Flare Poller [candidate] (3.656 ms) : 0, 3656
ProfilingAgent [baseline] (97.232 ms) : 0, 97232
ProfilingAgent [candidate] (97.2 ms) : 0, 97200
Profiling [baseline] (97.816 ms) : 0, 97816
Profiling [candidate] (97.792 ms) : 0, 97792
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/fix-npe-symdb
git_commit_date 1768211823 1768214894
git_commit_sha d184301 cb6b12f
release_version 1.59.0-SNAPSHOT~d184301c7c 1.59.0-SNAPSHOT~cb6b12f992
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1768217217 1768217217
ci_job_id 1342421798 1342421798
ci_pipeline_id 90154734 90154734
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-f2yhwa16 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-f2yhwa16 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 2 performance regressions! Performance is the same for 17 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:petclinic:code_origins:high_load worse
[+506.606µs; +992.646µs] or [+2.918%; +5.718%]		 unsure
[+336.284µs; +1488.186µs] or [+1.176%; +5.206%]		 unstable
[-36.750op/s; +15.937op/s] or [-13.937%; +6.044%]		 18.108ms 29.497ms 253.281op/s 17.359ms 28.584ms 263.688op/s
scenario:load:petclinic:profiling:high_load worse
[+528.706µs; +1316.039µs] or [+2.883%; +7.177%]		 unsure
[+7.199µs; +1821.922µs] or [+0.024%; +6.079%]		 unstable
[-35.399op/s; +15.149op/s] or [-14.199%; +6.076%]		 19.258ms 30.886ms 239.188op/s 18.336ms 29.971ms 249.312op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~cb6b12f992, baseline=1.59.0-SNAPSHOT~d184301c7c
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.185 ms) : 1173, 1197
.   : milestone, 1185,
iast (3.19 ms) : 3154, 3227
.   : milestone, 3190,
iast_FULL (5.835 ms) : 5777, 5893
.   : milestone, 5835,
iast_GLOBAL (3.491 ms) : 3444, 3538
.   : milestone, 3491,
profiling (2.052 ms) : 2033, 2071
.   : milestone, 2052,
tracing (1.752 ms) : 1738, 1766
.   : milestone, 1752,
section candidate
no_agent (1.192 ms) : 1180, 1204
.   : milestone, 1192,
iast (3.249 ms) : 3202, 3296
.   : milestone, 3249,
iast_FULL (5.985 ms) : 5924, 6046
.   : milestone, 5985,
iast_GLOBAL (3.585 ms) : 3532, 3637
.   : milestone, 3585,
profiling (2.07 ms) : 2052, 2088
.   : milestone, 2070,
tracing (1.803 ms) : 1788, 1818
.   : milestone, 1803,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.185 ms [1.173 ms, 1.197 ms] -
iast 3.19 ms [3.154 ms, 3.227 ms] 2.005 ms (169.2%)
iast_FULL 5.835 ms [5.777 ms, 5.893 ms] 4.65 ms (392.4%)
iast_GLOBAL 3.491 ms [3.444 ms, 3.538 ms] 2.306 ms (194.6%)
profiling 2.052 ms [2.033 ms, 2.071 ms] 867.082 µs (73.2%)
tracing 1.752 ms [1.738 ms, 1.766 ms] 567.022 µs (47.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.192 ms [1.18 ms, 1.204 ms] -
iast 3.249 ms [3.202 ms, 3.296 ms] 2.057 ms (172.5%)
iast_FULL 5.985 ms [5.924 ms, 6.046 ms] 4.793 ms (402.1%)
iast_GLOBAL 3.585 ms [3.532 ms, 3.637 ms] 2.393 ms (200.7%)
profiling 2.07 ms [2.052 ms, 2.088 ms] 878.134 µs (73.7%)
tracing 1.803 ms [1.788 ms, 1.818 ms] 611.141 µs (51.3%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~cb6b12f992, baseline=1.59.0-SNAPSHOT~d184301c7c
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.386 ms) : 18199, 18574
.   : milestone, 18386,
appsec (18.725 ms) : 18533, 18918
.   : milestone, 18725,
code_origins (17.693 ms) : 17516, 17871
.   : milestone, 17693,
iast (17.784 ms) : 17606, 17962
.   : milestone, 17784,
profiling (18.721 ms) : 18531, 18911
.   : milestone, 18721,
tracing (17.735 ms) : 17559, 17911
.   : milestone, 17735,
section candidate
no_agent (18.062 ms) : 17877, 18246
.   : milestone, 18062,
appsec (18.734 ms) : 18545, 18923
.   : milestone, 18734,
code_origins (18.426 ms) : 18241, 18611
.   : milestone, 18426,
iast (17.686 ms) : 17510, 17862
.   : milestone, 17686,
profiling (19.513 ms) : 19318, 19709
.   : milestone, 19513,
tracing (17.86 ms) : 17679, 18041
.   : milestone, 17860,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.386 ms [18.199 ms, 18.574 ms] -
appsec 18.725 ms [18.533 ms, 18.918 ms] 338.987 µs (1.8%)
code_origins 17.693 ms [17.516 ms, 17.871 ms] -692.951 µs (-3.8%)
iast 17.784 ms [17.606 ms, 17.962 ms] -602.45 µs (-3.3%)
profiling 18.721 ms [18.531 ms, 18.911 ms] 334.776 µs (1.8%)
tracing 17.735 ms [17.559 ms, 17.911 ms] -651.501 µs (-3.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.062 ms [17.877 ms, 18.246 ms] -
appsec 18.734 ms [18.545 ms, 18.923 ms] 672.341 µs (3.7%)
code_origins 18.426 ms [18.241 ms, 18.611 ms] 364.247 µs (2.0%)
iast 17.686 ms [17.51 ms, 17.862 ms] -375.464 µs (-2.1%)
profiling 19.513 ms [19.318 ms, 19.709 ms] 1.452 ms (8.0%)
tracing 17.86 ms [17.679 ms, 18.041 ms] -201.591 µs (-1.1%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/fix-npe-symdb
git_commit_date 1768211823 1768214894
git_commit_sha d184301 cb6b12f
release_version 1.59.0-SNAPSHOT~d184301c7c 1.59.0-SNAPSHOT~cb6b12f992
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1768216815 1768216815
ci_job_id 1342421800 1342421800
ci_pipeline_id 90154734 90154734
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-yp33ymui 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-yp33ymui 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~cb6b12f992, baseline=1.59.0-SNAPSHOT~d184301c7c
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.923 s) : 14923000, 14923000
.   : milestone, 14923000,
appsec (14.502 s) : 14502000, 14502000
.   : milestone, 14502000,
iast (18.252 s) : 18252000, 18252000
.   : milestone, 18252000,
iast_GLOBAL (17.411 s) : 17411000, 17411000
.   : milestone, 17411000,
profiling (15.393 s) : 15393000, 15393000
.   : milestone, 15393000,
tracing (14.84 s) : 14840000, 14840000
.   : milestone, 14840000,
section candidate
no_agent (15.618 s) : 15618000, 15618000
.   : milestone, 15618000,
appsec (14.638 s) : 14638000, 14638000
.   : milestone, 14638000,
iast (17.829 s) : 17829000, 17829000
.   : milestone, 17829000,
iast_GLOBAL (17.653 s) : 17653000, 17653000
.   : milestone, 17653000,
profiling (14.945 s) : 14945000, 14945000
.   : milestone, 14945000,
tracing (14.84 s) : 14840000, 14840000
.   : milestone, 14840000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.923 s [14.923 s, 14.923 s] -
appsec 14.502 s [14.502 s, 14.502 s] -421.0 ms (-2.8%)
iast 18.252 s [18.252 s, 18.252 s] 3.329 s (22.3%)
iast_GLOBAL 17.411 s [17.411 s, 17.411 s] 2.488 s (16.7%)
profiling 15.393 s [15.393 s, 15.393 s] 470.0 ms (3.1%)
tracing 14.84 s [14.84 s, 14.84 s] -83.0 ms (-0.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.618 s [15.618 s, 15.618 s] -
appsec 14.638 s [14.638 s, 14.638 s] -980.0 ms (-6.3%)
iast 17.829 s [17.829 s, 17.829 s] 2.211 s (14.2%)
iast_GLOBAL 17.653 s [17.653 s, 17.653 s] 2.035 s (13.0%)
profiling 14.945 s [14.945 s, 14.945 s] -673.0 ms (-4.3%)
tracing 14.84 s [14.84 s, 14.84 s] -778.0 ms (-5.0%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~cb6b12f992, baseline=1.59.0-SNAPSHOT~d184301c7c
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.474 ms) : 1462, 1485
.   : milestone, 1474,
appsec (3.707 ms) : 3487, 3926
.   : milestone, 3707,
iast (2.209 ms) : 2144, 2274
.   : milestone, 2209,
iast_GLOBAL (2.261 ms) : 2195, 2327
.   : milestone, 2261,
profiling (2.088 ms) : 2034, 2143
.   : milestone, 2088,
tracing (2.045 ms) : 1994, 2097
.   : milestone, 2045,
section candidate
no_agent (1.478 ms) : 1466, 1490
.   : milestone, 1478,
appsec (3.705 ms) : 3486, 3925
.   : milestone, 3705,
iast (2.218 ms) : 2153, 2283
.   : milestone, 2218,
iast_GLOBAL (2.26 ms) : 2194, 2325
.   : milestone, 2260,
profiling (2.075 ms) : 2022, 2129
.   : milestone, 2075,
tracing (2.055 ms) : 2004, 2107
.   : milestone, 2055,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.462 ms, 1.485 ms] -
appsec 3.707 ms [3.487 ms, 3.926 ms] 2.233 ms (151.5%)
iast 2.209 ms [2.144 ms, 2.274 ms] 735.489 µs (49.9%)
iast_GLOBAL 2.261 ms [2.195 ms, 2.327 ms] 787.312 µs (53.4%)
profiling 2.088 ms [2.034 ms, 2.143 ms] 614.483 µs (41.7%)
tracing 2.045 ms [1.994 ms, 2.097 ms] 571.591 µs (38.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.478 ms [1.466 ms, 1.49 ms] -
appsec 3.705 ms [3.486 ms, 3.925 ms] 2.227 ms (150.7%)
iast 2.218 ms [2.153 ms, 2.283 ms] 740.28 µs (50.1%)
iast_GLOBAL 2.26 ms [2.194 ms, 2.325 ms] 781.832 µs (52.9%)
profiling 2.075 ms [2.022 ms, 2.129 ms] 597.498 µs (40.4%)
tracing 2.055 ms [2.004 ms, 2.107 ms] 577.511 µs (39.1%)