Home Original page

Avoid null store put on Ignite instrumentation by amarziali · Pull Request #10291 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/ignite-npe
git_commit_date 1767637205 1767691020
git_commit_sha bd3f6f5 5b77c73
release_version 1.58.0-SNAPSHOT~bd3f6f5c89 1.58.0-SNAPSHOT~5b77c73366
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1767692860 1767692860
ci_job_id 1328810132 1328810132
ci_pipeline_id 89132945 89132945
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-yk6i5qmg 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-yk6i5qmg 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 59 metrics, 6 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.58.0-SNAPSHOT~5b77c73366, baseline=1.58.0-SNAPSHOT~bd3f6f5c89

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.084 s) : 0, 1084142
Total [baseline] (8.762 s) : 0, 8762500
Agent [candidate] (1.089 s) : 0, 1088589
Total [candidate] (8.721 s) : 0, 8721481
section iast
Agent [baseline] (1.23 s) : 0, 1229606
Total [baseline] (9.291 s) : 0, 9291356
Agent [candidate] (1.225 s) : 0, 1225306
Total [candidate] (9.316 s) : 0, 9316495
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.084 s -
Agent iast 1.23 s 145.464 ms (13.4%)
Total tracing 8.762 s -
Total iast 9.291 s 528.856 ms (6.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.089 s -
Agent iast 1.225 s 136.717 ms (12.6%)
Total tracing 8.721 s -
Total iast 9.316 s 595.013 ms (6.8%) 
gantt
    title insecure-bank - break down per module: candidate=1.58.0-SNAPSHOT~5b77c73366, baseline=1.58.0-SNAPSHOT~bd3f6f5c89

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.177 ms) : 0, 1177
crashtracking [candidate] (1.193 ms) : 0, 1193
BytebuddyAgent [baseline] (652.291 ms) : 0, 652291
BytebuddyAgent [candidate] (653.56 ms) : 0, 653560
GlobalTracer [baseline] (281.702 ms) : 0, 281702
GlobalTracer [candidate] (284.094 ms) : 0, 284094
AppSec [baseline] (32.6 ms) : 0, 32600
AppSec [candidate] (32.826 ms) : 0, 32826
Debugger [baseline] (67.463 ms) : 0, 67463
Debugger [candidate] (67.986 ms) : 0, 67986
Remote Config [baseline] (616.793 µs) : 0, 617
Remote Config [candidate] (605.373 µs) : 0, 605
Telemetry [baseline] (8.996 ms) : 0, 8996
Telemetry [candidate] (8.975 ms) : 0, 8975
Flare Poller [baseline] (3.748 ms) : 0, 3748
Flare Poller [candidate] (3.74 ms) : 0, 3740
section iast
crashtracking [baseline] (1.197 ms) : 0, 1197
crashtracking [candidate] (1.181 ms) : 0, 1181
BytebuddyAgent [baseline] (796.528 ms) : 0, 796528
BytebuddyAgent [candidate] (792.176 ms) : 0, 792176
GlobalTracer [baseline] (256.913 ms) : 0, 256913
GlobalTracer [candidate] (257.301 ms) : 0, 257301
IAST [baseline] (27.36 ms) : 0, 27360
IAST [candidate] (27.315 ms) : 0, 27315
AppSec [baseline] (35.312 ms) : 0, 35312
AppSec [candidate] (34.348 ms) : 0, 34348
Debugger [baseline] (64.26 ms) : 0, 64260
Debugger [candidate] (65.007 ms) : 0, 65007
Remote Config [baseline] (569.524 µs) : 0, 570
Remote Config [candidate] (613.485 µs) : 0, 613
Telemetry [baseline] (8.497 ms) : 0, 8497
Telemetry [candidate] (8.472 ms) : 0, 8472
Flare Poller [baseline] (3.576 ms) : 0, 3576
Flare Poller [candidate] (3.585 ms) : 0, 3585
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.58.0-SNAPSHOT~5b77c73366, baseline=1.58.0-SNAPSHOT~bd3f6f5c89

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.08 s) : 0, 1079717
Total [baseline] (10.809 s) : 0, 10809256
Agent [candidate] (1.083 s) : 0, 1083200
Total [candidate] (10.805 s) : 0, 10804751
section appsec
Agent [baseline] (1.264 s) : 0, 1263658
Total [baseline] (10.94 s) : 0, 10939832
Agent [candidate] (1.263 s) : 0, 1263458
Total [candidate] (11.009 s) : 0, 11009228
section iast
Agent [baseline] (1.222 s) : 0, 1222246
Total [baseline] (11.07 s) : 0, 11070035
Agent [candidate] (1.228 s) : 0, 1228147
Total [candidate] (11.212 s) : 0, 11212443
section profiling
Agent [baseline] (1.202 s) : 0, 1202353
Total [baseline] (10.874 s) : 0, 10874253
Agent [candidate] (1.212 s) : 0, 1211857
Total [candidate] (10.881 s) : 0, 10881184
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.08 s -
Agent appsec 1.264 s 183.941 ms (17.0%)
Agent iast 1.222 s 142.529 ms (13.2%)
Agent profiling 1.202 s 122.636 ms (11.4%)
Total tracing 10.809 s -
Total appsec 10.94 s 130.576 ms (1.2%)
Total iast 11.07 s 260.779 ms (2.4%)
Total profiling 10.874 s 64.997 ms (0.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.083 s -
Agent appsec 1.263 s 180.258 ms (16.6%)
Agent iast 1.228 s 144.947 ms (13.4%)
Agent profiling 1.212 s 128.657 ms (11.9%)
Total tracing 10.805 s -
Total appsec 11.009 s 204.477 ms (1.9%)
Total iast 11.212 s 407.692 ms (3.8%)
Total profiling 10.881 s 76.433 ms (0.7%) 
gantt
    title petclinic - break down per module: candidate=1.58.0-SNAPSHOT~5b77c73366, baseline=1.58.0-SNAPSHOT~bd3f6f5c89

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.17 ms) : 0, 1170
crashtracking [candidate] (1.188 ms) : 0, 1188
BytebuddyAgent [baseline] (647.684 ms) : 0, 647684
BytebuddyAgent [candidate] (650.334 ms) : 0, 650334
GlobalTracer [baseline] (281.483 ms) : 0, 281483
GlobalTracer [candidate] (282.118 ms) : 0, 282118
AppSec [baseline] (32.469 ms) : 0, 32469
AppSec [candidate] (32.62 ms) : 0, 32620
Debugger [baseline] (68.301 ms) : 0, 68301
Debugger [candidate] (68.157 ms) : 0, 68157
Remote Config [baseline] (617.526 µs) : 0, 618
Remote Config [candidate] (598.681 µs) : 0, 599
Telemetry [baseline] (8.946 ms) : 0, 8946
Telemetry [candidate] (9.014 ms) : 0, 9014
Flare Poller [baseline] (3.734 ms) : 0, 3734
Flare Poller [candidate] (3.778 ms) : 0, 3778
section appsec
crashtracking [baseline] (1.183 ms) : 0, 1183
crashtracking [candidate] (1.177 ms) : 0, 1177
BytebuddyAgent [baseline] (689.778 ms) : 0, 689778
BytebuddyAgent [candidate] (689.638 ms) : 0, 689638
GlobalTracer [baseline] (257.955 ms) : 0, 257955
GlobalTracer [candidate] (257.938 ms) : 0, 257938
IAST [baseline] (24.53 ms) : 0, 24530
IAST [candidate] (24.62 ms) : 0, 24620
AppSec [baseline] (172.445 ms) : 0, 172445
AppSec [candidate] (172.66 ms) : 0, 172660
Debugger [baseline] (68.297 ms) : 0, 68297
Debugger [candidate] (68.213 ms) : 0, 68213
Remote Config [baseline] (759.28 µs) : 0, 759
Remote Config [candidate] (754.234 µs) : 0, 754
Telemetry [baseline] (9.504 ms) : 0, 9504
Telemetry [candidate] (9.282 ms) : 0, 9282
Flare Poller [baseline] (3.897 ms) : 0, 3897
Flare Poller [candidate] (3.821 ms) : 0, 3821
section iast
crashtracking [baseline] (1.185 ms) : 0, 1185
crashtracking [candidate] (1.183 ms) : 0, 1183
BytebuddyAgent [baseline] (791.671 ms) : 0, 791671
BytebuddyAgent [candidate] (794.25 ms) : 0, 794250
GlobalTracer [baseline] (255.187 ms) : 0, 255187
GlobalTracer [candidate] (257.604 ms) : 0, 257604
IAST [baseline] (26.776 ms) : 0, 26776
IAST [candidate] (27.233 ms) : 0, 27233
AppSec [baseline] (33.837 ms) : 0, 33837
AppSec [candidate] (33.531 ms) : 0, 33531
Debugger [baseline] (65.623 ms) : 0, 65623
Debugger [candidate] (66.392 ms) : 0, 66392
Remote Config [baseline] (592.498 µs) : 0, 592
Remote Config [candidate] (580.284 µs) : 0, 580
Telemetry [baseline] (8.46 ms) : 0, 8460
Telemetry [candidate] (8.444 ms) : 0, 8444
Flare Poller [baseline] (3.549 ms) : 0, 3549
Flare Poller [candidate] (3.566 ms) : 0, 3566
section profiling
crashtracking [baseline] (1.213 ms) : 0, 1213
crashtracking [candidate] (1.214 ms) : 0, 1214
BytebuddyAgent [baseline] (701.557 ms) : 0, 701557
BytebuddyAgent [candidate] (707.054 ms) : 0, 707054
GlobalTracer [baseline] (220.018 ms) : 0, 220018
GlobalTracer [candidate] (222.549 ms) : 0, 222549
AppSec [baseline] (32.172 ms) : 0, 32172
AppSec [candidate] (32.414 ms) : 0, 32414
Debugger [baseline] (67.823 ms) : 0, 67823
Debugger [candidate] (68.396 ms) : 0, 68396
Remote Config [baseline] (639.11 µs) : 0, 639
Remote Config [candidate] (631.861 µs) : 0, 632
Telemetry [baseline] (8.823 ms) : 0, 8823
Telemetry [candidate] (8.937 ms) : 0, 8937
Flare Poller [baseline] (3.705 ms) : 0, 3705
Flare Poller [candidate] (3.758 ms) : 0, 3758
ProfilingAgent [baseline] (96.754 ms) : 0, 96754
ProfilingAgent [candidate] (96.629 ms) : 0, 96629
Profiling [baseline] (97.33 ms) : 0, 97330
Profiling [candidate] (97.199 ms) : 0, 97199
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/ignite-npe
git_commit_date 1767637205 1767691020
git_commit_sha bd3f6f5 5b77c73
release_version 1.58.0-SNAPSHOT~bd3f6f5c89 1.58.0-SNAPSHOT~5b77c73366
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1767693350 1767693350
ci_job_id 1328810135 1328810135
ci_pipeline_id 89132945 89132945
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-jmfaxm0u 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-jmfaxm0u 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 3 performance regressions! Performance is the same for 16 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_FULL:high_load worse
[+0.914ms; +1.355ms] or [+18.886%; +27.989%]		 worse
[+2.013ms; +3.167ms] or [+16.911%; +26.611%]		 unstable
[-224.720op/s; -55.030op/s] or [-26.896%; -6.587%]		 5.977ms 14.493ms 695.625op/s 4.842ms 11.903ms 835.500op/s
scenario:load:petclinic:profiling:high_load better
[-1220.926µs; -510.482µs] or [-6.371%; -2.664%]		 unsure
[-1650.732µs; -339.952µs] or [-5.357%; -1.103%]		 unstable
[-11.736op/s; +33.611op/s] or [-4.895%; +14.019%]		 18.297ms 29.817ms 250.688op/s 19.163ms 30.812ms 239.750op/s
scenario:load:petclinic:code_origins:high_load worse
[+432.444µs; +798.108µs] or [+2.531%; +4.672%]		 same
[-334.070µs; +835.403µs] or [-1.170%; +2.926%]		 unstable
[-33.621op/s; +13.996op/s] or [-12.582%; +5.238%]		 17.699ms 28.799ms 257.406op/s 17.084ms 28.548ms 267.219op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.58.0-SNAPSHOT~5b77c73366, baseline=1.58.0-SNAPSHOT~bd3f6f5c89
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.302 ms) : 19099, 19504
.   : milestone, 19302,
appsec (18.657 ms) : 18465, 18849
.   : milestone, 18657,
code_origins (17.461 ms) : 17286, 17636
.   : milestone, 17461,
iast (17.856 ms) : 17675, 18036
.   : milestone, 17856,
profiling (19.467 ms) : 19272, 19663
.   : milestone, 19467,
tracing (17.698 ms) : 17519, 17876
.   : milestone, 17698,
section candidate
no_agent (19.48 ms) : 19281, 19680
.   : milestone, 19480,
appsec (18.663 ms) : 18473, 18852
.   : milestone, 18663,
code_origins (18.129 ms) : 17952, 18306
.   : milestone, 18129,
iast (17.774 ms) : 17598, 17949
.   : milestone, 17774,
profiling (18.617 ms) : 18431, 18804
.   : milestone, 18617,
tracing (17.519 ms) : 17345, 17694
.   : milestone, 17519,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.302 ms [19.099 ms, 19.504 ms] -
appsec 18.657 ms [18.465 ms, 18.849 ms] -644.909 µs (-3.3%)
code_origins 17.461 ms [17.286 ms, 17.636 ms] -1.841 ms (-9.5%)
iast 17.856 ms [17.675 ms, 18.036 ms] -1.446 ms (-7.5%)
profiling 19.467 ms [19.272 ms, 19.663 ms] 165.608 µs (0.9%)
tracing 17.698 ms [17.519 ms, 17.876 ms] -1.604 ms (-8.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.48 ms [19.281 ms, 19.68 ms] -
appsec 18.663 ms [18.473 ms, 18.852 ms] -817.688 µs (-4.2%)
code_origins 18.129 ms [17.952 ms, 18.306 ms] -1.352 ms (-6.9%)
iast 17.774 ms [17.598 ms, 17.949 ms] -1.707 ms (-8.8%)
profiling 18.617 ms [18.431 ms, 18.804 ms] -862.961 µs (-4.4%)
tracing 17.519 ms [17.345 ms, 17.694 ms] -1.961 ms (-10.1%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.58.0-SNAPSHOT~5b77c73366, baseline=1.58.0-SNAPSHOT~bd3f6f5c89
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.181 ms) : 1170, 1193
.   : milestone, 1181,
iast (3.107 ms) : 3068, 3146
.   : milestone, 3107,
iast_FULL (5.531 ms) : 5475, 5586
.   : milestone, 5531,
iast_GLOBAL (3.624 ms) : 3567, 3681
.   : milestone, 3624,
profiling (1.929 ms) : 1913, 1945
.   : milestone, 1929,
tracing (1.779 ms) : 1765, 1794
.   : milestone, 1779,
section candidate
no_agent (1.199 ms) : 1187, 1211
.   : milestone, 1199,
iast (3.192 ms) : 3154, 3230
.   : milestone, 3192,
iast_FULL (6.66 ms) : 6586, 6733
.   : milestone, 6660,
iast_GLOBAL (3.482 ms) : 3430, 3535
.   : milestone, 3482,
profiling (1.979 ms) : 1961, 1996
.   : milestone, 1979,
tracing (1.835 ms) : 1819, 1850
.   : milestone, 1835,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.181 ms [1.17 ms, 1.193 ms] -
iast 3.107 ms [3.068 ms, 3.146 ms] 1.926 ms (163.0%)
iast_FULL 5.531 ms [5.475 ms, 5.586 ms] 4.349 ms (368.2%)
iast_GLOBAL 3.624 ms [3.567 ms, 3.681 ms] 2.443 ms (206.8%)
profiling 1.929 ms [1.913 ms, 1.945 ms] 747.837 µs (63.3%)
tracing 1.779 ms [1.765 ms, 1.794 ms] 598.028 µs (50.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.199 ms [1.187 ms, 1.211 ms] -
iast 3.192 ms [3.154 ms, 3.23 ms] 1.994 ms (166.3%)
iast_FULL 6.66 ms [6.586 ms, 6.733 ms] 5.461 ms (455.6%)
iast_GLOBAL 3.482 ms [3.43 ms, 3.535 ms] 2.284 ms (190.5%)
profiling 1.979 ms [1.961 ms, 1.996 ms] 779.905 µs (65.1%)
tracing 1.835 ms [1.819 ms, 1.85 ms] 636.064 µs (53.1%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/ignite-npe
git_commit_date 1767637205 1767691020
git_commit_sha bd3f6f5 5b77c73
release_version 1.58.0-SNAPSHOT~bd3f6f5c89 1.58.0-SNAPSHOT~5b77c73366
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1767693117 1767693117
ci_job_id 1328810138 1328810138
ci_pipeline_id 89132945 89132945
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-2wd9cxr4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-2wd9cxr4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.58.0-SNAPSHOT~5b77c73366, baseline=1.58.0-SNAPSHOT~bd3f6f5c89
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.423 s) : 15423000, 15423000
.   : milestone, 15423000,
appsec (14.547 s) : 14547000, 14547000
.   : milestone, 14547000,
iast (18.057 s) : 18057000, 18057000
.   : milestone, 18057000,
iast_GLOBAL (17.932 s) : 17932000, 17932000
.   : milestone, 17932000,
profiling (14.746 s) : 14746000, 14746000
.   : milestone, 14746000,
tracing (14.58 s) : 14580000, 14580000
.   : milestone, 14580000,
section candidate
no_agent (15.037 s) : 15037000, 15037000
.   : milestone, 15037000,
appsec (14.857 s) : 14857000, 14857000
.   : milestone, 14857000,
iast (18.449 s) : 18449000, 18449000
.   : milestone, 18449000,
iast_GLOBAL (17.826 s) : 17826000, 17826000
.   : milestone, 17826000,
profiling (14.712 s) : 14712000, 14712000
.   : milestone, 14712000,
tracing (14.629 s) : 14629000, 14629000
.   : milestone, 14629000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.423 s [15.423 s, 15.423 s] -
appsec 14.547 s [14.547 s, 14.547 s] -876.0 ms (-5.7%)
iast 18.057 s [18.057 s, 18.057 s] 2.634 s (17.1%)
iast_GLOBAL 17.932 s [17.932 s, 17.932 s] 2.509 s (16.3%)
profiling 14.746 s [14.746 s, 14.746 s] -677.0 ms (-4.4%)
tracing 14.58 s [14.58 s, 14.58 s] -843.0 ms (-5.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.037 s [15.037 s, 15.037 s] -
appsec 14.857 s [14.857 s, 14.857 s] -180.0 ms (-1.2%)
iast 18.449 s [18.449 s, 18.449 s] 3.412 s (22.7%)
iast_GLOBAL 17.826 s [17.826 s, 17.826 s] 2.789 s (18.5%)
profiling 14.712 s [14.712 s, 14.712 s] -325.0 ms (-2.2%)
tracing 14.629 s [14.629 s, 14.629 s] -408.0 ms (-2.7%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.58.0-SNAPSHOT~5b77c73366, baseline=1.58.0-SNAPSHOT~bd3f6f5c89
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.48 ms) : 1468, 1491
.   : milestone, 1480,
appsec (3.669 ms) : 3454, 3885
.   : milestone, 3669,
iast (2.22 ms) : 2155, 2284
.   : milestone, 2220,
iast_GLOBAL (2.268 ms) : 2203, 2333
.   : milestone, 2268,
profiling (2.508 ms) : 2345, 2671
.   : milestone, 2508,
tracing (2.058 ms) : 2007, 2109
.   : milestone, 2058,
section candidate
no_agent (1.475 ms) : 1464, 1487
.   : milestone, 1475,
appsec (3.654 ms) : 3439, 3869
.   : milestone, 3654,
iast (2.224 ms) : 2159, 2289
.   : milestone, 2224,
iast_GLOBAL (2.269 ms) : 2204, 2334
.   : milestone, 2269,
profiling (2.083 ms) : 2029, 2137
.   : milestone, 2083,
tracing (2.059 ms) : 2008, 2111
.   : milestone, 2059,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.48 ms [1.468 ms, 1.491 ms] -
appsec 3.669 ms [3.454 ms, 3.885 ms] 2.19 ms (148.0%)
iast 2.22 ms [2.155 ms, 2.284 ms] 740.226 µs (50.0%)
iast_GLOBAL 2.268 ms [2.203 ms, 2.333 ms] 788.384 µs (53.3%)
profiling 2.508 ms [2.345 ms, 2.671 ms] 1.028 ms (69.5%)
tracing 2.058 ms [2.007 ms, 2.109 ms] 578.14 µs (39.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.475 ms [1.464 ms, 1.487 ms] -
appsec 3.654 ms [3.439 ms, 3.869 ms] 2.179 ms (147.7%)
iast 2.224 ms [2.159 ms, 2.289 ms] 748.875 µs (50.8%)
iast_GLOBAL 2.269 ms [2.204 ms, 2.334 ms] 794.016 µs (53.8%)
profiling 2.083 ms [2.029 ms, 2.137 ms] 608.038 µs (41.2%)
tracing 2.059 ms [2.008 ms, 2.111 ms] 584.245 µs (39.6%)