Avoid NPE on DSM context extraction by amarziali · Pull Request #10491 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/npe
git_commit_date 1769935402 1770022555
git_commit_sha f2f109e 6d113f3
release_version 1.59.0-SNAPSHOT~f2f109ef18 1.59.0-SNAPSHOT~6d113f399f
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1770024479 1770024479
ci_job_id 1392681016 1392681016
ci_pipeline_id 94024603 94024603
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-d777at3x 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-d777at3x 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 57 metrics, 14 unstable metrics.

Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.59.0-SNAPSHOT~6d113f399f, baseline=1.59.0-SNAPSHOT~f2f109ef18

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.062 s) : 0, 1062280
Total [baseline] (10.922 s) : 0, 10921881
Agent [candidate] (1.072 s) : 0, 1071782
Total [candidate] (10.959 s) : 0, 10958549
section appsec
Agent [baseline] (1.237 s) : 0, 1237449
Total [baseline] (11.025 s) : 0, 11024640
Agent [candidate] (1.24 s) : 0, 1240333
Total [candidate] (11.08 s) : 0, 11079748
section iast
Agent [baseline] (1.237 s) : 0, 1237423
Total [baseline] (11.13 s) : 0, 11130175
Agent [candidate] (1.239 s) : 0, 1239386
Total [candidate] (11.309 s) : 0, 11309105
section profiling
Agent [baseline] (1.187 s) : 0, 1186986
Total [baseline] (10.865 s) : 0, 10865181
Agent [candidate] (1.188 s) : 0, 1187625
Total [candidate] (10.929 s) : 0, 10929389
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.062 s -
Agent appsec 1.237 s 175.169 ms (16.5%)
Agent iast 1.237 s 175.143 ms (16.5%)
Agent profiling 1.187 s 124.706 ms (11.7%)
Total tracing 10.922 s -
Total appsec 11.025 s 102.758 ms (0.9%)
Total iast 11.13 s 208.294 ms (1.9%)
Total profiling 10.865 s -56.7 ms (-0.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.072 s -
Agent appsec 1.24 s 168.552 ms (15.7%)
Agent iast 1.239 s 167.604 ms (15.6%)
Agent profiling 1.188 s 115.844 ms (10.8%)
Total tracing 10.959 s -
Total appsec 11.08 s 121.199 ms (1.1%)
Total iast 11.309 s 350.557 ms (3.2%)
Total profiling 10.929 s -29.16 ms (-0.3%)
gantt
    title petclinic - break down per module: candidate=1.59.0-SNAPSHOT~6d113f399f, baseline=1.59.0-SNAPSHOT~f2f109ef18

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.188 ms) : 0, 1188
crashtracking [candidate] (1.19 ms) : 0, 1190
BytebuddyAgent [baseline] (627.361 ms) : 0, 627361
BytebuddyAgent [candidate] (632.212 ms) : 0, 632212
AgentMeter [baseline] (28.684 ms) : 0, 28684
AgentMeter [candidate] (28.902 ms) : 0, 28902
GlobalTracer [baseline] (257.814 ms) : 0, 257814
GlobalTracer [candidate] (259.416 ms) : 0, 259416
AppSec [baseline] (32.711 ms) : 0, 32711
AppSec [candidate] (33.132 ms) : 0, 33132
Debugger [baseline] (60.216 ms) : 0, 60216
Debugger [candidate] (61.897 ms) : 0, 61897
Remote Config [baseline] (627.498 µs) : 0, 627
Remote Config [candidate] (628.44 µs) : 0, 628
Telemetry [baseline] (13.745 ms) : 0, 13745
Telemetry [candidate] (13.564 ms) : 0, 13564
Flare Poller [baseline] (4.588 ms) : 0, 4588
Flare Poller [candidate] (5.402 ms) : 0, 5402
section appsec
crashtracking [baseline] (1.193 ms) : 0, 1193
crashtracking [candidate] (1.188 ms) : 0, 1188
BytebuddyAgent [baseline] (656.357 ms) : 0, 656357
BytebuddyAgent [candidate] (659.855 ms) : 0, 659855
AgentMeter [baseline] (11.727 ms) : 0, 11727
AgentMeter [candidate] (11.759 ms) : 0, 11759
GlobalTracer [baseline] (258.257 ms) : 0, 258257
GlobalTracer [candidate] (258.787 ms) : 0, 258787
AppSec [baseline] (168.107 ms) : 0, 168107
AppSec [candidate] (167.328 ms) : 0, 167328
Debugger [baseline] (67.406 ms) : 0, 67406
Debugger [candidate] (67.258 ms) : 0, 67258
Remote Config [baseline] (673.545 µs) : 0, 674
Remote Config [candidate] (663.383 µs) : 0, 663
Telemetry [baseline] (9.414 ms) : 0, 9414
Telemetry [candidate] (9.148 ms) : 0, 9148
Flare Poller [baseline] (3.72 ms) : 0, 3720
Flare Poller [candidate] (3.679 ms) : 0, 3679
IAST [baseline] (25.199 ms) : 0, 25199
IAST [candidate] (25.183 ms) : 0, 25183
section iast
crashtracking [baseline] (1.188 ms) : 0, 1188
crashtracking [candidate] (1.194 ms) : 0, 1194
BytebuddyAgent [baseline] (800.804 ms) : 0, 800804
BytebuddyAgent [candidate] (801.064 ms) : 0, 801064
AgentMeter [baseline] (11.379 ms) : 0, 11379
AgentMeter [candidate] (11.381 ms) : 0, 11381
GlobalTracer [baseline] (249.063 ms) : 0, 249063
GlobalTracer [candidate] (249.132 ms) : 0, 249132
AppSec [baseline] (33.802 ms) : 0, 33802
AppSec [candidate] (34.394 ms) : 0, 34394
Debugger [baseline] (66.21 ms) : 0, 66210
Debugger [candidate] (66.811 ms) : 0, 66811
Remote Config [baseline] (541.122 µs) : 0, 541
Remote Config [candidate] (561.39 µs) : 0, 561
Telemetry [baseline] (8.589 ms) : 0, 8589
Telemetry [candidate] (8.78 ms) : 0, 8780
Flare Poller [baseline] (3.398 ms) : 0, 3398
Flare Poller [candidate] (3.541 ms) : 0, 3541
IAST [baseline] (27.074 ms) : 0, 27074
IAST [candidate] (27.113 ms) : 0, 27113
section profiling
crashtracking [baseline] (1.23 ms) : 0, 1230
crashtracking [candidate] (1.213 ms) : 0, 1213
BytebuddyAgent [baseline] (679.674 ms) : 0, 679674
BytebuddyAgent [candidate] (680.136 ms) : 0, 680136
AgentMeter [baseline] (8.662 ms) : 0, 8662
AgentMeter [candidate] (8.604 ms) : 0, 8604
GlobalTracer [baseline] (215.9 ms) : 0, 215900
GlobalTracer [candidate] (215.738 ms) : 0, 215738
AppSec [baseline] (32.322 ms) : 0, 32322
AppSec [candidate] (32.122 ms) : 0, 32122
Debugger [baseline] (67.043 ms) : 0, 67043
Debugger [candidate] (67.204 ms) : 0, 67204
Remote Config [baseline] (598.793 µs) : 0, 599
Remote Config [candidate] (590.666 µs) : 0, 591
Telemetry [baseline] (8.777 ms) : 0, 8777
Telemetry [candidate] (8.779 ms) : 0, 8779
Flare Poller [baseline] (3.763 ms) : 0, 3763
Flare Poller [candidate] (3.746 ms) : 0, 3746
ProfilingAgent [baseline] (99.303 ms) : 0, 99303
ProfilingAgent [candidate] (99.58 ms) : 0, 99580
Profiling [baseline] (99.865 ms) : 0, 99865
Profiling [candidate] (100.145 ms) : 0, 100145
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.59.0-SNAPSHOT~6d113f399f, baseline=1.59.0-SNAPSHOT~f2f109ef18

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.062 s) : 0, 1061978
Total [baseline] (8.751 s) : 0, 8751328
Agent [candidate] (1.064 s) : 0, 1063907
Total [candidate] (8.715 s) : 0, 8715241
section iast
Agent [baseline] (1.244 s) : 0, 1244194
Total [baseline] (9.394 s) : 0, 9394067
Agent [candidate] (1.23 s) : 0, 1229897
Total [candidate] (9.363 s) : 0, 9363233
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.062 s -
Agent iast 1.244 s 182.216 ms (17.2%)
Total tracing 8.751 s -
Total iast 9.394 s 642.739 ms (7.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.064 s -
Agent iast 1.23 s 165.99 ms (15.6%)
Total tracing 8.715 s -
Total iast 9.363 s 647.992 ms (7.4%)
gantt
    title insecure-bank - break down per module: candidate=1.59.0-SNAPSHOT~6d113f399f, baseline=1.59.0-SNAPSHOT~f2f109ef18

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.181 ms) : 0, 1181
crashtracking [candidate] (1.183 ms) : 0, 1183
BytebuddyAgent [baseline] (626.832 ms) : 0, 626832
BytebuddyAgent [candidate] (627.991 ms) : 0, 627991
AgentMeter [baseline] (28.634 ms) : 0, 28634
AgentMeter [candidate] (28.654 ms) : 0, 28654
GlobalTracer [baseline] (257.228 ms) : 0, 257228
GlobalTracer [candidate] (257.738 ms) : 0, 257738
AppSec [baseline] (32.751 ms) : 0, 32751
AppSec [candidate] (32.754 ms) : 0, 32754
Debugger [baseline] (61.868 ms) : 0, 61868
Debugger [candidate] (61.947 ms) : 0, 61947
Remote Config [baseline] (610.776 µs) : 0, 611
Remote Config [candidate] (622.152 µs) : 0, 622
Telemetry [baseline] (11.349 ms) : 0, 11349
Telemetry [candidate] (13.086 ms) : 0, 13086
Flare Poller [baseline] (6.121 ms) : 0, 6121
Flare Poller [candidate] (4.588 ms) : 0, 4588
section iast
crashtracking [baseline] (1.202 ms) : 0, 1202
crashtracking [candidate] (1.186 ms) : 0, 1186
BytebuddyAgent [baseline] (805.663 ms) : 0, 805663
BytebuddyAgent [candidate] (795.293 ms) : 0, 795293
AgentMeter [baseline] (11.612 ms) : 0, 11612
AgentMeter [candidate] (11.134 ms) : 0, 11134
GlobalTracer [baseline] (249.839 ms) : 0, 249839
GlobalTracer [candidate] (247.422 ms) : 0, 247422
AppSec [baseline] (33.127 ms) : 0, 33127
AppSec [candidate] (33.955 ms) : 0, 33955
Debugger [baseline] (66.838 ms) : 0, 66838
Debugger [candidate] (65.753 ms) : 0, 65753
Remote Config [baseline] (564.295 µs) : 0, 564
Remote Config [candidate] (549.805 µs) : 0, 550
Telemetry [baseline] (8.747 ms) : 0, 8747
Telemetry [candidate] (8.759 ms) : 0, 8759
Flare Poller [baseline] (3.575 ms) : 0, 3575
Flare Poller [candidate] (3.477 ms) : 0, 3477
IAST [baseline] (27.419 ms) : 0, 27419
IAST [candidate] (27.001 ms) : 0, 27001
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/npe
git_commit_date 1769935402 1770022555
git_commit_sha f2f109e 6d113f3
release_version 1.59.0-SNAPSHOT~f2f109ef18 1.59.0-SNAPSHOT~6d113f399f
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1770024869 1770024869
ci_job_id 1392681017 1392681017
ci_pipeline_id 94024603 94024603
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-lkud1ga9 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-lkud1ga9 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 2 performance regressions! Performance is the same for 15 metrics, 19 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:petclinic:tracing:high_load worse
[+1.126ms; +1.870ms] or [+6.605%; +10.972%]
worse
[+1.252ms; +2.449ms] or [+4.443%; +8.686%]
unstable
[-46.563op/s; +8.188op/s] or [-17.478%; +3.073%]
18.545ms 30.043ms 247.219op/s 17.046ms 28.192ms 266.406op/s
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~6d113f399f, baseline=1.59.0-SNAPSHOT~f2f109ef18
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.653 ms) : 18457, 18848
.   : milestone, 18653,
appsec (18.586 ms) : 18399, 18774
.   : milestone, 18586,
code_origins (17.792 ms) : 17615, 17969
.   : milestone, 17792,
iast (17.348 ms) : 17176, 17520
.   : milestone, 17348,
profiling (18.743 ms) : 18553, 18933
.   : milestone, 18743,
tracing (17.51 ms) : 17337, 17683
.   : milestone, 17510,
section candidate
no_agent (18.211 ms) : 18023, 18399
.   : milestone, 18211,
appsec (18.403 ms) : 18217, 18589
.   : milestone, 18403,
code_origins (18.004 ms) : 17825, 18182
.   : milestone, 18004,
iast (17.431 ms) : 17260, 17602
.   : milestone, 17431,
profiling (18.683 ms) : 18495, 18871
.   : milestone, 18683,
tracing (18.878 ms) : 18687, 19068
.   : milestone, 18878,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.653 ms [18.457 ms, 18.848 ms] -
appsec 18.586 ms [18.399 ms, 18.774 ms] -66.124 µs (-0.4%)
code_origins 17.792 ms [17.615 ms, 17.969 ms] -860.822 µs (-4.6%)
iast 17.348 ms [17.176 ms, 17.52 ms] -1.305 ms (-7.0%)
profiling 18.743 ms [18.553 ms, 18.933 ms] 90.369 µs (0.5%)
tracing 17.51 ms [17.337 ms, 17.683 ms] -1.142 ms (-6.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.211 ms [18.023 ms, 18.399 ms] -
appsec 18.403 ms [18.217 ms, 18.589 ms] 192.372 µs (1.1%)
code_origins 18.004 ms [17.825 ms, 18.182 ms] -207.078 µs (-1.1%)
iast 17.431 ms [17.26 ms, 17.602 ms] -779.563 µs (-4.3%)
profiling 18.683 ms [18.495 ms, 18.871 ms] 472.276 µs (2.6%)
tracing 18.878 ms [18.687 ms, 19.068 ms] 667.0 µs (3.7%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~6d113f399f, baseline=1.59.0-SNAPSHOT~f2f109ef18
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.181 ms) : 1169, 1192
.   : milestone, 1181,
iast (3.232 ms) : 3185, 3279
.   : milestone, 3232,
iast_FULL (6.023 ms) : 5961, 6085
.   : milestone, 6023,
iast_GLOBAL (3.609 ms) : 3550, 3668
.   : milestone, 3609,
profiling (1.953 ms) : 1936, 1969
.   : milestone, 1953,
tracing (1.808 ms) : 1793, 1824
.   : milestone, 1808,
section candidate
no_agent (1.172 ms) : 1160, 1183
.   : milestone, 1172,
iast (3.134 ms) : 3093, 3175
.   : milestone, 3134,
iast_FULL (6.64 ms) : 6564, 6715
.   : milestone, 6640,
iast_GLOBAL (3.61 ms) : 3550, 3670
.   : milestone, 3610,
profiling (1.988 ms) : 1971, 2006
.   : milestone, 1988,
tracing (1.79 ms) : 1774, 1806
.   : milestone, 1790,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.181 ms [1.169 ms, 1.192 ms] -
iast 3.232 ms [3.185 ms, 3.279 ms] 2.051 ms (173.7%)
iast_FULL 6.023 ms [5.961 ms, 6.085 ms] 4.842 ms (410.1%)
iast_GLOBAL 3.609 ms [3.55 ms, 3.668 ms] 2.429 ms (205.7%)
profiling 1.953 ms [1.936 ms, 1.969 ms] 772.02 µs (65.4%)
tracing 1.808 ms [1.793 ms, 1.824 ms] 627.804 µs (53.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.172 ms [1.16 ms, 1.183 ms] -
iast 3.134 ms [3.093 ms, 3.175 ms] 1.962 ms (167.5%)
iast_FULL 6.64 ms [6.564 ms, 6.715 ms] 5.468 ms (466.6%)
iast_GLOBAL 3.61 ms [3.55 ms, 3.67 ms] 2.438 ms (208.1%)
profiling 1.988 ms [1.971 ms, 2.006 ms] 816.65 µs (69.7%)
tracing 1.79 ms [1.774 ms, 1.806 ms] 618.167 µs (52.8%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/npe
git_commit_date 1769935402 1770022555
git_commit_sha f2f109e 6d113f3
release_version 1.59.0-SNAPSHOT~f2f109ef18 1.59.0-SNAPSHOT~6d113f399f
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1770024563 1770024563
ci_job_id 1392681018 1392681018
ci_pipeline_id 94024603 94024603
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-kw5c37nr 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-kw5c37nr 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~6d113f399f, baseline=1.59.0-SNAPSHOT~f2f109ef18
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.47 ms) : 1459, 1482
.   : milestone, 1470,
appsec (3.729 ms) : 3507, 3951
.   : milestone, 3729,
iast (2.251 ms) : 2182, 2320
.   : milestone, 2251,
iast_GLOBAL (2.291 ms) : 2221, 2360
.   : milestone, 2291,
profiling (2.096 ms) : 2039, 2153
.   : milestone, 2096,
tracing (2.061 ms) : 2008, 2115
.   : milestone, 2061,
section candidate
no_agent (1.474 ms) : 1462, 1485
.   : milestone, 1474,
appsec (3.738 ms) : 3517, 3959
.   : milestone, 3738,
iast (2.252 ms) : 2183, 2322
.   : milestone, 2252,
iast_GLOBAL (2.288 ms) : 2219, 2358
.   : milestone, 2288,
profiling (2.067 ms) : 2013, 2122
.   : milestone, 2067,
tracing (2.071 ms) : 2017, 2125
.   : milestone, 2071,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.47 ms [1.459 ms, 1.482 ms] -
appsec 3.729 ms [3.507 ms, 3.951 ms] 2.259 ms (153.6%)
iast 2.251 ms [2.182 ms, 2.32 ms] 780.6 µs (53.1%)
iast_GLOBAL 2.291 ms [2.221 ms, 2.36 ms] 820.131 µs (55.8%)
profiling 2.096 ms [2.039 ms, 2.153 ms] 625.5 µs (42.5%)
tracing 2.061 ms [2.008 ms, 2.115 ms] 590.993 µs (40.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.462 ms, 1.485 ms] -
appsec 3.738 ms [3.517 ms, 3.959 ms] 2.265 ms (153.7%)
iast 2.252 ms [2.183 ms, 2.322 ms] 778.68 µs (52.8%)
iast_GLOBAL 2.288 ms [2.219 ms, 2.358 ms] 814.898 µs (55.3%)
profiling 2.067 ms [2.013 ms, 2.122 ms] 593.706 µs (40.3%)
tracing 2.071 ms [2.017 ms, 2.125 ms] 597.302 µs (40.5%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~6d113f399f, baseline=1.59.0-SNAPSHOT~f2f109ef18
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.555 s) : 15555000, 15555000
.   : milestone, 15555000,
appsec (14.922 s) : 14922000, 14922000
.   : milestone, 14922000,
iast (18.647 s) : 18647000, 18647000
.   : milestone, 18647000,
iast_GLOBAL (17.864 s) : 17864000, 17864000
.   : milestone, 17864000,
profiling (15.024 s) : 15024000, 15024000
.   : milestone, 15024000,
tracing (14.578 s) : 14578000, 14578000
.   : milestone, 14578000,
section candidate
no_agent (15.264 s) : 15264000, 15264000
.   : milestone, 15264000,
appsec (14.911 s) : 14911000, 14911000
.   : milestone, 14911000,
iast (18.275 s) : 18275000, 18275000
.   : milestone, 18275000,
iast_GLOBAL (17.907 s) : 17907000, 17907000
.   : milestone, 17907000,
profiling (14.965 s) : 14965000, 14965000
.   : milestone, 14965000,
tracing (14.503 s) : 14503000, 14503000
.   : milestone, 14503000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.555 s [15.555 s, 15.555 s] -
appsec 14.922 s [14.922 s, 14.922 s] -633.0 ms (-4.1%)
iast 18.647 s [18.647 s, 18.647 s] 3.092 s (19.9%)
iast_GLOBAL 17.864 s [17.864 s, 17.864 s] 2.309 s (14.8%)
profiling 15.024 s [15.024 s, 15.024 s] -531.0 ms (-3.4%)
tracing 14.578 s [14.578 s, 14.578 s] -977.0 ms (-6.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.264 s [15.264 s, 15.264 s] -
appsec 14.911 s [14.911 s, 14.911 s] -353.0 ms (-2.3%)
iast 18.275 s [18.275 s, 18.275 s] 3.011 s (19.7%)
iast_GLOBAL 17.907 s [17.907 s, 17.907 s] 2.643 s (17.3%)
profiling 14.965 s [14.965 s, 14.965 s] -299.0 ms (-2.0%)
tracing 14.503 s [14.503 s, 14.503 s] -761.0 ms (-5.0%)