fix Capture Expressions for line probes by jpbempel · Pull Request #10303 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/fix-cpature-expr-line-probe
git_commit_date 1767720455 1767803570
git_commit_sha 92c84e2 84ec8a6
release_version 1.59.0-SNAPSHOT~92c84e28db 1.59.0-SNAPSHOT~84ec8a69dd
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1767805407 1767805407
ci_job_id 1333577687 1333577687
ci_pipeline_id 89492523 89492523
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-igkfg11q 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-igkfg11q 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 56 metrics, 9 unstable metrics.

Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.59.0-SNAPSHOT~84ec8a69dd, baseline=1.59.0-SNAPSHOT~92c84e28db

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.096 s) : 0, 1096147
Total [baseline] (8.788 s) : 0, 8788080
Agent [candidate] (1.091 s) : 0, 1090546
Total [candidate] (8.742 s) : 0, 8741502
section iast
Agent [baseline] (1.219 s) : 0, 1219055
Total [baseline] (9.289 s) : 0, 9289145
Agent [candidate] (1.232 s) : 0, 1231732
Total [candidate] (9.377 s) : 0, 9376732
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.096 s -
Agent iast 1.219 s 122.908 ms (11.2%)
Total tracing 8.788 s -
Total iast 9.289 s 501.065 ms (5.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.091 s -
Agent iast 1.232 s 141.186 ms (12.9%)
Total tracing 8.742 s -
Total iast 9.377 s 635.23 ms (7.3%)
gantt
    title insecure-bank - break down per module: candidate=1.59.0-SNAPSHOT~84ec8a69dd, baseline=1.59.0-SNAPSHOT~92c84e28db

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.21 ms) : 0, 1210
crashtracking [candidate] (1.193 ms) : 0, 1193
BytebuddyAgent [baseline] (658.946 ms) : 0, 658946
BytebuddyAgent [candidate] (654.894 ms) : 0, 654894
GlobalTracer [baseline] (285.281 ms) : 0, 285281
GlobalTracer [candidate] (284.551 ms) : 0, 284551
AppSec [baseline] (33.308 ms) : 0, 33308
AppSec [candidate] (32.979 ms) : 0, 32979
Debugger [baseline] (68.047 ms) : 0, 68047
Debugger [candidate] (67.999 ms) : 0, 67999
Remote Config [baseline] (622.878 µs) : 0, 623
Remote Config [candidate] (637.25 µs) : 0, 637
Telemetry [baseline] (9.126 ms) : 0, 9126
Telemetry [candidate] (8.901 ms) : 0, 8901
Flare Poller [baseline] (3.855 ms) : 0, 3855
Flare Poller [candidate] (3.752 ms) : 0, 3752
section iast
crashtracking [baseline] (1.187 ms) : 0, 1187
crashtracking [candidate] (1.195 ms) : 0, 1195
BytebuddyAgent [baseline] (788.755 ms) : 0, 788755
BytebuddyAgent [candidate] (797.656 ms) : 0, 797656
GlobalTracer [baseline] (255.271 ms) : 0, 255271
GlobalTracer [candidate] (257.703 ms) : 0, 257703
AppSec [baseline] (33.482 ms) : 0, 33482
AppSec [candidate] (31.893 ms) : 0, 31893
Debugger [baseline] (65.462 ms) : 0, 65462
Debugger [candidate] (67.892 ms) : 0, 67892
Remote Config [baseline] (601.274 µs) : 0, 601
Remote Config [candidate] (604.51 µs) : 0, 605
Telemetry [baseline] (8.329 ms) : 0, 8329
Telemetry [candidate] (8.424 ms) : 0, 8424
Flare Poller [baseline] (3.548 ms) : 0, 3548
Flare Poller [candidate] (3.554 ms) : 0, 3554
IAST [baseline] (27.059 ms) : 0, 27059
IAST [candidate] (27.326 ms) : 0, 27326
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.59.0-SNAPSHOT~84ec8a69dd, baseline=1.59.0-SNAPSHOT~92c84e28db

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.09 s) : 0, 1089782
Total [baseline] (10.77 s) : 0, 10769640
Agent [candidate] (1.086 s) : 0, 1086124
Total [candidate] (10.819 s) : 0, 10819381
section appsec
Agent [baseline] (1.267 s) : 0, 1266782
Total [baseline] (10.949 s) : 0, 10948860
Agent [candidate] (1.264 s) : 0, 1264150
Total [candidate] (10.895 s) : 0, 10895475
section iast
Agent [baseline] (1.225 s) : 0, 1224645
Total [baseline] (11.233 s) : 0, 11233086
Agent [candidate] (1.228 s) : 0, 1228143
Total [candidate] (11.111 s) : 0, 11110995
section profiling
Agent [baseline] (1.21 s) : 0, 1209625
Total [baseline] (10.947 s) : 0, 10947020
Agent [candidate] (1.201 s) : 0, 1201367
Total [candidate] (10.893 s) : 0, 10892525
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.09 s -
Agent appsec 1.267 s 177.0 ms (16.2%)
Agent iast 1.225 s 134.863 ms (12.4%)
Agent profiling 1.21 s 119.843 ms (11.0%)
Total tracing 10.77 s -
Total appsec 10.949 s 179.219 ms (1.7%)
Total iast 11.233 s 463.445 ms (4.3%)
Total profiling 10.947 s 177.38 ms (1.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.086 s -
Agent appsec 1.264 s 178.026 ms (16.4%)
Agent iast 1.228 s 142.019 ms (13.1%)
Agent profiling 1.201 s 115.243 ms (10.6%)
Total tracing 10.819 s -
Total appsec 10.895 s 76.094 ms (0.7%)
Total iast 11.111 s 291.614 ms (2.7%)
Total profiling 10.893 s 73.144 ms (0.7%)
gantt
    title petclinic - break down per module: candidate=1.59.0-SNAPSHOT~84ec8a69dd, baseline=1.59.0-SNAPSHOT~92c84e28db

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.187 ms) : 0, 1187
crashtracking [candidate] (1.183 ms) : 0, 1183
BytebuddyAgent [baseline] (654.112 ms) : 0, 654112
BytebuddyAgent [candidate] (651.691 ms) : 0, 651691
GlobalTracer [baseline] (283.761 ms) : 0, 283761
GlobalTracer [candidate] (283.112 ms) : 0, 283112
AppSec [baseline] (32.798 ms) : 0, 32798
AppSec [candidate] (32.687 ms) : 0, 32687
Debugger [baseline] (68.983 ms) : 0, 68983
Debugger [candidate] (68.281 ms) : 0, 68281
Remote Config [baseline] (609.142 µs) : 0, 609
Remote Config [candidate] (648.144 µs) : 0, 648
Telemetry [baseline] (8.935 ms) : 0, 8935
Telemetry [candidate] (9.148 ms) : 0, 9148
Flare Poller [baseline] (3.764 ms) : 0, 3764
Flare Poller [candidate] (3.82 ms) : 0, 3820
section appsec
crashtracking [baseline] (1.181 ms) : 0, 1181
crashtracking [candidate] (1.182 ms) : 0, 1182
BytebuddyAgent [baseline] (691.595 ms) : 0, 691595
BytebuddyAgent [candidate] (690.009 ms) : 0, 690009
GlobalTracer [baseline] (258.395 ms) : 0, 258395
GlobalTracer [candidate] (257.835 ms) : 0, 257835
IAST [baseline] (24.533 ms) : 0, 24533
IAST [candidate] (24.56 ms) : 0, 24560
AppSec [baseline] (172.692 ms) : 0, 172692
AppSec [candidate] (173.707 ms) : 0, 173707
Debugger [baseline] (68.991 ms) : 0, 68991
Debugger [candidate] (67.686 ms) : 0, 67686
Remote Config [baseline] (799.564 µs) : 0, 800
Remote Config [candidate] (746.881 µs) : 0, 747
Telemetry [baseline] (9.406 ms) : 0, 9406
Telemetry [candidate] (9.349 ms) : 0, 9349
Flare Poller [baseline] (3.789 ms) : 0, 3789
Flare Poller [candidate] (3.739 ms) : 0, 3739
section iast
crashtracking [baseline] (1.181 ms) : 0, 1181
crashtracking [candidate] (1.202 ms) : 0, 1202
BytebuddyAgent [baseline] (792.162 ms) : 0, 792162
BytebuddyAgent [candidate] (794.405 ms) : 0, 794405
GlobalTracer [baseline] (256.143 ms) : 0, 256143
GlobalTracer [candidate] (256.835 ms) : 0, 256835
IAST [baseline] (27.103 ms) : 0, 27103
IAST [candidate] (27.188 ms) : 0, 27188
AppSec [baseline] (34.422 ms) : 0, 34422
AppSec [candidate] (33.684 ms) : 0, 33684
Debugger [baseline] (65.637 ms) : 0, 65637
Debugger [candidate] (66.607 ms) : 0, 66607
Remote Config [baseline] (547.929 µs) : 0, 548
Remote Config [candidate] (590.333 µs) : 0, 590
Telemetry [baseline] (8.398 ms) : 0, 8398
Telemetry [candidate] (8.557 ms) : 0, 8557
Flare Poller [baseline] (3.614 ms) : 0, 3614
Flare Poller [candidate] (3.672 ms) : 0, 3672
section profiling
crashtracking [baseline] (1.217 ms) : 0, 1217
crashtracking [candidate] (1.2 ms) : 0, 1200
BytebuddyAgent [baseline] (707.44 ms) : 0, 707440
BytebuddyAgent [candidate] (700.597 ms) : 0, 700597
GlobalTracer [baseline] (221.623 ms) : 0, 221623
GlobalTracer [candidate] (219.875 ms) : 0, 219875
AppSec [baseline] (32.509 ms) : 0, 32509
AppSec [candidate] (32.07 ms) : 0, 32070
Debugger [baseline] (67.544 ms) : 0, 67544
Debugger [candidate] (67.875 ms) : 0, 67875
Remote Config [baseline] (658.86 µs) : 0, 659
Remote Config [candidate] (643.681 µs) : 0, 644
Telemetry [baseline] (8.721 ms) : 0, 8721
Telemetry [candidate] (8.644 ms) : 0, 8644
Flare Poller [baseline] (3.627 ms) : 0, 3627
Flare Poller [candidate] (3.616 ms) : 0, 3616
ProfilingAgent [baseline] (96.178 ms) : 0, 96178
ProfilingAgent [candidate] (97.275 ms) : 0, 97275
Profiling [baseline] (96.753 ms) : 0, 96753
Profiling [candidate] (97.852 ms) : 0, 97852
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/fix-cpature-expr-line-probe
git_commit_date 1767720455 1767803570
git_commit_sha 92c84e2 84ec8a6
release_version 1.59.0-SNAPSHOT~92c84e28db 1.59.0-SNAPSHOT~84ec8a69dd
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1767805812 1767805812
ci_job_id 1333577690 1333577690
ci_pipeline_id 89492523 89492523
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-l7bsisvs 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-l7bsisvs 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 4 performance regressions! Performance is the same for 15 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast:high_load worse
[+172.987µs; +264.554µs] or [+7.414%; +11.339%]
worse
[+266.777µs; +614.399µs] or [+3.816%; +8.789%]
unstable
[-253.154op/s; +49.716op/s] or [-16.775%; +3.294%]
2.552ms 7.431ms 1407.375op/s 2.333ms 6.990ms 1509.094op/s
scenario:load:insecure-bank:iast_GLOBAL:high_load unsure
[+46.106µs; +138.418µs] or [+1.694%; +5.086%]
worse
[+172.944µs; +606.088µs] or [+2.238%; +7.843%]
unstable
[-194.265op/s; +75.015op/s] or [-14.655%; +5.659%]
2.814ms 8.118ms 1266.000op/s 2.722ms 7.728ms 1325.625op/s
scenario:load:petclinic:iast:high_load better
[-1.705ms; -0.744ms] or [-9.209%; -4.019%]
unsure
[-1564.468µs; -74.635µs] or [-5.262%; -0.251%]
unstable
[-16.938op/s; +41.126op/s] or [-6.766%; +16.428%]
17.292ms 28.909ms 262.438op/s 18.517ms 29.729ms 250.344op/s
scenario:load:petclinic:profiling:high_load worse
[+0.831ms; +1.751ms] or [+4.563%; +9.614%]
unsure
[+0.360ms; +1.879ms] or [+1.217%; +6.361%]
unstable
[-41.031op/s; +14.343op/s] or [-16.343%; +5.713%]
19.508ms 30.663ms 237.719op/s 18.216ms 29.544ms 251.062op/s
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~84ec8a69dd, baseline=1.59.0-SNAPSHOT~92c84e28db
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.188 ms) : 1176, 1200
.   : milestone, 1188,
iast (3.027 ms) : 2991, 3063
.   : milestone, 3027,
iast_FULL (5.841 ms) : 5783, 5899
.   : milestone, 5841,
iast_GLOBAL (3.456 ms) : 3406, 3506
.   : milestone, 3456,
profiling (1.99 ms) : 1973, 2008
.   : milestone, 1990,
tracing (1.782 ms) : 1767, 1797
.   : milestone, 1782,
section candidate
no_agent (1.176 ms) : 1165, 1187
.   : milestone, 1176,
iast (3.251 ms) : 3210, 3292
.   : milestone, 3251,
iast_FULL (5.925 ms) : 5865, 5985
.   : milestone, 5925,
iast_GLOBAL (3.624 ms) : 3563, 3684
.   : milestone, 3624,
profiling (2.062 ms) : 2043, 2080
.   : milestone, 2062,
tracing (1.786 ms) : 1771, 1802
.   : milestone, 1786,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.188 ms [1.176 ms, 1.2 ms] -
iast 3.027 ms [2.991 ms, 3.063 ms] 1.839 ms (154.8%)
iast_FULL 5.841 ms [5.783 ms, 5.899 ms] 4.653 ms (391.6%)
iast_GLOBAL 3.456 ms [3.406 ms, 3.506 ms] 2.268 ms (190.9%)
profiling 1.99 ms [1.973 ms, 2.008 ms] 802.288 µs (67.5%)
tracing 1.782 ms [1.767 ms, 1.797 ms] 593.604 µs (50.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.176 ms [1.165 ms, 1.187 ms] -
iast 3.251 ms [3.21 ms, 3.292 ms] 2.075 ms (176.4%)
iast_FULL 5.925 ms [5.865 ms, 5.985 ms] 4.749 ms (403.8%)
iast_GLOBAL 3.624 ms [3.563 ms, 3.684 ms] 2.448 ms (208.1%)
profiling 2.062 ms [2.043 ms, 2.08 ms] 885.693 µs (75.3%)
tracing 1.786 ms [1.771 ms, 1.802 ms] 610.18 µs (51.9%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~84ec8a69dd, baseline=1.59.0-SNAPSHOT~92c84e28db
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.975 ms) : 18781, 19170
.   : milestone, 18975,
appsec (18.567 ms) : 18376, 18758
.   : milestone, 18567,
code_origins (17.902 ms) : 17722, 18082
.   : milestone, 17902,
iast (18.64 ms) : 18451, 18829
.   : milestone, 18640,
profiling (18.586 ms) : 18400, 18772
.   : milestone, 18586,
tracing (17.54 ms) : 17368, 17712
.   : milestone, 17540,
section candidate
no_agent (18.098 ms) : 17912, 18284
.   : milestone, 18098,
appsec (18.373 ms) : 18188, 18559
.   : milestone, 18373,
code_origins (17.678 ms) : 17503, 17854
.   : milestone, 17678,
iast (17.777 ms) : 17600, 17955
.   : milestone, 17777,
profiling (19.639 ms) : 19440, 19837
.   : milestone, 19639,
tracing (17.606 ms) : 17430, 17782
.   : milestone, 17606,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.975 ms [18.781 ms, 19.17 ms] -
appsec 18.567 ms [18.376 ms, 18.758 ms] -407.824 µs (-2.1%)
code_origins 17.902 ms [17.722 ms, 18.082 ms] -1.073 ms (-5.7%)
iast 18.64 ms [18.451 ms, 18.829 ms] -335.494 µs (-1.8%)
profiling 18.586 ms [18.4 ms, 18.772 ms] -388.756 µs (-2.0%)
tracing 17.54 ms [17.368 ms, 17.712 ms] -1.435 ms (-7.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.098 ms [17.912 ms, 18.284 ms] -
appsec 18.373 ms [18.188 ms, 18.559 ms] 275.865 µs (1.5%)
code_origins 17.678 ms [17.503 ms, 17.854 ms] -419.166 µs (-2.3%)
iast 17.777 ms [17.6 ms, 17.955 ms] -320.281 µs (-1.8%)
profiling 19.639 ms [19.44 ms, 19.837 ms] 1.541 ms (8.5%)
tracing 17.606 ms [17.43 ms, 17.782 ms] -491.818 µs (-2.7%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/fix-cpature-expr-line-probe
git_commit_date 1767720455 1767803570
git_commit_sha 92c84e2 84ec8a6
release_version 1.59.0-SNAPSHOT~92c84e28db 1.59.0-SNAPSHOT~84ec8a69dd
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1767805638 1767805638
ci_job_id 1333577692 1333577692
ci_pipeline_id 89492523 89492523
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-uztfpgxs 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-uztfpgxs 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~84ec8a69dd, baseline=1.59.0-SNAPSHOT~92c84e28db
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.551 s) : 15551000, 15551000
.   : milestone, 15551000,
appsec (14.754 s) : 14754000, 14754000
.   : milestone, 14754000,
iast (18.265 s) : 18265000, 18265000
.   : milestone, 18265000,
iast_GLOBAL (18.077 s) : 18077000, 18077000
.   : milestone, 18077000,
profiling (14.902 s) : 14902000, 14902000
.   : milestone, 14902000,
tracing (14.868 s) : 14868000, 14868000
.   : milestone, 14868000,
section candidate
no_agent (14.822 s) : 14822000, 14822000
.   : milestone, 14822000,
appsec (14.658 s) : 14658000, 14658000
.   : milestone, 14658000,
iast (18.005 s) : 18005000, 18005000
.   : milestone, 18005000,
iast_GLOBAL (17.993 s) : 17993000, 17993000
.   : milestone, 17993000,
profiling (14.723 s) : 14723000, 14723000
.   : milestone, 14723000,
tracing (14.53 s) : 14530000, 14530000
.   : milestone, 14530000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.551 s [15.551 s, 15.551 s] -
appsec 14.754 s [14.754 s, 14.754 s] -797.0 ms (-5.1%)
iast 18.265 s [18.265 s, 18.265 s] 2.714 s (17.5%)
iast_GLOBAL 18.077 s [18.077 s, 18.077 s] 2.526 s (16.2%)
profiling 14.902 s [14.902 s, 14.902 s] -649.0 ms (-4.2%)
tracing 14.868 s [14.868 s, 14.868 s] -683.0 ms (-4.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.822 s [14.822 s, 14.822 s] -
appsec 14.658 s [14.658 s, 14.658 s] -164.0 ms (-1.1%)
iast 18.005 s [18.005 s, 18.005 s] 3.183 s (21.5%)
iast_GLOBAL 17.993 s [17.993 s, 17.993 s] 3.171 s (21.4%)
profiling 14.723 s [14.723 s, 14.723 s] -99.0 ms (-0.7%)
tracing 14.53 s [14.53 s, 14.53 s] -292.0 ms (-2.0%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~84ec8a69dd, baseline=1.59.0-SNAPSHOT~92c84e28db
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.472 ms) : 1460, 1483
.   : milestone, 1472,
appsec (3.728 ms) : 3509, 3948
.   : milestone, 3728,
iast (2.196 ms) : 2131, 2260
.   : milestone, 2196,
iast_GLOBAL (2.254 ms) : 2189, 2319
.   : milestone, 2254,
profiling (2.087 ms) : 2033, 2142
.   : milestone, 2087,
tracing (2.04 ms) : 1989, 2091
.   : milestone, 2040,
section candidate
no_agent (1.475 ms) : 1463, 1486
.   : milestone, 1475,
appsec (3.655 ms) : 3440, 3871
.   : milestone, 3655,
iast (2.21 ms) : 2145, 2275
.   : milestone, 2210,
iast_GLOBAL (2.259 ms) : 2193, 2324
.   : milestone, 2259,
profiling (2.072 ms) : 2018, 2126
.   : milestone, 2072,
tracing (2.029 ms) : 1978, 2079
.   : milestone, 2029,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.472 ms [1.46 ms, 1.483 ms] -
appsec 3.728 ms [3.509 ms, 3.948 ms] 2.257 ms (153.4%)
iast 2.196 ms [2.131 ms, 2.26 ms] 724.226 µs (49.2%)
iast_GLOBAL 2.254 ms [2.189 ms, 2.319 ms] 782.287 µs (53.2%)
profiling 2.087 ms [2.033 ms, 2.142 ms] 615.879 µs (41.9%)
tracing 2.04 ms [1.989 ms, 2.091 ms] 568.545 µs (38.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.475 ms [1.463 ms, 1.486 ms] -
appsec 3.655 ms [3.44 ms, 3.871 ms] 2.181 ms (147.9%)
iast 2.21 ms [2.145 ms, 2.275 ms] 735.283 µs (49.9%)
iast_GLOBAL 2.259 ms [2.193 ms, 2.324 ms] 784.139 µs (53.2%)
profiling 2.072 ms [2.018 ms, 2.126 ms] 597.299 µs (40.5%)
tracing 2.029 ms [1.978 ms, 2.079 ms] 554.165 µs (37.6%)