Analyze okhttp client redirections as separated request by manuel-alvarez-alvarez · Pull Request #10252 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master malvarez/api-10-redirect-support
git_commit_date 1767867104 1767867162
git_commit_sha a227cb1 f87a45c
release_version 1.59.0-SNAPSHOT~a227cb175c 1.58.0-SNAPSHOT~f87a45c04e
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1767869124 1767869124
ci_job_id 1335405201 1335405201
ci_pipeline_id 89631385 89631385
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-0ndepan4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-0ndepan4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 56 metrics, 9 unstable metrics.

Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.58.0-SNAPSHOT~f87a45c04e, baseline=1.59.0-SNAPSHOT~a227cb175c

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.081 s) : 0, 1081341
Total [baseline] (8.706 s) : 0, 8706266
Agent [candidate] (1.084 s) : 0, 1083657
Total [candidate] (8.735 s) : 0, 8734810
section iast
Agent [baseline] (1.221 s) : 0, 1220729
Total [baseline] (9.306 s) : 0, 9306171
Agent [candidate] (1.223 s) : 0, 1222590
Total [candidate] (9.313 s) : 0, 9312587
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.081 s -
Agent iast 1.221 s 139.388 ms (12.9%)
Total tracing 8.706 s -
Total iast 9.306 s 599.906 ms (6.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.084 s -
Agent iast 1.223 s 138.933 ms (12.8%)
Total tracing 8.735 s -
Total iast 9.313 s 577.777 ms (6.6%)
gantt
    title insecure-bank - break down per module: candidate=1.58.0-SNAPSHOT~f87a45c04e, baseline=1.59.0-SNAPSHOT~a227cb175c

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.181 ms) : 0, 1181
crashtracking [candidate] (1.184 ms) : 0, 1184
BytebuddyAgent [baseline] (649.971 ms) : 0, 649971
BytebuddyAgent [candidate] (651.586 ms) : 0, 651586
GlobalTracer [baseline] (281.884 ms) : 0, 281884
GlobalTracer [candidate] (282.391 ms) : 0, 282391
AppSec [baseline] (32.533 ms) : 0, 32533
AppSec [candidate] (32.568 ms) : 0, 32568
Debugger [baseline] (67.034 ms) : 0, 67034
Debugger [candidate] (67.121 ms) : 0, 67121
Remote Config [baseline] (649.545 µs) : 0, 650
Remote Config [candidate] (621.242 µs) : 0, 621
Telemetry [baseline] (8.918 ms) : 0, 8918
Telemetry [candidate] (8.994 ms) : 0, 8994
Flare Poller [baseline] (3.72 ms) : 0, 3720
Flare Poller [candidate] (3.72 ms) : 0, 3720
section iast
crashtracking [baseline] (1.189 ms) : 0, 1189
crashtracking [candidate] (1.174 ms) : 0, 1174
BytebuddyAgent [baseline] (789.916 ms) : 0, 789916
BytebuddyAgent [candidate] (791.644 ms) : 0, 791644
GlobalTracer [baseline] (255.605 ms) : 0, 255605
GlobalTracer [candidate] (256.018 ms) : 0, 256018
AppSec [baseline] (33.498 ms) : 0, 33498
AppSec [candidate] (34.276 ms) : 0, 34276
Debugger [baseline] (65.597 ms) : 0, 65597
Debugger [candidate] (64.31 ms) : 0, 64310
Remote Config [baseline] (609.073 µs) : 0, 609
Remote Config [candidate] (602.055 µs) : 0, 602
Telemetry [baseline] (8.483 ms) : 0, 8483
Telemetry [candidate] (8.532 ms) : 0, 8532
Flare Poller [baseline] (3.585 ms) : 0, 3585
Flare Poller [candidate] (3.554 ms) : 0, 3554
IAST [baseline] (26.848 ms) : 0, 26848
IAST [candidate] (27.054 ms) : 0, 27054
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.58.0-SNAPSHOT~f87a45c04e, baseline=1.59.0-SNAPSHOT~a227cb175c

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.085 s) : 0, 1085117
Total [baseline] (10.814 s) : 0, 10813860
Agent [candidate] (1.089 s) : 0, 1089296
Total [candidate] (10.813 s) : 0, 10812975
section appsec
Agent [baseline] (1.273 s) : 0, 1272530
Total [baseline] (10.925 s) : 0, 10925020
Agent [candidate] (1.272 s) : 0, 1271586
Total [candidate] (10.917 s) : 0, 10916786
section iast
Agent [baseline] (1.232 s) : 0, 1231889
Total [baseline] (11.127 s) : 0, 11127127
Agent [candidate] (1.223 s) : 0, 1223072
Total [candidate] (11.177 s) : 0, 11177308
section profiling
Agent [baseline] (1.22 s) : 0, 1219979
Total [baseline] (10.961 s) : 0, 10960964
Agent [candidate] (1.218 s) : 0, 1218227
Total [candidate] (11.004 s) : 0, 11003773
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.085 s -
Agent appsec 1.273 s 187.412 ms (17.3%)
Agent iast 1.232 s 146.771 ms (13.5%)
Agent profiling 1.22 s 134.862 ms (12.4%)
Total tracing 10.814 s -
Total appsec 10.925 s 111.16 ms (1.0%)
Total iast 11.127 s 313.267 ms (2.9%)
Total profiling 10.961 s 147.104 ms (1.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.089 s -
Agent appsec 1.272 s 182.289 ms (16.7%)
Agent iast 1.223 s 133.775 ms (12.3%)
Agent profiling 1.218 s 128.93 ms (11.8%)
Total tracing 10.813 s -
Total appsec 10.917 s 103.811 ms (1.0%)
Total iast 11.177 s 364.333 ms (3.4%)
Total profiling 11.004 s 190.797 ms (1.8%)
gantt
    title petclinic - break down per module: candidate=1.58.0-SNAPSHOT~f87a45c04e, baseline=1.59.0-SNAPSHOT~a227cb175c

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.18 ms) : 0, 1180
crashtracking [candidate] (1.183 ms) : 0, 1183
BytebuddyAgent [baseline] (651.469 ms) : 0, 651469
BytebuddyAgent [candidate] (654.16 ms) : 0, 654160
GlobalTracer [baseline] (282.339 ms) : 0, 282339
GlobalTracer [candidate] (283.804 ms) : 0, 283804
AppSec [baseline] (32.604 ms) : 0, 32604
AppSec [candidate] (32.878 ms) : 0, 32878
Debugger [baseline] (68.582 ms) : 0, 68582
Debugger [candidate] (68.392 ms) : 0, 68392
Remote Config [baseline] (616.424 µs) : 0, 616
Remote Config [candidate] (616.312 µs) : 0, 616
Telemetry [baseline] (9.046 ms) : 0, 9046
Telemetry [candidate] (9.034 ms) : 0, 9034
Flare Poller [baseline] (3.775 ms) : 0, 3775
Flare Poller [candidate] (3.752 ms) : 0, 3752
section appsec
crashtracking [baseline] (1.185 ms) : 0, 1185
crashtracking [candidate] (1.194 ms) : 0, 1194
BytebuddyAgent [baseline] (695.903 ms) : 0, 695903
BytebuddyAgent [candidate] (696.9 ms) : 0, 696900
GlobalTracer [baseline] (259.684 ms) : 0, 259684
GlobalTracer [candidate] (258.485 ms) : 0, 258485
AppSec [baseline] (174.468 ms) : 0, 174468
AppSec [candidate] (171.214 ms) : 0, 171214
Debugger [baseline] (67.16 ms) : 0, 67160
Debugger [candidate] (69.484 ms) : 0, 69484
Remote Config [baseline] (731.213 µs) : 0, 731
Remote Config [candidate] (756.638 µs) : 0, 757
Telemetry [baseline] (9.33 ms) : 0, 9330
Telemetry [candidate] (9.411 ms) : 0, 9411
Flare Poller [baseline] (3.757 ms) : 0, 3757
Flare Poller [candidate] (3.869 ms) : 0, 3869
IAST [baseline] (24.837 ms) : 0, 24837
IAST [candidate] (24.631 ms) : 0, 24631
section iast
crashtracking [baseline] (1.184 ms) : 0, 1184
crashtracking [candidate] (1.171 ms) : 0, 1171
BytebuddyAgent [baseline] (797.157 ms) : 0, 797157
BytebuddyAgent [candidate] (791.561 ms) : 0, 791561
GlobalTracer [baseline] (257.588 ms) : 0, 257588
GlobalTracer [candidate] (255.605 ms) : 0, 255605
AppSec [baseline] (32.797 ms) : 0, 32797
AppSec [candidate] (34.923 ms) : 0, 34923
Debugger [baseline] (67.77 ms) : 0, 67770
Debugger [candidate] (65.014 ms) : 0, 65014
Remote Config [baseline] (573.515 µs) : 0, 574
Remote Config [candidate] (554.26 µs) : 0, 554
Telemetry [baseline] (8.495 ms) : 0, 8495
Telemetry [candidate] (8.489 ms) : 0, 8489
Flare Poller [baseline] (3.658 ms) : 0, 3658
Flare Poller [candidate] (3.564 ms) : 0, 3564
IAST [baseline] (27.181 ms) : 0, 27181
IAST [candidate] (26.911 ms) : 0, 26911
section profiling
crashtracking [baseline] (1.227 ms) : 0, 1227
crashtracking [candidate] (1.223 ms) : 0, 1223
BytebuddyAgent [baseline] (712.633 ms) : 0, 712633
BytebuddyAgent [candidate] (710.921 ms) : 0, 710921
GlobalTracer [baseline] (222.616 ms) : 0, 222616
GlobalTracer [candidate] (223.313 ms) : 0, 223313
AppSec [baseline] (32.684 ms) : 0, 32684
AppSec [candidate] (32.852 ms) : 0, 32852
Debugger [baseline] (68.761 ms) : 0, 68761
Debugger [candidate] (68.329 ms) : 0, 68329
Remote Config [baseline] (657.252 µs) : 0, 657
Remote Config [candidate] (645.404 µs) : 0, 645
Telemetry [baseline] (8.899 ms) : 0, 8899
Telemetry [candidate] (8.889 ms) : 0, 8889
Flare Poller [baseline] (3.736 ms) : 0, 3736
Flare Poller [candidate] (3.756 ms) : 0, 3756
ProfilingAgent [baseline] (98.188 ms) : 0, 98188
ProfilingAgent [candidate] (98.158 ms) : 0, 98158
Profiling [baseline] (98.779 ms) : 0, 98779
Profiling [candidate] (98.743 ms) : 0, 98743
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master malvarez/api-10-redirect-support
git_commit_date 1767867104 1767867162
git_commit_sha a227cb1 f87a45c
release_version 1.59.0-SNAPSHOT~a227cb175c 1.58.0-SNAPSHOT~f87a45c04e
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1767869522 1767869522
ci_job_id 1335405202 1335405202
ci_pipeline_id 89631385 89631385
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-2i3o79kj 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-2i3o79kj 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 2 performance regressions! Performance is the same for 17 metrics, 15 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast:high_load better
[-150.680µs; -73.626µs] or [-6.013%; -2.938%]
unsure
[-524.522µs; -115.065µs] or [-7.074%; -1.552%]
unstable
[-87.366op/s; +233.053op/s] or [-6.199%; +16.535%]
2.394ms 7.095ms 1482.281op/s 2.506ms 7.414ms 1409.438op/s
scenario:load:petclinic:appsec:high_load worse
[+0.782ms; +1.798ms] or [+4.302%; +9.895%]
same
[-0.044ms; +2.425ms] or [-0.147%; +8.122%]
unstable
[-44.320op/s; +8.945op/s] or [-17.607%; +3.554%]
19.465ms 31.044ms 234.031op/s 18.175ms 29.854ms 251.719op/s
scenario:load:petclinic:no_agent:high_load better
[-2.092ms; -0.657ms] or [-11.750%; -3.690%]
unsure
[-3.260ms; -0.361ms] or [-10.982%; -1.217%]
unstable
[+1.125op/s; +52.103op/s] or [+0.439%; +20.350%]
16.430ms 27.876ms 282.645op/s 17.805ms 29.687ms 256.031op/s
scenario:load:petclinic:tracing:high_load worse
[+350.111µs; +1288.608µs] or [+2.036%; +7.495%]
same
[-537.125µs; +1681.788µs] or [-1.892%; +5.924%]
unstable
[-39.185op/s; +18.873op/s] or [-14.824%; +7.139%]
18.012ms 28.960ms 254.188op/s 17.193ms 28.387ms 264.344op/s
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.58.0-SNAPSHOT~f87a45c04e, baseline=1.59.0-SNAPSHOT~a227cb175c
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.228 ms) : 18040, 18416
.   : milestone, 18228,
appsec (18.54 ms) : 18353, 18727
.   : milestone, 18540,
code_origins (17.686 ms) : 17510, 17863
.   : milestone, 17686,
iast (17.631 ms) : 17457, 17805
.   : milestone, 17631,
profiling (18.613 ms) : 18424, 18802
.   : milestone, 18613,
tracing (17.649 ms) : 17472, 17825
.   : milestone, 17649,
section candidate
no_agent (17.037 ms) : 16871, 17202
.   : milestone, 17037,
appsec (19.947 ms) : 19745, 20149
.   : milestone, 19947,
code_origins (17.878 ms) : 17704, 18053
.   : milestone, 17878,
iast (17.764 ms) : 17587, 17940
.   : milestone, 17764,
profiling (18.764 ms) : 18573, 18956
.   : milestone, 18764,
tracing (18.362 ms) : 18176, 18548
.   : milestone, 18362,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.228 ms [18.04 ms, 18.416 ms] -
appsec 18.54 ms [18.353 ms, 18.727 ms] 312.136 µs (1.7%)
code_origins 17.686 ms [17.51 ms, 17.863 ms] -541.427 µs (-3.0%)
iast 17.631 ms [17.457 ms, 17.805 ms] -596.69 µs (-3.3%)
profiling 18.613 ms [18.424 ms, 18.802 ms] 385.287 µs (2.1%)
tracing 17.649 ms [17.472 ms, 17.825 ms] -578.928 µs (-3.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.037 ms [16.871 ms, 17.202 ms] -
appsec 19.947 ms [19.745 ms, 20.149 ms] 2.911 ms (17.1%)
code_origins 17.878 ms [17.704 ms, 18.053 ms] 841.774 µs (4.9%)
iast 17.764 ms [17.587 ms, 17.94 ms] 727.289 µs (4.3%)
profiling 18.764 ms [18.573 ms, 18.956 ms] 1.728 ms (10.1%)
tracing 18.362 ms [18.176 ms, 18.548 ms] 1.326 ms (7.8%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.58.0-SNAPSHOT~f87a45c04e, baseline=1.59.0-SNAPSHOT~a227cb175c
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.181 ms) : 1169, 1192
.   : milestone, 1181,
iast (3.247 ms) : 3204, 3290
.   : milestone, 3247,
iast_FULL (5.647 ms) : 5591, 5703
.   : milestone, 5647,
iast_GLOBAL (3.596 ms) : 3543, 3649
.   : milestone, 3596,
profiling (2.03 ms) : 2012, 2048
.   : milestone, 2030,
tracing (1.802 ms) : 1787, 1817
.   : milestone, 1802,
section candidate
no_agent (1.214 ms) : 1202, 1227
.   : milestone, 1214,
iast (3.082 ms) : 3043, 3121
.   : milestone, 3082,
iast_FULL (5.495 ms) : 5441, 5548
.   : milestone, 5495,
iast_GLOBAL (3.666 ms) : 3608, 3725
.   : milestone, 3666,
profiling (1.939 ms) : 1922, 1955
.   : milestone, 1939,
tracing (1.859 ms) : 1842, 1876
.   : milestone, 1859,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.181 ms [1.169 ms, 1.192 ms] -
iast 3.247 ms [3.204 ms, 3.29 ms] 2.066 ms (175.0%)
iast_FULL 5.647 ms [5.591 ms, 5.703 ms] 4.466 ms (378.3%)
iast_GLOBAL 3.596 ms [3.543 ms, 3.649 ms] 2.415 ms (204.6%)
profiling 2.03 ms [2.012 ms, 2.048 ms] 849.332 µs (71.9%)
tracing 1.802 ms [1.787 ms, 1.817 ms] 621.319 µs (52.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.214 ms [1.202 ms, 1.227 ms] -
iast 3.082 ms [3.043 ms, 3.121 ms] 1.868 ms (153.9%)
iast_FULL 5.495 ms [5.441 ms, 5.548 ms] 4.28 ms (352.5%)
iast_GLOBAL 3.666 ms [3.608 ms, 3.725 ms] 2.452 ms (202.0%)
profiling 1.939 ms [1.922 ms, 1.955 ms] 724.466 µs (59.7%)
tracing 1.859 ms [1.842 ms, 1.876 ms] 644.442 µs (53.1%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master malvarez/api-10-redirect-support
git_commit_date 1767867104 1767867162
git_commit_sha a227cb1 f87a45c
release_version 1.59.0-SNAPSHOT~a227cb175c 1.58.0-SNAPSHOT~f87a45c04e
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1767869487 1767869487
ci_job_id 1335405203 1335405203
ci_pipeline_id 89631385 89631385
cpu_model Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-0k032s83 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-0k032s83 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.58.0-SNAPSHOT~f87a45c04e, baseline=1.59.0-SNAPSHOT~a227cb175c
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.119 s) : 15119000, 15119000
.   : milestone, 15119000,
appsec (14.311 s) : 14311000, 14311000
.   : milestone, 14311000,
iast (17.555 s) : 17555000, 17555000
.   : milestone, 17555000,
iast_GLOBAL (17.174 s) : 17174000, 17174000
.   : milestone, 17174000,
profiling (14.671 s) : 14671000, 14671000
.   : milestone, 14671000,
tracing (14.118 s) : 14118000, 14118000
.   : milestone, 14118000,
section candidate
no_agent (14.616 s) : 14616000, 14616000
.   : milestone, 14616000,
appsec (14.32 s) : 14320000, 14320000
.   : milestone, 14320000,
iast (17.46 s) : 17460000, 17460000
.   : milestone, 17460000,
iast_GLOBAL (17.303 s) : 17303000, 17303000
.   : milestone, 17303000,
profiling (14.227 s) : 14227000, 14227000
.   : milestone, 14227000,
tracing (14.075 s) : 14075000, 14075000
.   : milestone, 14075000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.119 s [15.119 s, 15.119 s] -
appsec 14.311 s [14.311 s, 14.311 s] -808.0 ms (-5.3%)
iast 17.555 s [17.555 s, 17.555 s] 2.436 s (16.1%)
iast_GLOBAL 17.174 s [17.174 s, 17.174 s] 2.055 s (13.6%)
profiling 14.671 s [14.671 s, 14.671 s] -448.0 ms (-3.0%)
tracing 14.118 s [14.118 s, 14.118 s] -1.001 s (-6.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.616 s [14.616 s, 14.616 s] -
appsec 14.32 s [14.32 s, 14.32 s] -296.0 ms (-2.0%)
iast 17.46 s [17.46 s, 17.46 s] 2.844 s (19.5%)
iast_GLOBAL 17.303 s [17.303 s, 17.303 s] 2.687 s (18.4%)
profiling 14.227 s [14.227 s, 14.227 s] -389.0 ms (-2.7%)
tracing 14.075 s [14.075 s, 14.075 s] -541.0 ms (-3.7%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.58.0-SNAPSHOT~f87a45c04e, baseline=1.59.0-SNAPSHOT~a227cb175c
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.487 ms) : 1475, 1499
.   : milestone, 1487,
appsec (4.092 ms) : 3844, 4341
.   : milestone, 4092,
iast (2.586 ms) : 2484, 2688
.   : milestone, 2586,
iast_GLOBAL (2.622 ms) : 2520, 2724
.   : milestone, 2622,
profiling (2.417 ms) : 2329, 2506
.   : milestone, 2417,
tracing (2.379 ms) : 2296, 2463
.   : milestone, 2379,
section candidate
no_agent (1.48 ms) : 1468, 1492
.   : milestone, 1480,
appsec (4.182 ms) : 3929, 4434
.   : milestone, 4182,
iast (2.578 ms) : 2476, 2680
.   : milestone, 2578,
iast_GLOBAL (2.627 ms) : 2524, 2729
.   : milestone, 2627,
profiling (2.425 ms) : 2337, 2514
.   : milestone, 2425,
tracing (2.374 ms) : 2291, 2458
.   : milestone, 2374,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.487 ms [1.475 ms, 1.499 ms] -
appsec 4.092 ms [3.844 ms, 4.341 ms] 2.606 ms (175.3%)
iast 2.586 ms [2.484 ms, 2.688 ms] 1.099 ms (73.9%)
iast_GLOBAL 2.622 ms [2.52 ms, 2.724 ms] 1.135 ms (76.4%)
profiling 2.417 ms [2.329 ms, 2.506 ms] 930.505 µs (62.6%)
tracing 2.379 ms [2.296 ms, 2.463 ms] 892.493 µs (60.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.48 ms [1.468 ms, 1.492 ms] -
appsec 4.182 ms [3.929 ms, 4.434 ms] 2.702 ms (182.6%)
iast 2.578 ms [2.476 ms, 2.68 ms] 1.098 ms (74.2%)
iast_GLOBAL 2.627 ms [2.524 ms, 2.729 ms] 1.147 ms (77.5%)
profiling 2.425 ms [2.337 ms, 2.514 ms] 945.515 µs (63.9%)
tracing 2.374 ms [2.291 ms, 2.458 ms] 894.59 µs (60.4%)