Add a limit to the number of elements we process in a mongo document by vandonr · Pull Request #10277 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master vandonr/fix
git_commit_date 1767104829 1767106801
git_commit_sha 33864ab 6c2def3
release_version 1.58.0-SNAPSHOT~33864ab8fb 1.58.0-SNAPSHOT~6c2def347b
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1767108731 1767108731
ci_job_id 1321911708 1321911708
ci_pipeline_id 88582550 88582550
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-hlluv9hd 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-hlluv9hd 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 7 unstable metrics.

Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.58.0-SNAPSHOT~6c2def347b, baseline=1.58.0-SNAPSHOT~33864ab8fb

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.084 s) : 0, 1084442
Total [baseline] (8.77 s) : 0, 8770170
Agent [candidate] (1.085 s) : 0, 1085437
Total [candidate] (8.731 s) : 0, 8731310
section iast
Agent [baseline] (1.225 s) : 0, 1224591
Total [baseline] (9.331 s) : 0, 9330770
Agent [candidate] (1.234 s) : 0, 1233608
Total [candidate] (9.329 s) : 0, 9328786
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.084 s -
Agent iast 1.225 s 140.149 ms (12.9%)
Total tracing 8.77 s -
Total iast 9.331 s 560.6 ms (6.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.085 s -
Agent iast 1.234 s 148.17 ms (13.7%)
Total tracing 8.731 s -
Total iast 9.329 s 597.477 ms (6.8%)
gantt
    title insecure-bank - break down per module: candidate=1.58.0-SNAPSHOT~6c2def347b, baseline=1.58.0-SNAPSHOT~33864ab8fb

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.196 ms) : 0, 1196
crashtracking [candidate] (1.191 ms) : 0, 1191
BytebuddyAgent [baseline] (651.762 ms) : 0, 651762
BytebuddyAgent [candidate] (653.365 ms) : 0, 653365
GlobalTracer [baseline] (281.855 ms) : 0, 281855
GlobalTracer [candidate] (282.246 ms) : 0, 282246
AppSec [baseline] (32.598 ms) : 0, 32598
AppSec [candidate] (32.671 ms) : 0, 32671
Debugger [baseline] (67.952 ms) : 0, 67952
Debugger [candidate] (66.904 ms) : 0, 66904
Remote Config [baseline] (639.216 µs) : 0, 639
Remote Config [candidate] (632.287 µs) : 0, 632
Telemetry [baseline] (9.035 ms) : 0, 9035
Telemetry [candidate] (9.068 ms) : 0, 9068
Flare Poller [baseline] (3.72 ms) : 0, 3720
Flare Poller [candidate] (3.751 ms) : 0, 3751
section iast
crashtracking [baseline] (1.195 ms) : 0, 1195
crashtracking [candidate] (1.196 ms) : 0, 1196
BytebuddyAgent [baseline] (793.322 ms) : 0, 793322
BytebuddyAgent [candidate] (799.952 ms) : 0, 799952
GlobalTracer [baseline] (254.988 ms) : 0, 254988
GlobalTracer [candidate] (257.108 ms) : 0, 257108
IAST [baseline] (26.985 ms) : 0, 26985
IAST [candidate] (27.405 ms) : 0, 27405
AppSec [baseline] (33.754 ms) : 0, 33754
AppSec [candidate] (33.581 ms) : 0, 33581
Debugger [baseline] (66.173 ms) : 0, 66173
Debugger [candidate] (66.079 ms) : 0, 66079
Remote Config [baseline] (591.199 µs) : 0, 591
Remote Config [candidate] (609.724 µs) : 0, 610
Telemetry [baseline] (8.538 ms) : 0, 8538
Telemetry [candidate] (8.467 ms) : 0, 8467
Flare Poller [baseline] (3.548 ms) : 0, 3548
Flare Poller [candidate] (3.551 ms) : 0, 3551
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.58.0-SNAPSHOT~6c2def347b, baseline=1.58.0-SNAPSHOT~33864ab8fb

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.085 s) : 0, 1084692
Total [baseline] (10.758 s) : 0, 10758002
Agent [candidate] (1.092 s) : 0, 1092176
Total [candidate] (10.857 s) : 0, 10856896
section appsec
Agent [baseline] (1.266 s) : 0, 1265599
Total [baseline] (10.882 s) : 0, 10881692
Agent [candidate] (1.266 s) : 0, 1266356
Total [candidate] (10.904 s) : 0, 10904070
section iast
Agent [baseline] (1.233 s) : 0, 1232931
Total [baseline] (11.175 s) : 0, 11175194
Agent [candidate] (1.222 s) : 0, 1221827
Total [candidate] (11.158 s) : 0, 11158373
section profiling
Agent [baseline] (1.208 s) : 0, 1208263
Total [baseline] (10.981 s) : 0, 10980594
Agent [candidate] (1.216 s) : 0, 1216375
Total [candidate] (11.039 s) : 0, 11039247
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.085 s -
Agent appsec 1.266 s 180.907 ms (16.7%)
Agent iast 1.233 s 148.239 ms (13.7%)
Agent profiling 1.208 s 123.571 ms (11.4%)
Total tracing 10.758 s -
Total appsec 10.882 s 123.69 ms (1.1%)
Total iast 11.175 s 417.192 ms (3.9%)
Total profiling 10.981 s 222.592 ms (2.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.092 s -
Agent appsec 1.266 s 174.18 ms (15.9%)
Agent iast 1.222 s 129.652 ms (11.9%)
Agent profiling 1.216 s 124.199 ms (11.4%)
Total tracing 10.857 s -
Total appsec 10.904 s 47.175 ms (0.4%)
Total iast 11.158 s 301.477 ms (2.8%)
Total profiling 11.039 s 182.351 ms (1.7%)
gantt
    title petclinic - break down per module: candidate=1.58.0-SNAPSHOT~6c2def347b, baseline=1.58.0-SNAPSHOT~33864ab8fb

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.189 ms) : 0, 1189
crashtracking [candidate] (1.191 ms) : 0, 1191
BytebuddyAgent [baseline] (651.14 ms) : 0, 651140
BytebuddyAgent [candidate] (656.445 ms) : 0, 656445
GlobalTracer [baseline] (282.478 ms) : 0, 282478
GlobalTracer [candidate] (284.078 ms) : 0, 284078
AppSec [baseline] (32.522 ms) : 0, 32522
AppSec [candidate] (32.882 ms) : 0, 32882
Debugger [baseline] (68.449 ms) : 0, 68449
Debugger [candidate] (68.333 ms) : 0, 68333
Remote Config [baseline] (618.052 µs) : 0, 618
Remote Config [candidate] (619.26 µs) : 0, 619
Telemetry [baseline] (8.986 ms) : 0, 8986
Telemetry [candidate] (9.072 ms) : 0, 9072
Flare Poller [baseline] (3.747 ms) : 0, 3747
Flare Poller [candidate] (3.76 ms) : 0, 3760
section appsec
crashtracking [baseline] (1.194 ms) : 0, 1194
crashtracking [candidate] (1.18 ms) : 0, 1180
BytebuddyAgent [baseline] (692.124 ms) : 0, 692124
BytebuddyAgent [candidate] (691.882 ms) : 0, 691882
GlobalTracer [baseline] (257.91 ms) : 0, 257910
GlobalTracer [candidate] (258.032 ms) : 0, 258032
IAST [baseline] (24.568 ms) : 0, 24568
IAST [candidate] (24.758 ms) : 0, 24758
AppSec [baseline] (174.553 ms) : 0, 174553
AppSec [candidate] (174.385 ms) : 0, 174385
Debugger [baseline] (66.093 ms) : 0, 66093
Debugger [candidate] (66.8 ms) : 0, 66800
Remote Config [baseline] (764.545 µs) : 0, 765
Remote Config [candidate] (771.423 µs) : 0, 771
Telemetry [baseline] (9.355 ms) : 0, 9355
Telemetry [candidate] (9.467 ms) : 0, 9467
Flare Poller [baseline] (3.587 ms) : 0, 3587
Flare Poller [candidate] (3.714 ms) : 0, 3714
section iast
crashtracking [baseline] (1.188 ms) : 0, 1188
crashtracking [candidate] (1.185 ms) : 0, 1185
BytebuddyAgent [baseline] (796.694 ms) : 0, 796694
BytebuddyAgent [candidate] (790.713 ms) : 0, 790713
GlobalTracer [baseline] (257.617 ms) : 0, 257617
GlobalTracer [candidate] (255.198 ms) : 0, 255198
IAST [baseline] (27.378 ms) : 0, 27378
IAST [candidate] (26.9 ms) : 0, 26900
AppSec [baseline] (33.921 ms) : 0, 33921
AppSec [candidate] (35.375 ms) : 0, 35375
Debugger [baseline] (67.544 ms) : 0, 67544
Debugger [candidate] (64.477 ms) : 0, 64477
Remote Config [baseline] (612.0 µs) : 0, 612
Remote Config [candidate] (563.976 µs) : 0, 564
Telemetry [baseline] (8.691 ms) : 0, 8691
Telemetry [candidate] (8.436 ms) : 0, 8436
Flare Poller [baseline] (3.627 ms) : 0, 3627
Flare Poller [candidate] (3.53 ms) : 0, 3530
section profiling
crashtracking [baseline] (1.213 ms) : 0, 1213
crashtracking [candidate] (1.245 ms) : 0, 1245
BytebuddyAgent [baseline] (704.96 ms) : 0, 704960
BytebuddyAgent [candidate] (710.25 ms) : 0, 710250
GlobalTracer [baseline] (220.928 ms) : 0, 220928
GlobalTracer [candidate] (221.734 ms) : 0, 221734
AppSec [baseline] (32.232 ms) : 0, 32232
AppSec [candidate] (32.515 ms) : 0, 32515
Debugger [baseline] (68.009 ms) : 0, 68009
Debugger [candidate] (68.548 ms) : 0, 68548
Remote Config [baseline] (665.284 µs) : 0, 665
Remote Config [candidate] (638.039 µs) : 0, 638
Telemetry [baseline] (8.769 ms) : 0, 8769
Telemetry [candidate] (8.918 ms) : 0, 8918
Flare Poller [baseline] (3.754 ms) : 0, 3754
Flare Poller [candidate] (3.824 ms) : 0, 3824
ProfilingAgent [baseline] (97.809 ms) : 0, 97809
ProfilingAgent [candidate] (98.29 ms) : 0, 98290
Profiling [baseline] (98.386 ms) : 0, 98386
Profiling [candidate] (98.9 ms) : 0, 98900
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master vandonr/fix
git_commit_date 1767104829 1767106801
git_commit_sha 33864ab 6c2def3
release_version 1.58.0-SNAPSHOT~33864ab8fb 1.58.0-SNAPSHOT~6c2def347b
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1767109283 1767109283
ci_job_id 1321911711 1321911711
ci_pipeline_id 88582550 88582550
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-b7bpka77 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-b7bpka77 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 2 performance regressions! Performance is the same for 16 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load better
[-256.183µs; -121.789µs] or [-8.888%; -4.225%]
better
[-637.198µs; -235.228µs] or [-7.920%; -2.924%]
unstable
[-51.408op/s; +196.721op/s] or [-4.060%; +15.535%]
2.693ms 7.609ms 1338.938op/s 2.882ms 8.045ms 1266.281op/s
scenario:load:petclinic:tracing:high_load worse
[+627.303µs; +1294.987µs] or [+3.610%; +7.452%]
worse
[+0.599ms; +1.804ms] or [+2.104%; +6.340%]
unstable
[-37.887op/s; +13.762op/s] or [-14.421%; +5.238%]
18.340ms 29.649ms 250.656op/s 17.379ms 28.448ms 262.719op/s
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.58.0-SNAPSHOT~6c2def347b, baseline=1.58.0-SNAPSHOT~33864ab8fb
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.307 ms) : 19110, 19504
.   : milestone, 19307,
appsec (18.605 ms) : 18412, 18797
.   : milestone, 18605,
code_origins (18.025 ms) : 17844, 18207
.   : milestone, 18025,
iast (17.738 ms) : 17565, 17911
.   : milestone, 17738,
profiling (18.726 ms) : 18540, 18912
.   : milestone, 18726,
tracing (17.764 ms) : 17586, 17942
.   : milestone, 17764,
section candidate
no_agent (18.058 ms) : 17877, 18238
.   : milestone, 18058,
appsec (18.643 ms) : 18455, 18830
.   : milestone, 18643,
code_origins (17.904 ms) : 17723, 18084
.   : milestone, 17904,
iast (18.137 ms) : 17956, 18317
.   : milestone, 18137,
profiling (18.727 ms) : 18538, 18915
.   : milestone, 18727,
tracing (18.62 ms) : 18434, 18807
.   : milestone, 18620,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.307 ms [19.11 ms, 19.504 ms] -
appsec 18.605 ms [18.412 ms, 18.797 ms] -702.37 µs (-3.6%)
code_origins 18.025 ms [17.844 ms, 18.207 ms] -1.282 ms (-6.6%)
iast 17.738 ms [17.565 ms, 17.911 ms] -1.569 ms (-8.1%)
profiling 18.726 ms [18.54 ms, 18.912 ms] -580.768 µs (-3.0%)
tracing 17.764 ms [17.586 ms, 17.942 ms] -1.543 ms (-8.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.058 ms [17.877 ms, 18.238 ms] -
appsec 18.643 ms [18.455 ms, 18.83 ms] 585.008 µs (3.2%)
code_origins 17.904 ms [17.723 ms, 18.084 ms] -154.029 µs (-0.9%)
iast 18.137 ms [17.956 ms, 18.317 ms] 79.313 µs (0.4%)
profiling 18.727 ms [18.538 ms, 18.915 ms] 669.286 µs (3.7%)
tracing 18.62 ms [18.434 ms, 18.807 ms] 562.632 µs (3.1%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.58.0-SNAPSHOT~6c2def347b, baseline=1.58.0-SNAPSHOT~33864ab8fb
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.184 ms) : 1172, 1196
.   : milestone, 1184,
iast (3.095 ms) : 3055, 3134
.   : milestone, 3095,
iast_FULL (5.665 ms) : 5608, 5721
.   : milestone, 5665,
iast_GLOBAL (3.624 ms) : 3570, 3678
.   : milestone, 3624,
profiling (1.922 ms) : 1906, 1938
.   : milestone, 1922,
tracing (1.759 ms) : 1744, 1773
.   : milestone, 1759,
section candidate
no_agent (1.183 ms) : 1171, 1196
.   : milestone, 1183,
iast (3.206 ms) : 3164, 3247
.   : milestone, 3206,
iast_FULL (5.829 ms) : 5770, 5888
.   : milestone, 5829,
iast_GLOBAL (3.422 ms) : 3373, 3471
.   : milestone, 3422,
profiling (1.894 ms) : 1879, 1909
.   : milestone, 1894,
tracing (1.751 ms) : 1737, 1765
.   : milestone, 1751,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.184 ms [1.172 ms, 1.196 ms] -
iast 3.095 ms [3.055 ms, 3.134 ms] 1.911 ms (161.3%)
iast_FULL 5.665 ms [5.608 ms, 5.721 ms] 4.48 ms (378.3%)
iast_GLOBAL 3.624 ms [3.57 ms, 3.678 ms] 2.44 ms (206.0%)
profiling 1.922 ms [1.906 ms, 1.938 ms] 737.61 µs (62.3%)
tracing 1.759 ms [1.744 ms, 1.773 ms] 574.425 µs (48.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.183 ms [1.171 ms, 1.196 ms] -
iast 3.206 ms [3.164 ms, 3.247 ms] 2.022 ms (170.9%)
iast_FULL 5.829 ms [5.77 ms, 5.888 ms] 4.646 ms (392.6%)
iast_GLOBAL 3.422 ms [3.373 ms, 3.471 ms] 2.239 ms (189.2%)
profiling 1.894 ms [1.879 ms, 1.909 ms] 710.428 µs (60.0%)
tracing 1.751 ms [1.737 ms, 1.765 ms] 567.696 µs (48.0%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master vandonr/fix
git_commit_date 1767104829 1767106801
git_commit_sha 33864ab 6c2def3
release_version 1.58.0-SNAPSHOT~33864ab8fb 1.58.0-SNAPSHOT~6c2def347b
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1767108762 1767108762
ci_job_id 1321911715 1321911715
ci_pipeline_id 88582550 88582550
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-s5mn2yoc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-s5mn2yoc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics.

Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.58.0-SNAPSHOT~6c2def347b, baseline=1.58.0-SNAPSHOT~33864ab8fb
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.483 ms) : 1472, 1495
.   : milestone, 1483,
appsec (3.735 ms) : 3516, 3954
.   : milestone, 3735,
iast (2.211 ms) : 2147, 2275
.   : milestone, 2211,
iast_GLOBAL (2.263 ms) : 2198, 2328
.   : milestone, 2263,
profiling (2.056 ms) : 2004, 2108
.   : milestone, 2056,
tracing (2.049 ms) : 1997, 2100
.   : milestone, 2049,
section candidate
no_agent (1.479 ms) : 1468, 1491
.   : milestone, 1479,
appsec (3.699 ms) : 3481, 3917
.   : milestone, 3699,
iast (2.213 ms) : 2148, 2278
.   : milestone, 2213,
iast_GLOBAL (2.263 ms) : 2198, 2328
.   : milestone, 2263,
profiling (2.491 ms) : 2331, 2651
.   : milestone, 2491,
tracing (2.044 ms) : 1993, 2095
.   : milestone, 2044,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.483 ms [1.472 ms, 1.495 ms] -
appsec 3.735 ms [3.516 ms, 3.954 ms] 2.251 ms (151.8%)
iast 2.211 ms [2.147 ms, 2.275 ms] 727.172 µs (49.0%)
iast_GLOBAL 2.263 ms [2.198 ms, 2.328 ms] 779.174 µs (52.5%)
profiling 2.056 ms [2.004 ms, 2.108 ms] 572.65 µs (38.6%)
tracing 2.049 ms [1.997 ms, 2.1 ms] 565.082 µs (38.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.479 ms [1.468 ms, 1.491 ms] -
appsec 3.699 ms [3.481 ms, 3.917 ms] 2.22 ms (150.1%)
iast 2.213 ms [2.148 ms, 2.278 ms] 733.651 µs (49.6%)
iast_GLOBAL 2.263 ms [2.198 ms, 2.328 ms] 783.952 µs (53.0%)
profiling 2.491 ms [2.331 ms, 2.651 ms] 1.012 ms (68.4%)
tracing 2.044 ms [1.993 ms, 2.095 ms] 564.84 µs (38.2%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.58.0-SNAPSHOT~6c2def347b, baseline=1.58.0-SNAPSHOT~33864ab8fb
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.272 s) : 15272000, 15272000
.   : milestone, 15272000,
appsec (14.58 s) : 14580000, 14580000
.   : milestone, 14580000,
iast (18.414 s) : 18414000, 18414000
.   : milestone, 18414000,
iast_GLOBAL (17.924 s) : 17924000, 17924000
.   : milestone, 17924000,
profiling (14.702 s) : 14702000, 14702000
.   : milestone, 14702000,
tracing (14.688 s) : 14688000, 14688000
.   : milestone, 14688000,
section candidate
no_agent (14.965 s) : 14965000, 14965000
.   : milestone, 14965000,
appsec (14.972 s) : 14972000, 14972000
.   : milestone, 14972000,
iast (18.299 s) : 18299000, 18299000
.   : milestone, 18299000,
iast_GLOBAL (17.851 s) : 17851000, 17851000
.   : milestone, 17851000,
profiling (14.61 s) : 14610000, 14610000
.   : milestone, 14610000,
tracing (14.698 s) : 14698000, 14698000
.   : milestone, 14698000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.272 s [15.272 s, 15.272 s] -
appsec 14.58 s [14.58 s, 14.58 s] -692.0 ms (-4.5%)
iast 18.414 s [18.414 s, 18.414 s] 3.142 s (20.6%)
iast_GLOBAL 17.924 s [17.924 s, 17.924 s] 2.652 s (17.4%)
profiling 14.702 s [14.702 s, 14.702 s] -570.0 ms (-3.7%)
tracing 14.688 s [14.688 s, 14.688 s] -584.0 ms (-3.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.965 s [14.965 s, 14.965 s] -
appsec 14.972 s [14.972 s, 14.972 s] 7.0 ms (0.0%)
iast 18.299 s [18.299 s, 18.299 s] 3.334 s (22.3%)
iast_GLOBAL 17.851 s [17.851 s, 17.851 s] 2.886 s (19.3%)
profiling 14.61 s [14.61 s, 14.61 s] -355.0 ms (-2.4%)
tracing 14.698 s [14.698 s, 14.698 s] -267.0 ms (-1.8%)