Home Original page

Enabling optimized map by default by dougqh · Pull Request #10016 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master dougqh/optimized-map-on-by-default
git_commit_date 1768216781 1768229006
git_commit_sha 645ed32 1287c94
release_version 1.59.0-SNAPSHOT~645ed325fc 1.57.0-SNAPSHOT~1287c94bb7
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1768230918 1768230918
ci_job_id 1343210362 1343210362
ci_pipeline_id 90204341 90204341
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-irzy41pn 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-irzy41pn 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 54 metrics, 11 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.57.0-SNAPSHOT~1287c94bb7, baseline=1.59.0-SNAPSHOT~645ed325fc

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.084 s) : 0, 1083973
Total [baseline] (10.772 s) : 0, 10772330
Agent [candidate] (1.091 s) : 0, 1091033
Total [candidate] (10.92 s) : 0, 10919849
section appsec
Agent [baseline] (1.268 s) : 0, 1268135
Total [baseline] (11.053 s) : 0, 11052797
Agent [candidate] (1.269 s) : 0, 1268762
Total [candidate] (11.046 s) : 0, 11045804
section iast
Agent [baseline] (1.227 s) : 0, 1227169
Total [baseline] (11.226 s) : 0, 11225828
Agent [candidate] (1.232 s) : 0, 1231561
Total [candidate] (11.132 s) : 0, 11131687
section profiling
Agent [baseline] (1.214 s) : 0, 1213515
Total [baseline] (11.008 s) : 0, 11008096
Agent [candidate] (1.207 s) : 0, 1206512
Total [candidate] (10.955 s) : 0, 10955315
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.084 s -
Agent appsec 1.268 s 184.162 ms (17.0%)
Agent iast 1.227 s 143.195 ms (13.2%)
Agent profiling 1.214 s 129.542 ms (12.0%)
Total tracing 10.772 s -
Total appsec 11.053 s 280.467 ms (2.6%)
Total iast 11.226 s 453.498 ms (4.2%)
Total profiling 11.008 s 235.766 ms (2.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.091 s -
Agent appsec 1.269 s 177.729 ms (16.3%)
Agent iast 1.232 s 140.528 ms (12.9%)
Agent profiling 1.207 s 115.479 ms (10.6%)
Total tracing 10.92 s -
Total appsec 11.046 s 125.956 ms (1.2%)
Total iast 11.132 s 211.838 ms (1.9%)
Total profiling 10.955 s 35.466 ms (0.3%) 
gantt
    title petclinic - break down per module: candidate=1.57.0-SNAPSHOT~1287c94bb7, baseline=1.59.0-SNAPSHOT~645ed325fc

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.183 ms) : 0, 1183
crashtracking [candidate] (1.198 ms) : 0, 1198
BytebuddyAgent [baseline] (650.634 ms) : 0, 650634
BytebuddyAgent [candidate] (654.993 ms) : 0, 654993
GlobalTracer [baseline] (282.585 ms) : 0, 282585
GlobalTracer [candidate] (284.646 ms) : 0, 284646
AppSec [baseline] (32.417 ms) : 0, 32417
AppSec [candidate] (32.932 ms) : 0, 32932
Debugger [baseline] (68.081 ms) : 0, 68081
Debugger [candidate] (67.396 ms) : 0, 67396
Remote Config [baseline] (668.155 µs) : 0, 668
Remote Config [candidate] (655.708 µs) : 0, 656
Telemetry [baseline] (8.978 ms) : 0, 8978
Telemetry [candidate] (8.945 ms) : 0, 8945
Flare Poller [baseline] (3.794 ms) : 0, 3794
Flare Poller [candidate] (4.542 ms) : 0, 4542
section appsec
crashtracking [baseline] (1.189 ms) : 0, 1189
crashtracking [candidate] (1.191 ms) : 0, 1191
BytebuddyAgent [baseline] (691.605 ms) : 0, 691605
BytebuddyAgent [candidate] (691.509 ms) : 0, 691509
GlobalTracer [baseline] (258.937 ms) : 0, 258937
GlobalTracer [candidate] (259.75 ms) : 0, 259750
IAST [baseline] (24.559 ms) : 0, 24559
IAST [candidate] (24.513 ms) : 0, 24513
AppSec [baseline] (173.604 ms) : 0, 173604
AppSec [candidate] (174.309 ms) : 0, 174309
Debugger [baseline] (68.547 ms) : 0, 68547
Debugger [candidate] (68.025 ms) : 0, 68025
Remote Config [baseline] (787.906 µs) : 0, 788
Remote Config [candidate] (800.799 µs) : 0, 801
Telemetry [baseline] (9.512 ms) : 0, 9512
Telemetry [candidate] (9.368 ms) : 0, 9368
Flare Poller [baseline] (3.867 ms) : 0, 3867
Flare Poller [candidate] (3.778 ms) : 0, 3778
section iast
crashtracking [baseline] (1.205 ms) : 0, 1205
crashtracking [candidate] (1.202 ms) : 0, 1202
BytebuddyAgent [baseline] (793.699 ms) : 0, 793699
BytebuddyAgent [candidate] (795.877 ms) : 0, 795877
GlobalTracer [baseline] (256.819 ms) : 0, 256819
GlobalTracer [candidate] (258.117 ms) : 0, 258117
IAST [baseline] (26.99 ms) : 0, 26990
IAST [candidate] (27.207 ms) : 0, 27207
AppSec [baseline] (35.696 ms) : 0, 35696
AppSec [candidate] (33.034 ms) : 0, 33034
Debugger [baseline] (64.674 ms) : 0, 64674
Debugger [candidate] (67.697 ms) : 0, 67697
Remote Config [baseline] (574.107 µs) : 0, 574
Remote Config [candidate] (560.275 µs) : 0, 560
Telemetry [baseline] (8.468 ms) : 0, 8468
Telemetry [candidate] (8.568 ms) : 0, 8568
Flare Poller [baseline] (3.564 ms) : 0, 3564
Flare Poller [candidate] (3.601 ms) : 0, 3601
section profiling
crashtracking [baseline] (1.228 ms) : 0, 1228
crashtracking [candidate] (1.221 ms) : 0, 1221
BytebuddyAgent [baseline] (706.01 ms) : 0, 706010
BytebuddyAgent [candidate] (703.041 ms) : 0, 703041
GlobalTracer [baseline] (222.014 ms) : 0, 222014
GlobalTracer [candidate] (221.304 ms) : 0, 221304
AppSec [baseline] (32.659 ms) : 0, 32659
AppSec [candidate] (32.082 ms) : 0, 32082
Debugger [baseline] (68.751 ms) : 0, 68751
Debugger [candidate] (68.657 ms) : 0, 68657
Remote Config [baseline] (658.675 µs) : 0, 659
Remote Config [candidate] (647.168 µs) : 0, 647
Telemetry [baseline] (9.039 ms) : 0, 9039
Telemetry [candidate] (8.93 ms) : 0, 8930
Flare Poller [baseline] (3.802 ms) : 0, 3802
Flare Poller [candidate] (3.779 ms) : 0, 3779
ProfilingAgent [baseline] (99.055 ms) : 0, 99055
ProfilingAgent [candidate] (96.855 ms) : 0, 96855
Profiling [baseline] (99.648 ms) : 0, 99648
Profiling [candidate] (97.43 ms) : 0, 97430
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.57.0-SNAPSHOT~1287c94bb7, baseline=1.59.0-SNAPSHOT~645ed325fc

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.094 s) : 0, 1094463
Total [baseline] (8.773 s) : 0, 8772937
Agent [candidate] (1.087 s) : 0, 1086554
Total [candidate] (8.751 s) : 0, 8751257
section iast
Agent [baseline] (1.236 s) : 0, 1235685
Total [baseline] (9.343 s) : 0, 9342962
Agent [candidate] (1.227 s) : 0, 1226804
Total [candidate] (9.336 s) : 0, 9336056
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.094 s -
Agent iast 1.236 s 141.223 ms (12.9%)
Total tracing 8.773 s -
Total iast 9.343 s 570.025 ms (6.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.087 s -
Agent iast 1.227 s 140.25 ms (12.9%)
Total tracing 8.751 s -
Total iast 9.336 s 584.799 ms (6.7%) 
gantt
    title insecure-bank - break down per module: candidate=1.57.0-SNAPSHOT~1287c94bb7, baseline=1.59.0-SNAPSHOT~645ed325fc

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.199 ms) : 0, 1199
crashtracking [candidate] (1.19 ms) : 0, 1190
BytebuddyAgent [baseline] (657.617 ms) : 0, 657617
BytebuddyAgent [candidate] (652.259 ms) : 0, 652259
GlobalTracer [baseline] (285.316 ms) : 0, 285316
GlobalTracer [candidate] (283.593 ms) : 0, 283593
AppSec [baseline] (33.091 ms) : 0, 33091
AppSec [candidate] (32.841 ms) : 0, 32841
Debugger [baseline] (66.929 ms) : 0, 66929
Debugger [candidate] (67.708 ms) : 0, 67708
Remote Config [baseline] (683.362 µs) : 0, 683
Remote Config [candidate] (650.978 µs) : 0, 651
Telemetry [baseline] (9.063 ms) : 0, 9063
Telemetry [candidate] (8.947 ms) : 0, 8947
Flare Poller [baseline] (4.725 ms) : 0, 4725
Flare Poller [candidate] (3.735 ms) : 0, 3735
section iast
crashtracking [baseline] (1.211 ms) : 0, 1211
crashtracking [candidate] (1.192 ms) : 0, 1192
BytebuddyAgent [baseline] (800.707 ms) : 0, 800707
BytebuddyAgent [candidate] (793.552 ms) : 0, 793552
GlobalTracer [baseline] (257.955 ms) : 0, 257955
GlobalTracer [candidate] (257.036 ms) : 0, 257036
IAST [baseline] (27.226 ms) : 0, 27226
IAST [candidate] (27.101 ms) : 0, 27101
AppSec [baseline] (34.447 ms) : 0, 34447
AppSec [candidate] (33.635 ms) : 0, 33635
Debugger [baseline] (65.625 ms) : 0, 65625
Debugger [candidate] (66.083 ms) : 0, 66083
Remote Config [baseline] (606.697 µs) : 0, 607
Remote Config [candidate] (616.501 µs) : 0, 617
Telemetry [baseline] (8.437 ms) : 0, 8437
Telemetry [candidate] (8.467 ms) : 0, 8467
Flare Poller [baseline] (3.6 ms) : 0, 3600
Flare Poller [candidate] (3.572 ms) : 0, 3572
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master dougqh/optimized-map-on-by-default
git_commit_date 1768216781 1768229006
git_commit_sha 645ed32 1287c94
release_version 1.59.0-SNAPSHOT~645ed325fc 1.57.0-SNAPSHOT~1287c94bb7
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1768231567 1768231567
ci_job_id 1343210363 1343210363
ci_pipeline_id 90204341 90204341
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-7vvkz73r 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-7vvkz73r 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 0 performance regressions! Performance is the same for 18 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_FULL:high_load unsure
[-306.378µs; -80.502µs] or [-5.902%; -1.551%]		 better
[-897.226µs; -348.585µs] or [-7.194%; -2.795%]		 unstable
[-46.558op/s; +101.308op/s] or [-5.894%; +12.825%]		 4.997ms 11.848ms 817.312op/s 5.191ms 12.471ms 789.938op/s
scenario:load:petclinic:profiling:high_load better
[-1096.195µs; -436.332µs] or [-5.876%; -2.339%]		 unsure
[-1899.564µs; -31.679µs] or [-6.259%; -0.104%]		 unstable
[-15.988op/s; +33.363op/s] or [-6.511%; +13.587%]		 17.890ms 29.381ms 254.250op/s 18.656ms 30.347ms 245.562op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~1287c94bb7, baseline=1.59.0-SNAPSHOT~645ed325fc
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.919 ms) : 17737, 18101
.   : milestone, 17919,
appsec (18.251 ms) : 18066, 18437
.   : milestone, 18251,
code_origins (17.775 ms) : 17598, 17952
.   : milestone, 17775,
iast (17.977 ms) : 17799, 18154
.   : milestone, 17977,
profiling (19.008 ms) : 18813, 19202
.   : milestone, 19008,
tracing (17.734 ms) : 17557, 17912
.   : milestone, 17734,
section candidate
no_agent (17.832 ms) : 17653, 18011
.   : milestone, 17832,
appsec (18.373 ms) : 18189, 18556
.   : milestone, 18373,
code_origins (17.76 ms) : 17586, 17934
.   : milestone, 17760,
iast (17.867 ms) : 17687, 18047
.   : milestone, 17867,
profiling (18.354 ms) : 18170, 18539
.   : milestone, 18354,
tracing (17.69 ms) : 17514, 17865
.   : milestone, 17690,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.919 ms [17.737 ms, 18.101 ms] -
appsec 18.251 ms [18.066 ms, 18.437 ms] 332.459 µs (1.9%)
code_origins 17.775 ms [17.598 ms, 17.952 ms] -143.758 µs (-0.8%)
iast 17.977 ms [17.799 ms, 18.154 ms] 57.628 µs (0.3%)
profiling 19.008 ms [18.813 ms, 19.202 ms] 1.089 ms (6.1%)
tracing 17.734 ms [17.557 ms, 17.912 ms] -184.599 µs (-1.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.832 ms [17.653 ms, 18.011 ms] -
appsec 18.373 ms [18.189 ms, 18.556 ms] 540.554 µs (3.0%)
code_origins 17.76 ms [17.586 ms, 17.934 ms] -72.233 µs (-0.4%)
iast 17.867 ms [17.687 ms, 18.047 ms] 34.71 µs (0.2%)
profiling 18.354 ms [18.17 ms, 18.539 ms] 522.496 µs (2.9%)
tracing 17.69 ms [17.514 ms, 17.865 ms] -142.27 µs (-0.8%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~1287c94bb7, baseline=1.59.0-SNAPSHOT~645ed325fc
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.175 ms) : 1164, 1186
.   : milestone, 1175,
iast (3.249 ms) : 3200, 3297
.   : milestone, 3249,
iast_FULL (5.853 ms) : 5794, 5912
.   : milestone, 5853,
iast_GLOBAL (3.644 ms) : 3587, 3701
.   : milestone, 3644,
profiling (2.062 ms) : 2042, 2082
.   : milestone, 2062,
tracing (1.808 ms) : 1792, 1824
.   : milestone, 1808,
section candidate
no_agent (1.196 ms) : 1185, 1208
.   : milestone, 1196,
iast (3.257 ms) : 3211, 3302
.   : milestone, 3257,
iast_FULL (5.653 ms) : 5598, 5708
.   : milestone, 5653,
iast_GLOBAL (3.546 ms) : 3487, 3604
.   : milestone, 3546,
profiling (2.015 ms) : 1998, 2032
.   : milestone, 2015,
tracing (1.802 ms) : 1787, 1817
.   : milestone, 1802,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.175 ms [1.164 ms, 1.186 ms] -
iast 3.249 ms [3.2 ms, 3.297 ms] 2.073 ms (176.5%)
iast_FULL 5.853 ms [5.794 ms, 5.912 ms] 4.678 ms (398.1%)
iast_GLOBAL 3.644 ms [3.587 ms, 3.701 ms] 2.469 ms (210.1%)
profiling 2.062 ms [2.042 ms, 2.082 ms] 887.157 µs (75.5%)
tracing 1.808 ms [1.792 ms, 1.824 ms] 632.744 µs (53.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.196 ms [1.185 ms, 1.208 ms] -
iast 3.257 ms [3.211 ms, 3.302 ms] 2.06 ms (172.2%)
iast_FULL 5.653 ms [5.598 ms, 5.708 ms] 4.457 ms (372.5%)
iast_GLOBAL 3.546 ms [3.487 ms, 3.604 ms] 2.349 ms (196.4%)
profiling 2.015 ms [1.998 ms, 2.032 ms] 818.986 µs (68.5%)
tracing 1.802 ms [1.787 ms, 1.817 ms] 605.732 µs (50.6%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master dougqh/optimized-map-on-by-default
git_commit_date 1768216781 1768229006
git_commit_sha 645ed32 1287c94
release_version 1.59.0-SNAPSHOT~645ed325fc 1.57.0-SNAPSHOT~1287c94bb7
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1768231106 1768231106
ci_job_id 1343210364 1343210364
ci_pipeline_id 90204341 90204341
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-7isdhxag 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-7isdhxag 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~1287c94bb7, baseline=1.59.0-SNAPSHOT~645ed325fc
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.473 ms) : 1461, 1484
.   : milestone, 1473,
appsec (3.74 ms) : 3516, 3963
.   : milestone, 3740,
iast (2.224 ms) : 2158, 2289
.   : milestone, 2224,
iast_GLOBAL (2.265 ms) : 2199, 2331
.   : milestone, 2265,
profiling (2.089 ms) : 2034, 2143
.   : milestone, 2089,
tracing (2.042 ms) : 1991, 2093
.   : milestone, 2042,
section candidate
no_agent (1.475 ms) : 1464, 1487
.   : milestone, 1475,
appsec (3.735 ms) : 3513, 3956
.   : milestone, 3735,
iast (2.23 ms) : 2164, 2296
.   : milestone, 2230,
iast_GLOBAL (2.261 ms) : 2194, 2327
.   : milestone, 2261,
profiling (2.087 ms) : 2032, 2142
.   : milestone, 2087,
tracing (2.06 ms) : 2008, 2112
.   : milestone, 2060,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.473 ms [1.461 ms, 1.484 ms] -
appsec 3.74 ms [3.516 ms, 3.963 ms] 2.267 ms (154.0%)
iast 2.224 ms [2.158 ms, 2.289 ms] 751.243 µs (51.0%)
iast_GLOBAL 2.265 ms [2.199 ms, 2.331 ms] 792.697 µs (53.8%)
profiling 2.089 ms [2.034 ms, 2.143 ms] 616.161 µs (41.8%)
tracing 2.042 ms [1.991 ms, 2.093 ms] 569.284 µs (38.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.475 ms [1.464 ms, 1.487 ms] -
appsec 3.735 ms [3.513 ms, 3.956 ms] 2.259 ms (153.2%)
iast 2.23 ms [2.164 ms, 2.296 ms] 755.057 µs (51.2%)
iast_GLOBAL 2.261 ms [2.194 ms, 2.327 ms] 785.303 µs (53.2%)
profiling 2.087 ms [2.032 ms, 2.142 ms] 611.786 µs (41.5%)
tracing 2.06 ms [2.008 ms, 2.112 ms] 585.006 µs (39.7%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~1287c94bb7, baseline=1.59.0-SNAPSHOT~645ed325fc
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.785 s) : 14785000, 14785000
.   : milestone, 14785000,
appsec (14.942 s) : 14942000, 14942000
.   : milestone, 14942000,
iast (18.045 s) : 18045000, 18045000
.   : milestone, 18045000,
iast_GLOBAL (17.704 s) : 17704000, 17704000
.   : milestone, 17704000,
profiling (14.741 s) : 14741000, 14741000
.   : milestone, 14741000,
tracing (14.653 s) : 14653000, 14653000
.   : milestone, 14653000,
section candidate
no_agent (15.479 s) : 15479000, 15479000
.   : milestone, 15479000,
appsec (14.619 s) : 14619000, 14619000
.   : milestone, 14619000,
iast (18.776 s) : 18776000, 18776000
.   : milestone, 18776000,
iast_GLOBAL (18.033 s) : 18033000, 18033000
.   : milestone, 18033000,
profiling (15.421 s) : 15421000, 15421000
.   : milestone, 15421000,
tracing (14.822 s) : 14822000, 14822000
.   : milestone, 14822000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.785 s [14.785 s, 14.785 s] -
appsec 14.942 s [14.942 s, 14.942 s] 157.0 ms (1.1%)
iast 18.045 s [18.045 s, 18.045 s] 3.26 s (22.0%)
iast_GLOBAL 17.704 s [17.704 s, 17.704 s] 2.919 s (19.7%)
profiling 14.741 s [14.741 s, 14.741 s] -44.0 ms (-0.3%)
tracing 14.653 s [14.653 s, 14.653 s] -132.0 ms (-0.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.479 s [15.479 s, 15.479 s] -
appsec 14.619 s [14.619 s, 14.619 s] -860.0 ms (-5.6%)
iast 18.776 s [18.776 s, 18.776 s] 3.297 s (21.3%)
iast_GLOBAL 18.033 s [18.033 s, 18.033 s] 2.554 s (16.5%)
profiling 15.421 s [15.421 s, 15.421 s] -58.0 ms (-0.4%)
tracing 14.822 s [14.822 s, 14.822 s] -657.0 ms (-4.2%)