Home Original page

Remove high cardinality tags from Data Streams hashes by piochelepiotr · Pull Request #10287 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master piotr.wolski/reduce-cardinality-java
git_commit_date 1767634588 1767633877
git_commit_sha 2293097d06 a96d252
release_version 1.58.0-SNAPSHOT~62293097d06 1.58.0-SNAPSHOT~a96d252096
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1767635860 1767635860
ci_job_id 1327313499 1327313499
ci_pipeline_id 88982324 88982324
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-or3xwta1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-or3xwta1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 60 metrics, 5 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.58.0-SNAPSHOT~a96d252096, baseline=1.58.0-SNAPSHOT~62293097d06

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.085 s) : 0, 1084929
Total [baseline] (10.904 s) : 0, 10904377
Agent [candidate] (1.087 s) : 0, 1086586
Total [candidate] (10.786 s) : 0, 10785732
section appsec
Agent [baseline] (1.272 s) : 0, 1271949
Total [baseline] (10.865 s) : 0, 10865082
Agent [candidate] (1.269 s) : 0, 1269035
Total [candidate] (11.004 s) : 0, 11004020
section iast
Agent [baseline] (1.235 s) : 0, 1235296
Total [baseline] (11.212 s) : 0, 11212392
Agent [candidate] (1.226 s) : 0, 1225559
Total [candidate] (11.17 s) : 0, 11169850
section profiling
Agent [baseline] (1.213 s) : 0, 1212996
Total [baseline] (10.898 s) : 0, 10897616
Agent [candidate] (1.213 s) : 0, 1213068
Total [candidate] (10.944 s) : 0, 10944098
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.085 s -
Agent appsec 1.272 s 187.021 ms (17.2%)
Agent iast 1.235 s 150.367 ms (13.9%)
Agent profiling 1.213 s 128.068 ms (11.8%)
Total tracing 10.904 s -
Total appsec 10.865 s -39.295 ms (-0.4%)
Total iast 11.212 s 308.015 ms (2.8%)
Total profiling 10.898 s -6.76 ms (-0.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.087 s -
Agent appsec 1.269 s 182.449 ms (16.8%)
Agent iast 1.226 s 138.973 ms (12.8%)
Agent profiling 1.213 s 126.483 ms (11.6%)
Total tracing 10.786 s -
Total appsec 11.004 s 218.287 ms (2.0%)
Total iast 11.17 s 384.118 ms (3.6%)
Total profiling 10.944 s 158.366 ms (1.5%) 
gantt
    title petclinic - break down per module: candidate=1.58.0-SNAPSHOT~a96d252096, baseline=1.58.0-SNAPSHOT~62293097d06

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.182 ms) : 0, 1182
crashtracking [candidate] (1.187 ms) : 0, 1187
BytebuddyAgent [baseline] (651.131 ms) : 0, 651131
BytebuddyAgent [candidate] (652.049 ms) : 0, 652049
GlobalTracer [baseline] (282.626 ms) : 0, 282626
GlobalTracer [candidate] (283.091 ms) : 0, 283091
AppSec [baseline] (32.462 ms) : 0, 32462
AppSec [candidate] (32.676 ms) : 0, 32676
Debugger [baseline] (68.68 ms) : 0, 68680
Debugger [candidate] (68.472 ms) : 0, 68472
Remote Config [baseline] (635.832 µs) : 0, 636
Remote Config [candidate] (611.745 µs) : 0, 612
Telemetry [baseline] (8.946 ms) : 0, 8946
Telemetry [candidate] (9.045 ms) : 0, 9045
Flare Poller [baseline] (3.681 ms) : 0, 3681
Flare Poller [candidate] (3.714 ms) : 0, 3714
section appsec
crashtracking [baseline] (1.205 ms) : 0, 1205
crashtracking [candidate] (1.189 ms) : 0, 1189
BytebuddyAgent [baseline] (695.022 ms) : 0, 695022
BytebuddyAgent [candidate] (693.313 ms) : 0, 693313
GlobalTracer [baseline] (259.753 ms) : 0, 259753
GlobalTracer [candidate] (259.166 ms) : 0, 259166
AppSec [baseline] (174.749 ms) : 0, 174749
AppSec [candidate] (174.313 ms) : 0, 174313
Debugger [baseline] (66.893 ms) : 0, 66893
Debugger [candidate] (67.175 ms) : 0, 67175
Remote Config [baseline] (756.958 µs) : 0, 757
Remote Config [candidate] (768.502 µs) : 0, 769
Telemetry [baseline] (9.578 ms) : 0, 9578
Telemetry [candidate] (9.341 ms) : 0, 9341
Flare Poller [baseline] (3.771 ms) : 0, 3771
Flare Poller [candidate] (3.716 ms) : 0, 3716
IAST [baseline] (24.699 ms) : 0, 24699
IAST [candidate] (24.591 ms) : 0, 24591
section iast
crashtracking [baseline] (1.195 ms) : 0, 1195
crashtracking [candidate] (1.201 ms) : 0, 1201
BytebuddyAgent [baseline] (799.017 ms) : 0, 799017
BytebuddyAgent [candidate] (792.894 ms) : 0, 792894
GlobalTracer [baseline] (258.511 ms) : 0, 258511
GlobalTracer [candidate] (256.886 ms) : 0, 256886
AppSec [baseline] (35.12 ms) : 0, 35120
AppSec [candidate] (34.856 ms) : 0, 34856
Debugger [baseline] (65.713 ms) : 0, 65713
Debugger [candidate] (64.573 ms) : 0, 64573
Remote Config [baseline] (594.332 µs) : 0, 594
Remote Config [candidate] (573.004 µs) : 0, 573
Telemetry [baseline] (8.557 ms) : 0, 8557
Telemetry [candidate] (8.49 ms) : 0, 8490
Flare Poller [baseline] (3.63 ms) : 0, 3630
Flare Poller [candidate] (3.572 ms) : 0, 3572
IAST [baseline] (27.287 ms) : 0, 27287
IAST [candidate] (27.082 ms) : 0, 27082
section profiling
crashtracking [baseline] (1.233 ms) : 0, 1233
crashtracking [candidate] (1.23 ms) : 0, 1230
BytebuddyAgent [baseline] (707.711 ms) : 0, 707711
BytebuddyAgent [candidate] (708.83 ms) : 0, 708830
GlobalTracer [baseline] (221.833 ms) : 0, 221833
GlobalTracer [candidate] (222.23 ms) : 0, 222230
AppSec [baseline] (32.378 ms) : 0, 32378
AppSec [candidate] (32.319 ms) : 0, 32319
Debugger [baseline] (68.443 ms) : 0, 68443
Debugger [candidate] (68.071 ms) : 0, 68071
Remote Config [baseline] (656.89 µs) : 0, 657
Remote Config [candidate] (627.842 µs) : 0, 628
Telemetry [baseline] (8.817 ms) : 0, 8817
Telemetry [candidate] (8.713 ms) : 0, 8713
Flare Poller [baseline] (3.705 ms) : 0, 3705
Flare Poller [candidate] (3.635 ms) : 0, 3635
ProfilingAgent [baseline] (97.903 ms) : 0, 97903
ProfilingAgent [candidate] (97.308 ms) : 0, 97308
Profiling [baseline] (98.481 ms) : 0, 98481
Profiling [candidate] (97.896 ms) : 0, 97896
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.58.0-SNAPSHOT~a96d252096, baseline=1.58.0-SNAPSHOT~62293097d06

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.082 s) : 0, 1082032
Total [baseline] (8.796 s) : 0, 8795587
Agent [candidate] (1.093 s) : 0, 1093416
Total [candidate] (8.766 s) : 0, 8765662
section iast
Agent [baseline] (1.22 s) : 0, 1220464
Total [baseline] (9.297 s) : 0, 9296734
Agent [candidate] (1.222 s) : 0, 1222279
Total [candidate] (9.28 s) : 0, 9279600
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.082 s -
Agent iast 1.22 s 138.431 ms (12.8%)
Total tracing 8.796 s -
Total iast 9.297 s 501.147 ms (5.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.093 s -
Agent iast 1.222 s 128.863 ms (11.8%)
Total tracing 8.766 s -
Total iast 9.28 s 513.938 ms (5.9%) 
gantt
    title insecure-bank - break down per module: candidate=1.58.0-SNAPSHOT~a96d252096, baseline=1.58.0-SNAPSHOT~62293097d06

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.19 ms) : 0, 1190
crashtracking [candidate] (1.2 ms) : 0, 1200
BytebuddyAgent [baseline] (649.71 ms) : 0, 649710
BytebuddyAgent [candidate] (656.806 ms) : 0, 656806
GlobalTracer [baseline] (282.16 ms) : 0, 282160
GlobalTracer [candidate] (284.716 ms) : 0, 284716
AppSec [baseline] (32.507 ms) : 0, 32507
AppSec [candidate] (33.213 ms) : 0, 33213
Debugger [baseline] (67.497 ms) : 0, 67497
Debugger [candidate] (68.324 ms) : 0, 68324
Remote Config [baseline] (615.905 µs) : 0, 616
Remote Config [candidate] (619.531 µs) : 0, 620
Telemetry [baseline] (9.054 ms) : 0, 9054
Telemetry [candidate] (9.036 ms) : 0, 9036
Flare Poller [baseline] (3.761 ms) : 0, 3761
Flare Poller [candidate] (3.763 ms) : 0, 3763
section iast
crashtracking [baseline] (1.191 ms) : 0, 1191
crashtracking [candidate] (1.177 ms) : 0, 1177
BytebuddyAgent [baseline] (789.411 ms) : 0, 789411
BytebuddyAgent [candidate] (790.563 ms) : 0, 790563
GlobalTracer [baseline] (255.4 ms) : 0, 255400
GlobalTracer [candidate] (256.14 ms) : 0, 256140
AppSec [baseline] (33.449 ms) : 0, 33449
AppSec [candidate] (34.469 ms) : 0, 34469
Debugger [baseline] (65.897 ms) : 0, 65897
Debugger [candidate] (64.747 ms) : 0, 64747
Remote Config [baseline] (609.468 µs) : 0, 609
Remote Config [candidate] (608.055 µs) : 0, 608
Telemetry [baseline] (8.515 ms) : 0, 8515
Telemetry [candidate] (8.465 ms) : 0, 8465
Flare Poller [baseline] (3.573 ms) : 0, 3573
Flare Poller [candidate] (3.585 ms) : 0, 3585
IAST [baseline] (27.026 ms) : 0, 27026
IAST [candidate] (26.979 ms) : 0, 26979
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master piotr.wolski/reduce-cardinality-java
git_commit_date 1767634764 1767633877
git_commit_sha 2293097d06 a96d252
release_version 1.58.0-SNAPSHOT~62293097d06 1.58.0-SNAPSHOT~a96d252096
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1767636533 1767636533
ci_job_id 1327313500 1327313500
ci_pipeline_id 88982324 88982324
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-h93iul7n 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-h93iul7n 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 3 performance regressions! Performance is the same for 17 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:petclinic:appsec:high_load worse
[+0.596ms; +1.581ms] or [+3.301%; +8.751%]		 same
[-78.021µs; +1121.927µs] or [-0.258%; +3.710%]		 unstable
[-35.289op/s; +13.664op/s] or [-14.026%; +5.431%]		 19.160ms 30.760ms 240.781op/s 18.071ms 30.238ms 251.594op/s
scenario:load:petclinic:profiling:high_load worse
[+0.750ms; +1.593ms] or [+4.069%; +8.649%]		 unsure
[+0.251ms; +1.881ms] or [+0.840%; +6.298%]		 unstable
[-38.803op/s; +8.678op/s] or [-15.564%; +3.481%]		 19.593ms 30.930ms 234.250op/s 18.421ms 29.864ms 249.312op/s
scenario:load:petclinic:no_agent:high_load worse
[+0.360ms; +1.909ms] or [+2.083%; +11.032%]		 unstable
[+0.398ms; +3.410ms] or [+1.364%; +11.683%]		 unstable
[-44.356op/s; +9.543op/s] or [-16.885%; +3.633%]		 18.439ms 31.087ms 245.281op/s 17.305ms 29.183ms 262.688op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.58.0-SNAPSHOT~a96d252096, baseline=1.58.0-SNAPSHOT~62293097d06
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.764 ms) : 17581, 17947
.   : milestone, 17764,
appsec (18.548 ms) : 18355, 18741
.   : milestone, 18548,
code_origins (17.695 ms) : 17517, 17873
.   : milestone, 17695,
iast (17.596 ms) : 17422, 17771
.   : milestone, 17596,
profiling (18.721 ms) : 18535, 18908
.   : milestone, 18721,
tracing (17.807 ms) : 17630, 17984
.   : milestone, 17807,
section candidate
no_agent (19.032 ms) : 18834, 19230
.   : milestone, 19032,
appsec (19.386 ms) : 19187, 19585
.   : milestone, 19386,
code_origins (18.18 ms) : 18000, 18360
.   : milestone, 18180,
iast (17.632 ms) : 17457, 17808
.   : milestone, 17632,
profiling (19.927 ms) : 19731, 20122
.   : milestone, 19927,
tracing (17.692 ms) : 17513, 17870
.   : milestone, 17692,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.764 ms [17.581 ms, 17.947 ms] -
appsec 18.548 ms [18.355 ms, 18.741 ms] 784.037 µs (4.4%)
code_origins 17.695 ms [17.517 ms, 17.873 ms] -68.774 µs (-0.4%)
iast 17.596 ms [17.422 ms, 17.771 ms] -167.276 µs (-0.9%)
profiling 18.721 ms [18.535 ms, 18.908 ms] 957.597 µs (5.4%)
tracing 17.807 ms [17.63 ms, 17.984 ms] 43.321 µs (0.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.032 ms [18.834 ms, 19.23 ms] -
appsec 19.386 ms [19.187 ms, 19.585 ms] 354.348 µs (1.9%)
code_origins 18.18 ms [18.0 ms, 18.36 ms] -851.843 µs (-4.5%)
iast 17.632 ms [17.457 ms, 17.808 ms] -1.4 ms (-7.4%)
profiling 19.927 ms [19.731 ms, 20.122 ms] 894.997 µs (4.7%)
tracing 17.692 ms [17.513 ms, 17.87 ms] -1.34 ms (-7.0%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.58.0-SNAPSHOT~a96d252096, baseline=1.58.0-SNAPSHOT~62293097d06
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.255 ms) : 1242, 1268
.   : milestone, 1255,
iast (3.214 ms) : 3169, 3259
.   : milestone, 3214,
iast_FULL (5.597 ms) : 5542, 5652
.   : milestone, 5597,
iast_GLOBAL (3.484 ms) : 3438, 3530
.   : milestone, 3484,
profiling (2.014 ms) : 1995, 2034
.   : milestone, 2014,
tracing (1.783 ms) : 1768, 1798
.   : milestone, 1783,
section candidate
no_agent (1.179 ms) : 1167, 1190
.   : milestone, 1179,
iast (3.144 ms) : 3101, 3186
.   : milestone, 3144,
iast_FULL (5.612 ms) : 5557, 5668
.   : milestone, 5612,
iast_GLOBAL (3.622 ms) : 3569, 3675
.   : milestone, 3622,
profiling (1.953 ms) : 1936, 1969
.   : milestone, 1953,
tracing (1.794 ms) : 1779, 1809
.   : milestone, 1794,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.255 ms [1.242 ms, 1.268 ms] -
iast 3.214 ms [3.169 ms, 3.259 ms] 1.959 ms (156.0%)
iast_FULL 5.597 ms [5.542 ms, 5.652 ms] 4.341 ms (345.9%)
iast_GLOBAL 3.484 ms [3.438 ms, 3.53 ms] 2.229 ms (177.6%)
profiling 2.014 ms [1.995 ms, 2.034 ms] 759.08 µs (60.5%)
tracing 1.783 ms [1.768 ms, 1.798 ms] 527.577 µs (42.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.179 ms [1.167 ms, 1.19 ms] -
iast 3.144 ms [3.101 ms, 3.186 ms] 1.965 ms (166.7%)
iast_FULL 5.612 ms [5.557 ms, 5.668 ms] 4.434 ms (376.2%)
iast_GLOBAL 3.622 ms [3.569 ms, 3.675 ms] 2.443 ms (207.3%)
profiling 1.953 ms [1.936 ms, 1.969 ms] 774.073 µs (65.7%)
tracing 1.794 ms [1.779 ms, 1.809 ms] 615.328 µs (52.2%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master piotr.wolski/reduce-cardinality-java
git_commit_date 1767634764 1767633877
git_commit_sha 2293097d06 a96d252
release_version 1.58.0-SNAPSHOT~62293097d06 1.58.0-SNAPSHOT~a96d252096
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1767636223 1767636223
ci_job_id 1327313501 1327313501
ci_pipeline_id 88982324 88982324
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-68lplv6w 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-68lplv6w 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.58.0-SNAPSHOT~a96d252096, baseline=1.58.0-SNAPSHOT~62293097d06
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.947 s) : 14947000, 14947000
.   : milestone, 14947000,
appsec (14.64 s) : 14640000, 14640000
.   : milestone, 14640000,
iast (18.099 s) : 18099000, 18099000
.   : milestone, 18099000,
iast_GLOBAL (18.038 s) : 18038000, 18038000
.   : milestone, 18038000,
profiling (14.909 s) : 14909000, 14909000
.   : milestone, 14909000,
tracing (14.709 s) : 14709000, 14709000
.   : milestone, 14709000,
section candidate
no_agent (14.729 s) : 14729000, 14729000
.   : milestone, 14729000,
appsec (14.751 s) : 14751000, 14751000
.   : milestone, 14751000,
iast (18.071 s) : 18071000, 18071000
.   : milestone, 18071000,
iast_GLOBAL (17.726 s) : 17726000, 17726000
.   : milestone, 17726000,
profiling (14.909 s) : 14909000, 14909000
.   : milestone, 14909000,
tracing (14.622 s) : 14622000, 14622000
.   : milestone, 14622000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.947 s [14.947 s, 14.947 s] -
appsec 14.64 s [14.64 s, 14.64 s] -307.0 ms (-2.1%)
iast 18.099 s [18.099 s, 18.099 s] 3.152 s (21.1%)
iast_GLOBAL 18.038 s [18.038 s, 18.038 s] 3.091 s (20.7%)
profiling 14.909 s [14.909 s, 14.909 s] -38.0 ms (-0.3%)
tracing 14.709 s [14.709 s, 14.709 s] -238.0 ms (-1.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.729 s [14.729 s, 14.729 s] -
appsec 14.751 s [14.751 s, 14.751 s] 22.0 ms (0.1%)
iast 18.071 s [18.071 s, 18.071 s] 3.342 s (22.7%)
iast_GLOBAL 17.726 s [17.726 s, 17.726 s] 2.997 s (20.3%)
profiling 14.909 s [14.909 s, 14.909 s] 180.0 ms (1.2%)
tracing 14.622 s [14.622 s, 14.622 s] -107.0 ms (-0.7%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.58.0-SNAPSHOT~a96d252096, baseline=1.58.0-SNAPSHOT~62293097d06
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.472 ms) : 1461, 1484
.   : milestone, 1472,
appsec (3.66 ms) : 3445, 3875
.   : milestone, 3660,
iast (2.204 ms) : 2140, 2269
.   : milestone, 2204,
iast_GLOBAL (2.267 ms) : 2201, 2333
.   : milestone, 2267,
profiling (2.083 ms) : 2029, 2136
.   : milestone, 2083,
tracing (2.034 ms) : 1983, 2085
.   : milestone, 2034,
section candidate
no_agent (1.47 ms) : 1459, 1482
.   : milestone, 1470,
appsec (3.719 ms) : 3497, 3941
.   : milestone, 3719,
iast (2.204 ms) : 2140, 2269
.   : milestone, 2204,
iast_GLOBAL (2.239 ms) : 2174, 2303
.   : milestone, 2239,
profiling (2.048 ms) : 1996, 2100
.   : milestone, 2048,
tracing (2.039 ms) : 1988, 2089
.   : milestone, 2039,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.472 ms [1.461 ms, 1.484 ms] -
appsec 3.66 ms [3.445 ms, 3.875 ms] 2.188 ms (148.6%)
iast 2.204 ms [2.14 ms, 2.269 ms] 732.101 µs (49.7%)
iast_GLOBAL 2.267 ms [2.201 ms, 2.333 ms] 795.035 µs (54.0%)
profiling 2.083 ms [2.029 ms, 2.136 ms] 610.452 µs (41.5%)
tracing 2.034 ms [1.983 ms, 2.085 ms] 561.598 µs (38.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.47 ms [1.459 ms, 1.482 ms] -
appsec 3.719 ms [3.497 ms, 3.941 ms] 2.249 ms (153.0%)
iast 2.204 ms [2.14 ms, 2.269 ms] 734.309 µs (50.0%)
iast_GLOBAL 2.239 ms [2.174 ms, 2.303 ms] 768.591 µs (52.3%)
profiling 2.048 ms [1.996 ms, 2.1 ms] 578.398 µs (39.3%)
tracing 2.039 ms [1.988 ms, 2.089 ms] 568.582 µs (38.7%)