Have Vertx 4.0 prioritize `path` and fallback to `name` by mhlidd · Pull Request #10382 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mhlidd/update_quarkus_path
git_commit_date 1768422715 1768429310
git_commit_sha 2a6801e 0134ed4
release_version 1.59.0-SNAPSHOT~2a6801efde 1.59.0-SNAPSHOT~0134ed4dcf
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1768431309 1768431309
ci_job_id 1351592524 1351592524
ci_pipeline_id 90799626 90799626
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-jzpa3l93 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-jzpa3l93 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 56 metrics, 9 unstable metrics.

Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.59.0-SNAPSHOT~0134ed4dcf, baseline=1.59.0-SNAPSHOT~2a6801efde

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.091 s) : 0, 1090933
Total [baseline] (10.96 s) : 0, 10959561
Agent [candidate] (1.09 s) : 0, 1090358
Total [candidate] (10.858 s) : 0, 10857891
section appsec
Agent [baseline] (1.274 s) : 0, 1274386
Total [baseline] (11.034 s) : 0, 11034368
Agent [candidate] (1.283 s) : 0, 1283141
Total [candidate] (11.135 s) : 0, 11134997
section iast
Agent [baseline] (1.227 s) : 0, 1226737
Total [baseline] (11.232 s) : 0, 11231647
Agent [candidate] (1.245 s) : 0, 1245098
Total [candidate] (11.26 s) : 0, 11259545
section profiling
Agent [baseline] (1.205 s) : 0, 1204778
Total [baseline] (10.912 s) : 0, 10911781
Agent [candidate] (1.205 s) : 0, 1205273
Total [candidate] (10.842 s) : 0, 10841955
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.091 s -
Agent appsec 1.274 s 183.453 ms (16.8%)
Agent iast 1.227 s 135.804 ms (12.4%)
Agent profiling 1.205 s 113.845 ms (10.4%)
Total tracing 10.96 s -
Total appsec 11.034 s 74.808 ms (0.7%)
Total iast 11.232 s 272.086 ms (2.5%)
Total profiling 10.912 s -47.78 ms (-0.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.09 s -
Agent appsec 1.283 s 192.783 ms (17.7%)
Agent iast 1.245 s 154.74 ms (14.2%)
Agent profiling 1.205 s 114.916 ms (10.5%)
Total tracing 10.858 s -
Total appsec 11.135 s 277.106 ms (2.6%)
Total iast 11.26 s 401.654 ms (3.7%)
Total profiling 10.842 s -15.936 ms (-0.1%)
gantt
    title petclinic - break down per module: candidate=1.59.0-SNAPSHOT~0134ed4dcf, baseline=1.59.0-SNAPSHOT~2a6801efde

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.196 ms) : 0, 1196
crashtracking [candidate] (1.193 ms) : 0, 1193
BytebuddyAgent [baseline] (656.804 ms) : 0, 656804
BytebuddyAgent [candidate] (654.793 ms) : 0, 654793
GlobalTracer [baseline] (283.159 ms) : 0, 283159
GlobalTracer [candidate] (284.019 ms) : 0, 284019
AppSec [baseline] (32.658 ms) : 0, 32658
AppSec [candidate] (32.948 ms) : 0, 32948
Debugger [baseline] (67.809 ms) : 0, 67809
Debugger [candidate] (68.202 ms) : 0, 68202
Remote Config [baseline] (641.727 µs) : 0, 642
Remote Config [candidate] (653.473 µs) : 0, 653
Telemetry [baseline] (9.027 ms) : 0, 9027
Telemetry [candidate] (8.99 ms) : 0, 8990
Flare Poller [baseline] (3.825 ms) : 0, 3825
Flare Poller [candidate] (3.859 ms) : 0, 3859
section appsec
crashtracking [baseline] (1.2 ms) : 0, 1200
crashtracking [candidate] (1.2 ms) : 0, 1200
BytebuddyAgent [baseline] (697.237 ms) : 0, 697237
BytebuddyAgent [candidate] (701.95 ms) : 0, 701950
GlobalTracer [baseline] (260.197 ms) : 0, 260197
GlobalTracer [candidate] (262.737 ms) : 0, 262737
IAST [baseline] (24.64 ms) : 0, 24640
IAST [candidate] (25.218 ms) : 0, 25218
AppSec [baseline] (174.088 ms) : 0, 174088
AppSec [candidate] (174.056 ms) : 0, 174056
Debugger [baseline] (67.474 ms) : 0, 67474
Debugger [candidate] (68.158 ms) : 0, 68158
Remote Config [baseline] (770.007 µs) : 0, 770
Remote Config [candidate] (780.076 µs) : 0, 780
Telemetry [baseline] (9.374 ms) : 0, 9374
Telemetry [candidate] (9.417 ms) : 0, 9417
Flare Poller [baseline] (3.8 ms) : 0, 3800
Flare Poller [candidate] (3.769 ms) : 0, 3769
section iast
crashtracking [baseline] (1.173 ms) : 0, 1173
crashtracking [candidate] (1.209 ms) : 0, 1209
BytebuddyAgent [baseline] (791.517 ms) : 0, 791517
BytebuddyAgent [candidate] (805.758 ms) : 0, 805758
GlobalTracer [baseline] (258.063 ms) : 0, 258063
GlobalTracer [candidate] (260.541 ms) : 0, 260541
IAST [baseline] (27.148 ms) : 0, 27148
IAST [candidate] (27.461 ms) : 0, 27461
AppSec [baseline] (33.684 ms) : 0, 33684
AppSec [candidate] (35.675 ms) : 0, 35675
Debugger [baseline] (66.97 ms) : 0, 66970
Debugger [candidate] (65.764 ms) : 0, 65764
Remote Config [baseline] (595.229 µs) : 0, 595
Remote Config [candidate] (573.556 µs) : 0, 574
Telemetry [baseline] (8.53 ms) : 0, 8530
Telemetry [candidate] (8.598 ms) : 0, 8598
Flare Poller [baseline] (3.556 ms) : 0, 3556
Flare Poller [candidate] (3.611 ms) : 0, 3611
section profiling
crashtracking [baseline] (1.213 ms) : 0, 1213
crashtracking [candidate] (1.219 ms) : 0, 1219
BytebuddyAgent [baseline] (701.266 ms) : 0, 701266
BytebuddyAgent [candidate] (702.427 ms) : 0, 702427
GlobalTracer [baseline] (221.346 ms) : 0, 221346
GlobalTracer [candidate] (221.225 ms) : 0, 221225
AppSec [baseline] (32.106 ms) : 0, 32106
AppSec [candidate] (32.033 ms) : 0, 32033
Debugger [baseline] (68.45 ms) : 0, 68450
Debugger [candidate] (67.927 ms) : 0, 67927
Remote Config [baseline] (628.949 µs) : 0, 629
Remote Config [candidate] (625.652 µs) : 0, 626
Telemetry [baseline] (9.094 ms) : 0, 9094
Telemetry [candidate] (8.943 ms) : 0, 8943
Flare Poller [baseline] (3.775 ms) : 0, 3775
Flare Poller [candidate] (3.755 ms) : 0, 3755
ProfilingAgent [baseline] (96.319 ms) : 0, 96319
ProfilingAgent [candidate] (97.152 ms) : 0, 97152
Profiling [baseline] (97.51 ms) : 0, 97510
Profiling [candidate] (97.722 ms) : 0, 97722
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.59.0-SNAPSHOT~0134ed4dcf, baseline=1.59.0-SNAPSHOT~2a6801efde

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.087 s) : 0, 1086786
Total [baseline] (8.786 s) : 0, 8785692
Agent [candidate] (1.088 s) : 0, 1088107
Total [candidate] (8.778 s) : 0, 8777781
section iast
Agent [baseline] (1.234 s) : 0, 1233764
Total [baseline] (9.34 s) : 0, 9339626
Agent [candidate] (1.222 s) : 0, 1222001
Total [candidate] (9.346 s) : 0, 9346324
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.087 s -
Agent iast 1.234 s 146.978 ms (13.5%)
Total tracing 8.786 s -
Total iast 9.34 s 553.934 ms (6.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.088 s -
Agent iast 1.222 s 133.895 ms (12.3%)
Total tracing 8.778 s -
Total iast 9.346 s 568.543 ms (6.5%)
gantt
    title insecure-bank - break down per module: candidate=1.59.0-SNAPSHOT~0134ed4dcf, baseline=1.59.0-SNAPSHOT~2a6801efde

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.198 ms) : 0, 1198
crashtracking [candidate] (1.186 ms) : 0, 1186
BytebuddyAgent [baseline] (654.467 ms) : 0, 654467
BytebuddyAgent [candidate] (653.087 ms) : 0, 653087
GlobalTracer [baseline] (282.659 ms) : 0, 282659
GlobalTracer [candidate] (284.561 ms) : 0, 284561
AppSec [baseline] (32.382 ms) : 0, 32382
AppSec [candidate] (32.866 ms) : 0, 32866
Debugger [baseline] (66.933 ms) : 0, 66933
Debugger [candidate] (67.307 ms) : 0, 67307
Remote Config [baseline] (654.183 µs) : 0, 654
Remote Config [candidate] (620.397 µs) : 0, 620
Telemetry [baseline] (8.949 ms) : 0, 8949
Telemetry [candidate] (9.049 ms) : 0, 9049
Flare Poller [baseline] (3.767 ms) : 0, 3767
Flare Poller [candidate] (3.812 ms) : 0, 3812
section iast
crashtracking [baseline] (1.195 ms) : 0, 1195
crashtracking [candidate] (1.184 ms) : 0, 1184
BytebuddyAgent [baseline] (798.528 ms) : 0, 798528
BytebuddyAgent [candidate] (789.648 ms) : 0, 789648
GlobalTracer [baseline] (258.474 ms) : 0, 258474
GlobalTracer [candidate] (256.708 ms) : 0, 256708
IAST [baseline] (27.263 ms) : 0, 27263
IAST [candidate] (26.993 ms) : 0, 26993
AppSec [baseline] (34.968 ms) : 0, 34968
AppSec [candidate] (32.038 ms) : 0, 32038
Debugger [baseline] (64.906 ms) : 0, 64906
Debugger [candidate] (67.241 ms) : 0, 67241
Remote Config [baseline] (599.328 µs) : 0, 599
Remote Config [candidate] (584.558 µs) : 0, 585
Telemetry [baseline] (8.514 ms) : 0, 8514
Telemetry [candidate] (8.55 ms) : 0, 8550
Flare Poller [baseline] (3.589 ms) : 0, 3589
Flare Poller [candidate] (3.585 ms) : 0, 3585
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mhlidd/update_quarkus_path
git_commit_date 1768422715 1768429310
git_commit_sha 2a6801e 0134ed4
release_version 1.59.0-SNAPSHOT~2a6801efde 1.59.0-SNAPSHOT~0134ed4dcf
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1768431795 1768431795
ci_job_id 1351592526 1351592526
ci_pipeline_id 90799626 90799626
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-e1o8btub 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-e1o8btub 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 1 performance regressions! Performance is the same for 16 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_FULL:high_load better
[-378.574µs; -199.163µs] or [-7.046%; -3.707%]
better
[-860.466µs; -272.488µs] or [-6.645%; -2.104%]
unstable
[-46.589op/s; +115.401op/s] or [-6.104%; +15.118%]
5.084ms 12.382ms 797.719op/s 5.373ms 12.949ms 763.312op/s
scenario:load:petclinic:no_agent:high_load worse
[+1.497ms; +3.076ms] or [+8.933%; +18.347%]
unstable
[+2.210ms; +6.213ms] or [+7.925%; +22.282%]
unstable
[-56.268op/s; -1.294op/s] or [-21.099%; -0.485%]
19.049ms 32.095ms 237.906op/s 16.763ms 27.883ms 266.688op/s
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~0134ed4dcf, baseline=1.59.0-SNAPSHOT~2a6801efde
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.498 ms) : 17322, 17673
.   : milestone, 17498,
appsec (18.51 ms) : 18324, 18696
.   : milestone, 18510,
code_origins (18.059 ms) : 17876, 18243
.   : milestone, 18059,
iast (17.951 ms) : 17771, 18131
.   : milestone, 17951,
profiling (19.591 ms) : 19390, 19792
.   : milestone, 19591,
tracing (17.598 ms) : 17426, 17771
.   : milestone, 17598,
section candidate
no_agent (19.624 ms) : 19420, 19828
.   : milestone, 19624,
appsec (18.648 ms) : 18458, 18839
.   : milestone, 18648,
code_origins (17.882 ms) : 17703, 18061
.   : milestone, 17882,
iast (17.624 ms) : 17450, 17799
.   : milestone, 17624,
profiling (19.81 ms) : 19609, 20012
.   : milestone, 19810,
tracing (17.598 ms) : 17425, 17770
.   : milestone, 17598,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.498 ms [17.322 ms, 17.673 ms] -
appsec 18.51 ms [18.324 ms, 18.696 ms] 1.012 ms (5.8%)
code_origins 18.059 ms [17.876 ms, 18.243 ms] 561.736 µs (3.2%)
iast 17.951 ms [17.771 ms, 18.131 ms] 453.585 µs (2.6%)
profiling 19.591 ms [19.39 ms, 19.792 ms] 2.093 ms (12.0%)
tracing 17.598 ms [17.426 ms, 17.771 ms] 100.612 µs (0.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.624 ms [19.42 ms, 19.828 ms] -
appsec 18.648 ms [18.458 ms, 18.839 ms] -975.647 µs (-5.0%)
code_origins 17.882 ms [17.703 ms, 18.061 ms] -1.742 ms (-8.9%)
iast 17.624 ms [17.45 ms, 17.799 ms] -2.0 ms (-10.2%)
profiling 19.81 ms [19.609 ms, 20.012 ms] 186.359 µs (0.9%)
tracing 17.598 ms [17.425 ms, 17.77 ms] -2.026 ms (-10.3%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~0134ed4dcf, baseline=1.59.0-SNAPSHOT~2a6801efde
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.187 ms) : 1175, 1198
.   : milestone, 1187,
iast (3.307 ms) : 3261, 3352
.   : milestone, 3307,
iast_FULL (6.06 ms) : 5998, 6122
.   : milestone, 6060,
iast_GLOBAL (3.486 ms) : 3443, 3530
.   : milestone, 3486,
profiling (2.198 ms) : 2175, 2220
.   : milestone, 2198,
tracing (1.801 ms) : 1785, 1816
.   : milestone, 1801,
section candidate
no_agent (1.184 ms) : 1172, 1195
.   : milestone, 1184,
iast (3.245 ms) : 3201, 3288
.   : milestone, 3245,
iast_FULL (5.793 ms) : 5735, 5852
.   : milestone, 5793,
iast_GLOBAL (3.494 ms) : 3439, 3549
.   : milestone, 3494,
profiling (1.998 ms) : 1981, 2015
.   : milestone, 1998,
tracing (1.78 ms) : 1765, 1795
.   : milestone, 1780,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.187 ms [1.175 ms, 1.198 ms] -
iast 3.307 ms [3.261 ms, 3.352 ms] 2.12 ms (178.6%)
iast_FULL 6.06 ms [5.998 ms, 6.122 ms] 4.873 ms (410.5%)
iast_GLOBAL 3.486 ms [3.443 ms, 3.53 ms] 2.299 ms (193.7%)
profiling 2.198 ms [2.175 ms, 2.22 ms] 1.011 ms (85.2%)
tracing 1.801 ms [1.785 ms, 1.816 ms] 613.894 µs (51.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.184 ms [1.172 ms, 1.195 ms] -
iast 3.245 ms [3.201 ms, 3.288 ms] 2.061 ms (174.2%)
iast_FULL 5.793 ms [5.735 ms, 5.852 ms] 4.61 ms (389.5%)
iast_GLOBAL 3.494 ms [3.439 ms, 3.549 ms] 2.31 ms (195.2%)
profiling 1.998 ms [1.981 ms, 2.015 ms] 814.585 µs (68.8%)
tracing 1.78 ms [1.765 ms, 1.795 ms] 596.511 µs (50.4%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mhlidd/update_quarkus_path
git_commit_date 1768422715 1768429310
git_commit_sha 2a6801e 0134ed4
release_version 1.59.0-SNAPSHOT~2a6801efde 1.59.0-SNAPSHOT~0134ed4dcf
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1768431539 1768431539
ci_job_id 1351592530 1351592530
ci_pipeline_id 90799626 90799626
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-10bdcg2s 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-10bdcg2s 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~0134ed4dcf, baseline=1.59.0-SNAPSHOT~2a6801efde
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.976 s) : 14976000, 14976000
.   : milestone, 14976000,
appsec (14.411 s) : 14411000, 14411000
.   : milestone, 14411000,
iast (18.476 s) : 18476000, 18476000
.   : milestone, 18476000,
iast_GLOBAL (17.786 s) : 17786000, 17786000
.   : milestone, 17786000,
profiling (14.857 s) : 14857000, 14857000
.   : milestone, 14857000,
tracing (14.763 s) : 14763000, 14763000
.   : milestone, 14763000,
section candidate
no_agent (14.968 s) : 14968000, 14968000
.   : milestone, 14968000,
appsec (15.127 s) : 15127000, 15127000
.   : milestone, 15127000,
iast (18.106 s) : 18106000, 18106000
.   : milestone, 18106000,
iast_GLOBAL (18.113 s) : 18113000, 18113000
.   : milestone, 18113000,
profiling (14.788 s) : 14788000, 14788000
.   : milestone, 14788000,
tracing (14.569 s) : 14569000, 14569000
.   : milestone, 14569000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.976 s [14.976 s, 14.976 s] -
appsec 14.411 s [14.411 s, 14.411 s] -565.0 ms (-3.8%)
iast 18.476 s [18.476 s, 18.476 s] 3.5 s (23.4%)
iast_GLOBAL 17.786 s [17.786 s, 17.786 s] 2.81 s (18.8%)
profiling 14.857 s [14.857 s, 14.857 s] -119.0 ms (-0.8%)
tracing 14.763 s [14.763 s, 14.763 s] -213.0 ms (-1.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.968 s [14.968 s, 14.968 s] -
appsec 15.127 s [15.127 s, 15.127 s] 159.0 ms (1.1%)
iast 18.106 s [18.106 s, 18.106 s] 3.138 s (21.0%)
iast_GLOBAL 18.113 s [18.113 s, 18.113 s] 3.145 s (21.0%)
profiling 14.788 s [14.788 s, 14.788 s] -180.0 ms (-1.2%)
tracing 14.569 s [14.569 s, 14.569 s] -399.0 ms (-2.7%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~0134ed4dcf, baseline=1.59.0-SNAPSHOT~2a6801efde
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.478 ms) : 1467, 1490
.   : milestone, 1478,
appsec (3.72 ms) : 3500, 3940
.   : milestone, 3720,
iast (2.222 ms) : 2156, 2287
.   : milestone, 2222,
iast_GLOBAL (2.263 ms) : 2197, 2329
.   : milestone, 2263,
profiling (2.085 ms) : 2032, 2138
.   : milestone, 2085,
tracing (2.055 ms) : 2003, 2106
.   : milestone, 2055,
section candidate
no_agent (1.479 ms) : 1467, 1490
.   : milestone, 1479,
appsec (3.736 ms) : 3516, 3956
.   : milestone, 3736,
iast (2.23 ms) : 2165, 2296
.   : milestone, 2230,
iast_GLOBAL (2.28 ms) : 2214, 2346
.   : milestone, 2280,
profiling (2.505 ms) : 2344, 2666
.   : milestone, 2505,
tracing (2.067 ms) : 2015, 2118
.   : milestone, 2067,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.478 ms [1.467 ms, 1.49 ms] -
appsec 3.72 ms [3.5 ms, 3.94 ms] 2.241 ms (151.6%)
iast 2.222 ms [2.156 ms, 2.287 ms] 743.077 µs (50.3%)
iast_GLOBAL 2.263 ms [2.197 ms, 2.329 ms] 784.279 µs (53.0%)
profiling 2.085 ms [2.032 ms, 2.138 ms] 606.375 µs (41.0%)
tracing 2.055 ms [2.003 ms, 2.106 ms] 576.407 µs (39.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.479 ms [1.467 ms, 1.49 ms] -
appsec 3.736 ms [3.516 ms, 3.956 ms] 2.257 ms (152.7%)
iast 2.23 ms [2.165 ms, 2.296 ms] 751.55 µs (50.8%)
iast_GLOBAL 2.28 ms [2.214 ms, 2.346 ms] 801.331 µs (54.2%)
profiling 2.505 ms [2.344 ms, 2.666 ms] 1.026 ms (69.4%)
tracing 2.067 ms [2.015 ms, 2.118 ms] 587.928 µs (39.8%)