Home Original page

Bump OpenFeature SDK to 1.20.1 by leoromanovsky · Pull Request #10438 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master leo.romanovsky/bump-openfeature-1.20.1
git_commit_date 1769179884 1769193544
git_commit_sha c6c245f 9acbd3c
release_version 1.59.0-SNAPSHOT~c6c245fe4a 1.59.0-SNAPSHOT~9acbd3cd38
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1769195407 1769195407
ci_job_id 1374027656 1374027656
ci_pipeline_id 92558272 92558272
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-s0l6i7x1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-s0l6i7x1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 7 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.59.0-SNAPSHOT~9acbd3cd38, baseline=1.59.0-SNAPSHOT~c6c245fe4a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.093 s) : 0, 1092995
Total [baseline] (8.801 s) : 0, 8800569
Agent [candidate] (1.09 s) : 0, 1090384
Total [candidate] (8.761 s) : 0, 8760790
section iast
Agent [baseline] (1.24 s) : 0, 1239526
Total [baseline] (9.344 s) : 0, 9344416
Agent [candidate] (1.233 s) : 0, 1233285
Total [candidate] (9.316 s) : 0, 9316304
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.093 s -
Agent iast 1.24 s 146.531 ms (13.4%)
Total tracing 8.801 s -
Total iast 9.344 s 543.848 ms (6.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.09 s -
Agent iast 1.233 s 142.9 ms (13.1%)
Total tracing 8.761 s -
Total iast 9.316 s 555.514 ms (6.3%) 
gantt
    title insecure-bank - break down per module: candidate=1.59.0-SNAPSHOT~9acbd3cd38, baseline=1.59.0-SNAPSHOT~c6c245fe4a

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.188 ms) : 0, 1188
crashtracking [candidate] (1.213 ms) : 0, 1213
BytebuddyAgent [baseline] (655.155 ms) : 0, 655155
BytebuddyAgent [candidate] (653.697 ms) : 0, 653697
GlobalTracer [baseline] (286.929 ms) : 0, 286929
GlobalTracer [candidate] (286.626 ms) : 0, 286626
AppSec [baseline] (33.1 ms) : 0, 33100
AppSec [candidate] (32.936 ms) : 0, 32936
Debugger [baseline] (66.721 ms) : 0, 66721
Debugger [candidate] (66.298 ms) : 0, 66298
Remote Config [baseline] (621.371 µs) : 0, 621
Remote Config [candidate] (615.016 µs) : 0, 615
Telemetry [baseline] (8.954 ms) : 0, 8954
Telemetry [candidate] (8.936 ms) : 0, 8936
Flare Poller [baseline] (4.477 ms) : 0, 4477
Flare Poller [candidate] (4.525 ms) : 0, 4525
section iast
crashtracking [baseline] (1.193 ms) : 0, 1193
crashtracking [candidate] (1.192 ms) : 0, 1192
BytebuddyAgent [baseline] (801.114 ms) : 0, 801114
BytebuddyAgent [candidate] (795.757 ms) : 0, 795757
GlobalTracer [baseline] (261.531 ms) : 0, 261531
GlobalTracer [candidate] (260.752 ms) : 0, 260752
IAST [baseline] (27.358 ms) : 0, 27358
IAST [candidate] (27.079 ms) : 0, 27079
AppSec [baseline] (32.003 ms) : 0, 32003
AppSec [candidate] (32.096 ms) : 0, 32096
Debugger [baseline] (68.159 ms) : 0, 68159
Debugger [candidate] (68.446 ms) : 0, 68446
Remote Config [baseline] (547.005 µs) : 0, 547
Remote Config [candidate] (540.453 µs) : 0, 540
Telemetry [baseline] (8.473 ms) : 0, 8473
Telemetry [candidate] (8.551 ms) : 0, 8551
Flare Poller [baseline] (3.477 ms) : 0, 3477
Flare Poller [candidate] (3.462 ms) : 0, 3462
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.59.0-SNAPSHOT~9acbd3cd38, baseline=1.59.0-SNAPSHOT~c6c245fe4a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.102 s) : 0, 1101979
Total [baseline] (10.949 s) : 0, 10949049
Agent [candidate] (1.105 s) : 0, 1105240
Total [candidate] (10.882 s) : 0, 10881667
section appsec
Agent [baseline] (1.274 s) : 0, 1274116
Total [baseline] (11.057 s) : 0, 11057358
Agent [candidate] (1.272 s) : 0, 1271591
Total [candidate] (10.997 s) : 0, 10996547
section iast
Agent [baseline] (1.231 s) : 0, 1231390
Total [baseline] (11.144 s) : 0, 11143591
Agent [candidate] (1.232 s) : 0, 1232439
Total [candidate] (11.238 s) : 0, 11238207
section profiling
Agent [baseline] (1.22 s) : 0, 1219775
Total [baseline] (11.071 s) : 0, 11071371
Agent [candidate] (1.22 s) : 0, 1219593
Total [candidate] (10.958 s) : 0, 10957920
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.102 s -
Agent appsec 1.274 s 172.137 ms (15.6%)
Agent iast 1.231 s 129.411 ms (11.7%)
Agent profiling 1.22 s 117.796 ms (10.7%)
Total tracing 10.949 s -
Total appsec 11.057 s 108.309 ms (1.0%)
Total iast 11.144 s 194.542 ms (1.8%)
Total profiling 11.071 s 122.322 ms (1.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.105 s -
Agent appsec 1.272 s 166.351 ms (15.1%)
Agent iast 1.232 s 127.199 ms (11.5%)
Agent profiling 1.22 s 114.354 ms (10.3%)
Total tracing 10.882 s -
Total appsec 10.997 s 114.88 ms (1.1%)
Total iast 11.238 s 356.539 ms (3.3%)
Total profiling 10.958 s 76.252 ms (0.7%) 
gantt
    title petclinic - break down per module: candidate=1.59.0-SNAPSHOT~9acbd3cd38, baseline=1.59.0-SNAPSHOT~c6c245fe4a

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.23 ms) : 0, 1230
crashtracking [candidate] (1.196 ms) : 0, 1196
BytebuddyAgent [baseline] (662.257 ms) : 0, 662257
BytebuddyAgent [candidate] (662.884 ms) : 0, 662884
GlobalTracer [baseline] (288.417 ms) : 0, 288417
GlobalTracer [candidate] (290.137 ms) : 0, 290137
AppSec [baseline] (33.049 ms) : 0, 33049
AppSec [candidate] (33.349 ms) : 0, 33349
Debugger [baseline] (67.855 ms) : 0, 67855
Debugger [candidate] (68.308 ms) : 0, 68308
Remote Config [baseline] (604.364 µs) : 0, 604
Remote Config [candidate] (617.024 µs) : 0, 617
Telemetry [baseline] (8.847 ms) : 0, 8847
Telemetry [candidate] (9.068 ms) : 0, 9068
Flare Poller [baseline] (3.747 ms) : 0, 3747
Flare Poller [candidate] (3.772 ms) : 0, 3772
section appsec
crashtracking [baseline] (1.183 ms) : 0, 1183
crashtracking [candidate] (1.186 ms) : 0, 1186
BytebuddyAgent [baseline] (693.982 ms) : 0, 693982
BytebuddyAgent [candidate] (693.98 ms) : 0, 693980
GlobalTracer [baseline] (263.16 ms) : 0, 263160
GlobalTracer [candidate] (262.36 ms) : 0, 262360
IAST [baseline] (24.694 ms) : 0, 24694
IAST [candidate] (24.649 ms) : 0, 24649
AppSec [baseline] (174.933 ms) : 0, 174933
AppSec [candidate] (173.358 ms) : 0, 173358
Debugger [baseline] (66.773 ms) : 0, 66773
Debugger [candidate] (66.713 ms) : 0, 66713
Remote Config [baseline] (696.841 µs) : 0, 697
Remote Config [candidate] (699.449 µs) : 0, 699
Telemetry [baseline] (9.475 ms) : 0, 9475
Telemetry [candidate] (9.379 ms) : 0, 9379
Flare Poller [baseline] (3.62 ms) : 0, 3620
Flare Poller [candidate] (3.621 ms) : 0, 3621
section iast
crashtracking [baseline] (1.182 ms) : 0, 1182
crashtracking [candidate] (1.183 ms) : 0, 1183
BytebuddyAgent [baseline] (794.777 ms) : 0, 794777
BytebuddyAgent [candidate] (795.594 ms) : 0, 795594
GlobalTracer [baseline] (260.274 ms) : 0, 260274
GlobalTracer [candidate] (260.4 ms) : 0, 260400
IAST [baseline] (26.936 ms) : 0, 26936
IAST [candidate] (27.161 ms) : 0, 27161
AppSec [baseline] (35.049 ms) : 0, 35049
AppSec [candidate] (35.137 ms) : 0, 35137
Debugger [baseline] (65.144 ms) : 0, 65144
Debugger [candidate] (64.857 ms) : 0, 64857
Remote Config [baseline] (540.343 µs) : 0, 540
Remote Config [candidate] (541.639 µs) : 0, 542
Telemetry [baseline] (8.483 ms) : 0, 8483
Telemetry [candidate] (8.495 ms) : 0, 8495
Flare Poller [baseline] (3.5 ms) : 0, 3500
Flare Poller [candidate] (3.479 ms) : 0, 3479
section profiling
crashtracking [baseline] (1.229 ms) : 0, 1229
crashtracking [candidate] (1.226 ms) : 0, 1226
BytebuddyAgent [baseline] (707.661 ms) : 0, 707661
BytebuddyAgent [candidate] (709.234 ms) : 0, 709234
GlobalTracer [baseline] (226.798 ms) : 0, 226798
GlobalTracer [candidate] (227.299 ms) : 0, 227299
AppSec [baseline] (32.795 ms) : 0, 32795
AppSec [candidate] (32.72 ms) : 0, 32720
Debugger [baseline] (68.683 ms) : 0, 68683
Debugger [candidate] (68.137 ms) : 0, 68137
Remote Config [baseline] (629.097 µs) : 0, 629
Remote Config [candidate] (633.347 µs) : 0, 633
Telemetry [baseline] (9.013 ms) : 0, 9013
Telemetry [candidate] (8.924 ms) : 0, 8924
Flare Poller [baseline] (3.775 ms) : 0, 3775
Flare Poller [candidate] (3.643 ms) : 0, 3643
ProfilingAgent [baseline] (98.844 ms) : 0, 98844
ProfilingAgent [candidate] (97.477 ms) : 0, 97477
Profiling [baseline] (99.441 ms) : 0, 99441
Profiling [candidate] (98.081 ms) : 0, 98081
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master leo.romanovsky/bump-openfeature-1.20.1
git_commit_date 1769179884 1769193544
git_commit_sha c6c245f 9acbd3c
release_version 1.59.0-SNAPSHOT~c6c245fe4a 1.59.0-SNAPSHOT~9acbd3cd38
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1769195899 1769195899
ci_job_id 1374027657 1374027657
ci_pipeline_id 92558272 92558272
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-rv8l54ad 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-rv8l54ad 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 2 performance regressions! Performance is the same for 16 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:petclinic:profiling:high_load worse
[+1.035ms; +1.825ms] or [+5.796%; +10.221%]		 worse
[+0.988ms; +2.527ms] or [+3.377%; +8.640%]		 unstable
[-41.028op/s; +7.153op/s] or [-16.087%; +2.805%]		 19.284ms 31.000ms 238.094op/s 17.854ms 29.243ms 255.031op/s
scenario:load:petclinic:no_agent:high_load better
[-2.407ms; -0.933ms] or [-12.605%; -4.889%]		 unsure
[-3.302ms; -0.196ms] or [-10.507%; -0.624%]		 unstable
[-5.226op/s; +47.601op/s] or [-2.187%; +19.922%]		 17.424ms 29.679ms 260.125op/s 19.094ms 31.428ms 238.938op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~9acbd3cd38, baseline=1.59.0-SNAPSHOT~c6c245fe4a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.188 ms) : 1176, 1200
.   : milestone, 1188,
iast (3.263 ms) : 3221, 3305
.   : milestone, 3263,
iast_FULL (5.695 ms) : 5639, 5751
.   : milestone, 5695,
iast_GLOBAL (3.554 ms) : 3493, 3615
.   : milestone, 3554,
profiling (2.079 ms) : 2060, 2098
.   : milestone, 2079,
tracing (1.817 ms) : 1801, 1832
.   : milestone, 1817,
section candidate
no_agent (1.181 ms) : 1169, 1193
.   : milestone, 1181,
iast (3.295 ms) : 3247, 3343
.   : milestone, 3295,
iast_FULL (5.906 ms) : 5845, 5967
.   : milestone, 5906,
iast_GLOBAL (3.68 ms) : 3613, 3746
.   : milestone, 3680,
profiling (1.988 ms) : 1971, 2006
.   : milestone, 1988,
tracing (1.874 ms) : 1857, 1890
.   : milestone, 1874,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.188 ms [1.176 ms, 1.2 ms] -
iast 3.263 ms [3.221 ms, 3.305 ms] 2.075 ms (174.7%)
iast_FULL 5.695 ms [5.639 ms, 5.751 ms] 4.507 ms (379.4%)
iast_GLOBAL 3.554 ms [3.493 ms, 3.615 ms] 2.366 ms (199.2%)
profiling 2.079 ms [2.06 ms, 2.098 ms] 890.935 µs (75.0%)
tracing 1.817 ms [1.801 ms, 1.832 ms] 628.516 µs (52.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.181 ms [1.169 ms, 1.193 ms] -
iast 3.295 ms [3.247 ms, 3.343 ms] 2.114 ms (179.0%)
iast_FULL 5.906 ms [5.845 ms, 5.967 ms] 4.725 ms (400.1%)
iast_GLOBAL 3.68 ms [3.613 ms, 3.746 ms] 2.499 ms (211.6%)
profiling 1.988 ms [1.971 ms, 2.006 ms] 807.408 µs (68.4%)
tracing 1.874 ms [1.857 ms, 1.89 ms] 692.621 µs (58.6%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~9acbd3cd38, baseline=1.59.0-SNAPSHOT~c6c245fe4a
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.536 ms) : 19335, 19737
.   : milestone, 19536,
appsec (18.553 ms) : 18366, 18740
.   : milestone, 18553,
code_origins (17.588 ms) : 17414, 17763
.   : milestone, 17588,
iast (17.506 ms) : 17332, 17680
.   : milestone, 17506,
profiling (18.298 ms) : 18117, 18480
.   : milestone, 18298,
tracing (17.898 ms) : 17720, 18075
.   : milestone, 17898,
section candidate
no_agent (17.938 ms) : 17754, 18121
.   : milestone, 17938,
appsec (18.437 ms) : 18250, 18624
.   : milestone, 18437,
code_origins (17.857 ms) : 17678, 18036
.   : milestone, 17857,
iast (17.509 ms) : 17336, 17682
.   : milestone, 17509,
profiling (19.609 ms) : 19412, 19805
.   : milestone, 19609,
tracing (17.609 ms) : 17432, 17787
.   : milestone, 17609,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.536 ms [19.335 ms, 19.737 ms] -
appsec 18.553 ms [18.366 ms, 18.74 ms] -983.438 µs (-5.0%)
code_origins 17.588 ms [17.414 ms, 17.763 ms] -1.948 ms (-10.0%)
iast 17.506 ms [17.332 ms, 17.68 ms] -2.03 ms (-10.4%)
profiling 18.298 ms [18.117 ms, 18.48 ms] -1.238 ms (-6.3%)
tracing 17.898 ms [17.72 ms, 18.075 ms] -1.638 ms (-8.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.938 ms [17.754 ms, 18.121 ms] -
appsec 18.437 ms [18.25 ms, 18.624 ms] 499.127 µs (2.8%)
code_origins 17.857 ms [17.678 ms, 18.036 ms] -80.527 µs (-0.4%)
iast 17.509 ms [17.336 ms, 17.682 ms] -428.76 µs (-2.4%)
profiling 19.609 ms [19.412 ms, 19.805 ms] 1.671 ms (9.3%)
tracing 17.609 ms [17.432 ms, 17.787 ms] -328.619 µs (-1.8%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master leo.romanovsky/bump-openfeature-1.20.1
git_commit_date 1769179884 1769193544
git_commit_sha c6c245f 9acbd3c
release_version 1.59.0-SNAPSHOT~c6c245fe4a 1.59.0-SNAPSHOT~9acbd3cd38
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1769195621 1769195621
ci_job_id 1374027658 1374027658
ci_pipeline_id 92558272 92558272
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-zez6zil6 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-zez6zil6 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~9acbd3cd38, baseline=1.59.0-SNAPSHOT~c6c245fe4a
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.64 s) : 15640000, 15640000
.   : milestone, 15640000,
appsec (14.479 s) : 14479000, 14479000
.   : milestone, 14479000,
iast (17.819 s) : 17819000, 17819000
.   : milestone, 17819000,
iast_GLOBAL (17.792 s) : 17792000, 17792000
.   : milestone, 17792000,
profiling (15.163 s) : 15163000, 15163000
.   : milestone, 15163000,
tracing (15.02 s) : 15020000, 15020000
.   : milestone, 15020000,
section candidate
no_agent (15.603 s) : 15603000, 15603000
.   : milestone, 15603000,
appsec (14.553 s) : 14553000, 14553000
.   : milestone, 14553000,
iast (17.757 s) : 17757000, 17757000
.   : milestone, 17757000,
iast_GLOBAL (17.856 s) : 17856000, 17856000
.   : milestone, 17856000,
profiling (15.187 s) : 15187000, 15187000
.   : milestone, 15187000,
tracing (14.895 s) : 14895000, 14895000
.   : milestone, 14895000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.64 s [15.64 s, 15.64 s] -
appsec 14.479 s [14.479 s, 14.479 s] -1.161 s (-7.4%)
iast 17.819 s [17.819 s, 17.819 s] 2.179 s (13.9%)
iast_GLOBAL 17.792 s [17.792 s, 17.792 s] 2.152 s (13.8%)
profiling 15.163 s [15.163 s, 15.163 s] -477.0 ms (-3.0%)
tracing 15.02 s [15.02 s, 15.02 s] -620.0 ms (-4.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.603 s [15.603 s, 15.603 s] -
appsec 14.553 s [14.553 s, 14.553 s] -1.05 s (-6.7%)
iast 17.757 s [17.757 s, 17.757 s] 2.154 s (13.8%)
iast_GLOBAL 17.856 s [17.856 s, 17.856 s] 2.253 s (14.4%)
profiling 15.187 s [15.187 s, 15.187 s] -416.0 ms (-2.7%)
tracing 14.895 s [14.895 s, 14.895 s] -708.0 ms (-4.5%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~9acbd3cd38, baseline=1.59.0-SNAPSHOT~c6c245fe4a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.467 ms) : 1456, 1479
.   : milestone, 1467,
appsec (3.624 ms) : 3409, 3839
.   : milestone, 3624,
iast (2.212 ms) : 2147, 2278
.   : milestone, 2212,
iast_GLOBAL (2.241 ms) : 2176, 2305
.   : milestone, 2241,
profiling (2.063 ms) : 2010, 2116
.   : milestone, 2063,
tracing (2.041 ms) : 1990, 2092
.   : milestone, 2041,
section candidate
no_agent (1.472 ms) : 1460, 1483
.   : milestone, 1472,
appsec (3.699 ms) : 3479, 3919
.   : milestone, 3699,
iast (2.213 ms) : 2148, 2278
.   : milestone, 2213,
iast_GLOBAL (2.25 ms) : 2184, 2315
.   : milestone, 2250,
profiling (2.081 ms) : 2027, 2135
.   : milestone, 2081,
tracing (2.042 ms) : 1991, 2094
.   : milestone, 2042,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.467 ms [1.456 ms, 1.479 ms] -
appsec 3.624 ms [3.409 ms, 3.839 ms] 2.156 ms (146.9%)
iast 2.212 ms [2.147 ms, 2.278 ms] 744.93 µs (50.8%)
iast_GLOBAL 2.241 ms [2.176 ms, 2.305 ms] 773.043 µs (52.7%)
profiling 2.063 ms [2.01 ms, 2.116 ms] 595.889 µs (40.6%)
tracing 2.041 ms [1.99 ms, 2.092 ms] 573.406 µs (39.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.472 ms [1.46 ms, 1.483 ms] -
appsec 3.699 ms [3.479 ms, 3.919 ms] 2.227 ms (151.3%)
iast 2.213 ms [2.148 ms, 2.278 ms] 741.092 µs (50.4%)
iast_GLOBAL 2.25 ms [2.184 ms, 2.315 ms] 778.054 µs (52.9%)
profiling 2.081 ms [2.027 ms, 2.135 ms] 609.062 µs (41.4%)
tracing 2.042 ms [1.991 ms, 2.094 ms] 570.42 µs (38.8%)