Home Original page

Enable Code Origin by default for JDK21+ by jpbempel · Pull Request #10468 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/enable-co-jdk21
git_commit_date 1769651149 1769693136
git_commit_sha e74c6a7 8113a60
release_version 1.59.0-SNAPSHOT~e74c6a793a 1.59.0-SNAPSHOT~8113a6082a
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1769695001 1769695001
ci_job_id 1386576798 1386576798
ci_pipeline_id 93526630 93526630
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-w231zqq3 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-w231zqq3 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 62 metrics, 9 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.59.0-SNAPSHOT~8113a6082a, baseline=1.59.0-SNAPSHOT~e74c6a793a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.062 s) : 0, 1061981
Total [baseline] (8.743 s) : 0, 8742740
Agent [candidate] (1.06 s) : 0, 1059828
Total [candidate] (8.713 s) : 0, 8713332
section iast
Agent [baseline] (1.228 s) : 0, 1228459
Total [baseline] (9.361 s) : 0, 9360891
Agent [candidate] (1.243 s) : 0, 1243303
Total [candidate] (9.405 s) : 0, 9404762
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.062 s -
Agent iast 1.228 s 166.478 ms (15.7%)
Total tracing 8.743 s -
Total iast 9.361 s 618.151 ms (7.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.06 s -
Agent iast 1.243 s 183.474 ms (17.3%)
Total tracing 8.713 s -
Total iast 9.405 s 691.43 ms (7.9%) 
gantt
    title insecure-bank - break down per module: candidate=1.59.0-SNAPSHOT~8113a6082a, baseline=1.59.0-SNAPSHOT~e74c6a793a

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.193 ms) : 0, 1193
crashtracking [candidate] (1.19 ms) : 0, 1190
BytebuddyAgent [baseline] (626.36 ms) : 0, 626360
BytebuddyAgent [candidate] (625.395 ms) : 0, 625395
AgentMeter [baseline] (28.761 ms) : 0, 28761
AgentMeter [candidate] (28.65 ms) : 0, 28650
GlobalTracer [baseline] (257.621 ms) : 0, 257621
GlobalTracer [candidate] (257.076 ms) : 0, 257076
AppSec [baseline] (32.972 ms) : 0, 32972
AppSec [candidate] (32.963 ms) : 0, 32963
Debugger [baseline] (61.225 ms) : 0, 61225
Debugger [candidate] (61.843 ms) : 0, 61843
Remote Config [baseline] (621.542 µs) : 0, 622
Remote Config [candidate] (616.406 µs) : 0, 616
Telemetry [baseline] (9.115 ms) : 0, 9115
Telemetry [candidate] (9.811 ms) : 0, 9811
Flare Poller [baseline] (8.449 ms) : 0, 8449
Flare Poller [candidate] (6.8 ms) : 0, 6800
section iast
crashtracking [baseline] (1.181 ms) : 0, 1181
crashtracking [candidate] (1.202 ms) : 0, 1202
BytebuddyAgent [baseline] (792.945 ms) : 0, 792945
BytebuddyAgent [candidate] (802.762 ms) : 0, 802762
AgentMeter [baseline] (11.238 ms) : 0, 11238
AgentMeter [candidate] (11.488 ms) : 0, 11488
GlobalTracer [baseline] (248.785 ms) : 0, 248785
GlobalTracer [candidate] (250.942 ms) : 0, 250942
IAST [baseline] (26.813 ms) : 0, 26813
IAST [candidate] (27.271 ms) : 0, 27271
AppSec [baseline] (34.827 ms) : 0, 34827
AppSec [candidate] (33.533 ms) : 0, 33533
Debugger [baseline] (64.612 ms) : 0, 64612
Debugger [candidate] (67.666 ms) : 0, 67666
Remote Config [baseline] (550.554 µs) : 0, 551
Remote Config [candidate] (554.194 µs) : 0, 554
Telemetry [baseline] (8.553 ms) : 0, 8553
Telemetry [candidate] (8.657 ms) : 0, 8657
Flare Poller [baseline] (3.469 ms) : 0, 3469
Flare Poller [candidate] (3.497 ms) : 0, 3497
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.59.0-SNAPSHOT~8113a6082a, baseline=1.59.0-SNAPSHOT~e74c6a793a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.073 s) : 0, 1072997
Total [baseline] (11.018 s) : 0, 11018086
Agent [candidate] (1.069 s) : 0, 1068617
Total [candidate] (10.994 s) : 0, 10994053
section appsec
Agent [baseline] (1.232 s) : 0, 1231609
Total [baseline] (10.992 s) : 0, 10991836
Agent [candidate] (1.236 s) : 0, 1235515
Total [candidate] (10.985 s) : 0, 10985066
section iast
Agent [baseline] (1.228 s) : 0, 1228127
Total [baseline] (11.137 s) : 0, 11136875
Agent [candidate] (1.227 s) : 0, 1226558
Total [candidate] (11.098 s) : 0, 11098494
section profiling
Agent [baseline] (1.192 s) : 0, 1192333
Total [baseline] (10.801 s) : 0, 10800534
Agent [candidate] (1.202 s) : 0, 1201936
Total [candidate] (11.007 s) : 0, 11006665
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.073 s -
Agent appsec 1.232 s 158.612 ms (14.8%)
Agent iast 1.228 s 155.13 ms (14.5%)
Agent profiling 1.192 s 119.336 ms (11.1%)
Total tracing 11.018 s -
Total appsec 10.992 s -26.249 ms (-0.2%)
Total iast 11.137 s 118.79 ms (1.1%)
Total profiling 10.801 s -217.552 ms (-2.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.069 s -
Agent appsec 1.236 s 166.898 ms (15.6%)
Agent iast 1.227 s 157.942 ms (14.8%)
Agent profiling 1.202 s 133.319 ms (12.5%)
Total tracing 10.994 s -
Total appsec 10.985 s -8.987 ms (-0.1%)
Total iast 11.098 s 104.441 ms (0.9%)
Total profiling 11.007 s 12.612 ms (0.1%) 
gantt
    title petclinic - break down per module: candidate=1.59.0-SNAPSHOT~8113a6082a, baseline=1.59.0-SNAPSHOT~e74c6a793a

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.195 ms) : 0, 1195
crashtracking [candidate] (1.194 ms) : 0, 1194
BytebuddyAgent [baseline] (631.341 ms) : 0, 631341
BytebuddyAgent [candidate] (628.807 ms) : 0, 628807
AgentMeter [baseline] (29.37 ms) : 0, 29370
AgentMeter [candidate] (29.061 ms) : 0, 29061
GlobalTracer [baseline] (260.32 ms) : 0, 260320
GlobalTracer [candidate] (259.318 ms) : 0, 259318
AppSec [baseline] (33.541 ms) : 0, 33541
AppSec [candidate] (33.382 ms) : 0, 33382
Debugger [baseline] (62.848 ms) : 0, 62848
Debugger [candidate] (61.292 ms) : 0, 61292
Remote Config [baseline] (634.208 µs) : 0, 634
Remote Config [candidate] (645.681 µs) : 0, 646
Telemetry [baseline] (10.049 ms) : 0, 10049
Telemetry [candidate] (10.768 ms) : 0, 10768
Flare Poller [baseline] (7.853 ms) : 0, 7853
Flare Poller [candidate] (8.398 ms) : 0, 8398
section appsec
crashtracking [baseline] (1.182 ms) : 0, 1182
crashtracking [candidate] (1.192 ms) : 0, 1192
BytebuddyAgent [baseline] (651.742 ms) : 0, 651742
BytebuddyAgent [candidate] (653.783 ms) : 0, 653783
AgentMeter [baseline] (11.883 ms) : 0, 11883
AgentMeter [candidate] (11.887 ms) : 0, 11887
GlobalTracer [baseline] (257.165 ms) : 0, 257165
GlobalTracer [candidate] (258.067 ms) : 0, 258067
IAST [baseline] (25.53 ms) : 0, 25530
IAST [candidate] (25.586 ms) : 0, 25586
AppSec [baseline] (167.437 ms) : 0, 167437
AppSec [candidate] (168.427 ms) : 0, 168427
Debugger [baseline] (67.833 ms) : 0, 67833
Debugger [candidate] (67.676 ms) : 0, 67676
Remote Config [baseline] (669.659 µs) : 0, 670
Remote Config [candidate] (670.602 µs) : 0, 671
Telemetry [baseline] (9.198 ms) : 0, 9198
Telemetry [candidate] (9.162 ms) : 0, 9162
Flare Poller [baseline] (3.606 ms) : 0, 3606
Flare Poller [candidate] (3.675 ms) : 0, 3675
section iast
crashtracking [baseline] (1.189 ms) : 0, 1189
crashtracking [candidate] (1.18 ms) : 0, 1180
BytebuddyAgent [baseline] (792.023 ms) : 0, 792023
BytebuddyAgent [candidate] (790.326 ms) : 0, 790326
AgentMeter [baseline] (11.137 ms) : 0, 11137
AgentMeter [candidate] (11.132 ms) : 0, 11132
GlobalTracer [baseline] (248.037 ms) : 0, 248037
GlobalTracer [candidate] (248.034 ms) : 0, 248034
IAST [baseline] (26.973 ms) : 0, 26973
IAST [candidate] (27.003 ms) : 0, 27003
AppSec [baseline] (33.13 ms) : 0, 33130
AppSec [candidate] (31.624 ms) : 0, 31624
Debugger [baseline] (67.586 ms) : 0, 67586
Debugger [candidate] (69.301 ms) : 0, 69301
Remote Config [baseline] (542.345 µs) : 0, 542
Remote Config [candidate] (547.624 µs) : 0, 548
Telemetry [baseline] (8.545 ms) : 0, 8545
Telemetry [candidate] (8.539 ms) : 0, 8539
Flare Poller [baseline] (3.402 ms) : 0, 3402
Flare Poller [candidate] (3.446 ms) : 0, 3446
section profiling
crashtracking [baseline] (1.234 ms) : 0, 1234
crashtracking [candidate] (1.249 ms) : 0, 1249
BytebuddyAgent [baseline] (680.961 ms) : 0, 680961
BytebuddyAgent [candidate] (686.973 ms) : 0, 686973
AgentMeter [baseline] (8.68 ms) : 0, 8680
AgentMeter [candidate] (8.739 ms) : 0, 8739
GlobalTracer [baseline] (217.667 ms) : 0, 217667
GlobalTracer [candidate] (219.529 ms) : 0, 219529
AppSec [baseline] (32.557 ms) : 0, 32557
AppSec [candidate] (33.026 ms) : 0, 33026
Debugger [baseline] (68.169 ms) : 0, 68169
Debugger [candidate] (68.487 ms) : 0, 68487
Remote Config [baseline] (593.08 µs) : 0, 593
Remote Config [candidate] (594.118 µs) : 0, 594
Telemetry [baseline] (8.772 ms) : 0, 8772
Telemetry [candidate] (8.797 ms) : 0, 8797
Flare Poller [baseline] (3.81 ms) : 0, 3810
Flare Poller [candidate] (3.852 ms) : 0, 3852
ProfilingAgent [baseline] (99.655 ms) : 0, 99655
ProfilingAgent [candidate] (99.856 ms) : 0, 99856
Profiling [baseline] (100.241 ms) : 0, 100241
Profiling [candidate] (100.43 ms) : 0, 100430
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/enable-co-jdk21
git_commit_date 1769651149 1769693136
git_commit_sha e74c6a7 8113a60
release_version 1.59.0-SNAPSHOT~e74c6a793a 1.59.0-SNAPSHOT~8113a6082a
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1769695405 1769695405
ci_job_id 1386576799 1386576799
ci_pipeline_id 93526630 93526630
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-kz2oi3x4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-kz2oi3x4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 0 performance regressions! Performance is the same for 19 metrics, 15 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_FULL:high_load better
[-553.280µs; -275.545µs] or [-10.173%; -5.066%]		 better
[-1195.553µs; -499.101µs] or [-9.313%; -3.888%]		 unstable
[-15.786op/s; +128.098op/s] or [-2.079%; +16.867%]		 5.024ms 11.990ms 815.625op/s 5.439ms 12.838ms 759.469op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~8113a6082a, baseline=1.59.0-SNAPSHOT~e74c6a793a
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.159 ms) : 18965, 19353
.   : milestone, 19159,
appsec (18.597 ms) : 18410, 18783
.   : milestone, 18597,
code_origins (17.547 ms) : 17368, 17725
.   : milestone, 17547,
iast (17.667 ms) : 17492, 17843
.   : milestone, 17667,
profiling (18.768 ms) : 18581, 18956
.   : milestone, 18768,
tracing (17.681 ms) : 17502, 17860
.   : milestone, 17681,
section candidate
no_agent (17.95 ms) : 17766, 18134
.   : milestone, 17950,
appsec (18.564 ms) : 18375, 18753
.   : milestone, 18564,
code_origins (17.818 ms) : 17641, 17995
.   : milestone, 17818,
iast (17.618 ms) : 17445, 17792
.   : milestone, 17618,
profiling (18.847 ms) : 18657, 19038
.   : milestone, 18847,
tracing (17.604 ms) : 17427, 17780
.   : milestone, 17604,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.159 ms [18.965 ms, 19.353 ms] -
appsec 18.597 ms [18.41 ms, 18.783 ms] -562.404 µs (-2.9%)
code_origins 17.547 ms [17.368 ms, 17.725 ms] -1.612 ms (-8.4%)
iast 17.667 ms [17.492 ms, 17.843 ms] -1.492 ms (-7.8%)
profiling 18.768 ms [18.581 ms, 18.956 ms] -390.427 µs (-2.0%)
tracing 17.681 ms [17.502 ms, 17.86 ms] -1.478 ms (-7.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.95 ms [17.766 ms, 18.134 ms] -
appsec 18.564 ms [18.375 ms, 18.753 ms] 613.697 µs (3.4%)
code_origins 17.818 ms [17.641 ms, 17.995 ms] -132.127 µs (-0.7%)
iast 17.618 ms [17.445 ms, 17.792 ms] -332.062 µs (-1.8%)
profiling 18.847 ms [18.657 ms, 19.038 ms] 896.784 µs (5.0%)
tracing 17.604 ms [17.427 ms, 17.78 ms] -346.798 µs (-1.9%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~8113a6082a, baseline=1.59.0-SNAPSHOT~e74c6a793a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.187 ms) : 1176, 1199
.   : milestone, 1187,
iast (3.125 ms) : 3084, 3166
.   : milestone, 3125,
iast_FULL (6.091 ms) : 6029, 6154
.   : milestone, 6091,
iast_GLOBAL (3.633 ms) : 3581, 3686
.   : milestone, 3633,
profiling (1.943 ms) : 1927, 1960
.   : milestone, 1943,
tracing (1.818 ms) : 1804, 1832
.   : milestone, 1818,
section candidate
no_agent (1.195 ms) : 1183, 1206
.   : milestone, 1195,
iast (3.212 ms) : 3168, 3256
.   : milestone, 3212,
iast_FULL (5.668 ms) : 5611, 5724
.   : milestone, 5668,
iast_GLOBAL (3.602 ms) : 3544, 3660
.   : milestone, 3602,
profiling (1.923 ms) : 1908, 1938
.   : milestone, 1923,
tracing (1.794 ms) : 1779, 1809
.   : milestone, 1794,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.187 ms [1.176 ms, 1.199 ms] -
iast 3.125 ms [3.084 ms, 3.166 ms] 1.938 ms (163.2%)
iast_FULL 6.091 ms [6.029 ms, 6.154 ms] 4.904 ms (413.1%)
iast_GLOBAL 3.633 ms [3.581 ms, 3.686 ms] 2.446 ms (206.0%)
profiling 1.943 ms [1.927 ms, 1.96 ms] 756.136 µs (63.7%)
tracing 1.818 ms [1.804 ms, 1.832 ms] 630.965 µs (53.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.195 ms [1.183 ms, 1.206 ms] -
iast 3.212 ms [3.168 ms, 3.256 ms] 2.017 ms (168.8%)
iast_FULL 5.668 ms [5.611 ms, 5.724 ms] 4.473 ms (374.3%)
iast_GLOBAL 3.602 ms [3.544 ms, 3.66 ms] 2.407 ms (201.4%)
profiling 1.923 ms [1.908 ms, 1.938 ms] 728.037 µs (60.9%)
tracing 1.794 ms [1.779 ms, 1.809 ms] 599.157 µs (50.1%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/enable-co-jdk21
git_commit_date 1769651149 1769693136
git_commit_sha e74c6a7 8113a60
release_version 1.59.0-SNAPSHOT~e74c6a793a 1.59.0-SNAPSHOT~8113a6082a
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1769695212 1769695212
ci_job_id 1386576800 1386576800
ci_pipeline_id 93526630 93526630
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-b7c5y6q1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-b7c5y6q1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~8113a6082a, baseline=1.59.0-SNAPSHOT~e74c6a793a
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.475 s) : 15475000, 15475000
.   : milestone, 15475000,
appsec (14.998 s) : 14998000, 14998000
.   : milestone, 14998000,
iast (18.64 s) : 18640000, 18640000
.   : milestone, 18640000,
iast_GLOBAL (18.069 s) : 18069000, 18069000
.   : milestone, 18069000,
profiling (15.156 s) : 15156000, 15156000
.   : milestone, 15156000,
tracing (14.623 s) : 14623000, 14623000
.   : milestone, 14623000,
section candidate
no_agent (15.036 s) : 15036000, 15036000
.   : milestone, 15036000,
appsec (14.822 s) : 14822000, 14822000
.   : milestone, 14822000,
iast (18.265 s) : 18265000, 18265000
.   : milestone, 18265000,
iast_GLOBAL (17.985 s) : 17985000, 17985000
.   : milestone, 17985000,
profiling (14.87 s) : 14870000, 14870000
.   : milestone, 14870000,
tracing (14.769 s) : 14769000, 14769000
.   : milestone, 14769000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.475 s [15.475 s, 15.475 s] -
appsec 14.998 s [14.998 s, 14.998 s] -477.0 ms (-3.1%)
iast 18.64 s [18.64 s, 18.64 s] 3.165 s (20.5%)
iast_GLOBAL 18.069 s [18.069 s, 18.069 s] 2.594 s (16.8%)
profiling 15.156 s [15.156 s, 15.156 s] -319.0 ms (-2.1%)
tracing 14.623 s [14.623 s, 14.623 s] -852.0 ms (-5.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.036 s [15.036 s, 15.036 s] -
appsec 14.822 s [14.822 s, 14.822 s] -214.0 ms (-1.4%)
iast 18.265 s [18.265 s, 18.265 s] 3.229 s (21.5%)
iast_GLOBAL 17.985 s [17.985 s, 17.985 s] 2.949 s (19.6%)
profiling 14.87 s [14.87 s, 14.87 s] -166.0 ms (-1.1%)
tracing 14.769 s [14.769 s, 14.769 s] -267.0 ms (-1.8%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~8113a6082a, baseline=1.59.0-SNAPSHOT~e74c6a793a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.469 ms) : 1457, 1480
.   : milestone, 1469,
appsec (3.744 ms) : 3523, 3965
.   : milestone, 3744,
iast (2.239 ms) : 2170, 2308
.   : milestone, 2239,
iast_GLOBAL (2.283 ms) : 2214, 2353
.   : milestone, 2283,
profiling (2.501 ms) : 2336, 2667
.   : milestone, 2501,
tracing (2.048 ms) : 1995, 2102
.   : milestone, 2048,
section candidate
no_agent (1.47 ms) : 1458, 1481
.   : milestone, 1470,
appsec (3.759 ms) : 3537, 3981
.   : milestone, 3759,
iast (2.245 ms) : 2176, 2314
.   : milestone, 2245,
iast_GLOBAL (2.284 ms) : 2215, 2353
.   : milestone, 2284,
profiling (2.49 ms) : 2331, 2649
.   : milestone, 2490,
tracing (2.049 ms) : 1996, 2103
.   : milestone, 2049,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.469 ms [1.457 ms, 1.48 ms] -
appsec 3.744 ms [3.523 ms, 3.965 ms] 2.275 ms (154.9%)
iast 2.239 ms [2.17 ms, 2.308 ms] 770.503 µs (52.5%)
iast_GLOBAL 2.283 ms [2.214 ms, 2.353 ms] 814.689 µs (55.5%)
profiling 2.501 ms [2.336 ms, 2.667 ms] 1.033 ms (70.3%)
tracing 2.048 ms [1.995 ms, 2.102 ms] 579.683 µs (39.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.47 ms [1.458 ms, 1.481 ms] -
appsec 3.759 ms [3.537 ms, 3.981 ms] 2.289 ms (155.8%)
iast 2.245 ms [2.176 ms, 2.314 ms] 775.483 µs (52.8%)
iast_GLOBAL 2.284 ms [2.215 ms, 2.353 ms] 814.041 µs (55.4%)
profiling 2.49 ms [2.331 ms, 2.649 ms] 1.021 ms (69.4%)
tracing 2.049 ms [1.996 ms, 2.103 ms] 579.688 µs (39.4%)