Home Original page

Avoid potential `ConcurrentModificationException` in `TunnelingJdkSocket` by mcculls · Pull Request #10564 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/tunneling-socket-thread-safety
git_commit_date 1770808413 1770808593
git_commit_sha 6d44cf9 d44c576
release_version 1.60.0-SNAPSHOT~6d44cf9e09 1.60.0-SNAPSHOT~d44c576819
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1770810576 1770810576
ci_job_id 1416731647 1416731647
ci_pipeline_id 95775023 95775023
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-zn0oum98 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-zn0oum98 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 63 metrics, 8 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~d44c576819, baseline=1.60.0-SNAPSHOT~6d44cf9e09

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.072 s) : 0, 1071865
Total [baseline] (8.761 s) : 0, 8760862
Agent [candidate] (1.061 s) : 0, 1061185
Total [candidate] (8.708 s) : 0, 8708349
section iast
Agent [baseline] (1.228 s) : 0, 1227562
Total [baseline] (9.343 s) : 0, 9343014
Agent [candidate] (1.228 s) : 0, 1227874
Total [candidate] (9.32 s) : 0, 9319849
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.072 s -
Agent iast 1.228 s 155.697 ms (14.5%)
Total tracing 8.761 s -
Total iast 9.343 s 582.152 ms (6.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.061 s -
Agent iast 1.228 s 166.689 ms (15.7%)
Total tracing 8.708 s -
Total iast 9.32 s 611.5 ms (7.0%) 
gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~d44c576819, baseline=1.60.0-SNAPSHOT~6d44cf9e09

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.197 ms) : 0, 1197
crashtracking [candidate] (1.176 ms) : 0, 1176
BytebuddyAgent [baseline] (634.705 ms) : 0, 634705
BytebuddyAgent [candidate] (626.738 ms) : 0, 626738
AgentMeter [baseline] (29.163 ms) : 0, 29163
AgentMeter [candidate] (28.803 ms) : 0, 28803
GlobalTracer [baseline] (258.965 ms) : 0, 258965
GlobalTracer [candidate] (256.978 ms) : 0, 256978
AppSec [baseline] (33.203 ms) : 0, 33203
AppSec [candidate] (32.713 ms) : 0, 32713
Debugger [baseline] (61.668 ms) : 0, 61668
Debugger [candidate] (60.49 ms) : 0, 60490
Remote Config [baseline] (638.554 µs) : 0, 639
Remote Config [candidate] (626.907 µs) : 0, 627
Telemetry [baseline] (11.436 ms) : 0, 11436
Telemetry [candidate] (11.543 ms) : 0, 11543
Flare Poller [baseline] (5.388 ms) : 0, 5388
Flare Poller [candidate] (6.821 ms) : 0, 6821
section iast
crashtracking [baseline] (1.171 ms) : 0, 1171
crashtracking [candidate] (1.169 ms) : 0, 1169
BytebuddyAgent [baseline] (793.496 ms) : 0, 793496
BytebuddyAgent [candidate] (792.947 ms) : 0, 792947
AgentMeter [baseline] (11.193 ms) : 0, 11193
AgentMeter [candidate] (11.199 ms) : 0, 11199
GlobalTracer [baseline] (247.005 ms) : 0, 247005
GlobalTracer [candidate] (247.833 ms) : 0, 247833
IAST [baseline] (26.855 ms) : 0, 26855
IAST [candidate] (26.818 ms) : 0, 26818
AppSec [baseline] (33.958 ms) : 0, 33958
AppSec [candidate] (33.988 ms) : 0, 33988
Debugger [baseline] (65.874 ms) : 0, 65874
Debugger [candidate] (66.097 ms) : 0, 66097
Remote Config [baseline] (537.696 µs) : 0, 538
Remote Config [candidate] (529.561 µs) : 0, 530
Telemetry [baseline] (8.675 ms) : 0, 8675
Telemetry [candidate] (8.631 ms) : 0, 8631
Flare Poller [baseline] (3.595 ms) : 0, 3595
Flare Poller [candidate] (3.465 ms) : 0, 3465
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~d44c576819, baseline=1.60.0-SNAPSHOT~6d44cf9e09

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.061 s) : 0, 1061042
Total [baseline] (10.846 s) : 0, 10846436
Agent [candidate] (1.074 s) : 0, 1074176
Total [candidate] (10.914 s) : 0, 10913741
section appsec
Agent [baseline] (1.233 s) : 0, 1233250
Total [baseline] (10.95 s) : 0, 10950312
Agent [candidate] (1.236 s) : 0, 1236373
Total [candidate] (10.938 s) : 0, 10937795
section iast
Agent [baseline] (1.229 s) : 0, 1229362
Total [baseline] (11.138 s) : 0, 11138422
Agent [candidate] (1.233 s) : 0, 1233343
Total [candidate] (11.163 s) : 0, 11163217
section profiling
Agent [baseline] (1.185 s) : 0, 1185273
Total [baseline] (10.935 s) : 0, 10934668
Agent [candidate] (1.187 s) : 0, 1187062
Total [candidate] (11.002 s) : 0, 11002307
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.061 s -
Agent appsec 1.233 s 172.208 ms (16.2%)
Agent iast 1.229 s 168.32 ms (15.9%)
Agent profiling 1.185 s 124.231 ms (11.7%)
Total tracing 10.846 s -
Total appsec 10.95 s 103.876 ms (1.0%)
Total iast 11.138 s 291.987 ms (2.7%)
Total profiling 10.935 s 88.232 ms (0.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.074 s -
Agent appsec 1.236 s 162.197 ms (15.1%)
Agent iast 1.233 s 159.167 ms (14.8%)
Agent profiling 1.187 s 112.886 ms (10.5%)
Total tracing 10.914 s -
Total appsec 10.938 s 24.054 ms (0.2%)
Total iast 11.163 s 249.477 ms (2.3%)
Total profiling 11.002 s 88.567 ms (0.8%) 
gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~d44c576819, baseline=1.60.0-SNAPSHOT~6d44cf9e09

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.184 ms) : 0, 1184
crashtracking [candidate] (1.191 ms) : 0, 1191
BytebuddyAgent [baseline] (627.834 ms) : 0, 627834
BytebuddyAgent [candidate] (634.606 ms) : 0, 634606
AgentMeter [baseline] (29.035 ms) : 0, 29035
AgentMeter [candidate] (29.183 ms) : 0, 29183
GlobalTracer [baseline] (257.342 ms) : 0, 257342
GlobalTracer [candidate] (259.295 ms) : 0, 259295
AppSec [baseline] (32.626 ms) : 0, 32626
AppSec [candidate] (33.161 ms) : 0, 33161
Debugger [baseline] (61.009 ms) : 0, 61009
Debugger [candidate] (62.368 ms) : 0, 62368
Remote Config [baseline] (625.63 µs) : 0, 626
Remote Config [candidate] (623.024 µs) : 0, 623
Telemetry [baseline] (10.832 ms) : 0, 10832
Telemetry [candidate] (10.676 ms) : 0, 10676
Flare Poller [baseline] (5.328 ms) : 0, 5328
Flare Poller [candidate] (7.616 ms) : 0, 7616
section appsec
crashtracking [baseline] (1.175 ms) : 0, 1175
crashtracking [candidate] (1.177 ms) : 0, 1177
BytebuddyAgent [baseline] (654.489 ms) : 0, 654489
BytebuddyAgent [candidate] (657.665 ms) : 0, 657665
AgentMeter [baseline] (11.912 ms) : 0, 11912
AgentMeter [candidate] (11.897 ms) : 0, 11897
GlobalTracer [baseline] (257.093 ms) : 0, 257093
GlobalTracer [candidate] (256.841 ms) : 0, 256841
IAST [baseline] (25.014 ms) : 0, 25014
IAST [candidate] (25.022 ms) : 0, 25022
AppSec [baseline] (167.219 ms) : 0, 167219
AppSec [candidate] (167.574 ms) : 0, 167574
Debugger [baseline] (66.983 ms) : 0, 66983
Debugger [candidate] (66.951 ms) : 0, 66951
Remote Config [baseline] (668.937 µs) : 0, 669
Remote Config [candidate] (645.124 µs) : 0, 645
Telemetry [baseline] (9.752 ms) : 0, 9752
Telemetry [candidate] (9.651 ms) : 0, 9651
Flare Poller [baseline] (3.73 ms) : 0, 3730
Flare Poller [candidate] (3.719 ms) : 0, 3719
section iast
crashtracking [baseline] (1.175 ms) : 0, 1175
crashtracking [candidate] (1.2 ms) : 0, 1200
BytebuddyAgent [baseline] (794.406 ms) : 0, 794406
BytebuddyAgent [candidate] (796.696 ms) : 0, 796696
AgentMeter [baseline] (11.217 ms) : 0, 11217
AgentMeter [candidate] (11.268 ms) : 0, 11268
GlobalTracer [baseline] (247.85 ms) : 0, 247850
GlobalTracer [candidate] (248.84 ms) : 0, 248840
IAST [baseline] (26.84 ms) : 0, 26840
IAST [candidate] (26.867 ms) : 0, 26867
AppSec [baseline] (32.866 ms) : 0, 32866
AppSec [candidate] (32.934 ms) : 0, 32934
Debugger [baseline] (67.229 ms) : 0, 67229
Debugger [candidate] (67.906 ms) : 0, 67906
Remote Config [baseline] (535.882 µs) : 0, 536
Remote Config [candidate] (526.063 µs) : 0, 526
Telemetry [baseline] (8.57 ms) : 0, 8570
Telemetry [candidate] (8.473 ms) : 0, 8473
Flare Poller [baseline] (3.456 ms) : 0, 3456
Flare Poller [candidate] (3.406 ms) : 0, 3406
section profiling
crashtracking [baseline] (1.211 ms) : 0, 1211
crashtracking [candidate] (1.215 ms) : 0, 1215
BytebuddyAgent [baseline] (678.821 ms) : 0, 678821
BytebuddyAgent [candidate] (680.081 ms) : 0, 680081
AgentMeter [baseline] (8.545 ms) : 0, 8545
AgentMeter [candidate] (8.55 ms) : 0, 8550
GlobalTracer [baseline] (215.143 ms) : 0, 215143
GlobalTracer [candidate] (215.472 ms) : 0, 215472
AppSec [baseline] (32.57 ms) : 0, 32570
AppSec [candidate] (32.226 ms) : 0, 32226
Debugger [baseline] (67.3 ms) : 0, 67300
Debugger [candidate] (67.102 ms) : 0, 67102
Remote Config [baseline] (621.792 µs) : 0, 622
Remote Config [candidate] (623.13 µs) : 0, 623
Telemetry [baseline] (8.793 ms) : 0, 8793
Telemetry [candidate] (8.948 ms) : 0, 8948
Flare Poller [baseline] (3.724 ms) : 0, 3724
Flare Poller [candidate] (3.753 ms) : 0, 3753
ProfilingAgent [baseline] (98.957 ms) : 0, 98957
ProfilingAgent [candidate] (99.45 ms) : 0, 99450
Profiling [baseline] (99.526 ms) : 0, 99526
Profiling [candidate] (100.025 ms) : 0, 100025
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/tunneling-socket-thread-safety
git_commit_date 1770808413 1770808593
git_commit_sha 6d44cf9 d44c576
release_version 1.60.0-SNAPSHOT~6d44cf9e09 1.60.0-SNAPSHOT~d44c576819
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1770810930 1770810930
ci_job_id 1416731648 1416731648
ci_pipeline_id 95775023 95775023
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-nzujztx9 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-nzujztx9 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 2 performance regressions! Performance is the same for 15 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load worse
[+126.415µs; +230.058µs] or [+4.694%; +8.542%]		 worse
[+228.987µs; +611.652µs] or [+2.986%; +7.976%]		 unstable
[-216.758op/s; +65.070op/s] or [-16.217%; +4.868%]		 2.871ms 8.089ms 1260.750op/s 2.693ms 7.669ms 1336.594op/s
scenario:load:petclinic:code_origins:high_load better
[-1.683ms; -0.834ms] or [-9.179%; -4.548%]		 better
[-2.598ms; -1.319ms] or [-8.711%; -4.421%]		 unstable
[-6.620op/s; +42.933op/s] or [-2.650%; +17.188%]		 17.079ms 27.865ms 267.938op/s 18.338ms 29.823ms 249.781op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~d44c576819, baseline=1.60.0-SNAPSHOT~6d44cf9e09
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.175 ms) : 1164, 1186
.   : milestone, 1175,
iast (3.191 ms) : 3147, 3234
.   : milestone, 3191,
iast_FULL (5.977 ms) : 5916, 6037
.   : milestone, 5977,
iast_GLOBAL (3.427 ms) : 3380, 3474
.   : milestone, 3427,
profiling (1.895 ms) : 1879, 1910
.   : milestone, 1895,
tracing (1.769 ms) : 1754, 1784
.   : milestone, 1769,
section candidate
no_agent (1.181 ms) : 1169, 1192
.   : milestone, 1181,
iast (3.13 ms) : 3086, 3173
.   : milestone, 3130,
iast_FULL (5.946 ms) : 5886, 6006
.   : milestone, 5946,
iast_GLOBAL (3.639 ms) : 3585, 3692
.   : milestone, 3639,
profiling (1.937 ms) : 1920, 1953
.   : milestone, 1937,
tracing (1.817 ms) : 1802, 1831
.   : milestone, 1817,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.175 ms [1.164 ms, 1.186 ms] -
iast 3.191 ms [3.147 ms, 3.234 ms] 2.015 ms (171.5%)
iast_FULL 5.977 ms [5.916 ms, 6.037 ms] 4.802 ms (408.6%)
iast_GLOBAL 3.427 ms [3.38 ms, 3.474 ms] 2.252 ms (191.6%)
profiling 1.895 ms [1.879 ms, 1.91 ms] 719.63 µs (61.2%)
tracing 1.769 ms [1.754 ms, 1.784 ms] 593.866 µs (50.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.181 ms [1.169 ms, 1.192 ms] -
iast 3.13 ms [3.086 ms, 3.173 ms] 1.949 ms (165.1%)
iast_FULL 5.946 ms [5.886 ms, 6.006 ms] 4.765 ms (403.6%)
iast_GLOBAL 3.639 ms [3.585 ms, 3.692 ms] 2.458 ms (208.2%)
profiling 1.937 ms [1.92 ms, 1.953 ms] 756.096 µs (64.0%)
tracing 1.817 ms [1.802 ms, 1.831 ms] 636.075 µs (53.9%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~d44c576819, baseline=1.60.0-SNAPSHOT~6d44cf9e09
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.25 ms) : 18062, 18438
.   : milestone, 18250,
appsec (18.981 ms) : 18785, 19177
.   : milestone, 18981,
code_origins (18.686 ms) : 18498, 18873
.   : milestone, 18686,
iast (17.483 ms) : 17309, 17657
.   : milestone, 17483,
profiling (18.854 ms) : 18663, 19045
.   : milestone, 18854,
tracing (17.742 ms) : 17564, 17920
.   : milestone, 17742,
section candidate
no_agent (18.257 ms) : 18069, 18444
.   : milestone, 18257,
appsec (18.683 ms) : 18494, 18873
.   : milestone, 18683,
code_origins (17.416 ms) : 17247, 17585
.   : milestone, 17416,
iast (17.699 ms) : 17519, 17879
.   : milestone, 17699,
profiling (18.944 ms) : 18753, 19135
.   : milestone, 18944,
tracing (17.869 ms) : 17689, 18048
.   : milestone, 17869,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.25 ms [18.062 ms, 18.438 ms] -
appsec 18.981 ms [18.785 ms, 19.177 ms] 730.932 µs (4.0%)
code_origins 18.686 ms [18.498 ms, 18.873 ms] 435.707 µs (2.4%)
iast 17.483 ms [17.309 ms, 17.657 ms] -767.53 µs (-4.2%)
profiling 18.854 ms [18.663 ms, 19.045 ms] 603.755 µs (3.3%)
tracing 17.742 ms [17.564 ms, 17.92 ms] -508.209 µs (-2.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.257 ms [18.069 ms, 18.444 ms] -
appsec 18.683 ms [18.494 ms, 18.873 ms] 426.714 µs (2.3%)
code_origins 17.416 ms [17.247 ms, 17.585 ms] -840.96 µs (-4.6%)
iast 17.699 ms [17.519 ms, 17.879 ms] -557.696 µs (-3.1%)
profiling 18.944 ms [18.753 ms, 19.135 ms] 687.225 µs (3.8%)
tracing 17.869 ms [17.689 ms, 18.048 ms] -388.059 µs (-2.1%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/tunneling-socket-thread-safety
git_commit_date 1770808413 1770808593
git_commit_sha 6d44cf9 d44c576
release_version 1.60.0-SNAPSHOT~6d44cf9e09 1.60.0-SNAPSHOT~d44c576819
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1770810722 1770810722
ci_job_id 1416731649 1416731649
ci_pipeline_id 95775023 95775023
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-jyh91b3o 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-jyh91b3o 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~d44c576819, baseline=1.60.0-SNAPSHOT~6d44cf9e09
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.699 s) : 15699000, 15699000
.   : milestone, 15699000,
appsec (14.961 s) : 14961000, 14961000
.   : milestone, 14961000,
iast (18.309 s) : 18309000, 18309000
.   : milestone, 18309000,
iast_GLOBAL (17.722 s) : 17722000, 17722000
.   : milestone, 17722000,
profiling (14.908 s) : 14908000, 14908000
.   : milestone, 14908000,
tracing (14.79 s) : 14790000, 14790000
.   : milestone, 14790000,
section candidate
no_agent (15.009 s) : 15009000, 15009000
.   : milestone, 15009000,
appsec (15.102 s) : 15102000, 15102000
.   : milestone, 15102000,
iast (18.198 s) : 18198000, 18198000
.   : milestone, 18198000,
iast_GLOBAL (17.811 s) : 17811000, 17811000
.   : milestone, 17811000,
profiling (14.957 s) : 14957000, 14957000
.   : milestone, 14957000,
tracing (14.598 s) : 14598000, 14598000
.   : milestone, 14598000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.699 s [15.699 s, 15.699 s] -
appsec 14.961 s [14.961 s, 14.961 s] -738.0 ms (-4.7%)
iast 18.309 s [18.309 s, 18.309 s] 2.61 s (16.6%)
iast_GLOBAL 17.722 s [17.722 s, 17.722 s] 2.023 s (12.9%)
profiling 14.908 s [14.908 s, 14.908 s] -791.0 ms (-5.0%)
tracing 14.79 s [14.79 s, 14.79 s] -909.0 ms (-5.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.009 s [15.009 s, 15.009 s] -
appsec 15.102 s [15.102 s, 15.102 s] 93.0 ms (0.6%)
iast 18.198 s [18.198 s, 18.198 s] 3.189 s (21.2%)
iast_GLOBAL 17.811 s [17.811 s, 17.811 s] 2.802 s (18.7%)
profiling 14.957 s [14.957 s, 14.957 s] -52.0 ms (-0.3%)
tracing 14.598 s [14.598 s, 14.598 s] -411.0 ms (-2.7%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~d44c576819, baseline=1.60.0-SNAPSHOT~6d44cf9e09
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.477 ms) : 1465, 1488
.   : milestone, 1477,
appsec (3.699 ms) : 3482, 3915
.   : milestone, 3699,
iast (2.259 ms) : 2190, 2329
.   : milestone, 2259,
iast_GLOBAL (2.303 ms) : 2233, 2372
.   : milestone, 2303,
profiling (2.093 ms) : 2038, 2148
.   : milestone, 2093,
tracing (2.068 ms) : 2014, 2122
.   : milestone, 2068,
section candidate
no_agent (1.475 ms) : 1463, 1486
.   : milestone, 1475,
appsec (3.776 ms) : 3555, 3997
.   : milestone, 3776,
iast (2.264 ms) : 2195, 2333
.   : milestone, 2264,
iast_GLOBAL (2.299 ms) : 2230, 2369
.   : milestone, 2299,
profiling (2.092 ms) : 2036, 2148
.   : milestone, 2092,
tracing (2.076 ms) : 2022, 2130
.   : milestone, 2076,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.477 ms [1.465 ms, 1.488 ms] -
appsec 3.699 ms [3.482 ms, 3.915 ms] 2.222 ms (150.4%)
iast 2.259 ms [2.19 ms, 2.329 ms] 782.475 µs (53.0%)
iast_GLOBAL 2.303 ms [2.233 ms, 2.372 ms] 825.985 µs (55.9%)
profiling 2.093 ms [2.038 ms, 2.148 ms] 615.825 µs (41.7%)
tracing 2.068 ms [2.014 ms, 2.122 ms] 591.138 µs (40.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.475 ms [1.463 ms, 1.486 ms] -
appsec 3.776 ms [3.555 ms, 3.997 ms] 2.301 ms (156.1%)
iast 2.264 ms [2.195 ms, 2.333 ms] 789.669 µs (53.6%)
iast_GLOBAL 2.299 ms [2.23 ms, 2.369 ms] 824.923 µs (55.9%)
profiling 2.092 ms [2.036 ms, 2.148 ms] 617.631 µs (41.9%)
tracing 2.076 ms [2.022 ms, 2.13 ms] 601.031 µs (40.8%)