DbInfo Thread Safety by dougqh · Pull Request #10517 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master dougqh/dbinfo-default-final
git_commit_date 1770217470 1770221902
git_commit_sha 786c771 45a6329
release_version 1.60.0-SNAPSHOT~786c771187 1.60.0-SNAPSHOT~45a6329b4e
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1770223583 1770223583
ci_job_id 1401062472 1401062472
ci_pipeline_id 94639876 94639876
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-stjw9sn1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-stjw9sn1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 60 metrics, 11 unstable metrics.

Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~45a6329b4e, baseline=1.60.0-SNAPSHOT~786c771187

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.077 s) : 0, 1077376
Total [baseline] (10.946 s) : 0, 10946399
Agent [candidate] (1.066 s) : 0, 1065699
Total [candidate] (10.881 s) : 0, 10880525
section appsec
Agent [baseline] (1.24 s) : 0, 1239578
Total [baseline] (11.142 s) : 0, 11142306
Agent [candidate] (1.249 s) : 0, 1249244
Total [candidate] (11.181 s) : 0, 11181042
section iast
Agent [baseline] (1.24 s) : 0, 1239742
Total [baseline] (11.212 s) : 0, 11211899
Agent [candidate] (1.239 s) : 0, 1239100
Total [candidate] (11.324 s) : 0, 11324318
section profiling
Agent [baseline] (1.191 s) : 0, 1191494
Total [baseline] (11.009 s) : 0, 11008678
Agent [candidate] (1.202 s) : 0, 1202062
Total [candidate] (11.052 s) : 0, 11052349
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.077 s -
Agent appsec 1.24 s 162.202 ms (15.1%)
Agent iast 1.24 s 162.366 ms (15.1%)
Agent profiling 1.191 s 114.118 ms (10.6%)
Total tracing 10.946 s -
Total appsec 11.142 s 195.908 ms (1.8%)
Total iast 11.212 s 265.5 ms (2.4%)
Total profiling 11.009 s 62.28 ms (0.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.066 s -
Agent appsec 1.249 s 183.546 ms (17.2%)
Agent iast 1.239 s 173.401 ms (16.3%)
Agent profiling 1.202 s 136.364 ms (12.8%)
Total tracing 10.881 s -
Total appsec 11.181 s 300.517 ms (2.8%)
Total iast 11.324 s 443.793 ms (4.1%)
Total profiling 11.052 s 171.824 ms (1.6%)
gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~45a6329b4e, baseline=1.60.0-SNAPSHOT~786c771187

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.196 ms) : 0, 1196
crashtracking [candidate] (1.189 ms) : 0, 1189
BytebuddyAgent [baseline] (636.771 ms) : 0, 636771
BytebuddyAgent [candidate] (628.443 ms) : 0, 628443
AgentMeter [baseline] (29.27 ms) : 0, 29270
AgentMeter [candidate] (28.761 ms) : 0, 28761
GlobalTracer [baseline] (260.838 ms) : 0, 260838
GlobalTracer [candidate] (258.0 ms) : 0, 258000
AppSec [baseline] (33.306 ms) : 0, 33306
AppSec [candidate] (32.689 ms) : 0, 32689
Debugger [baseline] (62.065 ms) : 0, 62065
Debugger [candidate] (63.062 ms) : 0, 63062
Remote Config [baseline] (625.418 µs) : 0, 625
Remote Config [candidate] (612.092 µs) : 0, 612
Telemetry [baseline] (13.829 ms) : 0, 13829
Telemetry [candidate] (12.248 ms) : 0, 12248
Flare Poller [baseline] (3.844 ms) : 0, 3844
Flare Poller [candidate] (5.322 ms) : 0, 5322
section appsec
crashtracking [baseline] (1.193 ms) : 0, 1193
crashtracking [candidate] (1.217 ms) : 0, 1217
BytebuddyAgent [baseline] (658.378 ms) : 0, 658378
BytebuddyAgent [candidate] (663.977 ms) : 0, 663977
AgentMeter [baseline] (11.768 ms) : 0, 11768
AgentMeter [candidate] (11.867 ms) : 0, 11867
GlobalTracer [baseline] (258.782 ms) : 0, 258782
GlobalTracer [candidate] (260.611 ms) : 0, 260611
AppSec [baseline] (168.199 ms) : 0, 168199
AppSec [candidate] (169.67 ms) : 0, 169670
Debugger [baseline] (67.238 ms) : 0, 67238
Debugger [candidate] (66.907 ms) : 0, 66907
Remote Config [baseline] (672.33 µs) : 0, 672
Remote Config [candidate] (698.546 µs) : 0, 699
Telemetry [baseline] (9.141 ms) : 0, 9141
Telemetry [candidate] (9.231 ms) : 0, 9231
Flare Poller [baseline] (3.634 ms) : 0, 3634
Flare Poller [candidate] (3.71 ms) : 0, 3710
IAST [baseline] (25.222 ms) : 0, 25222
IAST [candidate] (25.716 ms) : 0, 25716
section iast
crashtracking [baseline] (1.196 ms) : 0, 1196
crashtracking [candidate] (1.208 ms) : 0, 1208
BytebuddyAgent [baseline] (802.136 ms) : 0, 802136
BytebuddyAgent [candidate] (799.82 ms) : 0, 799820
AgentMeter [baseline] (11.372 ms) : 0, 11372
AgentMeter [candidate] (11.226 ms) : 0, 11226
GlobalTracer [baseline] (249.309 ms) : 0, 249309
GlobalTracer [candidate] (249.374 ms) : 0, 249374
AppSec [baseline] (33.908 ms) : 0, 33908
AppSec [candidate] (34.881 ms) : 0, 34881
Debugger [baseline] (66.67 ms) : 0, 66670
Debugger [candidate] (66.766 ms) : 0, 66766
Remote Config [baseline] (542.473 µs) : 0, 542
Remote Config [candidate] (565.197 µs) : 0, 565
Telemetry [baseline] (8.712 ms) : 0, 8712
Telemetry [candidate] (8.986 ms) : 0, 8986
Flare Poller [baseline] (3.485 ms) : 0, 3485
Flare Poller [candidate] (3.569 ms) : 0, 3569
IAST [baseline] (26.987 ms) : 0, 26987
IAST [candidate] (27.233 ms) : 0, 27233
section profiling
ProfilingAgent [baseline] (101.113 ms) : 0, 101113
ProfilingAgent [candidate] (101.392 ms) : 0, 101392
crashtracking [baseline] (1.211 ms) : 0, 1211
crashtracking [candidate] (1.223 ms) : 0, 1223
BytebuddyAgent [baseline] (681.445 ms) : 0, 681445
BytebuddyAgent [candidate] (688.3 ms) : 0, 688300
AgentMeter [baseline] (8.617 ms) : 0, 8617
AgentMeter [candidate] (8.727 ms) : 0, 8727
GlobalTracer [baseline] (215.914 ms) : 0, 215914
GlobalTracer [candidate] (217.543 ms) : 0, 217543
AppSec [baseline] (32.458 ms) : 0, 32458
AppSec [candidate] (32.907 ms) : 0, 32907
Debugger [baseline] (67.589 ms) : 0, 67589
Debugger [candidate] (68.266 ms) : 0, 68266
Remote Config [baseline] (607.437 µs) : 0, 607
Remote Config [candidate] (612.944 µs) : 0, 613
Telemetry [baseline] (8.971 ms) : 0, 8971
Telemetry [candidate] (8.904 ms) : 0, 8904
Flare Poller [baseline] (3.825 ms) : 0, 3825
Flare Poller [candidate] (3.794 ms) : 0, 3794
Profiling [baseline] (101.696 ms) : 0, 101696
Profiling [candidate] (101.977 ms) : 0, 101977
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~45a6329b4e, baseline=1.60.0-SNAPSHOT~786c771187

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.066 s) : 0, 1066474
Total [baseline] (8.767 s) : 0, 8766535
Agent [candidate] (1.066 s) : 0, 1066243
Total [candidate] (8.761 s) : 0, 8760745
section iast
Agent [baseline] (1.256 s) : 0, 1255575
Total [baseline] (9.455 s) : 0, 9455387
Agent [candidate] (1.238 s) : 0, 1238382
Total [candidate] (9.4 s) : 0, 9399652
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.066 s -
Agent iast 1.256 s 189.101 ms (17.7%)
Total tracing 8.767 s -
Total iast 9.455 s 688.851 ms (7.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.066 s -
Agent iast 1.238 s 172.139 ms (16.1%)
Total tracing 8.761 s -
Total iast 9.4 s 638.908 ms (7.3%)
gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~45a6329b4e, baseline=1.60.0-SNAPSHOT~786c771187

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.184 ms) : 0, 1184
crashtracking [candidate] (1.19 ms) : 0, 1190
BytebuddyAgent [baseline] (629.482 ms) : 0, 629482
BytebuddyAgent [candidate] (630.163 ms) : 0, 630163
AgentMeter [baseline] (28.732 ms) : 0, 28732
AgentMeter [candidate] (28.728 ms) : 0, 28728
GlobalTracer [baseline] (258.127 ms) : 0, 258127
GlobalTracer [candidate] (258.331 ms) : 0, 258331
AppSec [baseline] (32.898 ms) : 0, 32898
AppSec [candidate] (32.822 ms) : 0, 32822
Debugger [baseline] (60.586 ms) : 0, 60586
Debugger [candidate] (59.67 ms) : 0, 59670
Remote Config [baseline] (619.343 µs) : 0, 619
Remote Config [candidate] (621.596 µs) : 0, 622
Telemetry [baseline] (13.957 ms) : 0, 13957
Telemetry [candidate] (13.134 ms) : 0, 13134
Flare Poller [baseline] (5.438 ms) : 0, 5438
Flare Poller [candidate] (6.15 ms) : 0, 6150
section iast
crashtracking [baseline] (1.213 ms) : 0, 1213
crashtracking [candidate] (1.191 ms) : 0, 1191
BytebuddyAgent [baseline] (814.076 ms) : 0, 814076
BytebuddyAgent [candidate] (801.653 ms) : 0, 801653
AgentMeter [baseline] (11.835 ms) : 0, 11835
AgentMeter [candidate] (11.397 ms) : 0, 11397
GlobalTracer [baseline] (251.729 ms) : 0, 251729
GlobalTracer [candidate] (248.683 ms) : 0, 248683
AppSec [baseline] (35.172 ms) : 0, 35172
AppSec [candidate] (34.916 ms) : 0, 34916
Debugger [baseline] (65.384 ms) : 0, 65384
Debugger [candidate] (64.739 ms) : 0, 64739
Remote Config [baseline] (545.768 µs) : 0, 546
Remote Config [candidate] (542.197 µs) : 0, 542
Telemetry [baseline] (8.704 ms) : 0, 8704
Telemetry [candidate] (8.757 ms) : 0, 8757
Flare Poller [baseline] (3.545 ms) : 0, 3545
Flare Poller [candidate] (3.49 ms) : 0, 3490
IAST [baseline] (27.641 ms) : 0, 27641
IAST [candidate] (27.471 ms) : 0, 27471
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master dougqh/dbinfo-default-final
git_commit_date 1770217470 1770221902
git_commit_sha 786c771 45a6329
release_version 1.60.0-SNAPSHOT~786c771187 1.60.0-SNAPSHOT~45a6329b4e
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1770224071 1770224071
ci_job_id 1401062477 1401062477
ci_pipeline_id 94639876 94639876
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-wkyq8i0z 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-wkyq8i0z 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 0 performance regressions! Performance is the same for 17 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:profiling:high_load better
[-232.121µs; -118.900µs] or [-13.017%; -6.668%]
unstable
[-1390.638µs; -464.743µs] or [-25.830%; -8.632%]
unstable
[+82.346op/s; +608.591op/s] or [+4.141%; +30.605%]
1.608ms 4.456ms 2334.000op/s 1.783ms 5.384ms 1988.531op/s
scenario:load:petclinic:profiling:high_load better
[-1238.687µs; -526.532µs] or [-6.257%; -2.659%]
unsure
[-1.920ms; -0.298ms] or [-6.118%; -0.951%]
unstable
[-15.052op/s; +35.427op/s] or [-6.443%; +15.164%]
18.916ms 30.277ms 243.812op/s 19.798ms 31.387ms 233.625op/s
scenario:load:petclinic:appsec:high_load better
[-1.511ms; -0.794ms] or [-7.716%; -4.053%]
unsure
[-1.690ms; -0.428ms] or [-5.403%; -1.368%]
unstable
[-11.711op/s; +38.524op/s] or [-4.978%; +16.373%]
18.429ms 30.220ms 248.688op/s 19.582ms 31.280ms 235.281op/s
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~45a6329b4e, baseline=1.60.0-SNAPSHOT~786c771187
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.677 ms) : 19473, 19882
.   : milestone, 19677,
appsec (19.841 ms) : 19640, 20043
.   : milestone, 19841,
code_origins (17.766 ms) : 17587, 17944
.   : milestone, 17766,
iast (17.471 ms) : 17297, 17646
.   : milestone, 17471,
profiling (19.984 ms) : 19784, 20185
.   : milestone, 19984,
tracing (17.607 ms) : 17431, 17782
.   : milestone, 17607,
section candidate
no_agent (19.092 ms) : 18896, 19289
.   : milestone, 19092,
appsec (18.767 ms) : 18574, 18961
.   : milestone, 18767,
code_origins (17.69 ms) : 17517, 17863
.   : milestone, 17690,
iast (17.559 ms) : 17381, 17737
.   : milestone, 17559,
profiling (19.143 ms) : 18950, 19335
.   : milestone, 19143,
tracing (17.572 ms) : 17398, 17745
.   : milestone, 17572,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.677 ms [19.473 ms, 19.882 ms] -
appsec 19.841 ms [19.64 ms, 20.043 ms] 163.897 µs (0.8%)
code_origins 17.766 ms [17.587 ms, 17.944 ms] -1.912 ms (-9.7%)
iast 17.471 ms [17.297 ms, 17.646 ms] -2.206 ms (-11.2%)
profiling 19.984 ms [19.784 ms, 20.185 ms] 306.957 µs (1.6%)
tracing 17.607 ms [17.431 ms, 17.782 ms] -2.071 ms (-10.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.092 ms [18.896 ms, 19.289 ms] -
appsec 18.767 ms [18.574 ms, 18.961 ms] -325.014 µs (-1.7%)
code_origins 17.69 ms [17.517 ms, 17.863 ms] -1.402 ms (-7.3%)
iast 17.559 ms [17.381 ms, 17.737 ms] -1.533 ms (-8.0%)
profiling 19.143 ms [18.95 ms, 19.335 ms] 50.021 µs (0.3%)
tracing 17.572 ms [17.398 ms, 17.745 ms] -1.521 ms (-8.0%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~45a6329b4e, baseline=1.60.0-SNAPSHOT~786c771187
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.175 ms) : 1164, 1187
.   : milestone, 1175,
iast (3.103 ms) : 3062, 3144
.   : milestone, 3103,
iast_FULL (6.021 ms) : 5960, 6082
.   : milestone, 6021,
iast_GLOBAL (3.473 ms) : 3424, 3523
.   : milestone, 3473,
profiling (2.28 ms) : 2257, 2302
.   : milestone, 2280,
tracing (1.804 ms) : 1788, 1819
.   : milestone, 1804,
section candidate
no_agent (1.174 ms) : 1162, 1185
.   : milestone, 1174,
iast (3.212 ms) : 3164, 3260
.   : milestone, 3212,
iast_FULL (5.949 ms) : 5889, 6009
.   : milestone, 5949,
iast_GLOBAL (3.605 ms) : 3539, 3670
.   : milestone, 3605,
profiling (1.932 ms) : 1915, 1949
.   : milestone, 1932,
tracing (1.889 ms) : 1872, 1905
.   : milestone, 1889,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.175 ms [1.164 ms, 1.187 ms] -
iast 3.103 ms [3.062 ms, 3.144 ms] 1.927 ms (164.0%)
iast_FULL 6.021 ms [5.96 ms, 6.082 ms] 4.846 ms (412.3%)
iast_GLOBAL 3.473 ms [3.424 ms, 3.523 ms] 2.298 ms (195.5%)
profiling 2.28 ms [2.257 ms, 2.302 ms] 1.104 ms (94.0%)
tracing 1.804 ms [1.788 ms, 1.819 ms] 628.431 µs (53.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.174 ms [1.162 ms, 1.185 ms] -
iast 3.212 ms [3.164 ms, 3.26 ms] 2.038 ms (173.7%)
iast_FULL 5.949 ms [5.889 ms, 6.009 ms] 4.776 ms (406.9%)
iast_GLOBAL 3.605 ms [3.539 ms, 3.67 ms] 2.431 ms (207.1%)
profiling 1.932 ms [1.915 ms, 1.949 ms] 758.319 µs (64.6%)
tracing 1.889 ms [1.872 ms, 1.905 ms] 715.153 µs (60.9%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master dougqh/dbinfo-default-final
git_commit_date 1770217470 1770221902
git_commit_sha 786c771 45a6329
release_version 1.60.0-SNAPSHOT~786c771187 1.60.0-SNAPSHOT~45a6329b4e
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1770223811 1770223811
ci_job_id 1401062480 1401062480
ci_pipeline_id 94639876 94639876
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-8g5l2m7r 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-8g5l2m7r 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~45a6329b4e, baseline=1.60.0-SNAPSHOT~786c771187
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.052 s) : 15052000, 15052000
.   : milestone, 15052000,
appsec (14.658 s) : 14658000, 14658000
.   : milestone, 14658000,
iast (18.279 s) : 18279000, 18279000
.   : milestone, 18279000,
iast_GLOBAL (18.002 s) : 18002000, 18002000
.   : milestone, 18002000,
profiling (15.551 s) : 15551000, 15551000
.   : milestone, 15551000,
tracing (14.83 s) : 14830000, 14830000
.   : milestone, 14830000,
section candidate
no_agent (15.576 s) : 15576000, 15576000
.   : milestone, 15576000,
appsec (14.831 s) : 14831000, 14831000
.   : milestone, 14831000,
iast (18.826 s) : 18826000, 18826000
.   : milestone, 18826000,
iast_GLOBAL (17.843 s) : 17843000, 17843000
.   : milestone, 17843000,
profiling (15.305 s) : 15305000, 15305000
.   : milestone, 15305000,
tracing (14.617 s) : 14617000, 14617000
.   : milestone, 14617000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.052 s [15.052 s, 15.052 s] -
appsec 14.658 s [14.658 s, 14.658 s] -394.0 ms (-2.6%)
iast 18.279 s [18.279 s, 18.279 s] 3.227 s (21.4%)
iast_GLOBAL 18.002 s [18.002 s, 18.002 s] 2.95 s (19.6%)
profiling 15.551 s [15.551 s, 15.551 s] 499.0 ms (3.3%)
tracing 14.83 s [14.83 s, 14.83 s] -222.0 ms (-1.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.576 s [15.576 s, 15.576 s] -
appsec 14.831 s [14.831 s, 14.831 s] -745.0 ms (-4.8%)
iast 18.826 s [18.826 s, 18.826 s] 3.25 s (20.9%)
iast_GLOBAL 17.843 s [17.843 s, 17.843 s] 2.267 s (14.6%)
profiling 15.305 s [15.305 s, 15.305 s] -271.0 ms (-1.7%)
tracing 14.617 s [14.617 s, 14.617 s] -959.0 ms (-6.2%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~45a6329b4e, baseline=1.60.0-SNAPSHOT~786c771187
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.475 ms) : 1464, 1487
.   : milestone, 1475,
appsec (3.771 ms) : 3550, 3993
.   : milestone, 3771,
iast (2.249 ms) : 2179, 2318
.   : milestone, 2249,
iast_GLOBAL (2.297 ms) : 2228, 2366
.   : milestone, 2297,
profiling (2.095 ms) : 2040, 2150
.   : milestone, 2095,
tracing (2.076 ms) : 2022, 2129
.   : milestone, 2076,
section candidate
no_agent (1.471 ms) : 1460, 1483
.   : milestone, 1471,
appsec (3.781 ms) : 3558, 4003
.   : milestone, 3781,
iast (2.257 ms) : 2188, 2326
.   : milestone, 2257,
iast_GLOBAL (2.303 ms) : 2234, 2373
.   : milestone, 2303,
profiling (2.088 ms) : 2033, 2144
.   : milestone, 2088,
tracing (2.066 ms) : 2013, 2120
.   : milestone, 2066,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.475 ms [1.464 ms, 1.487 ms] -
appsec 3.771 ms [3.55 ms, 3.993 ms] 2.296 ms (155.6%)
iast 2.249 ms [2.179 ms, 2.318 ms] 773.187 µs (52.4%)
iast_GLOBAL 2.297 ms [2.228 ms, 2.366 ms] 821.755 µs (55.7%)
profiling 2.095 ms [2.04 ms, 2.15 ms] 619.393 µs (42.0%)
tracing 2.076 ms [2.022 ms, 2.129 ms] 600.248 µs (40.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.471 ms [1.46 ms, 1.483 ms] -
appsec 3.781 ms [3.558 ms, 4.003 ms] 2.309 ms (157.0%)
iast 2.257 ms [2.188 ms, 2.326 ms] 785.937 µs (53.4%)
iast_GLOBAL 2.303 ms [2.234 ms, 2.373 ms] 832.087 µs (56.6%)
profiling 2.088 ms [2.033 ms, 2.144 ms] 617.021 µs (41.9%)
tracing 2.066 ms [2.013 ms, 2.12 ms] 595.212 µs (40.5%)