Home Original page

Handle SQL AnalysisException failures by aboitreaud · Pull Request #10933 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master adrien.boitreaud/sql-analysis-exception-support
git_commit_date 1774270822 1774274916
git_commit_sha 1f5d818 f2ccab4
release_version 1.61.0-SNAPSHOT~1f5d8183d8 1.61.0-SNAPSHOT~f2ccab44fc
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1774276959 1774276959
ci_job_id 1530380054 1530380054
ci_pipeline_id 103992642 103992642
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-f0ncr9nq 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-f0ncr9nq 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 65 metrics, 6 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.61.0-SNAPSHOT~f2ccab44fc, baseline=1.61.0-SNAPSHOT~1f5d8183d8

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.06 s) : 0, 1060109
Total [baseline] (8.878 s) : 0, 8877572
Agent [candidate] (1.058 s) : 0, 1057762
Total [candidate] (8.876 s) : 0, 8876094
section iast
Agent [baseline] (1.226 s) : 0, 1225698
Total [baseline] (9.563 s) : 0, 9562540
Agent [candidate] (1.228 s) : 0, 1228031
Total [candidate] (9.593 s) : 0, 9593474
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.06 s -
Agent iast 1.226 s 165.589 ms (15.6%)
Total tracing 8.878 s -
Total iast 9.563 s 684.968 ms (7.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.058 s -
Agent iast 1.228 s 170.269 ms (16.1%)
Total tracing 8.876 s -
Total iast 9.593 s 717.38 ms (8.1%) 
gantt
    title insecure-bank - break down per module: candidate=1.61.0-SNAPSHOT~f2ccab44fc, baseline=1.61.0-SNAPSHOT~1f5d8183d8

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.196 ms) : 0, 1196
crashtracking [candidate] (1.197 ms) : 0, 1197
BytebuddyAgent [baseline] (630.081 ms) : 0, 630081
BytebuddyAgent [candidate] (629.522 ms) : 0, 629522
AgentMeter [baseline] (29.536 ms) : 0, 29536
AgentMeter [candidate] (29.406 ms) : 0, 29406
GlobalTracer [baseline] (257.71 ms) : 0, 257710
GlobalTracer [candidate] (257.234 ms) : 0, 257234
AppSec [baseline] (31.884 ms) : 0, 31884
AppSec [candidate] (31.818 ms) : 0, 31818
Debugger [baseline] (59.991 ms) : 0, 59991
Debugger [candidate] (59.609 ms) : 0, 59609
Remote Config [baseline] (593.73 µs) : 0, 594
Remote Config [candidate] (593.761 µs) : 0, 594
Telemetry [baseline] (8.814 ms) : 0, 8814
Telemetry [candidate] (8.011 ms) : 0, 8011
Flare Poller [baseline] (4.304 ms) : 0, 4304
Flare Poller [candidate] (4.315 ms) : 0, 4315
section iast
crashtracking [baseline] (1.2 ms) : 0, 1200
crashtracking [candidate] (1.214 ms) : 0, 1214
BytebuddyAgent [baseline] (795.097 ms) : 0, 795097
BytebuddyAgent [candidate] (796.41 ms) : 0, 796410
AgentMeter [baseline] (11.41 ms) : 0, 11410
AgentMeter [candidate] (11.395 ms) : 0, 11395
GlobalTracer [baseline] (246.843 ms) : 0, 246843
GlobalTracer [candidate] (247.67 ms) : 0, 247670
IAST [baseline] (25.353 ms) : 0, 25353
IAST [candidate] (25.336 ms) : 0, 25336
AppSec [baseline] (26.409 ms) : 0, 26409
AppSec [candidate] (26.472 ms) : 0, 26472
Debugger [baseline] (69.395 ms) : 0, 69395
Debugger [candidate] (68.29 ms) : 0, 68290
Remote Config [baseline] (534.429 µs) : 0, 534
Remote Config [candidate] (538.079 µs) : 0, 538
Telemetry [baseline] (9.795 ms) : 0, 9795
Telemetry [candidate] (10.802 ms) : 0, 10802
Flare Poller [baseline] (3.576 ms) : 0, 3576
Flare Poller [candidate] (3.896 ms) : 0, 3896
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.61.0-SNAPSHOT~f2ccab44fc, baseline=1.61.0-SNAPSHOT~1f5d8183d8

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.055 s) : 0, 1054996
Total [baseline] (11.095 s) : 0, 11095030
Agent [candidate] (1.06 s) : 0, 1059863
Total [candidate] (11.204 s) : 0, 11204245
section appsec
Agent [baseline] (1.244 s) : 0, 1243650
Total [baseline] (11.127 s) : 0, 11127262
Agent [candidate] (1.248 s) : 0, 1247541
Total [candidate] (11.206 s) : 0, 11205535
section iast
Agent [baseline] (1.225 s) : 0, 1224550
Total [baseline] (11.265 s) : 0, 11265059
Agent [candidate] (1.236 s) : 0, 1235870
Total [candidate] (11.307 s) : 0, 11307070
section profiling
Agent [baseline] (1.2 s) : 0, 1200050
Total [baseline] (11.139 s) : 0, 11139279
Agent [candidate] (1.181 s) : 0, 1180801
Total [candidate] (10.971 s) : 0, 10970519
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.055 s -
Agent appsec 1.244 s 188.654 ms (17.9%)
Agent iast 1.225 s 169.554 ms (16.1%)
Agent profiling 1.2 s 145.055 ms (13.7%)
Total tracing 11.095 s -
Total appsec 11.127 s 32.232 ms (0.3%)
Total iast 11.265 s 170.029 ms (1.5%)
Total profiling 11.139 s 44.249 ms (0.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.06 s -
Agent appsec 1.248 s 187.678 ms (17.7%)
Agent iast 1.236 s 176.007 ms (16.6%)
Agent profiling 1.181 s 120.938 ms (11.4%)
Total tracing 11.204 s -
Total appsec 11.206 s 1.29 ms (0.0%)
Total iast 11.307 s 102.825 ms (0.9%)
Total profiling 10.971 s -233.726 ms (-2.1%) 
gantt
    title petclinic - break down per module: candidate=1.61.0-SNAPSHOT~f2ccab44fc, baseline=1.61.0-SNAPSHOT~1f5d8183d8

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.192 ms) : 0, 1192
crashtracking [candidate] (1.194 ms) : 0, 1194
BytebuddyAgent [baseline] (627.631 ms) : 0, 627631
BytebuddyAgent [candidate] (630.679 ms) : 0, 630679
AgentMeter [baseline] (29.373 ms) : 0, 29373
AgentMeter [candidate] (29.39 ms) : 0, 29390
GlobalTracer [baseline] (256.724 ms) : 0, 256724
GlobalTracer [candidate] (257.927 ms) : 0, 257927
AppSec [baseline] (31.672 ms) : 0, 31672
AppSec [candidate] (31.725 ms) : 0, 31725
Debugger [baseline] (60.352 ms) : 0, 60352
Debugger [candidate] (60.676 ms) : 0, 60676
Remote Config [baseline] (593.371 µs) : 0, 593
Remote Config [candidate] (587.534 µs) : 0, 588
Telemetry [baseline] (8.016 ms) : 0, 8016
Telemetry [candidate] (8.05 ms) : 0, 8050
Flare Poller [baseline] (3.514 ms) : 0, 3514
Flare Poller [candidate] (3.512 ms) : 0, 3512
section appsec
crashtracking [baseline] (1.2 ms) : 0, 1200
crashtracking [candidate] (1.195 ms) : 0, 1195
BytebuddyAgent [baseline] (656.983 ms) : 0, 656983
BytebuddyAgent [candidate] (657.277 ms) : 0, 657277
AgentMeter [baseline] (12.107 ms) : 0, 12107
AgentMeter [candidate] (12.189 ms) : 0, 12189
GlobalTracer [baseline] (257.309 ms) : 0, 257309
GlobalTracer [candidate] (258.85 ms) : 0, 258850
IAST [baseline] (24.102 ms) : 0, 24102
IAST [candidate] (24.33 ms) : 0, 24330
AppSec [baseline] (177.279 ms) : 0, 177279
AppSec [candidate] (178.236 ms) : 0, 178236
Debugger [baseline] (65.765 ms) : 0, 65765
Debugger [candidate] (66.517 ms) : 0, 66517
Remote Config [baseline] (643.22 µs) : 0, 643
Remote Config [candidate] (623.804 µs) : 0, 624
Telemetry [baseline] (8.361 ms) : 0, 8361
Telemetry [candidate] (8.38 ms) : 0, 8380
Flare Poller [baseline] (3.602 ms) : 0, 3602
Flare Poller [candidate] (3.658 ms) : 0, 3658
section iast
crashtracking [baseline] (1.192 ms) : 0, 1192
crashtracking [candidate] (1.198 ms) : 0, 1198
BytebuddyAgent [baseline] (793.836 ms) : 0, 793836
BytebuddyAgent [candidate] (802.166 ms) : 0, 802166
AgentMeter [baseline] (11.378 ms) : 0, 11378
AgentMeter [candidate] (11.657 ms) : 0, 11657
GlobalTracer [baseline] (246.581 ms) : 0, 246581
GlobalTracer [candidate] (248.464 ms) : 0, 248464
IAST [baseline] (25.258 ms) : 0, 25258
IAST [candidate] (25.433 ms) : 0, 25433
AppSec [baseline] (26.457 ms) : 0, 26457
AppSec [candidate] (26.665 ms) : 0, 26665
Debugger [baseline] (70.679 ms) : 0, 70679
Debugger [candidate] (70.992 ms) : 0, 70992
Remote Config [baseline] (535.57 µs) : 0, 536
Remote Config [candidate] (522.708 µs) : 0, 523
Telemetry [baseline] (9.197 ms) : 0, 9197
Telemetry [candidate] (9.141 ms) : 0, 9141
Flare Poller [baseline] (3.331 ms) : 0, 3331
Flare Poller [candidate] (3.361 ms) : 0, 3361
section profiling
crashtracking [baseline] (1.196 ms) : 0, 1196
crashtracking [candidate] (1.176 ms) : 0, 1176
BytebuddyAgent [baseline] (692.902 ms) : 0, 692902
BytebuddyAgent [candidate] (681.478 ms) : 0, 681478
AgentMeter [baseline] (9.19 ms) : 0, 9190
AgentMeter [candidate] (8.951 ms) : 0, 8951
GlobalTracer [baseline] (218.52 ms) : 0, 218520
GlobalTracer [candidate] (215.075 ms) : 0, 215075
AppSec [baseline] (32.626 ms) : 0, 32626
AppSec [candidate] (32.06 ms) : 0, 32060
Debugger [baseline] (66.941 ms) : 0, 66941
Debugger [candidate] (65.143 ms) : 0, 65143
Remote Config [baseline] (572.7 µs) : 0, 573
Remote Config [candidate] (569.624 µs) : 0, 570
Telemetry [baseline] (7.81 ms) : 0, 7810
Telemetry [candidate] (8.507 ms) : 0, 8507
Flare Poller [baseline] (3.492 ms) : 0, 3492
Flare Poller [candidate] (3.426 ms) : 0, 3426
ProfilingAgent [baseline] (94.651 ms) : 0, 94651
ProfilingAgent [candidate] (93.66 ms) : 0, 93660
Profiling [baseline] (95.203 ms) : 0, 95203
Profiling [candidate] (94.22 ms) : 0, 94220
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master adrien.boitreaud/sql-analysis-exception-support
git_commit_date 1774270822 1774274916
git_commit_sha 1f5d818 f2ccab4
release_version 1.61.0-SNAPSHOT~1f5d8183d8 1.61.0-SNAPSHOT~f2ccab44fc
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1774277185 1774277185
ci_job_id 1530380057 1530380057
ci_pipeline_id 103992642 103992642
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-tdipui9f 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-tdipui9f 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 20 metrics, 15 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:petclinic:no_agent:high_load better
[-2.138ms; -0.802ms] or [-11.618%; -4.355%]		 unsure
[-3.381ms; -0.584ms] or [-11.011%; -1.903%]		 unstable
[-9.342op/s; +37.068op/s] or [-3.672%; +14.571%]		 16.935ms 28.722ms 268.250op/s 18.405ms 30.704ms 254.387op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~f2ccab44fc, baseline=1.61.0-SNAPSHOT~1f5d8183d8
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.94 ms) : 18747, 19132
.   : milestone, 18940,
appsec (18.534 ms) : 18346, 18722
.   : milestone, 18534,
code_origins (17.916 ms) : 17737, 18094
.   : milestone, 17916,
iast (18.22 ms) : 18039, 18401
.   : milestone, 18220,
profiling (18.881 ms) : 18694, 19068
.   : milestone, 18881,
tracing (17.558 ms) : 17383, 17733
.   : milestone, 17558,
section candidate
no_agent (17.393 ms) : 17217, 17569
.   : milestone, 17393,
appsec (18.567 ms) : 18379, 18756
.   : milestone, 18567,
code_origins (17.963 ms) : 17781, 18145
.   : milestone, 17963,
iast (17.832 ms) : 17655, 18010
.   : milestone, 17832,
profiling (19.179 ms) : 18981, 19378
.   : milestone, 19179,
tracing (17.672 ms) : 17500, 17844
.   : milestone, 17672,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.94 ms [18.747 ms, 19.132 ms] -
appsec 18.534 ms [18.346 ms, 18.722 ms] -405.443 µs (-2.1%)
code_origins 17.916 ms [17.737 ms, 18.094 ms] -1.024 ms (-5.4%)
iast 18.22 ms [18.039 ms, 18.401 ms] -719.489 µs (-3.8%)
profiling 18.881 ms [18.694 ms, 19.068 ms] -59.035 µs (-0.3%)
tracing 17.558 ms [17.383 ms, 17.733 ms] -1.382 ms (-7.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.393 ms [17.217 ms, 17.569 ms] -
appsec 18.567 ms [18.379 ms, 18.756 ms] 1.174 ms (6.8%)
code_origins 17.963 ms [17.781 ms, 18.145 ms] 570.046 µs (3.3%)
iast 17.832 ms [17.655 ms, 18.01 ms] 439.468 µs (2.5%)
profiling 19.179 ms [18.981 ms, 19.378 ms] 1.786 ms (10.3%)
tracing 17.672 ms [17.5 ms, 17.844 ms] 278.967 µs (1.6%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~f2ccab44fc, baseline=1.61.0-SNAPSHOT~1f5d8183d8
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.172 ms) : 1161, 1184
.   : milestone, 1172,
iast (3.253 ms) : 3208, 3298
.   : milestone, 3253,
iast_FULL (5.835 ms) : 5776, 5894
.   : milestone, 5835,
iast_GLOBAL (3.574 ms) : 3515, 3634
.   : milestone, 3574,
profiling (2.095 ms) : 2077, 2114
.   : milestone, 2095,
tracing (1.777 ms) : 1763, 1791
.   : milestone, 1777,
section candidate
no_agent (1.169 ms) : 1158, 1181
.   : milestone, 1169,
iast (3.222 ms) : 3180, 3265
.   : milestone, 3222,
iast_FULL (5.73 ms) : 5674, 5787
.   : milestone, 5730,
iast_GLOBAL (3.444 ms) : 3399, 3489
.   : milestone, 3444,
profiling (2.026 ms) : 2008, 2045
.   : milestone, 2026,
tracing (1.808 ms) : 1793, 1823
.   : milestone, 1808,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.172 ms [1.161 ms, 1.184 ms] -
iast 3.253 ms [3.208 ms, 3.298 ms] 2.08 ms (177.4%)
iast_FULL 5.835 ms [5.776 ms, 5.894 ms] 4.662 ms (397.6%)
iast_GLOBAL 3.574 ms [3.515 ms, 3.634 ms] 2.402 ms (204.9%)
profiling 2.095 ms [2.077 ms, 2.114 ms] 922.901 µs (78.7%)
tracing 1.777 ms [1.763 ms, 1.791 ms] 604.504 µs (51.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.169 ms [1.158 ms, 1.181 ms] -
iast 3.222 ms [3.18 ms, 3.265 ms] 2.053 ms (175.6%)
iast_FULL 5.73 ms [5.674 ms, 5.787 ms] 4.561 ms (390.1%)
iast_GLOBAL 3.444 ms [3.399 ms, 3.489 ms] 2.275 ms (194.5%)
profiling 2.026 ms [2.008 ms, 2.045 ms] 857.138 µs (73.3%)
tracing 1.808 ms [1.793 ms, 1.823 ms] 638.635 µs (54.6%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master adrien.boitreaud/sql-analysis-exception-support
git_commit_date 1774270822 1774274916
git_commit_sha 1f5d818 f2ccab4
release_version 1.61.0-SNAPSHOT~1f5d8183d8 1.61.0-SNAPSHOT~f2ccab44fc
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1774276916 1774276916
ci_job_id 1530380060 1530380060
ci_pipeline_id 103992642 103992642
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-we0mmpx3 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-we0mmpx3 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~f2ccab44fc, baseline=1.61.0-SNAPSHOT~1f5d8183d8
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.479 ms) : 1467, 1490
.   : milestone, 1479,
appsec (3.805 ms) : 3582, 4029
.   : milestone, 3805,
iast (2.285 ms) : 2215, 2355
.   : milestone, 2285,
iast_GLOBAL (2.316 ms) : 2245, 2386
.   : milestone, 2316,
profiling (2.114 ms) : 2056, 2171
.   : milestone, 2114,
tracing (2.077 ms) : 2022, 2131
.   : milestone, 2077,
section candidate
no_agent (1.481 ms) : 1469, 1493
.   : milestone, 1481,
appsec (3.848 ms) : 3625, 4070
.   : milestone, 3848,
iast (2.277 ms) : 2207, 2348
.   : milestone, 2277,
iast_GLOBAL (2.314 ms) : 2244, 2385
.   : milestone, 2314,
profiling (2.091 ms) : 2035, 2146
.   : milestone, 2091,
tracing (2.072 ms) : 2018, 2127
.   : milestone, 2072,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.479 ms [1.467 ms, 1.49 ms] -
appsec 3.805 ms [3.582 ms, 4.029 ms] 2.327 ms (157.4%)
iast 2.285 ms [2.215 ms, 2.355 ms] 806.185 µs (54.5%)
iast_GLOBAL 2.316 ms [2.245 ms, 2.386 ms] 837.035 µs (56.6%)
profiling 2.114 ms [2.056 ms, 2.171 ms] 635.111 µs (43.0%)
tracing 2.077 ms [2.022 ms, 2.131 ms] 597.952 µs (40.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.481 ms [1.469 ms, 1.493 ms] -
appsec 3.848 ms [3.625 ms, 4.07 ms] 2.367 ms (159.8%)
iast 2.277 ms [2.207 ms, 2.348 ms] 796.244 µs (53.8%)
iast_GLOBAL 2.314 ms [2.244 ms, 2.385 ms] 833.331 µs (56.3%)
profiling 2.091 ms [2.035 ms, 2.146 ms] 609.705 µs (41.2%)
tracing 2.072 ms [2.018 ms, 2.127 ms] 591.136 µs (39.9%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~f2ccab44fc, baseline=1.61.0-SNAPSHOT~1f5d8183d8
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.526 s) : 15526000, 15526000
.   : milestone, 15526000,
appsec (15.119 s) : 15119000, 15119000
.   : milestone, 15119000,
iast (18.151 s) : 18151000, 18151000
.   : milestone, 18151000,
iast_GLOBAL (17.903 s) : 17903000, 17903000
.   : milestone, 17903000,
profiling (14.834 s) : 14834000, 14834000
.   : milestone, 14834000,
tracing (14.814 s) : 14814000, 14814000
.   : milestone, 14814000,
section candidate
no_agent (15.436 s) : 15436000, 15436000
.   : milestone, 15436000,
appsec (15.067 s) : 15067000, 15067000
.   : milestone, 15067000,
iast (18.166 s) : 18166000, 18166000
.   : milestone, 18166000,
iast_GLOBAL (18.106 s) : 18106000, 18106000
.   : milestone, 18106000,
profiling (14.82 s) : 14820000, 14820000
.   : milestone, 14820000,
tracing (14.785 s) : 14785000, 14785000
.   : milestone, 14785000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.526 s [15.526 s, 15.526 s] -
appsec 15.119 s [15.119 s, 15.119 s] -407.0 ms (-2.6%)
iast 18.151 s [18.151 s, 18.151 s] 2.625 s (16.9%)
iast_GLOBAL 17.903 s [17.903 s, 17.903 s] 2.377 s (15.3%)
profiling 14.834 s [14.834 s, 14.834 s] -692.0 ms (-4.5%)
tracing 14.814 s [14.814 s, 14.814 s] -712.0 ms (-4.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.436 s [15.436 s, 15.436 s] -
appsec 15.067 s [15.067 s, 15.067 s] -369.0 ms (-2.4%)
iast 18.166 s [18.166 s, 18.166 s] 2.73 s (17.7%)
iast_GLOBAL 18.106 s [18.106 s, 18.106 s] 2.67 s (17.3%)
profiling 14.82 s [14.82 s, 14.82 s] -616.0 ms (-4.0%)
tracing 14.785 s [14.785 s, 14.785 s] -651.0 ms (-4.2%)