Home Original page

Adding Logging for JMS `ITERATION` Scope by mhlidd · Pull Request #10632 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mhlidd/add_jms_logging
git_commit_date 1771513426 1771522703
git_commit_sha 5418feb 2b2852b
release_version 1.60.0-SNAPSHOT~5418feb23a 1.60.0-SNAPSHOT~2b2852ba31
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1771524647 1771524647
ci_job_id 1440478724 1440478724
ci_pipeline_id 97639726 97639726
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-x7w0pyik 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-x7w0pyik 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 60 metrics, 11 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~2b2852ba31, baseline=1.60.0-SNAPSHOT~5418feb23a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.062 s) : 0, 1061928
Total [baseline] (10.871 s) : 0, 10871139
Agent [candidate] (1.066 s) : 0, 1065589
Total [candidate] (10.807 s) : 0, 10806577
section appsec
Agent [baseline] (1.239 s) : 0, 1238950
Total [baseline] (10.983 s) : 0, 10982946
Agent [candidate] (1.238 s) : 0, 1237720
Total [candidate] (11.059 s) : 0, 11059183
section iast
Agent [baseline] (1.233 s) : 0, 1232791
Total [baseline] (11.226 s) : 0, 11225999
Agent [candidate] (1.23 s) : 0, 1230447
Total [candidate] (11.154 s) : 0, 11154192
section profiling
Agent [baseline] (1.188 s) : 0, 1188176
Total [baseline] (10.894 s) : 0, 10893617
Agent [candidate] (1.197 s) : 0, 1197297
Total [candidate] (10.906 s) : 0, 10905798
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.062 s -
Agent appsec 1.239 s 177.021 ms (16.7%)
Agent iast 1.233 s 170.863 ms (16.1%)
Agent profiling 1.188 s 126.248 ms (11.9%)
Total tracing 10.871 s -
Total appsec 10.983 s 111.807 ms (1.0%)
Total iast 11.226 s 354.86 ms (3.3%)
Total profiling 10.894 s 22.478 ms (0.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.066 s -
Agent appsec 1.238 s 172.131 ms (16.2%)
Agent iast 1.23 s 164.858 ms (15.5%)
Agent profiling 1.197 s 131.708 ms (12.4%)
Total tracing 10.807 s -
Total appsec 11.059 s 252.606 ms (2.3%)
Total iast 11.154 s 347.615 ms (3.2%)
Total profiling 10.906 s 99.221 ms (0.9%) 
gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~2b2852ba31, baseline=1.60.0-SNAPSHOT~5418feb23a

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.189 ms) : 0, 1189
crashtracking [candidate] (1.203 ms) : 0, 1203
BytebuddyAgent [baseline] (626.4 ms) : 0, 626400
BytebuddyAgent [candidate] (627.483 ms) : 0, 627483
AgentMeter [baseline] (29.064 ms) : 0, 29064
AgentMeter [candidate] (29.286 ms) : 0, 29286
GlobalTracer [baseline] (256.896 ms) : 0, 256896
GlobalTracer [candidate] (258.812 ms) : 0, 258812
AppSec [baseline] (32.931 ms) : 0, 32931
AppSec [candidate] (32.988 ms) : 0, 32988
Debugger [baseline] (62.97 ms) : 0, 62970
Debugger [candidate] (64.677 ms) : 0, 64677
Remote Config [baseline] (621.695 µs) : 0, 622
Remote Config [candidate] (648.617 µs) : 0, 649
Telemetry [baseline] (12.213 ms) : 0, 12213
Telemetry [candidate] (10.697 ms) : 0, 10697
Flare Poller [baseline] (3.669 ms) : 0, 3669
Flare Poller [candidate] (3.786 ms) : 0, 3786
section appsec
crashtracking [baseline] (1.204 ms) : 0, 1204
crashtracking [candidate] (1.189 ms) : 0, 1189
BytebuddyAgent [baseline] (657.282 ms) : 0, 657282
BytebuddyAgent [candidate] (656.892 ms) : 0, 656892
AgentMeter [baseline] (11.98 ms) : 0, 11980
AgentMeter [candidate] (11.968 ms) : 0, 11968
GlobalTracer [baseline] (257.821 ms) : 0, 257821
GlobalTracer [candidate] (257.776 ms) : 0, 257776
AppSec [baseline] (168.122 ms) : 0, 168122
AppSec [candidate] (167.696 ms) : 0, 167696
Debugger [baseline] (67.23 ms) : 0, 67230
Debugger [candidate] (66.972 ms) : 0, 66972
Remote Config [baseline] (660.15 µs) : 0, 660
Remote Config [candidate] (653.771 µs) : 0, 654
Telemetry [baseline] (9.593 ms) : 0, 9593
Telemetry [candidate] (9.494 ms) : 0, 9494
Flare Poller [baseline] (3.757 ms) : 0, 3757
Flare Poller [candidate] (3.759 ms) : 0, 3759
IAST [baseline] (25.36 ms) : 0, 25360
IAST [candidate] (25.343 ms) : 0, 25343
section iast
crashtracking [baseline] (1.187 ms) : 0, 1187
crashtracking [candidate] (1.193 ms) : 0, 1193
BytebuddyAgent [baseline] (794.609 ms) : 0, 794609
BytebuddyAgent [candidate] (795.036 ms) : 0, 795036
AgentMeter [baseline] (11.449 ms) : 0, 11449
AgentMeter [candidate] (11.287 ms) : 0, 11287
GlobalTracer [baseline] (248.693 ms) : 0, 248693
GlobalTracer [candidate] (247.635 ms) : 0, 247635
AppSec [baseline] (33.289 ms) : 0, 33289
AppSec [candidate] (33.05 ms) : 0, 33050
Debugger [baseline] (67.715 ms) : 0, 67715
Debugger [candidate] (66.872 ms) : 0, 66872
Remote Config [baseline] (541.135 µs) : 0, 541
Remote Config [candidate] (526.5 µs) : 0, 526
Telemetry [baseline] (8.697 ms) : 0, 8697
Telemetry [candidate] (8.525 ms) : 0, 8525
Flare Poller [baseline] (3.467 ms) : 0, 3467
Flare Poller [candidate] (3.37 ms) : 0, 3370
IAST [baseline] (27.161 ms) : 0, 27161
IAST [candidate] (27.045 ms) : 0, 27045
section profiling
ProfilingAgent [baseline] (98.858 ms) : 0, 98858
ProfilingAgent [candidate] (99.629 ms) : 0, 99629
crashtracking [baseline] (1.183 ms) : 0, 1183
crashtracking [candidate] (1.192 ms) : 0, 1192
BytebuddyAgent [baseline] (681.087 ms) : 0, 681087
BytebuddyAgent [candidate] (686.362 ms) : 0, 686362
AgentMeter [baseline] (8.513 ms) : 0, 8513
AgentMeter [candidate] (8.576 ms) : 0, 8576
GlobalTracer [baseline] (215.335 ms) : 0, 215335
GlobalTracer [candidate] (216.947 ms) : 0, 216947
AppSec [baseline] (32.503 ms) : 0, 32503
AppSec [candidate] (32.71 ms) : 0, 32710
Debugger [baseline] (66.812 ms) : 0, 66812
Debugger [candidate] (67.441 ms) : 0, 67441
Remote Config [baseline] (624.516 µs) : 0, 625
Remote Config [candidate] (633.01 µs) : 0, 633
Telemetry [baseline] (9.023 ms) : 0, 9023
Telemetry [candidate] (9.099 ms) : 0, 9099
Flare Poller [baseline] (3.72 ms) : 0, 3720
Flare Poller [candidate] (3.773 ms) : 0, 3773
Profiling [baseline] (99.437 ms) : 0, 99437
Profiling [candidate] (100.204 ms) : 0, 100204
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~2b2852ba31, baseline=1.60.0-SNAPSHOT~5418feb23a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.063 s) : 0, 1063193
Total [baseline] (8.738 s) : 0, 8738113
Agent [candidate] (1.061 s) : 0, 1061335
Total [candidate] (8.735 s) : 0, 8735305
section iast
Agent [baseline] (1.229 s) : 0, 1228708
Total [baseline] (9.381 s) : 0, 9380774
Agent [candidate] (1.235 s) : 0, 1235374
Total [candidate] (9.421 s) : 0, 9420512
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.063 s -
Agent iast 1.229 s 165.515 ms (15.6%)
Total tracing 8.738 s -
Total iast 9.381 s 642.661 ms (7.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.061 s -
Agent iast 1.235 s 174.039 ms (16.4%)
Total tracing 8.735 s -
Total iast 9.421 s 685.207 ms (7.8%) 
gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~2b2852ba31, baseline=1.60.0-SNAPSHOT~5418feb23a

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.198 ms) : 0, 1198
crashtracking [candidate] (1.217 ms) : 0, 1217
BytebuddyAgent [baseline] (626.766 ms) : 0, 626766
BytebuddyAgent [candidate] (625.731 ms) : 0, 625731
AgentMeter [baseline] (29.003 ms) : 0, 29003
AgentMeter [candidate] (29.034 ms) : 0, 29034
GlobalTracer [baseline] (257.265 ms) : 0, 257265
GlobalTracer [candidate] (257.044 ms) : 0, 257044
AppSec [baseline] (32.975 ms) : 0, 32975
AppSec [candidate] (32.898 ms) : 0, 32898
Debugger [baseline] (64.26 ms) : 0, 64260
Debugger [candidate] (63.813 ms) : 0, 63813
Remote Config [baseline] (614.074 µs) : 0, 614
Remote Config [candidate] (612.347 µs) : 0, 612
Telemetry [baseline] (10.621 ms) : 0, 10621
Telemetry [candidate] (9.774 ms) : 0, 9774
Flare Poller [baseline] (4.464 ms) : 0, 4464
Flare Poller [candidate] (5.254 ms) : 0, 5254
section iast
crashtracking [baseline] (1.197 ms) : 0, 1197
crashtracking [candidate] (1.215 ms) : 0, 1215
BytebuddyAgent [baseline] (794.267 ms) : 0, 794267
BytebuddyAgent [candidate] (799.367 ms) : 0, 799367
AgentMeter [baseline] (11.286 ms) : 0, 11286
AgentMeter [candidate] (11.552 ms) : 0, 11552
GlobalTracer [baseline] (247.128 ms) : 0, 247128
GlobalTracer [candidate] (247.857 ms) : 0, 247857
AppSec [baseline] (30.621 ms) : 0, 30621
AppSec [candidate] (34.1 ms) : 0, 34100
Debugger [baseline] (68.572 ms) : 0, 68572
Debugger [candidate] (65.365 ms) : 0, 65365
Remote Config [baseline] (536.448 µs) : 0, 536
Remote Config [candidate] (534.74 µs) : 0, 535
Telemetry [baseline] (8.602 ms) : 0, 8602
Telemetry [candidate] (8.6 ms) : 0, 8600
Flare Poller [baseline] (3.415 ms) : 0, 3415
Flare Poller [candidate] (3.477 ms) : 0, 3477
IAST [baseline] (27.058 ms) : 0, 27058
IAST [candidate] (27.186 ms) : 0, 27186
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mhlidd/add_jms_logging
git_commit_date 1771513426 1771522703
git_commit_sha 5418feb 2b2852b
release_version 1.60.0-SNAPSHOT~5418feb23a 1.60.0-SNAPSHOT~2b2852ba31
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1771524965 1771524965
ci_job_id 1440478725 1440478725
ci_pipeline_id 97639726 97639726
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-hmdpm0dx 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-hmdpm0dx 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 20 metrics, 15 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_FULL:high_load unsure
[-403.305µs; -62.831µs] or [-7.671%; -1.195%]		 better
[-1139.000µs; -321.350µs] or [-8.922%; -2.517%]		 unstable
[-58.231op/s; +119.731op/s] or [-7.480%; +15.380%]		 5.024ms 12.036ms 809.250op/s 5.257ms 12.766ms 778.500op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~2b2852ba31, baseline=1.60.0-SNAPSHOT~5418feb23a
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.201 ms) : 19004, 19398
.   : milestone, 19201,
appsec (18.876 ms) : 18686, 19066
.   : milestone, 18876,
code_origins (17.852 ms) : 17673, 18032
.   : milestone, 17852,
iast (17.536 ms) : 17363, 17710
.   : milestone, 17536,
profiling (18.848 ms) : 18657, 19039
.   : milestone, 18848,
tracing (17.77 ms) : 17592, 17949
.   : milestone, 17770,
section candidate
no_agent (19.205 ms) : 19008, 19402
.   : milestone, 19205,
appsec (18.402 ms) : 18215, 18588
.   : milestone, 18402,
code_origins (17.664 ms) : 17490, 17838
.   : milestone, 17664,
iast (17.675 ms) : 17499, 17851
.   : milestone, 17675,
profiling (18.796 ms) : 18610, 18983
.   : milestone, 18796,
tracing (17.839 ms) : 17663, 18015
.   : milestone, 17839,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.201 ms [19.004 ms, 19.398 ms] -
appsec 18.876 ms [18.686 ms, 19.066 ms] -325.376 µs (-1.7%)
code_origins 17.852 ms [17.673 ms, 18.032 ms] -1.349 ms (-7.0%)
iast 17.536 ms [17.363 ms, 17.71 ms] -1.665 ms (-8.7%)
profiling 18.848 ms [18.657 ms, 19.039 ms] -353.3 µs (-1.8%)
tracing 17.77 ms [17.592 ms, 17.949 ms] -1.431 ms (-7.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.205 ms [19.008 ms, 19.402 ms] -
appsec 18.402 ms [18.215 ms, 18.588 ms] -803.816 µs (-4.2%)
code_origins 17.664 ms [17.49 ms, 17.838 ms] -1.541 ms (-8.0%)
iast 17.675 ms [17.499 ms, 17.851 ms] -1.53 ms (-8.0%)
profiling 18.796 ms [18.61 ms, 18.983 ms] -409.106 µs (-2.1%)
tracing 17.839 ms [17.663 ms, 18.015 ms] -1.367 ms (-7.1%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~2b2852ba31, baseline=1.60.0-SNAPSHOT~5418feb23a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.17 ms) : 1159, 1181
.   : milestone, 1170,
iast (3.103 ms) : 3062, 3144
.   : milestone, 3103,
iast_FULL (5.939 ms) : 5879, 5999
.   : milestone, 5939,
iast_GLOBAL (3.592 ms) : 3527, 3657
.   : milestone, 3592,
profiling (2.144 ms) : 2123, 2164
.   : milestone, 2144,
tracing (1.855 ms) : 1838, 1872
.   : milestone, 1855,
section candidate
no_agent (1.169 ms) : 1157, 1180
.   : milestone, 1169,
iast (3.185 ms) : 3141, 3229
.   : milestone, 3185,
iast_FULL (5.712 ms) : 5656, 5768
.   : milestone, 5712,
iast_GLOBAL (3.497 ms) : 3443, 3552
.   : milestone, 3497,
profiling (2.14 ms) : 2121, 2158
.   : milestone, 2140,
tracing (1.87 ms) : 1852, 1887
.   : milestone, 1870,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.17 ms [1.159 ms, 1.181 ms] -
iast 3.103 ms [3.062 ms, 3.144 ms] 1.933 ms (165.2%)
iast_FULL 5.939 ms [5.879 ms, 5.999 ms] 4.769 ms (407.5%)
iast_GLOBAL 3.592 ms [3.527 ms, 3.657 ms] 2.422 ms (207.0%)
profiling 2.144 ms [2.123 ms, 2.164 ms] 973.661 µs (83.2%)
tracing 1.855 ms [1.838 ms, 1.872 ms] 684.645 µs (58.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.169 ms [1.157 ms, 1.18 ms] -
iast 3.185 ms [3.141 ms, 3.229 ms] 2.017 ms (172.6%)
iast_FULL 5.712 ms [5.656 ms, 5.768 ms] 4.544 ms (388.8%)
iast_GLOBAL 3.497 ms [3.443 ms, 3.552 ms] 2.329 ms (199.3%)
profiling 2.14 ms [2.121 ms, 2.158 ms] 971.09 µs (83.1%)
tracing 1.87 ms [1.852 ms, 1.887 ms] 701.249 µs (60.0%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mhlidd/add_jms_logging
git_commit_date 1771513426 1771522703
git_commit_sha 5418feb 2b2852b
release_version 1.60.0-SNAPSHOT~5418feb23a 1.60.0-SNAPSHOT~2b2852ba31
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1771524745 1771524745
ci_job_id 1440478726 1440478726
ci_pipeline_id 97639726 97639726
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-qxezzyge 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-qxezzyge 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~2b2852ba31, baseline=1.60.0-SNAPSHOT~5418feb23a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.479 ms) : 1467, 1490
.   : milestone, 1479,
appsec (3.797 ms) : 3575, 4020
.   : milestone, 3797,
iast (2.261 ms) : 2191, 2330
.   : milestone, 2261,
iast_GLOBAL (2.308 ms) : 2238, 2377
.   : milestone, 2308,
profiling (2.086 ms) : 2031, 2141
.   : milestone, 2086,
tracing (2.078 ms) : 2024, 2133
.   : milestone, 2078,
section candidate
no_agent (1.474 ms) : 1462, 1485
.   : milestone, 1474,
appsec (3.79 ms) : 3568, 4013
.   : milestone, 3790,
iast (2.261 ms) : 2191, 2331
.   : milestone, 2261,
iast_GLOBAL (2.297 ms) : 2228, 2367
.   : milestone, 2297,
profiling (2.104 ms) : 2048, 2161
.   : milestone, 2104,
tracing (2.074 ms) : 2020, 2128
.   : milestone, 2074,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.479 ms [1.467 ms, 1.49 ms] -
appsec 3.797 ms [3.575 ms, 4.02 ms] 2.319 ms (156.8%)
iast 2.261 ms [2.191 ms, 2.33 ms] 782.026 µs (52.9%)
iast_GLOBAL 2.308 ms [2.238 ms, 2.377 ms] 829.064 µs (56.1%)
profiling 2.086 ms [2.031 ms, 2.141 ms] 607.773 µs (41.1%)
tracing 2.078 ms [2.024 ms, 2.133 ms] 599.804 µs (40.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.462 ms, 1.485 ms] -
appsec 3.79 ms [3.568 ms, 4.013 ms] 2.316 ms (157.2%)
iast 2.261 ms [2.191 ms, 2.331 ms] 787.133 µs (53.4%)
iast_GLOBAL 2.297 ms [2.228 ms, 2.367 ms] 823.614 µs (55.9%)
profiling 2.104 ms [2.048 ms, 2.161 ms] 630.451 µs (42.8%)
tracing 2.074 ms [2.02 ms, 2.128 ms] 600.228 µs (40.7%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~2b2852ba31, baseline=1.60.0-SNAPSHOT~5418feb23a
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.03 s) : 15030000, 15030000
.   : milestone, 15030000,
appsec (14.883 s) : 14883000, 14883000
.   : milestone, 14883000,
iast (18.072 s) : 18072000, 18072000
.   : milestone, 18072000,
iast_GLOBAL (17.915 s) : 17915000, 17915000
.   : milestone, 17915000,
profiling (14.709 s) : 14709000, 14709000
.   : milestone, 14709000,
tracing (14.844 s) : 14844000, 14844000
.   : milestone, 14844000,
section candidate
no_agent (15.719 s) : 15719000, 15719000
.   : milestone, 15719000,
appsec (15.149 s) : 15149000, 15149000
.   : milestone, 15149000,
iast (18.223 s) : 18223000, 18223000
.   : milestone, 18223000,
iast_GLOBAL (17.992 s) : 17992000, 17992000
.   : milestone, 17992000,
profiling (14.975 s) : 14975000, 14975000
.   : milestone, 14975000,
tracing (14.523 s) : 14523000, 14523000
.   : milestone, 14523000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.03 s [15.03 s, 15.03 s] -
appsec 14.883 s [14.883 s, 14.883 s] -147.0 ms (-1.0%)
iast 18.072 s [18.072 s, 18.072 s] 3.042 s (20.2%)
iast_GLOBAL 17.915 s [17.915 s, 17.915 s] 2.885 s (19.2%)
profiling 14.709 s [14.709 s, 14.709 s] -321.0 ms (-2.1%)
tracing 14.844 s [14.844 s, 14.844 s] -186.0 ms (-1.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.719 s [15.719 s, 15.719 s] -
appsec 15.149 s [15.149 s, 15.149 s] -570.0 ms (-3.6%)
iast 18.223 s [18.223 s, 18.223 s] 2.504 s (15.9%)
iast_GLOBAL 17.992 s [17.992 s, 17.992 s] 2.273 s (14.5%)
profiling 14.975 s [14.975 s, 14.975 s] -744.0 ms (-4.7%)
tracing 14.523 s [14.523 s, 14.523 s] -1.196 s (-7.6%)