Home Original page

Create final status tag on test events by daniel-mohedano · Pull Request #10528 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/final-status
git_commit_date 1770571409 1770647186
git_commit_sha d10055d 7e7637f
release_version 1.60.0-SNAPSHOT~d10055d2a1 1.60.0-SNAPSHOT~7e7637f2c3
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1770649079 1770649079
ci_job_id 1409815639 1409815639
ci_pipeline_id 95239457 95239457
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-97wkjoxb 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-97wkjoxb 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 62 metrics, 9 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~7e7637f2c3, baseline=1.60.0-SNAPSHOT~d10055d2a1

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.064 s) : 0, 1063950
Total [baseline] (10.941 s) : 0, 10940794
Agent [candidate] (1.065 s) : 0, 1065451
Total [candidate] (10.863 s) : 0, 10862857
section appsec
Agent [baseline] (1.237 s) : 0, 1236868
Total [baseline] (10.969 s) : 0, 10969101
Agent [candidate] (1.24 s) : 0, 1240177
Total [candidate] (10.985 s) : 0, 10984635
section iast
Agent [baseline] (1.248 s) : 0, 1247933
Total [baseline] (11.227 s) : 0, 11226914
Agent [candidate] (1.233 s) : 0, 1233045
Total [candidate] (11.237 s) : 0, 11236663
section profiling
Agent [baseline] (1.192 s) : 0, 1191706
Total [baseline] (11.032 s) : 0, 11032298
Agent [candidate] (1.189 s) : 0, 1188788
Total [candidate] (11.013 s) : 0, 11012705
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.064 s -
Agent appsec 1.237 s 172.918 ms (16.3%)
Agent iast 1.248 s 183.983 ms (17.3%)
Agent profiling 1.192 s 127.756 ms (12.0%)
Total tracing 10.941 s -
Total appsec 10.969 s 28.307 ms (0.3%)
Total iast 11.227 s 286.12 ms (2.6%)
Total profiling 11.032 s 91.504 ms (0.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.065 s -
Agent appsec 1.24 s 174.726 ms (16.4%)
Agent iast 1.233 s 167.594 ms (15.7%)
Agent profiling 1.189 s 123.337 ms (11.6%)
Total tracing 10.863 s -
Total appsec 10.985 s 121.778 ms (1.1%)
Total iast 11.237 s 373.806 ms (3.4%)
Total profiling 11.013 s 149.848 ms (1.4%) 
gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~7e7637f2c3, baseline=1.60.0-SNAPSHOT~d10055d2a1

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.172 ms) : 0, 1172
crashtracking [candidate] (1.179 ms) : 0, 1179
BytebuddyAgent [baseline] (627.786 ms) : 0, 627786
BytebuddyAgent [candidate] (629.253 ms) : 0, 629253
AgentMeter [baseline] (28.869 ms) : 0, 28869
AgentMeter [candidate] (28.917 ms) : 0, 28917
GlobalTracer [baseline] (257.404 ms) : 0, 257404
GlobalTracer [candidate] (257.689 ms) : 0, 257689
AppSec [baseline] (32.675 ms) : 0, 32675
AppSec [candidate] (32.693 ms) : 0, 32693
Debugger [baseline] (63.331 ms) : 0, 63331
Debugger [candidate] (61.347 ms) : 0, 61347
Remote Config [baseline] (605.928 µs) : 0, 606
Remote Config [candidate] (620.819 µs) : 0, 621
Telemetry [baseline] (10.59 ms) : 0, 10590
Telemetry [candidate] (13.799 ms) : 0, 13799
Flare Poller [baseline] (6.161 ms) : 0, 6161
Flare Poller [candidate] (4.549 ms) : 0, 4549
section appsec
crashtracking [baseline] (1.178 ms) : 0, 1178
crashtracking [candidate] (1.183 ms) : 0, 1183
BytebuddyAgent [baseline] (657.171 ms) : 0, 657171
BytebuddyAgent [candidate] (658.647 ms) : 0, 658647
AgentMeter [baseline] (11.953 ms) : 0, 11953
AgentMeter [candidate] (11.953 ms) : 0, 11953
GlobalTracer [baseline] (258.06 ms) : 0, 258060
GlobalTracer [candidate] (258.9 ms) : 0, 258900
IAST [baseline] (25.057 ms) : 0, 25057
IAST [candidate] (25.351 ms) : 0, 25351
AppSec [baseline] (167.381 ms) : 0, 167381
AppSec [candidate] (168.125 ms) : 0, 168125
Debugger [baseline] (67.351 ms) : 0, 67351
Debugger [candidate] (67.361 ms) : 0, 67361
Remote Config [baseline] (669.846 µs) : 0, 670
Remote Config [candidate] (661.307 µs) : 0, 661
Telemetry [baseline] (9.231 ms) : 0, 9231
Telemetry [candidate] (9.171 ms) : 0, 9171
Flare Poller [baseline] (3.663 ms) : 0, 3663
Flare Poller [candidate] (3.62 ms) : 0, 3620
section iast
crashtracking [baseline] (1.191 ms) : 0, 1191
crashtracking [candidate] (1.172 ms) : 0, 1172
BytebuddyAgent [baseline] (806.995 ms) : 0, 806995
BytebuddyAgent [candidate] (795.961 ms) : 0, 795961
AgentMeter [baseline] (11.712 ms) : 0, 11712
AgentMeter [candidate] (11.31 ms) : 0, 11310
GlobalTracer [baseline] (250.198 ms) : 0, 250198
GlobalTracer [candidate] (248.845 ms) : 0, 248845
IAST [baseline] (27.309 ms) : 0, 27309
IAST [candidate] (27.181 ms) : 0, 27181
AppSec [baseline] (32.435 ms) : 0, 32435
AppSec [candidate] (34.035 ms) : 0, 34035
Debugger [baseline] (69.796 ms) : 0, 69796
Debugger [candidate] (65.748 ms) : 0, 65748
Remote Config [baseline] (545.509 µs) : 0, 546
Remote Config [candidate] (535.757 µs) : 0, 536
Telemetry [baseline] (8.712 ms) : 0, 8712
Telemetry [candidate] (8.722 ms) : 0, 8722
Flare Poller [baseline] (3.513 ms) : 0, 3513
Flare Poller [candidate] (3.472 ms) : 0, 3472
section profiling
crashtracking [baseline] (1.21 ms) : 0, 1210
crashtracking [candidate] (1.219 ms) : 0, 1219
BytebuddyAgent [baseline] (683.234 ms) : 0, 683234
BytebuddyAgent [candidate] (680.821 ms) : 0, 680821
AgentMeter [baseline] (8.577 ms) : 0, 8577
AgentMeter [candidate] (8.543 ms) : 0, 8543
GlobalTracer [baseline] (216.149 ms) : 0, 216149
GlobalTracer [candidate] (215.81 ms) : 0, 215810
AppSec [baseline] (32.43 ms) : 0, 32430
AppSec [candidate] (32.395 ms) : 0, 32395
Debugger [baseline] (67.903 ms) : 0, 67903
Debugger [candidate] (67.644 ms) : 0, 67644
Remote Config [baseline] (600.315 µs) : 0, 600
Remote Config [candidate] (587.64 µs) : 0, 588
Telemetry [baseline] (8.961 ms) : 0, 8961
Telemetry [candidate] (8.801 ms) : 0, 8801
Flare Poller [baseline] (3.753 ms) : 0, 3753
Flare Poller [candidate] (3.741 ms) : 0, 3741
ProfilingAgent [baseline] (99.018 ms) : 0, 99018
ProfilingAgent [candidate] (99.481 ms) : 0, 99481
Profiling [baseline] (99.588 ms) : 0, 99588
Profiling [candidate] (100.057 ms) : 0, 100057
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~7e7637f2c3, baseline=1.60.0-SNAPSHOT~d10055d2a1

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.064 s) : 0, 1063554
Total [baseline] (8.738 s) : 0, 8738117
Agent [candidate] (1.077 s) : 0, 1077316
Total [candidate] (8.742 s) : 0, 8741747
section iast
Agent [baseline] (1.23 s) : 0, 1229942
Total [baseline] (9.392 s) : 0, 9392401
Agent [candidate] (1.232 s) : 0, 1232311
Total [candidate] (9.367 s) : 0, 9367313
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.064 s -
Agent iast 1.23 s 166.388 ms (15.6%)
Total tracing 8.738 s -
Total iast 9.392 s 654.284 ms (7.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.077 s -
Agent iast 1.232 s 154.995 ms (14.4%)
Total tracing 8.742 s -
Total iast 9.367 s 625.566 ms (7.2%) 
gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~7e7637f2c3, baseline=1.60.0-SNAPSHOT~d10055d2a1

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.169 ms) : 0, 1169
crashtracking [candidate] (1.193 ms) : 0, 1193
BytebuddyAgent [baseline] (628.364 ms) : 0, 628364
BytebuddyAgent [candidate] (635.929 ms) : 0, 635929
AgentMeter [baseline] (28.943 ms) : 0, 28943
AgentMeter [candidate] (29.315 ms) : 0, 29315
GlobalTracer [baseline] (257.501 ms) : 0, 257501
GlobalTracer [candidate] (260.286 ms) : 0, 260286
AppSec [baseline] (32.744 ms) : 0, 32744
AppSec [candidate] (33.196 ms) : 0, 33196
Debugger [baseline] (62.013 ms) : 0, 62013
Debugger [candidate] (61.748 ms) : 0, 61748
Remote Config [baseline] (640.297 µs) : 0, 640
Remote Config [candidate] (647.021 µs) : 0, 647
Telemetry [baseline] (12.193 ms) : 0, 12193
Telemetry [candidate] (11.606 ms) : 0, 11606
Flare Poller [baseline] (4.657 ms) : 0, 4657
Flare Poller [candidate] (7.773 ms) : 0, 7773
section iast
crashtracking [baseline] (1.181 ms) : 0, 1181
crashtracking [candidate] (1.182 ms) : 0, 1182
BytebuddyAgent [baseline] (794.94 ms) : 0, 794940
BytebuddyAgent [candidate] (796.727 ms) : 0, 796727
AgentMeter [baseline] (11.254 ms) : 0, 11254
AgentMeter [candidate] (11.277 ms) : 0, 11277
GlobalTracer [baseline] (247.847 ms) : 0, 247847
GlobalTracer [candidate] (248.883 ms) : 0, 248883
IAST [baseline] (26.729 ms) : 0, 26729
IAST [candidate] (26.87 ms) : 0, 26870
AppSec [baseline] (34.813 ms) : 0, 34813
AppSec [candidate] (32.964 ms) : 0, 32964
Debugger [baseline] (65.208 ms) : 0, 65208
Debugger [candidate] (66.422 ms) : 0, 66422
Remote Config [baseline] (539.354 µs) : 0, 539
Remote Config [candidate] (542.094 µs) : 0, 542
Telemetry [baseline] (8.723 ms) : 0, 8723
Telemetry [candidate] (8.618 ms) : 0, 8618
Flare Poller [baseline] (3.494 ms) : 0, 3494
Flare Poller [candidate] (3.526 ms) : 0, 3526
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/final-status
git_commit_date 1770571409 1770647186
git_commit_sha d10055d 7e7637f
release_version 1.60.0-SNAPSHOT~d10055d2a1 1.60.0-SNAPSHOT~7e7637f2c3
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1770649756 1770649756
ci_job_id 1409815643 1409815643
ci_pipeline_id 95239457 95239457
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-86437ahz 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-86437ahz 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 1 performance regressions! Performance is the same for 19 metrics, 15 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:petclinic:iast:high_load better
[-1.704ms; -0.781ms] or [-9.218%; -4.223%]		 unsure
[-1.826ms; -0.520ms] or [-6.161%; -1.754%]		 unstable
[-12.345op/s; +41.657op/s] or [-4.951%; +16.707%]		 17.244ms 28.467ms 264.000op/s 18.486ms 29.640ms 249.344op/s
scenario:load:petclinic:code_origins:high_load worse
[+0.751ms; +2.005ms] or [+4.331%; +11.558%]		 unsure
[+0.519ms; +2.210ms] or [+1.810%; +7.704%]		 unstable
[-45.241op/s; +9.429op/s] or [-17.127%; +3.569%]		 18.728ms 30.053ms 246.250op/s 17.349ms 28.689ms 264.156op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~7e7637f2c3, baseline=1.60.0-SNAPSHOT~d10055d2a1
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.168 ms) : 1157, 1180
.   : milestone, 1168,
iast (3.247 ms) : 3204, 3291
.   : milestone, 3247,
iast_FULL (5.89 ms) : 5830, 5950
.   : milestone, 5890,
iast_GLOBAL (3.505 ms) : 3448, 3562
.   : milestone, 3505,
profiling (2.089 ms) : 2070, 2107
.   : milestone, 2089,
tracing (1.837 ms) : 1822, 1852
.   : milestone, 1837,
section candidate
no_agent (1.173 ms) : 1162, 1185
.   : milestone, 1173,
iast (3.326 ms) : 3280, 3372
.   : milestone, 3326,
iast_FULL (5.984 ms) : 5922, 6046
.   : milestone, 5984,
iast_GLOBAL (3.536 ms) : 3483, 3588
.   : milestone, 3536,
profiling (2.213 ms) : 2192, 2234
.   : milestone, 2213,
tracing (1.839 ms) : 1824, 1855
.   : milestone, 1839,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.168 ms [1.157 ms, 1.18 ms] -
iast 3.247 ms [3.204 ms, 3.291 ms] 2.079 ms (177.9%)
iast_FULL 5.89 ms [5.83 ms, 5.95 ms] 4.722 ms (404.1%)
iast_GLOBAL 3.505 ms [3.448 ms, 3.562 ms] 2.337 ms (200.0%)
profiling 2.089 ms [2.07 ms, 2.107 ms] 920.443 µs (78.8%)
tracing 1.837 ms [1.822 ms, 1.852 ms] 668.33 µs (57.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.173 ms [1.162 ms, 1.185 ms] -
iast 3.326 ms [3.28 ms, 3.372 ms] 2.153 ms (183.5%)
iast_FULL 5.984 ms [5.922 ms, 6.046 ms] 4.811 ms (410.1%)
iast_GLOBAL 3.536 ms [3.483 ms, 3.588 ms] 2.363 ms (201.4%)
profiling 2.213 ms [2.192 ms, 2.234 ms] 1.04 ms (88.6%)
tracing 1.839 ms [1.824 ms, 1.855 ms] 666.344 µs (56.8%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~7e7637f2c3, baseline=1.60.0-SNAPSHOT~d10055d2a1
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.101 ms) : 17914, 18288
.   : milestone, 18101,
appsec (18.689 ms) : 18498, 18879
.   : milestone, 18689,
code_origins (17.66 ms) : 17482, 17838
.   : milestone, 17660,
iast (18.717 ms) : 18530, 18904
.   : milestone, 18717,
profiling (18.435 ms) : 18251, 18619
.   : milestone, 18435,
tracing (17.625 ms) : 17451, 17798
.   : milestone, 17625,
section candidate
no_agent (18.103 ms) : 17923, 18283
.   : milestone, 18103,
appsec (18.974 ms) : 18784, 19165
.   : milestone, 18974,
code_origins (18.956 ms) : 18763, 19149
.   : milestone, 18956,
iast (17.672 ms) : 17497, 17847
.   : milestone, 17672,
profiling (18.349 ms) : 18165, 18532
.   : milestone, 18349,
tracing (17.901 ms) : 17723, 18078
.   : milestone, 17901,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.101 ms [17.914 ms, 18.288 ms] -
appsec 18.689 ms [18.498 ms, 18.879 ms] 587.327 µs (3.2%)
code_origins 17.66 ms [17.482 ms, 17.838 ms] -441.441 µs (-2.4%)
iast 18.717 ms [18.53 ms, 18.904 ms] 616.011 µs (3.4%)
profiling 18.435 ms [18.251 ms, 18.619 ms] 333.973 µs (1.8%)
tracing 17.625 ms [17.451 ms, 17.798 ms] -476.52 µs (-2.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.103 ms [17.923 ms, 18.283 ms] -
appsec 18.974 ms [18.784 ms, 19.165 ms] 871.721 µs (4.8%)
code_origins 18.956 ms [18.763 ms, 19.149 ms] 853.221 µs (4.7%)
iast 17.672 ms [17.497 ms, 17.847 ms] -430.267 µs (-2.4%)
profiling 18.349 ms [18.165 ms, 18.532 ms] 245.921 µs (1.4%)
tracing 17.901 ms [17.723 ms, 18.078 ms] -202.032 µs (-1.1%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/final-status
git_commit_date 1770571409 1770647186
git_commit_sha d10055d 7e7637f
release_version 1.60.0-SNAPSHOT~d10055d2a1 1.60.0-SNAPSHOT~7e7637f2c3
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1770649184 1770649184
ci_job_id 1409815646 1409815646
ci_pipeline_id 95239457 95239457
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-3b4cvk7b 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-3b4cvk7b 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:dacapo:tomcat:appsec better
[-1.436ms; -1.089ms] or [-37.870%; -28.705%]		 2.530ms 3.793ms
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~7e7637f2c3, baseline=1.60.0-SNAPSHOT~d10055d2a1
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.325 s) : 15325000, 15325000
.   : milestone, 15325000,
appsec (14.965 s) : 14965000, 14965000
.   : milestone, 14965000,
iast (18.241 s) : 18241000, 18241000
.   : milestone, 18241000,
iast_GLOBAL (17.782 s) : 17782000, 17782000
.   : milestone, 17782000,
profiling (14.869 s) : 14869000, 14869000
.   : milestone, 14869000,
tracing (14.708 s) : 14708000, 14708000
.   : milestone, 14708000,
section candidate
no_agent (15.028 s) : 15028000, 15028000
.   : milestone, 15028000,
appsec (14.887 s) : 14887000, 14887000
.   : milestone, 14887000,
iast (18.523 s) : 18523000, 18523000
.   : milestone, 18523000,
iast_GLOBAL (17.763 s) : 17763000, 17763000
.   : milestone, 17763000,
profiling (15.551 s) : 15551000, 15551000
.   : milestone, 15551000,
tracing (14.711 s) : 14711000, 14711000
.   : milestone, 14711000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.325 s [15.325 s, 15.325 s] -
appsec 14.965 s [14.965 s, 14.965 s] -360.0 ms (-2.3%)
iast 18.241 s [18.241 s, 18.241 s] 2.916 s (19.0%)
iast_GLOBAL 17.782 s [17.782 s, 17.782 s] 2.457 s (16.0%)
profiling 14.869 s [14.869 s, 14.869 s] -456.0 ms (-3.0%)
tracing 14.708 s [14.708 s, 14.708 s] -617.0 ms (-4.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.028 s [15.028 s, 15.028 s] -
appsec 14.887 s [14.887 s, 14.887 s] -141.0 ms (-0.9%)
iast 18.523 s [18.523 s, 18.523 s] 3.495 s (23.3%)
iast_GLOBAL 17.763 s [17.763 s, 17.763 s] 2.735 s (18.2%)
profiling 15.551 s [15.551 s, 15.551 s] 523.0 ms (3.5%)
tracing 14.711 s [14.711 s, 14.711 s] -317.0 ms (-2.1%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~7e7637f2c3, baseline=1.60.0-SNAPSHOT~d10055d2a1
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.476 ms) : 1464, 1487
.   : milestone, 1476,
appsec (3.793 ms) : 3572, 4015
.   : milestone, 3793,
iast (2.274 ms) : 2203, 2344
.   : milestone, 2274,
iast_GLOBAL (2.307 ms) : 2236, 2378
.   : milestone, 2307,
profiling (2.121 ms) : 2062, 2179
.   : milestone, 2121,
tracing (2.085 ms) : 2030, 2140
.   : milestone, 2085,
section candidate
no_agent (1.476 ms) : 1465, 1488
.   : milestone, 1476,
appsec (2.53 ms) : 2475, 2586
.   : milestone, 2530,
iast (2.267 ms) : 2197, 2338
.   : milestone, 2267,
iast_GLOBAL (2.315 ms) : 2244, 2385
.   : milestone, 2315,
profiling (2.104 ms) : 2047, 2161
.   : milestone, 2104,
tracing (2.073 ms) : 2018, 2128
.   : milestone, 2073,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.464 ms, 1.487 ms] -
appsec 3.793 ms [3.572 ms, 4.015 ms] 2.318 ms (157.1%)
iast 2.274 ms [2.203 ms, 2.344 ms] 798.186 µs (54.1%)
iast_GLOBAL 2.307 ms [2.236 ms, 2.378 ms] 831.464 µs (56.3%)
profiling 2.121 ms [2.062 ms, 2.179 ms] 645.102 µs (43.7%)
tracing 2.085 ms [2.03 ms, 2.14 ms] 609.467 µs (41.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.465 ms, 1.488 ms] -
appsec 2.53 ms [2.475 ms, 2.586 ms] 1.054 ms (71.4%)
iast 2.267 ms [2.197 ms, 2.338 ms] 791.002 µs (53.6%)
iast_GLOBAL 2.315 ms [2.244 ms, 2.385 ms] 838.357 µs (56.8%)
profiling 2.104 ms [2.047 ms, 2.161 ms] 628.094 µs (42.5%)
tracing 2.073 ms [2.018 ms, 2.128 ms] 596.717 µs (40.4%)