Home Original page

Do not remove the version tag if manually set by amarziali · Pull Request #10703 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/version
git_commit_date 1772385877 1772445470
git_commit_sha b0ab971 cb724ed
release_version 1.60.0-SNAPSHOT~b0ab971941 1.60.0-SNAPSHOT~cb724edfe1
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1772447244 1772447244
ci_job_id 1466182701 1466182701
ci_pipeline_id 99704564 99704564
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-5jygp9yb 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-5jygp9yb 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 59 metrics, 12 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~cb724edfe1, baseline=1.60.0-SNAPSHOT~b0ab971941

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.07 s) : 0, 1070042
Total [baseline] (10.931 s) : 0, 10931280
Agent [candidate] (1.064 s) : 0, 1064216
Total [candidate] (10.846 s) : 0, 10846378
section appsec
Agent [baseline] (1.241 s) : 0, 1240586
Total [baseline] (11.068 s) : 0, 11067528
Agent [candidate] (1.239 s) : 0, 1239026
Total [candidate] (11.067 s) : 0, 11067067
section iast
Agent [baseline] (1.234 s) : 0, 1234423
Total [baseline] (11.135 s) : 0, 11135461
Agent [candidate] (1.23 s) : 0, 1230246
Total [candidate] (11.174 s) : 0, 11173701
section profiling
Agent [baseline] (1.191 s) : 0, 1191011
Total [baseline] (10.962 s) : 0, 10961873
Agent [candidate] (1.198 s) : 0, 1198208
Total [candidate] (10.976 s) : 0, 10976321
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.07 s -
Agent appsec 1.241 s 170.543 ms (15.9%)
Agent iast 1.234 s 164.381 ms (15.4%)
Agent profiling 1.191 s 120.969 ms (11.3%)
Total tracing 10.931 s -
Total appsec 11.068 s 136.248 ms (1.2%)
Total iast 11.135 s 204.181 ms (1.9%)
Total profiling 10.962 s 30.593 ms (0.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.064 s -
Agent appsec 1.239 s 174.809 ms (16.4%)
Agent iast 1.23 s 166.029 ms (15.6%)
Agent profiling 1.198 s 133.992 ms (12.6%)
Total tracing 10.846 s -
Total appsec 11.067 s 220.689 ms (2.0%)
Total iast 11.174 s 327.323 ms (3.0%)
Total profiling 10.976 s 129.943 ms (1.2%) 
gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~cb724edfe1, baseline=1.60.0-SNAPSHOT~b0ab971941

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.188 ms) : 0, 1188
crashtracking [candidate] (1.203 ms) : 0, 1203
BytebuddyAgent [baseline] (631.332 ms) : 0, 631332
BytebuddyAgent [candidate] (627.915 ms) : 0, 627915
AgentMeter [baseline] (29.271 ms) : 0, 29271
AgentMeter [candidate] (29.087 ms) : 0, 29087
GlobalTracer [baseline] (258.961 ms) : 0, 258961
GlobalTracer [candidate] (257.903 ms) : 0, 257903
AppSec [baseline] (33.028 ms) : 0, 33028
AppSec [candidate] (33.047 ms) : 0, 33047
Debugger [baseline] (64.17 ms) : 0, 64170
Debugger [candidate] (65.544 ms) : 0, 65544
Remote Config [baseline] (616.184 µs) : 0, 616
Remote Config [candidate] (613.036 µs) : 0, 613
Telemetry [baseline] (10.77 ms) : 0, 10770
Telemetry [candidate] (9.08 ms) : 0, 9080
Flare Poller [baseline] (4.565 ms) : 0, 4565
Flare Poller [candidate] (3.712 ms) : 0, 3712
section appsec
crashtracking [baseline] (1.191 ms) : 0, 1191
crashtracking [candidate] (1.197 ms) : 0, 1197
BytebuddyAgent [baseline] (657.826 ms) : 0, 657826
BytebuddyAgent [candidate] (657.392 ms) : 0, 657392
AgentMeter [baseline] (12.059 ms) : 0, 12059
AgentMeter [candidate] (12.038 ms) : 0, 12038
GlobalTracer [baseline] (258.889 ms) : 0, 258889
GlobalTracer [candidate] (258.594 ms) : 0, 258594
AppSec [baseline] (168.3 ms) : 0, 168300
AppSec [candidate] (167.388 ms) : 0, 167388
Debugger [baseline] (66.985 ms) : 0, 66985
Debugger [candidate] (67.034 ms) : 0, 67034
Remote Config [baseline] (689.599 µs) : 0, 690
Remote Config [candidate] (693.954 µs) : 0, 694
Telemetry [baseline] (9.364 ms) : 0, 9364
Telemetry [candidate] (9.384 ms) : 0, 9384
Flare Poller [baseline] (3.677 ms) : 0, 3677
Flare Poller [candidate] (3.711 ms) : 0, 3711
IAST [baseline] (25.503 ms) : 0, 25503
IAST [candidate] (25.432 ms) : 0, 25432
section iast
crashtracking [baseline] (1.191 ms) : 0, 1191
crashtracking [candidate] (1.191 ms) : 0, 1191
BytebuddyAgent [baseline] (797.126 ms) : 0, 797126
BytebuddyAgent [candidate] (794.145 ms) : 0, 794145
AgentMeter [baseline] (11.358 ms) : 0, 11358
AgentMeter [candidate] (11.299 ms) : 0, 11299
GlobalTracer [baseline] (248.111 ms) : 0, 248111
GlobalTracer [candidate] (247.515 ms) : 0, 247515
AppSec [baseline] (32.369 ms) : 0, 32369
AppSec [candidate] (31.391 ms) : 0, 31391
Debugger [baseline] (68.347 ms) : 0, 68347
Debugger [candidate] (69.054 ms) : 0, 69054
Remote Config [baseline] (538.271 µs) : 0, 538
Remote Config [candidate] (533.478 µs) : 0, 533
Telemetry [baseline] (8.602 ms) : 0, 8602
Telemetry [candidate] (8.628 ms) : 0, 8628
Flare Poller [baseline] (3.44 ms) : 0, 3440
Flare Poller [candidate] (3.447 ms) : 0, 3447
IAST [baseline] (27.211 ms) : 0, 27211
IAST [candidate] (27.028 ms) : 0, 27028
section profiling
ProfilingAgent [baseline] (99.557 ms) : 0, 99557
ProfilingAgent [candidate] (99.625 ms) : 0, 99625
crashtracking [baseline] (1.177 ms) : 0, 1177
crashtracking [candidate] (1.172 ms) : 0, 1172
BytebuddyAgent [baseline] (682.148 ms) : 0, 682148
BytebuddyAgent [candidate] (686.471 ms) : 0, 686471
AgentMeter [baseline] (8.56 ms) : 0, 8560
AgentMeter [candidate] (8.622 ms) : 0, 8622
GlobalTracer [baseline] (216.199 ms) : 0, 216199
GlobalTracer [candidate] (217.564 ms) : 0, 217564
AppSec [baseline] (32.43 ms) : 0, 32430
AppSec [candidate] (32.753 ms) : 0, 32753
Debugger [baseline] (66.792 ms) : 0, 66792
Debugger [candidate] (67.583 ms) : 0, 67583
Remote Config [baseline] (621.729 µs) : 0, 622
Remote Config [candidate] (692.192 µs) : 0, 692
Telemetry [baseline] (8.956 ms) : 0, 8956
Telemetry [candidate] (8.958 ms) : 0, 8958
Flare Poller [baseline] (3.778 ms) : 0, 3778
Flare Poller [candidate] (3.77 ms) : 0, 3770
Profiling [baseline] (100.13 ms) : 0, 100130
Profiling [candidate] (100.191 ms) : 0, 100191
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~cb724edfe1, baseline=1.60.0-SNAPSHOT~b0ab971941

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.081 s) : 0, 1080544
Total [baseline] (8.763 s) : 0, 8762669
Agent [candidate] (1.065 s) : 0, 1064807
Total [candidate] (8.738 s) : 0, 8737744
section iast
Agent [baseline] (1.23 s) : 0, 1229690
Total [baseline] (9.375 s) : 0, 9374735
Agent [candidate] (1.229 s) : 0, 1229096
Total [candidate] (9.375 s) : 0, 9374990
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.081 s -
Agent iast 1.23 s 149.147 ms (13.8%)
Total tracing 8.763 s -
Total iast 9.375 s 612.067 ms (7.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.065 s -
Agent iast 1.229 s 164.289 ms (15.4%)
Total tracing 8.738 s -
Total iast 9.375 s 637.246 ms (7.3%) 
gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~cb724edfe1, baseline=1.60.0-SNAPSHOT~b0ab971941

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.215 ms) : 0, 1215
crashtracking [candidate] (1.192 ms) : 0, 1192
BytebuddyAgent [baseline] (637.432 ms) : 0, 637432
BytebuddyAgent [candidate] (627.874 ms) : 0, 627874
AgentMeter [baseline] (29.59 ms) : 0, 29590
AgentMeter [candidate] (29.114 ms) : 0, 29114
GlobalTracer [baseline] (260.803 ms) : 0, 260803
GlobalTracer [candidate] (257.588 ms) : 0, 257588
AppSec [baseline] (33.593 ms) : 0, 33593
AppSec [candidate] (32.781 ms) : 0, 32781
Debugger [baseline] (63.781 ms) : 0, 63781
Debugger [candidate] (63.535 ms) : 0, 63535
Remote Config [baseline] (644.714 µs) : 0, 645
Remote Config [candidate] (612.203 µs) : 0, 612
Telemetry [baseline] (11.627 ms) : 0, 11627
Telemetry [candidate] (10.647 ms) : 0, 10647
Flare Poller [baseline] (5.329 ms) : 0, 5329
Flare Poller [candidate] (5.318 ms) : 0, 5318
section iast
crashtracking [baseline] (1.194 ms) : 0, 1194
crashtracking [candidate] (1.198 ms) : 0, 1198
BytebuddyAgent [baseline] (794.432 ms) : 0, 794432
BytebuddyAgent [candidate] (793.644 ms) : 0, 793644
AgentMeter [baseline] (11.299 ms) : 0, 11299
AgentMeter [candidate] (11.316 ms) : 0, 11316
GlobalTracer [baseline] (246.778 ms) : 0, 246778
GlobalTracer [candidate] (247.272 ms) : 0, 247272
IAST [baseline] (27.006 ms) : 0, 27006
IAST [candidate] (26.839 ms) : 0, 26839
AppSec [baseline] (32.679 ms) : 0, 32679
AppSec [candidate] (31.539 ms) : 0, 31539
Debugger [baseline] (67.502 ms) : 0, 67502
Debugger [candidate] (68.498 ms) : 0, 68498
Remote Config [baseline] (536.699 µs) : 0, 537
Remote Config [candidate] (534.134 µs) : 0, 534
Telemetry [baseline] (8.684 ms) : 0, 8684
Telemetry [candidate] (8.689 ms) : 0, 8689
Flare Poller [baseline] (3.498 ms) : 0, 3498
Flare Poller [candidate] (3.442 ms) : 0, 3442
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/version
git_commit_date 1772385877 1772445470
git_commit_sha b0ab971 cb724ed
release_version 1.60.0-SNAPSHOT~b0ab971941 1.60.0-SNAPSHOT~cb724edfe1
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1772447831 1772447831
ci_job_id 1466182703 1466182703
ci_pipeline_id 99704564 99704564
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-ihnncp6r 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-ihnncp6r 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 1 performance regressions! Performance is the same for 15 metrics, 20 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:petclinic:profiling:high_load worse
[+0.583ms; +1.667ms] or [+3.186%; +9.109%]		 unsure
[+0.260ms; +1.769ms] or [+0.868%; +5.920%]		 unstable
[-35.077op/s; +13.202op/s] or [-14.079%; +5.299%]		 19.423ms 30.905ms 238.219op/s 18.298ms 29.891ms 249.156op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~cb724edfe1, baseline=1.60.0-SNAPSHOT~b0ab971941
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.2 ms) : 1188, 1212
.   : milestone, 1200,
iast (3.131 ms) : 3090, 3172
.   : milestone, 3131,
iast_FULL (5.671 ms) : 5616, 5727
.   : milestone, 5671,
iast_GLOBAL (3.544 ms) : 3487, 3601
.   : milestone, 3544,
profiling (1.943 ms) : 1927, 1960
.   : milestone, 1943,
tracing (1.82 ms) : 1803, 1838
.   : milestone, 1820,
section candidate
no_agent (1.194 ms) : 1182, 1205
.   : milestone, 1194,
iast (3.207 ms) : 3163, 3250
.   : milestone, 3207,
iast_FULL (5.794 ms) : 5737, 5851
.   : milestone, 5794,
iast_GLOBAL (3.738 ms) : 3675, 3801
.   : milestone, 3738,
profiling (1.973 ms) : 1956, 1990
.   : milestone, 1973,
tracing (1.844 ms) : 1828, 1860
.   : milestone, 1844,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.2 ms [1.188 ms, 1.212 ms] -
iast 3.131 ms [3.09 ms, 3.172 ms] 1.931 ms (160.9%)
iast_FULL 5.671 ms [5.616 ms, 5.727 ms] 4.471 ms (372.5%)
iast_GLOBAL 3.544 ms [3.487 ms, 3.601 ms] 2.344 ms (195.3%)
profiling 1.943 ms [1.927 ms, 1.96 ms] 743.144 µs (61.9%)
tracing 1.82 ms [1.803 ms, 1.838 ms] 620.356 µs (51.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.194 ms [1.182 ms, 1.205 ms] -
iast 3.207 ms [3.163 ms, 3.25 ms] 2.013 ms (168.6%)
iast_FULL 5.794 ms [5.737 ms, 5.851 ms] 4.6 ms (385.4%)
iast_GLOBAL 3.738 ms [3.675 ms, 3.801 ms] 2.545 ms (213.2%)
profiling 1.973 ms [1.956 ms, 1.99 ms] 779.432 µs (65.3%)
tracing 1.844 ms [1.828 ms, 1.86 ms] 650.65 µs (54.5%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~cb724edfe1, baseline=1.60.0-SNAPSHOT~b0ab971941
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.312 ms) : 17136, 17489
.   : milestone, 17312,
appsec (18.774 ms) : 18584, 18964
.   : milestone, 18774,
code_origins (17.564 ms) : 17389, 17739
.   : milestone, 17564,
iast (17.644 ms) : 17468, 17819
.   : milestone, 17644,
profiling (18.734 ms) : 18547, 18920
.   : milestone, 18734,
tracing (17.464 ms) : 17292, 17636
.   : milestone, 17464,
section candidate
no_agent (17.034 ms) : 16864, 17204
.   : milestone, 17034,
appsec (18.858 ms) : 18669, 19047
.   : milestone, 18858,
code_origins (17.515 ms) : 17343, 17688
.   : milestone, 17515,
iast (17.606 ms) : 17430, 17782
.   : milestone, 17606,
profiling (19.596 ms) : 19395, 19796
.   : milestone, 19596,
tracing (17.666 ms) : 17490, 17843
.   : milestone, 17666,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.312 ms [17.136 ms, 17.489 ms] -
appsec 18.774 ms [18.584 ms, 18.964 ms] 1.461 ms (8.4%)
code_origins 17.564 ms [17.389 ms, 17.739 ms] 251.387 µs (1.5%)
iast 17.644 ms [17.468 ms, 17.819 ms] 331.464 µs (1.9%)
profiling 18.734 ms [18.547 ms, 18.92 ms] 1.421 ms (8.2%)
tracing 17.464 ms [17.292 ms, 17.636 ms] 151.584 µs (0.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.034 ms [16.864 ms, 17.204 ms] -
appsec 18.858 ms [18.669 ms, 19.047 ms] 1.824 ms (10.7%)
code_origins 17.515 ms [17.343 ms, 17.688 ms] 480.976 µs (2.8%)
iast 17.606 ms [17.43 ms, 17.782 ms] 571.688 µs (3.4%)
profiling 19.596 ms [19.395 ms, 19.796 ms] 2.561 ms (15.0%)
tracing 17.666 ms [17.49 ms, 17.843 ms] 631.86 µs (3.7%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/version
git_commit_date 1772385877 1772445470
git_commit_sha b0ab971 cb724ed
release_version 1.60.0-SNAPSHOT~b0ab971941 1.60.0-SNAPSHOT~cb724edfe1
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1772447452 1772447452
ci_job_id 1466182705 1466182705
ci_pipeline_id 99704564 99704564
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-oh6z1n3g 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-oh6z1n3g 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~cb724edfe1, baseline=1.60.0-SNAPSHOT~b0ab971941
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.476 ms) : 1464, 1487
.   : milestone, 1476,
appsec (3.797 ms) : 3572, 4022
.   : milestone, 3797,
iast (2.248 ms) : 2179, 2317
.   : milestone, 2248,
iast_GLOBAL (2.307 ms) : 2237, 2376
.   : milestone, 2307,
profiling (2.11 ms) : 2053, 2166
.   : milestone, 2110,
tracing (2.078 ms) : 2024, 2132
.   : milestone, 2078,
section candidate
no_agent (1.472 ms) : 1461, 1484
.   : milestone, 1472,
appsec (3.813 ms) : 3590, 4036
.   : milestone, 3813,
iast (2.268 ms) : 2199, 2337
.   : milestone, 2268,
iast_GLOBAL (2.299 ms) : 2230, 2369
.   : milestone, 2299,
profiling (2.099 ms) : 2042, 2155
.   : milestone, 2099,
tracing (2.073 ms) : 2019, 2127
.   : milestone, 2073,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.464 ms, 1.487 ms] -
appsec 3.797 ms [3.572 ms, 4.022 ms] 2.322 ms (157.3%)
iast 2.248 ms [2.179 ms, 2.317 ms] 772.858 µs (52.4%)
iast_GLOBAL 2.307 ms [2.237 ms, 2.376 ms] 831.198 µs (56.3%)
profiling 2.11 ms [2.053 ms, 2.166 ms] 634.211 µs (43.0%)
tracing 2.078 ms [2.024 ms, 2.132 ms] 602.238 µs (40.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.472 ms [1.461 ms, 1.484 ms] -
appsec 3.813 ms [3.59 ms, 4.036 ms] 2.341 ms (159.0%)
iast 2.268 ms [2.199 ms, 2.337 ms] 795.731 µs (54.0%)
iast_GLOBAL 2.299 ms [2.23 ms, 2.369 ms] 827.01 µs (56.2%)
profiling 2.099 ms [2.042 ms, 2.155 ms] 626.475 µs (42.6%)
tracing 2.073 ms [2.019 ms, 2.127 ms] 600.687 µs (40.8%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~cb724edfe1, baseline=1.60.0-SNAPSHOT~b0ab971941
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.201 s) : 15201000, 15201000
.   : milestone, 15201000,
appsec (14.96 s) : 14960000, 14960000
.   : milestone, 14960000,
iast (17.768 s) : 17768000, 17768000
.   : milestone, 17768000,
iast_GLOBAL (17.754 s) : 17754000, 17754000
.   : milestone, 17754000,
profiling (14.835 s) : 14835000, 14835000
.   : milestone, 14835000,
tracing (15.036 s) : 15036000, 15036000
.   : milestone, 15036000,
section candidate
no_agent (15.623 s) : 15623000, 15623000
.   : milestone, 15623000,
appsec (15.095 s) : 15095000, 15095000
.   : milestone, 15095000,
iast (18.006 s) : 18006000, 18006000
.   : milestone, 18006000,
iast_GLOBAL (17.676 s) : 17676000, 17676000
.   : milestone, 17676000,
profiling (14.699 s) : 14699000, 14699000
.   : milestone, 14699000,
tracing (14.741 s) : 14741000, 14741000
.   : milestone, 14741000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.201 s [15.201 s, 15.201 s] -
appsec 14.96 s [14.96 s, 14.96 s] -241.0 ms (-1.6%)
iast 17.768 s [17.768 s, 17.768 s] 2.567 s (16.9%)
iast_GLOBAL 17.754 s [17.754 s, 17.754 s] 2.553 s (16.8%)
profiling 14.835 s [14.835 s, 14.835 s] -366.0 ms (-2.4%)
tracing 15.036 s [15.036 s, 15.036 s] -165.0 ms (-1.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.623 s [15.623 s, 15.623 s] -
appsec 15.095 s [15.095 s, 15.095 s] -528.0 ms (-3.4%)
iast 18.006 s [18.006 s, 18.006 s] 2.383 s (15.3%)
iast_GLOBAL 17.676 s [17.676 s, 17.676 s] 2.053 s (13.1%)
profiling 14.699 s [14.699 s, 14.699 s] -924.0 ms (-5.9%)
tracing 14.741 s [14.741 s, 14.741 s] -882.0 ms (-5.6%)