Home Original page

Preserve the function relative address when parsing a crash by amarziali · Pull Request #10544 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/keep-rel-adddr
git_commit_date 1770378849 1770386762
git_commit_sha cffe9c6 d600b71
release_version 1.60.0-SNAPSHOT~cffe9c6085 1.60.0-SNAPSHOT~d600b71b0f
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1770388512 1770388512
ci_job_id 1406274619 1406274619
ci_pipeline_id 94998599 94998599
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-gk3spg8j 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-gk3spg8j 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 63 metrics, 8 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~d600b71b0f, baseline=1.60.0-SNAPSHOT~cffe9c6085

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.074 s) : 0, 1073791
Total [baseline] (10.969 s) : 0, 10969346
Agent [candidate] (1.081 s) : 0, 1081281
Total [candidate] (10.985 s) : 0, 10984548
section appsec
Agent [baseline] (1.247 s) : 0, 1247298
Total [baseline] (11.162 s) : 0, 11161641
Agent [candidate] (1.238 s) : 0, 1237939
Total [candidate] (11.051 s) : 0, 11051056
section iast
Agent [baseline] (1.231 s) : 0, 1231385
Total [baseline] (11.202 s) : 0, 11202457
Agent [candidate] (1.238 s) : 0, 1238370
Total [candidate] (11.157 s) : 0, 11157427
section profiling
Agent [baseline] (1.19 s) : 0, 1189621
Total [baseline] (11.052 s) : 0, 11051862
Agent [candidate] (1.192 s) : 0, 1192452
Total [candidate] (10.989 s) : 0, 10988909
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.074 s -
Agent appsec 1.247 s 173.507 ms (16.2%)
Agent iast 1.231 s 157.594 ms (14.7%)
Agent profiling 1.19 s 115.831 ms (10.8%)
Total tracing 10.969 s -
Total appsec 11.162 s 192.296 ms (1.8%)
Total iast 11.202 s 233.111 ms (2.1%)
Total profiling 11.052 s 82.516 ms (0.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.081 s -
Agent appsec 1.238 s 156.658 ms (14.5%)
Agent iast 1.238 s 157.089 ms (14.5%)
Agent profiling 1.192 s 111.171 ms (10.3%)
Total tracing 10.985 s -
Total appsec 11.051 s 66.508 ms (0.6%)
Total iast 11.157 s 172.879 ms (1.6%)
Total profiling 10.989 s 4.361 ms (0.0%) 
gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~d600b71b0f, baseline=1.60.0-SNAPSHOT~cffe9c6085

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.191 ms) : 0, 1191
crashtracking [candidate] (1.209 ms) : 0, 1209
BytebuddyAgent [baseline] (633.34 ms) : 0, 633340
BytebuddyAgent [candidate] (638.302 ms) : 0, 638302
AgentMeter [baseline] (29.161 ms) : 0, 29161
AgentMeter [candidate] (29.39 ms) : 0, 29390
GlobalTracer [baseline] (259.922 ms) : 0, 259922
GlobalTracer [candidate] (261.498 ms) : 0, 261498
AppSec [baseline] (33.199 ms) : 0, 33199
AppSec [candidate] (33.341 ms) : 0, 33341
Debugger [baseline] (61.778 ms) : 0, 61778
Debugger [candidate] (63.556 ms) : 0, 63556
Remote Config [baseline] (623.707 µs) : 0, 624
Remote Config [candidate] (613.905 µs) : 0, 614
Telemetry [baseline] (11.345 ms) : 0, 11345
Telemetry [candidate] (10.775 ms) : 0, 10775
Flare Poller [baseline] (7.69 ms) : 0, 7690
Flare Poller [candidate] (6.844 ms) : 0, 6844
section appsec
crashtracking [baseline] (1.197 ms) : 0, 1197
crashtracking [candidate] (1.187 ms) : 0, 1187
BytebuddyAgent [baseline] (662.762 ms) : 0, 662762
BytebuddyAgent [candidate] (656.878 ms) : 0, 656878
AgentMeter [baseline] (11.995 ms) : 0, 11995
AgentMeter [candidate] (11.941 ms) : 0, 11941
GlobalTracer [baseline] (260.304 ms) : 0, 260304
GlobalTracer [candidate] (258.475 ms) : 0, 258475
IAST [baseline] (25.46 ms) : 0, 25460
IAST [candidate] (25.127 ms) : 0, 25127
AppSec [baseline] (168.872 ms) : 0, 168872
AppSec [candidate] (168.084 ms) : 0, 168084
Debugger [baseline] (67.636 ms) : 0, 67636
Debugger [candidate] (67.402 ms) : 0, 67402
Remote Config [baseline] (662.139 µs) : 0, 662
Remote Config [candidate] (677.262 µs) : 0, 677
Telemetry [baseline] (9.244 ms) : 0, 9244
Telemetry [candidate] (9.177 ms) : 0, 9177
Flare Poller [baseline] (3.623 ms) : 0, 3623
Flare Poller [candidate] (3.616 ms) : 0, 3616
section iast
crashtracking [baseline] (1.191 ms) : 0, 1191
crashtracking [candidate] (1.199 ms) : 0, 1199
BytebuddyAgent [baseline] (795.565 ms) : 0, 795565
BytebuddyAgent [candidate] (800.145 ms) : 0, 800145
AgentMeter [baseline] (11.242 ms) : 0, 11242
AgentMeter [candidate] (11.295 ms) : 0, 11295
GlobalTracer [baseline] (248.396 ms) : 0, 248396
GlobalTracer [candidate] (249.224 ms) : 0, 249224
IAST [baseline] (26.833 ms) : 0, 26833
IAST [candidate] (26.998 ms) : 0, 26998
AppSec [baseline] (32.894 ms) : 0, 32894
AppSec [candidate] (33.014 ms) : 0, 33014
Debugger [baseline] (67.128 ms) : 0, 67128
Debugger [candidate] (68.319 ms) : 0, 68319
Remote Config [baseline] (542.019 µs) : 0, 542
Remote Config [candidate] (551.559 µs) : 0, 552
Telemetry [baseline] (8.77 ms) : 0, 8770
Telemetry [candidate] (8.668 ms) : 0, 8668
Flare Poller [baseline] (3.486 ms) : 0, 3486
Flare Poller [candidate] (3.502 ms) : 0, 3502
section profiling
crashtracking [baseline] (1.209 ms) : 0, 1209
crashtracking [candidate] (1.21 ms) : 0, 1210
BytebuddyAgent [baseline] (680.992 ms) : 0, 680992
BytebuddyAgent [candidate] (683.092 ms) : 0, 683092
AgentMeter [baseline] (8.806 ms) : 0, 8806
AgentMeter [candidate] (8.82 ms) : 0, 8820
GlobalTracer [baseline] (215.664 ms) : 0, 215664
GlobalTracer [candidate] (216.176 ms) : 0, 216176
AppSec [baseline] (32.302 ms) : 0, 32302
AppSec [candidate] (32.346 ms) : 0, 32346
Debugger [baseline] (67.387 ms) : 0, 67387
Debugger [candidate] (67.587 ms) : 0, 67587
Remote Config [baseline] (591.477 µs) : 0, 591
Remote Config [candidate] (597.078 µs) : 0, 597
Telemetry [baseline] (8.871 ms) : 0, 8871
Telemetry [candidate] (8.904 ms) : 0, 8904
Flare Poller [baseline] (3.753 ms) : 0, 3753
Flare Poller [candidate] (3.801 ms) : 0, 3801
ProfilingAgent [baseline] (100.059 ms) : 0, 100059
ProfilingAgent [candidate] (99.98 ms) : 0, 99980
Profiling [baseline] (100.638 ms) : 0, 100638
Profiling [candidate] (100.549 ms) : 0, 100549
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~d600b71b0f, baseline=1.60.0-SNAPSHOT~cffe9c6085

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.066 s) : 0, 1066482
Total [baseline] (8.782 s) : 0, 8782455
Agent [candidate] (1.064 s) : 0, 1064288
Total [candidate] (8.732 s) : 0, 8732195
section iast
Agent [baseline] (1.232 s) : 0, 1232336
Total [baseline] (9.417 s) : 0, 9416754
Agent [candidate] (1.233 s) : 0, 1232948
Total [candidate] (9.394 s) : 0, 9394325
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.066 s -
Agent iast 1.232 s 165.854 ms (15.6%)
Total tracing 8.782 s -
Total iast 9.417 s 634.299 ms (7.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.064 s -
Agent iast 1.233 s 168.66 ms (15.8%)
Total tracing 8.732 s -
Total iast 9.394 s 662.13 ms (7.6%) 
gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~d600b71b0f, baseline=1.60.0-SNAPSHOT~cffe9c6085

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.192 ms) : 0, 1192
crashtracking [candidate] (1.182 ms) : 0, 1182
BytebuddyAgent [baseline] (630.016 ms) : 0, 630016
BytebuddyAgent [candidate] (628.94 ms) : 0, 628940
AgentMeter [baseline] (28.958 ms) : 0, 28958
AgentMeter [candidate] (28.939 ms) : 0, 28939
GlobalTracer [baseline] (258.036 ms) : 0, 258036
GlobalTracer [candidate] (257.883 ms) : 0, 257883
AppSec [baseline] (32.967 ms) : 0, 32967
AppSec [candidate] (32.771 ms) : 0, 32771
Debugger [baseline] (61.747 ms) : 0, 61747
Debugger [candidate] (61.014 ms) : 0, 61014
Remote Config [baseline] (613.174 µs) : 0, 613
Remote Config [candidate] (624.969 µs) : 0, 625
Telemetry [baseline] (11.302 ms) : 0, 11302
Telemetry [candidate] (11.467 ms) : 0, 11467
Flare Poller [baseline] (6.125 ms) : 0, 6125
Flare Poller [candidate] (6.017 ms) : 0, 6017
section iast
crashtracking [baseline] (1.188 ms) : 0, 1188
crashtracking [candidate] (1.183 ms) : 0, 1183
BytebuddyAgent [baseline] (796.245 ms) : 0, 796245
BytebuddyAgent [candidate] (796.234 ms) : 0, 796234
AgentMeter [baseline] (11.268 ms) : 0, 11268
AgentMeter [candidate] (11.28 ms) : 0, 11280
GlobalTracer [baseline] (249.321 ms) : 0, 249321
GlobalTracer [candidate] (248.846 ms) : 0, 248846
IAST [baseline] (26.88 ms) : 0, 26880
IAST [candidate] (27.002 ms) : 0, 27002
AppSec [baseline] (30.875 ms) : 0, 30875
AppSec [candidate] (33.251 ms) : 0, 33251
Debugger [baseline] (68.532 ms) : 0, 68532
Debugger [candidate] (66.95 ms) : 0, 66950
Remote Config [baseline] (551.165 µs) : 0, 551
Remote Config [candidate] (552.478 µs) : 0, 552
Telemetry [baseline] (8.601 ms) : 0, 8601
Telemetry [candidate] (8.729 ms) : 0, 8729
Flare Poller [baseline] (3.487 ms) : 0, 3487
Flare Poller [candidate] (3.517 ms) : 0, 3517
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/keep-rel-adddr
git_commit_date 1770378849 1770386762
git_commit_sha cffe9c6 d600b71
release_version 1.60.0-SNAPSHOT~cffe9c6085 1.60.0-SNAPSHOT~d600b71b0f
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1770389004 1770389004
ci_job_id 1406274621 1406274621
ci_pipeline_id 94998599 94998599
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-fhba4cj8 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-fhba4cj8 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 2 performance regressions! Performance is the same for 17 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load worse
[+118.577µs; +214.882µs] or [+4.590%; +8.318%]		 worse
[+187.183µs; +607.124µs] or [+2.512%; +8.148%]		 unstable
[-226.648op/s; +62.211op/s] or [-16.526%; +4.536%]		 2.750ms 7.849ms 1289.250op/s 2.583ms 7.451ms 1371.469op/s
scenario:load:petclinic:no_agent:high_load better
[-1.869ms; -0.438ms] or [-10.109%; -2.371%]		 unstable
[-3.606ms; +0.089ms] or [-11.760%; +0.291%]		 unstable
[-11.700op/s; +48.825op/s] or [-4.839%; +20.191%]		 17.331ms 28.902ms 260.375op/s 18.484ms 30.660ms 241.812op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~d600b71b0f, baseline=1.60.0-SNAPSHOT~cffe9c6085
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.304 ms) : 19104, 19504
.   : milestone, 19304,
appsec (19.521 ms) : 19320, 19722
.   : milestone, 19521,
code_origins (17.77 ms) : 17594, 17946
.   : milestone, 17770,
iast (17.551 ms) : 17374, 17727
.   : milestone, 17551,
profiling (19.406 ms) : 19209, 19603
.   : milestone, 19406,
tracing (17.709 ms) : 17533, 17885
.   : milestone, 17709,
section candidate
no_agent (17.918 ms) : 17743, 18093
.   : milestone, 17918,
appsec (19.429 ms) : 19229, 19630
.   : milestone, 19429,
code_origins (17.536 ms) : 17364, 17709
.   : milestone, 17536,
iast (17.706 ms) : 17528, 17883
.   : milestone, 17706,
profiling (19.658 ms) : 19457, 19859
.   : milestone, 19658,
tracing (17.66 ms) : 17484, 17836
.   : milestone, 17660,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.304 ms [19.104 ms, 19.504 ms] -
appsec 19.521 ms [19.32 ms, 19.722 ms] 217.319 µs (1.1%)
code_origins 17.77 ms [17.594 ms, 17.946 ms] -1.534 ms (-7.9%)
iast 17.551 ms [17.374 ms, 17.727 ms] -1.753 ms (-9.1%)
profiling 19.406 ms [19.209 ms, 19.603 ms] 101.872 µs (0.5%)
tracing 17.709 ms [17.533 ms, 17.885 ms] -1.595 ms (-8.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.918 ms [17.743 ms, 18.093 ms] -
appsec 19.429 ms [19.229 ms, 19.63 ms] 1.511 ms (8.4%)
code_origins 17.536 ms [17.364 ms, 17.709 ms] -381.867 µs (-2.1%)
iast 17.706 ms [17.528 ms, 17.883 ms] -212.424 µs (-1.2%)
profiling 19.658 ms [19.457 ms, 19.859 ms] 1.74 ms (9.7%)
tracing 17.66 ms [17.484 ms, 17.836 ms] -258.454 µs (-1.4%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~d600b71b0f, baseline=1.60.0-SNAPSHOT~cffe9c6085
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.196 ms) : 1185, 1208
.   : milestone, 1196,
iast (3.127 ms) : 3085, 3169
.   : milestone, 3127,
iast_FULL (5.62 ms) : 5565, 5676
.   : milestone, 5620,
iast_GLOBAL (3.338 ms) : 3285, 3391
.   : milestone, 3338,
profiling (2.091 ms) : 2071, 2110
.   : milestone, 2091,
tracing (1.778 ms) : 1763, 1793
.   : milestone, 1778,
section candidate
no_agent (1.189 ms) : 1177, 1200
.   : milestone, 1189,
iast (3.245 ms) : 3199, 3291
.   : milestone, 3245,
iast_FULL (5.847 ms) : 5788, 5906
.   : milestone, 5847,
iast_GLOBAL (3.559 ms) : 3494, 3624
.   : milestone, 3559,
profiling (2.072 ms) : 2054, 2090
.   : milestone, 2072,
tracing (1.852 ms) : 1837, 1868
.   : milestone, 1852,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.196 ms [1.185 ms, 1.208 ms] -
iast 3.127 ms [3.085 ms, 3.169 ms] 1.931 ms (161.4%)
iast_FULL 5.62 ms [5.565 ms, 5.676 ms] 4.424 ms (369.9%)
iast_GLOBAL 3.338 ms [3.285 ms, 3.391 ms] 2.142 ms (179.1%)
profiling 2.091 ms [2.071 ms, 2.11 ms] 894.756 µs (74.8%)
tracing 1.778 ms [1.763 ms, 1.793 ms] 582.101 µs (48.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.189 ms [1.177 ms, 1.2 ms] -
iast 3.245 ms [3.199 ms, 3.291 ms] 2.056 ms (172.9%)
iast_FULL 5.847 ms [5.788 ms, 5.906 ms] 4.659 ms (391.9%)
iast_GLOBAL 3.559 ms [3.494 ms, 3.624 ms] 2.37 ms (199.4%)
profiling 2.072 ms [2.054 ms, 2.09 ms] 883.171 µs (74.3%)
tracing 1.852 ms [1.837 ms, 1.868 ms] 663.671 µs (55.8%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/keep-rel-adddr
git_commit_date 1770378849 1770386762
git_commit_sha cffe9c6 d600b71
release_version 1.60.0-SNAPSHOT~cffe9c6085 1.60.0-SNAPSHOT~d600b71b0f
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1770388713 1770388713
ci_job_id 1406274623 1406274623
ci_pipeline_id 94998599 94998599
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-3ewzmb8t 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-3ewzmb8t 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~d600b71b0f, baseline=1.60.0-SNAPSHOT~cffe9c6085
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.474 ms) : 1463, 1486
.   : milestone, 1474,
appsec (2.508 ms) : 2454, 2563
.   : milestone, 2508,
iast (2.25 ms) : 2181, 2318
.   : milestone, 2250,
iast_GLOBAL (2.296 ms) : 2227, 2365
.   : milestone, 2296,
profiling (2.077 ms) : 2022, 2131
.   : milestone, 2077,
tracing (2.074 ms) : 2020, 2127
.   : milestone, 2074,
section candidate
no_agent (1.477 ms) : 1465, 1488
.   : milestone, 1477,
appsec (2.512 ms) : 2457, 2566
.   : milestone, 2512,
iast (2.254 ms) : 2185, 2322
.   : milestone, 2254,
iast_GLOBAL (2.298 ms) : 2229, 2367
.   : milestone, 2298,
profiling (2.094 ms) : 2038, 2150
.   : milestone, 2094,
tracing (2.06 ms) : 2006, 2113
.   : milestone, 2060,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.463 ms, 1.486 ms] -
appsec 2.508 ms [2.454 ms, 2.563 ms] 1.034 ms (70.1%)
iast 2.25 ms [2.181 ms, 2.318 ms] 775.483 µs (52.6%)
iast_GLOBAL 2.296 ms [2.227 ms, 2.365 ms] 821.936 µs (55.8%)
profiling 2.077 ms [2.022 ms, 2.131 ms] 602.32 µs (40.9%)
tracing 2.074 ms [2.02 ms, 2.127 ms] 599.458 µs (40.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.477 ms [1.465 ms, 1.488 ms] -
appsec 2.512 ms [2.457 ms, 2.566 ms] 1.035 ms (70.1%)
iast 2.254 ms [2.185 ms, 2.322 ms] 777.177 µs (52.6%)
iast_GLOBAL 2.298 ms [2.229 ms, 2.367 ms] 821.148 µs (55.6%)
profiling 2.094 ms [2.038 ms, 2.15 ms] 617.713 µs (41.8%)
tracing 2.06 ms [2.006 ms, 2.113 ms] 583.007 µs (39.5%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~d600b71b0f, baseline=1.60.0-SNAPSHOT~cffe9c6085
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.649 s) : 15649000, 15649000
.   : milestone, 15649000,
appsec (14.961 s) : 14961000, 14961000
.   : milestone, 14961000,
iast (18.113 s) : 18113000, 18113000
.   : milestone, 18113000,
iast_GLOBAL (17.661 s) : 17661000, 17661000
.   : milestone, 17661000,
profiling (15.016 s) : 15016000, 15016000
.   : milestone, 15016000,
tracing (14.645 s) : 14645000, 14645000
.   : milestone, 14645000,
section candidate
no_agent (15.685 s) : 15685000, 15685000
.   : milestone, 15685000,
appsec (14.584 s) : 14584000, 14584000
.   : milestone, 14584000,
iast (18.114 s) : 18114000, 18114000
.   : milestone, 18114000,
iast_GLOBAL (17.857 s) : 17857000, 17857000
.   : milestone, 17857000,
profiling (14.691 s) : 14691000, 14691000
.   : milestone, 14691000,
tracing (14.931 s) : 14931000, 14931000
.   : milestone, 14931000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.649 s [15.649 s, 15.649 s] -
appsec 14.961 s [14.961 s, 14.961 s] -688.0 ms (-4.4%)
iast 18.113 s [18.113 s, 18.113 s] 2.464 s (15.7%)
iast_GLOBAL 17.661 s [17.661 s, 17.661 s] 2.012 s (12.9%)
profiling 15.016 s [15.016 s, 15.016 s] -633.0 ms (-4.0%)
tracing 14.645 s [14.645 s, 14.645 s] -1.004 s (-6.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.685 s [15.685 s, 15.685 s] -
appsec 14.584 s [14.584 s, 14.584 s] -1.101 s (-7.0%)
iast 18.114 s [18.114 s, 18.114 s] 2.429 s (15.5%)
iast_GLOBAL 17.857 s [17.857 s, 17.857 s] 2.172 s (13.8%)
profiling 14.691 s [14.691 s, 14.691 s] -994.0 ms (-6.3%)
tracing 14.931 s [14.931 s, 14.931 s] -754.0 ms (-4.8%)