Home Original page

byte-buddy 1.18.3 by mcculls · Pull Request #10275 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/byte-buddy-1.18.3
git_commit_date 1767084450 1767097427
git_commit_sha a1ce9ae ff199e1
release_version 1.58.0-SNAPSHOT~a1ce9aec9d 1.58.0-SNAPSHOT~ff199e174b
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1767099356 1767099356
ci_job_id 1321690618 1321690618
ci_pipeline_id 88566253 88566253
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-7y0abo30 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-7y0abo30 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 57 metrics, 8 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.58.0-SNAPSHOT~ff199e174b, baseline=1.58.0-SNAPSHOT~a1ce9aec9d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.089 s) : 0, 1089357
Total [baseline] (8.767 s) : 0, 8767462
Agent [candidate] (1.083 s) : 0, 1083217
Total [candidate] (8.743 s) : 0, 8742846
section iast
Agent [baseline] (1.223 s) : 0, 1223447
Total [baseline] (9.282 s) : 0, 9282064
Agent [candidate] (1.232 s) : 0, 1231736
Total [candidate] (9.3 s) : 0, 9299950
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.089 s -
Agent iast 1.223 s 134.09 ms (12.3%)
Total tracing 8.767 s -
Total iast 9.282 s 514.602 ms (5.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.083 s -
Agent iast 1.232 s 148.519 ms (13.7%)
Total tracing 8.743 s -
Total iast 9.3 s 557.104 ms (6.4%) 
gantt
    title insecure-bank - break down per module: candidate=1.58.0-SNAPSHOT~ff199e174b, baseline=1.58.0-SNAPSHOT~a1ce9aec9d

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.195 ms) : 0, 1195
crashtracking [candidate] (1.182 ms) : 0, 1182
BytebuddyAgent [baseline] (655.336 ms) : 0, 655336
BytebuddyAgent [candidate] (651.932 ms) : 0, 651932
GlobalTracer [baseline] (282.843 ms) : 0, 282843
GlobalTracer [candidate] (281.902 ms) : 0, 281902
AppSec [baseline] (32.906 ms) : 0, 32906
AppSec [candidate] (32.529 ms) : 0, 32529
Debugger [baseline] (67.824 ms) : 0, 67824
Debugger [candidate] (66.983 ms) : 0, 66983
Remote Config [baseline] (629.412 µs) : 0, 629
Remote Config [candidate] (636.275 µs) : 0, 636
Telemetry [baseline] (9.134 ms) : 0, 9134
Telemetry [candidate] (8.908 ms) : 0, 8908
Flare Poller [baseline] (3.825 ms) : 0, 3825
Flare Poller [candidate] (3.728 ms) : 0, 3728
section iast
crashtracking [baseline] (1.204 ms) : 0, 1204
crashtracking [candidate] (1.193 ms) : 0, 1193
BytebuddyAgent [baseline] (792.994 ms) : 0, 792994
BytebuddyAgent [candidate] (797.596 ms) : 0, 797596
GlobalTracer [baseline] (255.014 ms) : 0, 255014
GlobalTracer [candidate] (257.174 ms) : 0, 257174
AppSec [baseline] (35.286 ms) : 0, 35286
AppSec [candidate] (32.808 ms) : 0, 32808
Debugger [baseline] (63.876 ms) : 0, 63876
Debugger [candidate] (67.476 ms) : 0, 67476
Remote Config [baseline] (607.54 µs) : 0, 608
Remote Config [candidate] (608.541 µs) : 0, 609
Telemetry [baseline] (8.442 ms) : 0, 8442
Telemetry [candidate] (8.545 ms) : 0, 8545
Flare Poller [baseline] (3.57 ms) : 0, 3570
Flare Poller [candidate] (3.585 ms) : 0, 3585
IAST [baseline] (27.01 ms) : 0, 27010
IAST [candidate] (27.257 ms) : 0, 27257
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.58.0-SNAPSHOT~ff199e174b, baseline=1.58.0-SNAPSHOT~a1ce9aec9d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.085 s) : 0, 1084918
Total [baseline] (10.872 s) : 0, 10871835
Agent [candidate] (1.083 s) : 0, 1083430
Total [candidate] (10.87 s) : 0, 10870002
section appsec
Agent [baseline] (1.266 s) : 0, 1266063
Total [baseline] (10.933 s) : 0, 10932790
Agent [candidate] (1.266 s) : 0, 1266481
Total [candidate] (10.94 s) : 0, 10940045
section iast
Agent [baseline] (1.227 s) : 0, 1226522
Total [baseline] (11.16 s) : 0, 11159861
Agent [candidate] (1.227 s) : 0, 1226915
Total [candidate] (11.14 s) : 0, 11140103
section profiling
Agent [baseline] (1.204 s) : 0, 1204456
Total [baseline] (10.933 s) : 0, 10932665
Agent [candidate] (1.21 s) : 0, 1209617
Total [candidate] (10.834 s) : 0, 10833532
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.085 s -
Agent appsec 1.266 s 181.146 ms (16.7%)
Agent iast 1.227 s 141.604 ms (13.1%)
Agent profiling 1.204 s 119.538 ms (11.0%)
Total tracing 10.872 s -
Total appsec 10.933 s 60.955 ms (0.6%)
Total iast 11.16 s 288.026 ms (2.6%)
Total profiling 10.933 s 60.83 ms (0.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.083 s -
Agent appsec 1.266 s 183.051 ms (16.9%)
Agent iast 1.227 s 143.486 ms (13.2%)
Agent profiling 1.21 s 126.188 ms (11.6%)
Total tracing 10.87 s -
Total appsec 10.94 s 70.043 ms (0.6%)
Total iast 11.14 s 270.101 ms (2.5%)
Total profiling 10.834 s -36.47 ms (-0.3%) 
gantt
    title petclinic - break down per module: candidate=1.58.0-SNAPSHOT~ff199e174b, baseline=1.58.0-SNAPSHOT~a1ce9aec9d

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.189 ms) : 0, 1189
crashtracking [candidate] (1.179 ms) : 0, 1179
BytebuddyAgent [baseline] (651.906 ms) : 0, 651906
BytebuddyAgent [candidate] (651.282 ms) : 0, 651282
GlobalTracer [baseline] (282.182 ms) : 0, 282182
GlobalTracer [candidate] (281.811 ms) : 0, 281811
AppSec [baseline] (32.597 ms) : 0, 32597
AppSec [candidate] (32.434 ms) : 0, 32434
Debugger [baseline] (68.202 ms) : 0, 68202
Debugger [candidate] (68.027 ms) : 0, 68027
Remote Config [baseline] (632.524 µs) : 0, 633
Remote Config [candidate] (613.914 µs) : 0, 614
Telemetry [baseline] (8.954 ms) : 0, 8954
Telemetry [candidate] (8.955 ms) : 0, 8955
Flare Poller [baseline] (3.761 ms) : 0, 3761
Flare Poller [candidate] (3.715 ms) : 0, 3715
section appsec
crashtracking [baseline] (1.189 ms) : 0, 1189
crashtracking [candidate] (1.198 ms) : 0, 1198
BytebuddyAgent [baseline] (691.884 ms) : 0, 691884
BytebuddyAgent [candidate] (693.641 ms) : 0, 693641
GlobalTracer [baseline] (258.041 ms) : 0, 258041
GlobalTracer [candidate] (258.4 ms) : 0, 258400
IAST [baseline] (24.783 ms) : 0, 24783
IAST [candidate] (24.804 ms) : 0, 24804
AppSec [baseline] (174.851 ms) : 0, 174851
AppSec [candidate] (173.884 ms) : 0, 173884
Debugger [baseline] (66.094 ms) : 0, 66094
Debugger [candidate] (65.433 ms) : 0, 65433
Remote Config [baseline] (771.434 µs) : 0, 771
Remote Config [candidate] (783.78 µs) : 0, 784
Telemetry [baseline] (9.408 ms) : 0, 9408
Telemetry [candidate] (9.265 ms) : 0, 9265
Flare Poller [baseline] (3.706 ms) : 0, 3706
Flare Poller [candidate] (3.653 ms) : 0, 3653
section iast
crashtracking [baseline] (1.197 ms) : 0, 1197
crashtracking [candidate] (1.185 ms) : 0, 1185
BytebuddyAgent [baseline] (793.819 ms) : 0, 793819
BytebuddyAgent [candidate] (794.942 ms) : 0, 794942
GlobalTracer [baseline] (255.928 ms) : 0, 255928
GlobalTracer [candidate] (255.832 ms) : 0, 255832
IAST [baseline] (27.178 ms) : 0, 27178
IAST [candidate] (27.143 ms) : 0, 27143
AppSec [baseline] (34.655 ms) : 0, 34655
AppSec [candidate] (33.472 ms) : 0, 33472
Debugger [baseline] (65.725 ms) : 0, 65725
Debugger [candidate] (66.287 ms) : 0, 66287
Remote Config [baseline] (610.522 µs) : 0, 611
Remote Config [candidate] (608.393 µs) : 0, 608
Telemetry [baseline] (8.507 ms) : 0, 8507
Telemetry [candidate] (8.552 ms) : 0, 8552
Flare Poller [baseline] (3.514 ms) : 0, 3514
Flare Poller [candidate] (3.527 ms) : 0, 3527
section profiling
crashtracking [baseline] (1.222 ms) : 0, 1222
crashtracking [candidate] (1.217 ms) : 0, 1217
BytebuddyAgent [baseline] (703.302 ms) : 0, 703302
BytebuddyAgent [candidate] (707.595 ms) : 0, 707595
GlobalTracer [baseline] (220.16 ms) : 0, 220160
GlobalTracer [candidate] (221.22 ms) : 0, 221220
AppSec [baseline] (32.213 ms) : 0, 32213
AppSec [candidate] (32.41 ms) : 0, 32410
Debugger [baseline] (68.136 ms) : 0, 68136
Debugger [candidate] (67.678 ms) : 0, 67678
Remote Config [baseline] (615.964 µs) : 0, 616
Remote Config [candidate] (609.83 µs) : 0, 610
Telemetry [baseline] (8.793 ms) : 0, 8793
Telemetry [candidate] (8.754 ms) : 0, 8754
Flare Poller [baseline] (3.68 ms) : 0, 3680
Flare Poller [candidate] (3.658 ms) : 0, 3658
ProfilingAgent [baseline] (96.393 ms) : 0, 96393
ProfilingAgent [candidate] (96.544 ms) : 0, 96544
Profiling [baseline] (96.97 ms) : 0, 96970
Profiling [candidate] (97.117 ms) : 0, 97117
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/byte-buddy-1.18.3
git_commit_date 1767084450 1767097427
git_commit_sha a1ce9ae ff199e1
release_version 1.58.0-SNAPSHOT~a1ce9aec9d 1.58.0-SNAPSHOT~ff199e174b
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1767106577 1767106577
ci_job_id 1321842526 1321842526
ci_pipeline_id 88566253 88566253
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-ltiepkex 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-ltiepkex 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 4 performance regressions! Performance is the same for 16 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load worse
[+156.885µs; +292.284µs] or [+5.699%; +10.618%]		 worse
[+195.164µs; +628.504µs] or [+2.476%; +7.973%]		 unstable
[-223.686op/s; +58.124op/s] or [-17.081%; +4.438%]		 2.977ms 8.294ms 1226.812op/s 2.753ms 7.883ms 1309.594op/s
scenario:load:insecure-bank:iast:high_load worse
[+215.130µs; +280.060µs] or [+9.353%; +12.176%]		 worse
[+305.396µs; +626.127µs] or [+4.413%; +9.048%]		 unstable
[-272.385op/s; +50.385op/s] or [-17.961%; +3.322%]		 2.548ms 7.386ms 1405.500op/s 2.300ms 6.920ms 1516.500op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.58.0-SNAPSHOT~ff199e174b, baseline=1.58.0-SNAPSHOT~a1ce9aec9d
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.23 ms) : 1218, 1242
.   : milestone, 1230,
iast (3.012 ms) : 2971, 3054
.   : milestone, 3012,
iast_FULL (5.886 ms) : 5826, 5946
.   : milestone, 5886,
iast_GLOBAL (3.499 ms) : 3451, 3547
.   : milestone, 3499,
profiling (1.945 ms) : 1930, 1961
.   : milestone, 1945,
tracing (1.781 ms) : 1766, 1796
.   : milestone, 1781,
section candidate
no_agent (1.183 ms) : 1172, 1194
.   : milestone, 1183,
iast (3.256 ms) : 3212, 3300
.   : milestone, 3256,
iast_FULL (5.682 ms) : 5626, 5739
.   : milestone, 5682,
iast_GLOBAL (3.74 ms) : 3685, 3795
.   : milestone, 3740,
profiling (1.992 ms) : 1975, 2009
.   : milestone, 1992,
tracing (1.812 ms) : 1797, 1827
.   : milestone, 1812,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.23 ms [1.218 ms, 1.242 ms] -
iast 3.012 ms [2.971 ms, 3.054 ms] 1.783 ms (145.0%)
iast_FULL 5.886 ms [5.826 ms, 5.946 ms] 4.656 ms (378.6%)
iast_GLOBAL 3.499 ms [3.451 ms, 3.547 ms] 2.27 ms (184.5%)
profiling 1.945 ms [1.93 ms, 1.961 ms] 715.558 µs (58.2%)
tracing 1.781 ms [1.766 ms, 1.796 ms] 551.654 µs (44.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.183 ms [1.172 ms, 1.194 ms] -
iast 3.256 ms [3.212 ms, 3.3 ms] 2.073 ms (175.1%)
iast_FULL 5.682 ms [5.626 ms, 5.739 ms] 4.499 ms (380.2%)
iast_GLOBAL 3.74 ms [3.685 ms, 3.795 ms] 2.557 ms (216.0%)
profiling 1.992 ms [1.975 ms, 2.009 ms] 808.52 µs (68.3%)
tracing 1.812 ms [1.797 ms, 1.827 ms] 628.477 µs (53.1%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.58.0-SNAPSHOT~ff199e174b, baseline=1.58.0-SNAPSHOT~a1ce9aec9d
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.037 ms) : 18840, 19233
.   : milestone, 19037,
appsec (18.762 ms) : 18574, 18949
.   : milestone, 18762,
code_origins (17.955 ms) : 17772, 18137
.   : milestone, 17955,
iast (17.635 ms) : 17460, 17811
.   : milestone, 17635,
profiling (18.616 ms) : 18430, 18801
.   : milestone, 18616,
tracing (17.805 ms) : 17628, 17982
.   : milestone, 17805,
section candidate
no_agent (18.335 ms) : 18148, 18521
.   : milestone, 18335,
appsec (18.679 ms) : 18487, 18871
.   : milestone, 18679,
code_origins (18.065 ms) : 17887, 18243
.   : milestone, 18065,
iast (17.427 ms) : 17256, 17598
.   : milestone, 17427,
profiling (18.57 ms) : 18385, 18755
.   : milestone, 18570,
tracing (17.612 ms) : 17436, 17788
.   : milestone, 17612,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.037 ms [18.84 ms, 19.233 ms] -
appsec 18.762 ms [18.574 ms, 18.949 ms] -275.172 µs (-1.4%)
code_origins 17.955 ms [17.772 ms, 18.137 ms] -1.082 ms (-5.7%)
iast 17.635 ms [17.46 ms, 17.811 ms] -1.401 ms (-7.4%)
profiling 18.616 ms [18.43 ms, 18.801 ms] -420.997 µs (-2.2%)
tracing 17.805 ms [17.628 ms, 17.982 ms] -1.232 ms (-6.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.335 ms [18.148 ms, 18.521 ms] -
appsec 18.679 ms [18.487 ms, 18.871 ms] 344.272 µs (1.9%)
code_origins 18.065 ms [17.887 ms, 18.243 ms] -269.744 µs (-1.5%)
iast 17.427 ms [17.256 ms, 17.598 ms] -907.564 µs (-5.0%)
profiling 18.57 ms [18.385 ms, 18.755 ms] 235.392 µs (1.3%)
tracing 17.612 ms [17.436 ms, 17.788 ms] -722.3 µs (-3.9%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/byte-buddy-1.18.3
git_commit_date 1767084450 1767097427
git_commit_sha a1ce9ae ff199e1
release_version 1.58.0-SNAPSHOT~a1ce9aec9d 1.58.0-SNAPSHOT~ff199e174b
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1767099724 1767099724
ci_job_id 1321690620 1321690620
ci_pipeline_id 88566253 88566253
cpu_model Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-xwtyc1kv 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-xwtyc1kv 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.58.0-SNAPSHOT~ff199e174b, baseline=1.58.0-SNAPSHOT~a1ce9aec9d
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.48 ms) : 1468, 1491
.   : milestone, 1480,
appsec (2.773 ms) : 2690, 2856
.   : milestone, 2773,
iast (2.575 ms) : 2474, 2677
.   : milestone, 2575,
iast_GLOBAL (2.623 ms) : 2521, 2724
.   : milestone, 2623,
profiling (2.444 ms) : 2356, 2532
.   : milestone, 2444,
tracing (2.374 ms) : 2290, 2457
.   : milestone, 2374,
section candidate
no_agent (1.485 ms) : 1473, 1497
.   : milestone, 1485,
appsec (4.187 ms) : 3934, 4441
.   : milestone, 4187,
iast (2.567 ms) : 2466, 2669
.   : milestone, 2567,
iast_GLOBAL (2.628 ms) : 2526, 2730
.   : milestone, 2628,
profiling (2.439 ms) : 2351, 2526
.   : milestone, 2439,
tracing (2.357 ms) : 2274, 2439
.   : milestone, 2357,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.48 ms [1.468 ms, 1.491 ms] -
appsec 2.773 ms [2.69 ms, 2.856 ms] 1.293 ms (87.4%)
iast 2.575 ms [2.474 ms, 2.677 ms] 1.095 ms (74.0%)
iast_GLOBAL 2.623 ms [2.521 ms, 2.724 ms] 1.143 ms (77.2%)
profiling 2.444 ms [2.356 ms, 2.532 ms] 963.984 µs (65.1%)
tracing 2.374 ms [2.29 ms, 2.457 ms] 893.875 µs (60.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.485 ms [1.473 ms, 1.497 ms] -
appsec 4.187 ms [3.934 ms, 4.441 ms] 2.703 ms (182.0%)
iast 2.567 ms [2.466 ms, 2.669 ms] 1.082 ms (72.9%)
iast_GLOBAL 2.628 ms [2.526 ms, 2.73 ms] 1.143 ms (77.0%)
profiling 2.439 ms [2.351 ms, 2.526 ms] 953.662 µs (64.2%)
tracing 2.357 ms [2.274 ms, 2.439 ms] 871.784 µs (58.7%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.58.0-SNAPSHOT~ff199e174b, baseline=1.58.0-SNAPSHOT~a1ce9aec9d
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.428 s) : 14428000, 14428000
.   : milestone, 14428000,
appsec (14.393 s) : 14393000, 14393000
.   : milestone, 14393000,
iast (17.768 s) : 17768000, 17768000
.   : milestone, 17768000,
iast_GLOBAL (17.157 s) : 17157000, 17157000
.   : milestone, 17157000,
profiling (14.185 s) : 14185000, 14185000
.   : milestone, 14185000,
tracing (14.427 s) : 14427000, 14427000
.   : milestone, 14427000,
section candidate
no_agent (15.256 s) : 15256000, 15256000
.   : milestone, 15256000,
appsec (14.379 s) : 14379000, 14379000
.   : milestone, 14379000,
iast (17.716 s) : 17716000, 17716000
.   : milestone, 17716000,
iast_GLOBAL (17.17 s) : 17170000, 17170000
.   : milestone, 17170000,
profiling (14.382 s) : 14382000, 14382000
.   : milestone, 14382000,
tracing (13.915 s) : 13915000, 13915000
.   : milestone, 13915000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.428 s [14.428 s, 14.428 s] -
appsec 14.393 s [14.393 s, 14.393 s] -35.0 ms (-0.2%)
iast 17.768 s [17.768 s, 17.768 s] 3.34 s (23.1%)
iast_GLOBAL 17.157 s [17.157 s, 17.157 s] 2.729 s (18.9%)
profiling 14.185 s [14.185 s, 14.185 s] -243.0 ms (-1.7%)
tracing 14.427 s [14.427 s, 14.427 s] -1.0 ms (-0.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.256 s [15.256 s, 15.256 s] -
appsec 14.379 s [14.379 s, 14.379 s] -877.0 ms (-5.7%)
iast 17.716 s [17.716 s, 17.716 s] 2.46 s (16.1%)
iast_GLOBAL 17.17 s [17.17 s, 17.17 s] 1.914 s (12.5%)
profiling 14.382 s [14.382 s, 14.382 s] -874.0 ms (-5.7%)
tracing 13.915 s [13.915 s, 13.915 s] -1.341 s (-8.8%)