Home Original page

Fix `VerifyError` when instrumenting `org.apache.synapse.transport.passthru.SourceHandler` by mcculls · Pull Request #10154 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/fix-synapse-advice
git_commit_date 1765364626 1765368561
git_commit_sha a86bb9d 27d7c10
release_version 1.57.0-SNAPSHOT~a86bb9d9e2 1.57.0-SNAPSHOT~27d7c10783
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1765370415 1765370415
ci_job_id 1283281972 1283281972
ci_pipeline_id 85884144 85884144
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-wsnbnkka 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-wsnbnkka 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 59 metrics, 6 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.57.0-SNAPSHOT~27d7c10783, baseline=1.57.0-SNAPSHOT~a86bb9d9e2

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.085 s) : 0, 1084670
Total [baseline] (8.75 s) : 0, 8749946
Agent [candidate] (1.085 s) : 0, 1085467
Total [candidate] (8.789 s) : 0, 8789229
section iast
Agent [baseline] (1.218 s) : 0, 1218389
Total [baseline] (9.466 s) : 0, 9465514
Agent [candidate] (1.228 s) : 0, 1228489
Total [candidate] (9.489 s) : 0, 9489030
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.085 s -
Agent iast 1.218 s 133.719 ms (12.3%)
Total tracing 8.75 s -
Total iast 9.466 s 715.568 ms (8.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.085 s -
Agent iast 1.228 s 143.021 ms (13.2%)
Total tracing 8.789 s -
Total iast 9.489 s 699.801 ms (8.0%) 
gantt
    title insecure-bank - break down per module: candidate=1.57.0-SNAPSHOT~27d7c10783, baseline=1.57.0-SNAPSHOT~a86bb9d9e2

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.187 ms) : 0, 1187
crashtracking [candidate] (1.187 ms) : 0, 1187
BytebuddyAgent [baseline] (651.724 ms) : 0, 651724
BytebuddyAgent [candidate] (651.698 ms) : 0, 651698
GlobalTracer [baseline] (282.608 ms) : 0, 282608
GlobalTracer [candidate] (283.397 ms) : 0, 283397
AppSec [baseline] (32.575 ms) : 0, 32575
AppSec [candidate] (32.584 ms) : 0, 32584
Debugger [baseline] (67.532 ms) : 0, 67532
Debugger [candidate] (67.401 ms) : 0, 67401
Remote Config [baseline] (652.86 µs) : 0, 653
Remote Config [candidate] (667.809 µs) : 0, 668
Telemetry [baseline] (9.072 ms) : 0, 9072
Telemetry [candidate] (9.094 ms) : 0, 9094
Flare Poller [baseline] (3.755 ms) : 0, 3755
Flare Poller [candidate] (3.75 ms) : 0, 3750
section iast
crashtracking [baseline] (1.192 ms) : 0, 1192
crashtracking [candidate] (1.196 ms) : 0, 1196
BytebuddyAgent [baseline] (788.095 ms) : 0, 788095
BytebuddyAgent [candidate] (793.903 ms) : 0, 793903
GlobalTracer [baseline] (255.259 ms) : 0, 255259
GlobalTracer [candidate] (257.283 ms) : 0, 257283
AppSec [baseline] (34.975 ms) : 0, 34975
AppSec [candidate] (35.815 ms) : 0, 35815
Debugger [baseline] (64.113 ms) : 0, 64113
Debugger [candidate] (65.065 ms) : 0, 65065
Remote Config [baseline] (528.076 µs) : 0, 528
Remote Config [candidate] (523.879 µs) : 0, 524
Telemetry [baseline] (8.353 ms) : 0, 8353
Telemetry [candidate] (8.432 ms) : 0, 8432
Flare Poller [baseline] (3.448 ms) : 0, 3448
Flare Poller [candidate] (3.481 ms) : 0, 3481
IAST [baseline] (26.918 ms) : 0, 26918
IAST [candidate] (27.164 ms) : 0, 27164
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.57.0-SNAPSHOT~27d7c10783, baseline=1.57.0-SNAPSHOT~a86bb9d9e2

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.081 s) : 0, 1080737
Total [baseline] (10.866 s) : 0, 10865667
Agent [candidate] (1.086 s) : 0, 1086123
Total [candidate] (10.94 s) : 0, 10940003
section appsec
Agent [baseline] (1.272 s) : 0, 1271870
Total [baseline] (11.131 s) : 0, 11130738
Agent [candidate] (1.272 s) : 0, 1271689
Total [candidate] (11.243 s) : 0, 11242805
section iast
Agent [baseline] (1.224 s) : 0, 1224387
Total [baseline] (10.018 s) : 0, 10017637
Agent [candidate] (1.229 s) : 0, 1228823
Total [candidate] (11.253 s) : 0, 11253121
section profiling
Agent [baseline] (1.205 s) : 0, 1204607
Total [baseline] (10.943 s) : 0, 10942662
Agent [candidate] (1.212 s) : 0, 1211805
Total [candidate] (11.029 s) : 0, 11029243
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.081 s -
Agent appsec 1.272 s 191.134 ms (17.7%)
Agent iast 1.224 s 143.65 ms (13.3%)
Agent profiling 1.205 s 123.871 ms (11.5%)
Total tracing 10.866 s -
Total appsec 11.131 s 265.071 ms (2.4%)
Total iast 10.018 s -848.03 ms (-7.8%)
Total profiling 10.943 s 76.995 ms (0.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.086 s -
Agent appsec 1.272 s 185.566 ms (17.1%)
Agent iast 1.229 s 142.7 ms (13.1%)
Agent profiling 1.212 s 125.681 ms (11.6%)
Total tracing 10.94 s -
Total appsec 11.243 s 302.802 ms (2.8%)
Total iast 11.253 s 313.118 ms (2.9%)
Total profiling 11.029 s 89.24 ms (0.8%) 
gantt
    title petclinic - break down per module: candidate=1.57.0-SNAPSHOT~27d7c10783, baseline=1.57.0-SNAPSHOT~a86bb9d9e2

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.189 ms) : 0, 1189
crashtracking [candidate] (1.198 ms) : 0, 1198
BytebuddyAgent [baseline] (648.641 ms) : 0, 648641
BytebuddyAgent [candidate] (651.174 ms) : 0, 651174
GlobalTracer [baseline] (281.705 ms) : 0, 281705
GlobalTracer [candidate] (283.564 ms) : 0, 283564
AppSec [baseline] (32.333 ms) : 0, 32333
AppSec [candidate] (32.376 ms) : 0, 32376
Debugger [baseline] (68.068 ms) : 0, 68068
Debugger [candidate] (68.56 ms) : 0, 68560
Remote Config [baseline] (615.914 µs) : 0, 616
Remote Config [candidate] (642.132 µs) : 0, 642
Telemetry [baseline] (8.996 ms) : 0, 8996
Telemetry [candidate] (9.154 ms) : 0, 9154
Flare Poller [baseline] (3.723 ms) : 0, 3723
Flare Poller [candidate] (3.795 ms) : 0, 3795
section appsec
crashtracking [baseline] (1.188 ms) : 0, 1188
crashtracking [candidate] (1.195 ms) : 0, 1195
BytebuddyAgent [baseline] (693.959 ms) : 0, 693959
BytebuddyAgent [candidate] (693.354 ms) : 0, 693354
GlobalTracer [baseline] (260.828 ms) : 0, 260828
GlobalTracer [candidate] (261.207 ms) : 0, 261207
AppSec [baseline] (175.419 ms) : 0, 175419
AppSec [candidate] (175.473 ms) : 0, 175473
Debugger [baseline] (66.603 ms) : 0, 66603
Debugger [candidate] (66.321 ms) : 0, 66321
Remote Config [baseline] (706.901 µs) : 0, 707
Remote Config [candidate] (743.188 µs) : 0, 743
Telemetry [baseline] (8.931 ms) : 0, 8931
Telemetry [candidate] (9.053 ms) : 0, 9053
Flare Poller [baseline] (3.887 ms) : 0, 3887
Flare Poller [candidate] (4.012 ms) : 0, 4012
IAST [baseline] (24.754 ms) : 0, 24754
IAST [candidate] (24.683 ms) : 0, 24683
section iast
crashtracking [baseline] (1.187 ms) : 0, 1187
crashtracking [candidate] (1.2 ms) : 0, 1200
BytebuddyAgent [baseline] (790.791 ms) : 0, 790791
BytebuddyAgent [candidate] (793.535 ms) : 0, 793535
GlobalTracer [baseline] (256.017 ms) : 0, 256017
GlobalTracer [candidate] (257.404 ms) : 0, 257404
AppSec [baseline] (35.623 ms) : 0, 35623
AppSec [candidate] (34.494 ms) : 0, 34494
Debugger [baseline] (66.132 ms) : 0, 66132
Debugger [candidate] (66.867 ms) : 0, 66867
Remote Config [baseline] (536.623 µs) : 0, 537
Remote Config [candidate] (530.118 µs) : 0, 530
Telemetry [baseline] (8.373 ms) : 0, 8373
Telemetry [candidate] (8.529 ms) : 0, 8529
Flare Poller [baseline] (3.494 ms) : 0, 3494
Flare Poller [candidate] (3.511 ms) : 0, 3511
IAST [baseline] (26.885 ms) : 0, 26885
IAST [candidate] (27.221 ms) : 0, 27221
section profiling
crashtracking [baseline] (1.188 ms) : 0, 1188
crashtracking [candidate] (1.223 ms) : 0, 1223
BytebuddyAgent [baseline] (701.581 ms) : 0, 701581
BytebuddyAgent [candidate] (705.364 ms) : 0, 705364
GlobalTracer [baseline] (220.616 ms) : 0, 220616
GlobalTracer [candidate] (221.852 ms) : 0, 221852
AppSec [baseline] (32.358 ms) : 0, 32358
AppSec [candidate] (32.625 ms) : 0, 32625
Debugger [baseline] (68.25 ms) : 0, 68250
Debugger [candidate] (68.718 ms) : 0, 68718
Remote Config [baseline] (667.945 µs) : 0, 668
Remote Config [candidate] (620.515 µs) : 0, 621
Telemetry [baseline] (8.973 ms) : 0, 8973
Telemetry [candidate] (8.988 ms) : 0, 8988
Flare Poller [baseline] (3.808 ms) : 0, 3808
Flare Poller [candidate] (3.8 ms) : 0, 3800
ProfilingAgent [baseline] (97.644 ms) : 0, 97644
ProfilingAgent [candidate] (98.798 ms) : 0, 98798
Profiling [baseline] (98.222 ms) : 0, 98222
Profiling [candidate] (99.378 ms) : 0, 99378
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/fix-synapse-advice
git_commit_date 1765364626 1765368561
git_commit_sha a86bb9d 27d7c10
release_version 1.57.0-SNAPSHOT~a86bb9d9e2 1.57.0-SNAPSHOT~27d7c10783
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1765371037 1765371037
ci_job_id 1283281973 1283281973
ci_pipeline_id 85884144 85884144
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-u84y5ir3 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-u84y5ir3 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 1 performance regressions! Performance is the same for 17 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:petclinic:profiling:high_load better
[-1.813ms; -0.779ms] or [-9.203%; -3.955%]		 unsure
[-2.014ms; -0.472ms] or [-6.428%; -1.506%]		 unstable
[-14.878op/s; +40.315op/s] or [-6.321%; +17.128%]		 18.405ms 30.088ms 248.094op/s 19.701ms 31.331ms 235.375op/s
scenario:load:petclinic:no_agent:high_load worse
[+1.180ms; +2.554ms] or [+7.010%; +15.165%]		 unstable
[+1.299ms; +4.468ms] or [+4.580%; +15.759%]		 unstable
[-55.174op/s; +5.424op/s] or [-20.594%; +2.024%]		 18.706ms 31.236ms 243.031op/s 16.839ms 28.353ms 267.906op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~27d7c10783, baseline=1.57.0-SNAPSHOT~a86bb9d9e2
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.202 ms) : 1190, 1213
.   : milestone, 1202,
iast (3.227 ms) : 3187, 3268
.   : milestone, 3227,
iast_FULL (5.82 ms) : 5762, 5878
.   : milestone, 5820,
iast_GLOBAL (3.613 ms) : 3553, 3673
.   : milestone, 3613,
profiling (2.06 ms) : 2043, 2078
.   : milestone, 2060,
tracing (1.798 ms) : 1783, 1812
.   : milestone, 1798,
section candidate
no_agent (1.199 ms) : 1188, 1211
.   : milestone, 1199,
iast (3.161 ms) : 3122, 3199
.   : milestone, 3161,
iast_FULL (5.759 ms) : 5701, 5816
.   : milestone, 5759,
iast_GLOBAL (3.605 ms) : 3546, 3664
.   : milestone, 3605,
profiling (2.216 ms) : 2194, 2239
.   : milestone, 2216,
tracing (1.861 ms) : 1844, 1877
.   : milestone, 1861,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.202 ms [1.19 ms, 1.213 ms] -
iast 3.227 ms [3.187 ms, 3.268 ms] 2.026 ms (168.6%)
iast_FULL 5.82 ms [5.762 ms, 5.878 ms] 4.618 ms (384.4%)
iast_GLOBAL 3.613 ms [3.553 ms, 3.673 ms] 2.412 ms (200.7%)
profiling 2.06 ms [2.043 ms, 2.078 ms] 858.769 µs (71.5%)
tracing 1.798 ms [1.783 ms, 1.812 ms] 596.222 µs (49.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.199 ms [1.188 ms, 1.211 ms] -
iast 3.161 ms [3.122 ms, 3.199 ms] 1.961 ms (163.5%)
iast_FULL 5.759 ms [5.701 ms, 5.816 ms] 4.559 ms (380.1%)
iast_GLOBAL 3.605 ms [3.546 ms, 3.664 ms] 2.406 ms (200.6%)
profiling 2.216 ms [2.194 ms, 2.239 ms] 1.017 ms (84.8%)
tracing 1.861 ms [1.844 ms, 1.877 ms] 661.422 µs (55.1%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~27d7c10783, baseline=1.57.0-SNAPSHOT~a86bb9d9e2
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.413 ms) : 17240, 17586
.   : milestone, 17413,
appsec (18.841 ms) : 18648, 19033
.   : milestone, 18841,
code_origins (17.964 ms) : 17785, 18144
.   : milestone, 17964,
iast (17.987 ms) : 17803, 18170
.   : milestone, 17987,
profiling (19.836 ms) : 19633, 20040
.   : milestone, 19836,
tracing (17.588 ms) : 17415, 17760
.   : milestone, 17588,
section candidate
no_agent (19.205 ms) : 19006, 19404
.   : milestone, 19205,
appsec (18.9 ms) : 18706, 19093
.   : milestone, 18900,
code_origins (17.948 ms) : 17771, 18124
.   : milestone, 17948,
iast (17.921 ms) : 17739, 18103
.   : milestone, 17921,
profiling (18.809 ms) : 18622, 18995
.   : milestone, 18809,
tracing (17.791 ms) : 17615, 17967
.   : milestone, 17791,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.413 ms [17.24 ms, 17.586 ms] -
appsec 18.841 ms [18.648 ms, 19.033 ms] 1.428 ms (8.2%)
code_origins 17.964 ms [17.785 ms, 18.144 ms] 551.325 µs (3.2%)
iast 17.987 ms [17.803 ms, 18.17 ms] 573.455 µs (3.3%)
profiling 19.836 ms [19.633 ms, 20.04 ms] 2.423 ms (13.9%)
tracing 17.588 ms [17.415 ms, 17.76 ms] 174.365 µs (1.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.205 ms [19.006 ms, 19.404 ms] -
appsec 18.9 ms [18.706 ms, 19.093 ms] -305.194 µs (-1.6%)
code_origins 17.948 ms [17.771 ms, 18.124 ms] -1.257 ms (-6.5%)
iast 17.921 ms [17.739 ms, 18.103 ms] -1.284 ms (-6.7%)
profiling 18.809 ms [18.622 ms, 18.995 ms] -395.913 µs (-2.1%)
tracing 17.791 ms [17.615 ms, 17.967 ms] -1.414 ms (-7.4%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/fix-synapse-advice
git_commit_date 1765364626 1765368561
git_commit_sha a86bb9d 27d7c10
release_version 1.57.0-SNAPSHOT~a86bb9d9e2 1.57.0-SNAPSHOT~27d7c10783
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1765370707 1765370707
ci_job_id 1283281974 1283281974
ci_pipeline_id 85884144 85884144
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-432gottj 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-432gottj 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 1 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:dacapo:tomcat:appsec better
[-1.417ms; -1.072ms] or [-38.137%; -28.856%]		 2.471ms 3.715ms
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~27d7c10783, baseline=1.57.0-SNAPSHOT~a86bb9d9e2
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.482 ms) : 1470, 1493
.   : milestone, 1482,
appsec (3.715 ms) : 3495, 3936
.   : milestone, 3715,
iast (2.243 ms) : 2177, 2309
.   : milestone, 2243,
iast_GLOBAL (2.261 ms) : 2196, 2326
.   : milestone, 2261,
profiling (2.071 ms) : 2018, 2123
.   : milestone, 2071,
tracing (2.06 ms) : 2008, 2111
.   : milestone, 2060,
section candidate
no_agent (1.476 ms) : 1465, 1488
.   : milestone, 1476,
appsec (2.471 ms) : 2419, 2523
.   : milestone, 2471,
iast (2.218 ms) : 2153, 2282
.   : milestone, 2218,
iast_GLOBAL (2.263 ms) : 2198, 2328
.   : milestone, 2263,
profiling (2.51 ms) : 2347, 2674
.   : milestone, 2510,
tracing (2.057 ms) : 2006, 2108
.   : milestone, 2057,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.482 ms [1.47 ms, 1.493 ms] -
appsec 3.715 ms [3.495 ms, 3.936 ms] 2.233 ms (150.7%)
iast 2.243 ms [2.177 ms, 2.309 ms] 761.474 µs (51.4%)
iast_GLOBAL 2.261 ms [2.196 ms, 2.326 ms] 779.01 µs (52.6%)
profiling 2.071 ms [2.018 ms, 2.123 ms] 588.764 µs (39.7%)
tracing 2.06 ms [2.008 ms, 2.111 ms] 577.854 µs (39.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.465 ms, 1.488 ms] -
appsec 2.471 ms [2.419 ms, 2.523 ms] 994.281 µs (67.3%)
iast 2.218 ms [2.153 ms, 2.282 ms] 741.227 µs (50.2%)
iast_GLOBAL 2.263 ms [2.198 ms, 2.328 ms] 786.817 µs (53.3%)
profiling 2.51 ms [2.347 ms, 2.674 ms] 1.034 ms (70.0%)
tracing 2.057 ms [2.006 ms, 2.108 ms] 580.537 µs (39.3%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~27d7c10783, baseline=1.57.0-SNAPSHOT~a86bb9d9e2
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.016 s) : 15016000, 15016000
.   : milestone, 15016000,
appsec (14.47 s) : 14470000, 14470000
.   : milestone, 14470000,
iast (18.151 s) : 18151000, 18151000
.   : milestone, 18151000,
iast_GLOBAL (18.051 s) : 18051000, 18051000
.   : milestone, 18051000,
profiling (14.541 s) : 14541000, 14541000
.   : milestone, 14541000,
tracing (14.807 s) : 14807000, 14807000
.   : milestone, 14807000,
section candidate
no_agent (15.051 s) : 15051000, 15051000
.   : milestone, 15051000,
appsec (14.379 s) : 14379000, 14379000
.   : milestone, 14379000,
iast (18.489 s) : 18489000, 18489000
.   : milestone, 18489000,
iast_GLOBAL (18.012 s) : 18012000, 18012000
.   : milestone, 18012000,
profiling (15.251 s) : 15251000, 15251000
.   : milestone, 15251000,
tracing (14.86 s) : 14860000, 14860000
.   : milestone, 14860000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.016 s [15.016 s, 15.016 s] -
appsec 14.47 s [14.47 s, 14.47 s] -546.0 ms (-3.6%)
iast 18.151 s [18.151 s, 18.151 s] 3.135 s (20.9%)
iast_GLOBAL 18.051 s [18.051 s, 18.051 s] 3.035 s (20.2%)
profiling 14.541 s [14.541 s, 14.541 s] -475.0 ms (-3.2%)
tracing 14.807 s [14.807 s, 14.807 s] -209.0 ms (-1.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.051 s [15.051 s, 15.051 s] -
appsec 14.379 s [14.379 s, 14.379 s] -672.0 ms (-4.5%)
iast 18.489 s [18.489 s, 18.489 s] 3.438 s (22.8%)
iast_GLOBAL 18.012 s [18.012 s, 18.012 s] 2.961 s (19.7%)
profiling 15.251 s [15.251 s, 15.251 s] 200.0 ms (1.3%)
tracing 14.86 s [14.86 s, 14.86 s] -191.0 ms (-1.3%)