🍒 10935 - Use primitive types for RMI context payload serialization by PerfectSlayer · Pull Request #10937 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bruce.bujon/backport-pr-10935
git_commit_date 1772492986 1774277700
git_commit_sha 0f5d84f 1de8729
release_version 1.60.0~0f5d84f2c4 1.61.0-SNAPSHOT~1de8729049
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1774279928 1774279928
ci_job_id 1530639254 1530639254
ci_pipeline_id 104003561 104003561
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-02hmng33 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-02hmng33 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 60 metrics, 11 unstable metrics.

Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.61.0-SNAPSHOT~1de8729049, baseline=1.60.0~0f5d84f2c4

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.066 s) : 0, 1066196
Total [baseline] (8.758 s) : 0, 8757958
Agent [candidate] (1.062 s) : 0, 1061586
Total [candidate] (8.753 s) : 0, 8752699
section iast
Agent [baseline] (1.236 s) : 0, 1236382
Total [baseline] (9.378 s) : 0, 9377982
Agent [candidate] (1.236 s) : 0, 1235521
Total [candidate] (9.373 s) : 0, 9373102
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.066 s -
Agent iast 1.236 s 170.186 ms (16.0%)
Total tracing 8.758 s -
Total iast 9.378 s 620.024 ms (7.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.062 s -
Agent iast 1.236 s 173.934 ms (16.4%)
Total tracing 8.753 s -
Total iast 9.373 s 620.403 ms (7.1%)
gantt
    title insecure-bank - break down per module: candidate=1.61.0-SNAPSHOT~1de8729049, baseline=1.60.0~0f5d84f2c4

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.213 ms) : 0, 1213
crashtracking [candidate] (1.183 ms) : 0, 1183
BytebuddyAgent [baseline] (629.502 ms) : 0, 629502
BytebuddyAgent [candidate] (625.693 ms) : 0, 625693
AgentMeter [baseline] (28.858 ms) : 0, 28858
AgentMeter [candidate] (28.938 ms) : 0, 28938
GlobalTracer [baseline] (256.412 ms) : 0, 256412
GlobalTracer [candidate] (257.198 ms) : 0, 257198
AppSec [baseline] (32.998 ms) : 0, 32998
AppSec [candidate] (32.984 ms) : 0, 32984
Debugger [baseline] (64.241 ms) : 0, 64241
Debugger [candidate] (62.905 ms) : 0, 62905
Remote Config [baseline] (626.748 µs) : 0, 627
Remote Config [candidate] (625.046 µs) : 0, 625
Telemetry [baseline] (11.6 ms) : 0, 11600
Telemetry [candidate] (9.01 ms) : 0, 9010
Flare Poller [baseline] (4.6 ms) : 0, 4600
Flare Poller [candidate] (6.959 ms) : 0, 6959
section iast
crashtracking [baseline] (1.201 ms) : 0, 1201
crashtracking [candidate] (1.193 ms) : 0, 1193
BytebuddyAgent [baseline] (799.85 ms) : 0, 799850
BytebuddyAgent [candidate] (799.676 ms) : 0, 799676
AgentMeter [baseline] (11.488 ms) : 0, 11488
AgentMeter [candidate] (11.545 ms) : 0, 11545
GlobalTracer [baseline] (248.027 ms) : 0, 248027
GlobalTracer [candidate] (248.304 ms) : 0, 248304
AppSec [baseline] (34.248 ms) : 0, 34248
AppSec [candidate] (34.598 ms) : 0, 34598
Debugger [baseline] (65.473 ms) : 0, 65473
Debugger [candidate] (64.361 ms) : 0, 64361
Remote Config [baseline] (540.409 µs) : 0, 540
Remote Config [candidate] (528.321 µs) : 0, 528
Telemetry [baseline] (8.622 ms) : 0, 8622
Telemetry [candidate] (8.637 ms) : 0, 8637
Flare Poller [baseline] (3.44 ms) : 0, 3440
Flare Poller [candidate] (3.445 ms) : 0, 3445
IAST [baseline] (27.418 ms) : 0, 27418
IAST [candidate] (27.113 ms) : 0, 27113
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.61.0-SNAPSHOT~1de8729049, baseline=1.60.0~0f5d84f2c4

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.063 s) : 0, 1062503
Total [baseline] (10.905 s) : 0, 10904518
Agent [candidate] (1.062 s) : 0, 1062256
Total [candidate] (10.814 s) : 0, 10813642
section appsec
Agent [baseline] (1.238 s) : 0, 1238165
Total [baseline] (11.047 s) : 0, 11047449
Agent [candidate] (1.233 s) : 0, 1232814
Total [candidate] (10.926 s) : 0, 10925788
section iast
Agent [baseline] (1.232 s) : 0, 1232238
Total [baseline] (11.21 s) : 0, 11209880
Agent [candidate] (1.236 s) : 0, 1236229
Total [candidate] (11.032 s) : 0, 11031541
section profiling
Agent [baseline] (1.19 s) : 0, 1190488
Total [baseline] (10.856 s) : 0, 10856223
Agent [candidate] (1.204 s) : 0, 1204364
Total [candidate] (10.956 s) : 0, 10955576
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.063 s -
Agent appsec 1.238 s 175.662 ms (16.5%)
Agent iast 1.232 s 169.735 ms (16.0%)
Agent profiling 1.19 s 127.986 ms (12.0%)
Total tracing 10.905 s -
Total appsec 11.047 s 142.931 ms (1.3%)
Total iast 11.21 s 305.361 ms (2.8%)
Total profiling 10.856 s -48.295 ms (-0.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.062 s -
Agent appsec 1.233 s 170.558 ms (16.1%)
Agent iast 1.236 s 173.973 ms (16.4%)
Agent profiling 1.204 s 142.108 ms (13.4%)
Total tracing 10.814 s -
Total appsec 10.926 s 112.147 ms (1.0%)
Total iast 11.032 s 217.899 ms (2.0%)
Total profiling 10.956 s 141.934 ms (1.3%)
gantt
    title petclinic - break down per module: candidate=1.61.0-SNAPSHOT~1de8729049, baseline=1.60.0~0f5d84f2c4

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.198 ms) : 0, 1198
crashtracking [candidate] (1.196 ms) : 0, 1196
BytebuddyAgent [baseline] (625.308 ms) : 0, 625308
BytebuddyAgent [candidate] (626.57 ms) : 0, 626570
AgentMeter [baseline] (28.971 ms) : 0, 28971
AgentMeter [candidate] (28.988 ms) : 0, 28988
GlobalTracer [baseline] (256.788 ms) : 0, 256788
GlobalTracer [candidate] (256.815 ms) : 0, 256815
AppSec [baseline] (32.884 ms) : 0, 32884
AppSec [candidate] (32.798 ms) : 0, 32798
Debugger [baseline] (63.236 ms) : 0, 63236
Debugger [candidate] (62.529 ms) : 0, 62529
Remote Config [baseline] (623.091 µs) : 0, 623
Remote Config [candidate] (610.388 µs) : 0, 610
Telemetry [baseline] (11.526 ms) : 0, 11526
Telemetry [candidate] (11.387 ms) : 0, 11387
Flare Poller [baseline] (6.037 ms) : 0, 6037
Flare Poller [candidate] (5.28 ms) : 0, 5280
section appsec
crashtracking [baseline] (1.197 ms) : 0, 1197
crashtracking [candidate] (1.187 ms) : 0, 1187
BytebuddyAgent [baseline] (657.462 ms) : 0, 657462
BytebuddyAgent [candidate] (654.472 ms) : 0, 654472
AgentMeter [baseline] (12.012 ms) : 0, 12012
AgentMeter [candidate] (11.933 ms) : 0, 11933
GlobalTracer [baseline] (257.714 ms) : 0, 257714
GlobalTracer [candidate] (256.946 ms) : 0, 256946
AppSec [baseline] (168.335 ms) : 0, 168335
AppSec [candidate] (166.992 ms) : 0, 166992
Debugger [baseline] (66.477 ms) : 0, 66477
Debugger [candidate] (66.484 ms) : 0, 66484
Remote Config [baseline] (688.853 µs) : 0, 689
Remote Config [candidate] (675.029 µs) : 0, 675
Telemetry [baseline] (9.211 ms) : 0, 9211
Telemetry [candidate] (9.254 ms) : 0, 9254
Flare Poller [baseline] (3.658 ms) : 0, 3658
Flare Poller [candidate] (3.597 ms) : 0, 3597
IAST [baseline] (25.269 ms) : 0, 25269
IAST [candidate] (25.371 ms) : 0, 25371
section iast
crashtracking [baseline] (1.203 ms) : 0, 1203
crashtracking [candidate] (1.197 ms) : 0, 1197
BytebuddyAgent [baseline] (795.928 ms) : 0, 795928
BytebuddyAgent [candidate] (799.468 ms) : 0, 799468
AgentMeter [baseline] (11.288 ms) : 0, 11288
AgentMeter [candidate] (11.358 ms) : 0, 11358
GlobalTracer [baseline] (247.467 ms) : 0, 247467
GlobalTracer [candidate] (247.543 ms) : 0, 247543
AppSec [baseline] (35.033 ms) : 0, 35033
AppSec [candidate] (31.766 ms) : 0, 31766
Debugger [baseline] (65.681 ms) : 0, 65681
Debugger [candidate] (68.976 ms) : 0, 68976
Remote Config [baseline] (538.442 µs) : 0, 538
Remote Config [candidate] (529.959 µs) : 0, 530
Telemetry [baseline] (8.656 ms) : 0, 8656
Telemetry [candidate] (8.565 ms) : 0, 8565
Flare Poller [baseline] (3.453 ms) : 0, 3453
Flare Poller [candidate] (3.476 ms) : 0, 3476
IAST [baseline] (27.043 ms) : 0, 27043
IAST [candidate] (27.29 ms) : 0, 27290
section profiling
ProfilingAgent [baseline] (99.601 ms) : 0, 99601
ProfilingAgent [candidate] (99.978 ms) : 0, 99978
crashtracking [baseline] (1.168 ms) : 0, 1168
crashtracking [candidate] (1.184 ms) : 0, 1184
BytebuddyAgent [baseline] (681.448 ms) : 0, 681448
BytebuddyAgent [candidate] (690.13 ms) : 0, 690130
AgentMeter [baseline] (8.6 ms) : 0, 8600
AgentMeter [candidate] (8.692 ms) : 0, 8692
GlobalTracer [baseline] (215.742 ms) : 0, 215742
GlobalTracer [candidate] (218.273 ms) : 0, 218273
AppSec [baseline] (32.605 ms) : 0, 32605
AppSec [candidate] (33.153 ms) : 0, 33153
Debugger [baseline] (67.348 ms) : 0, 67348
Debugger [candidate] (67.981 ms) : 0, 67981
Remote Config [baseline] (619.128 µs) : 0, 619
Remote Config [candidate] (655.015 µs) : 0, 655
Telemetry [baseline] (8.881 ms) : 0, 8881
Telemetry [candidate] (9.066 ms) : 0, 9066
Flare Poller [baseline] (3.753 ms) : 0, 3753
Flare Poller [candidate] (3.809 ms) : 0, 3809
Profiling [baseline] (100.183 ms) : 0, 100183
Profiling [candidate] (100.56 ms) : 0, 100560
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bruce.bujon/backport-pr-10935
git_commit_date 1772492986 1774277700
git_commit_sha 0f5d84f 1de8729
release_version 1.60.0~0f5d84f2c4 1.61.0-SNAPSHOT~1de8729049
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1774280146 1774280146
ci_job_id 1530639255 1530639255
ci_pipeline_id 104003561 104003561
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-y36zcnjf 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-y36zcnjf 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 2 performance regressions! Performance is the same for 17 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:profiling:high_load worse
[+59.095µs; +205.849µs] or [+3.486%; +12.144%]
unstable
[+97.022µs; +967.341µs] or [+1.935%; +19.297%]
unstable
[-405.529op/s; +50.216op/s] or [-19.059%; +2.360%]
1.828ms 5.545ms 1950.094op/s 1.695ms 5.013ms 2127.750op/s
scenario:load:insecure-bank:iast_FULL:high_load unsure
[+83.734µs; +294.432µs] or [+1.622%; +5.703%]
worse
[+365.826µs; +1037.213µs] or [+2.973%; +8.429%]
unstable
[-101.503op/s; +49.940op/s] or [-12.771%; +6.283%]
5.352ms 13.007ms 769.031op/s 5.163ms 12.306ms 794.812op/s
scenario:load:petclinic:no_agent:high_load better
[-1.945ms; -0.488ms] or [-10.348%; -2.599%]
unstable
[-3.160ms; +0.102ms] or [-10.113%; +0.327%]
unstable
[-11.712op/s; +45.899op/s] or [-4.846%; +18.994%]
17.575ms 29.720ms 258.750op/s 18.791ms 31.249ms 241.656op/s
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~1de8729049, baseline=1.60.0~0f5d84f2c4
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.314 ms) : 19110, 19517
.   : milestone, 19314,
appsec (18.466 ms) : 18278, 18653
.   : milestone, 18466,
code_origins (17.762 ms) : 17586, 17938
.   : milestone, 17762,
iast (17.911 ms) : 17733, 18088
.   : milestone, 17911,
profiling (18.518 ms) : 18335, 18700
.   : milestone, 18518,
tracing (17.735 ms) : 17559, 17911
.   : milestone, 17735,
section candidate
no_agent (18.032 ms) : 17850, 18214
.   : milestone, 18032,
appsec (18.754 ms) : 18565, 18944
.   : milestone, 18754,
code_origins (17.45 ms) : 17278, 17623
.   : milestone, 17450,
iast (17.747 ms) : 17567, 17926
.   : milestone, 17747,
profiling (18.782 ms) : 18595, 18970
.   : milestone, 18782,
tracing (17.552 ms) : 17377, 17727
.   : milestone, 17552,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.314 ms [19.11 ms, 19.517 ms] -
appsec 18.466 ms [18.278 ms, 18.653 ms] -848.166 µs (-4.4%)
code_origins 17.762 ms [17.586 ms, 17.938 ms] -1.552 ms (-8.0%)
iast 17.911 ms [17.733 ms, 18.088 ms] -1.403 ms (-7.3%)
profiling 18.518 ms [18.335 ms, 18.7 ms] -796.135 µs (-4.1%)
tracing 17.735 ms [17.559 ms, 17.911 ms] -1.579 ms (-8.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.032 ms [17.85 ms, 18.214 ms] -
appsec 18.754 ms [18.565 ms, 18.944 ms] 721.92 µs (4.0%)
code_origins 17.45 ms [17.278 ms, 17.623 ms] -581.925 µs (-3.2%)
iast 17.747 ms [17.567 ms, 17.926 ms] -285.492 µs (-1.6%)
profiling 18.782 ms [18.595 ms, 18.97 ms] 749.926 µs (4.2%)
tracing 17.552 ms [17.377 ms, 17.727 ms] -480.526 µs (-2.7%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~1de8729049, baseline=1.60.0~0f5d84f2c4
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.204 ms) : 1192, 1216
.   : milestone, 1204,
iast (3.179 ms) : 3137, 3221
.   : milestone, 3179,
iast_FULL (5.819 ms) : 5760, 5877
.   : milestone, 5819,
iast_GLOBAL (3.651 ms) : 3589, 3714
.   : milestone, 3651,
profiling (2.126 ms) : 2107, 2145
.   : milestone, 2126,
tracing (1.781 ms) : 1766, 1796
.   : milestone, 1781,
section candidate
no_agent (1.171 ms) : 1160, 1183
.   : milestone, 1171,
iast (3.211 ms) : 3165, 3257
.   : milestone, 3211,
iast_FULL (6.014 ms) : 5953, 6075
.   : milestone, 6014,
iast_GLOBAL (3.573 ms) : 3516, 3630
.   : milestone, 3573,
profiling (2.326 ms) : 2303, 2348
.   : milestone, 2326,
tracing (1.772 ms) : 1758, 1787
.   : milestone, 1772,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.204 ms [1.192 ms, 1.216 ms] -
iast 3.179 ms [3.137 ms, 3.221 ms] 1.975 ms (164.1%)
iast_FULL 5.819 ms [5.76 ms, 5.877 ms] 4.615 ms (383.4%)
iast_GLOBAL 3.651 ms [3.589 ms, 3.714 ms] 2.448 ms (203.4%)
profiling 2.126 ms [2.107 ms, 2.145 ms] 922.417 µs (76.6%)
tracing 1.781 ms [1.766 ms, 1.796 ms] 577.638 µs (48.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.171 ms [1.16 ms, 1.183 ms] -
iast 3.211 ms [3.165 ms, 3.257 ms] 2.039 ms (174.1%)
iast_FULL 6.014 ms [5.953 ms, 6.075 ms] 4.842 ms (413.4%)
iast_GLOBAL 3.573 ms [3.516 ms, 3.63 ms] 2.402 ms (205.1%)
profiling 2.326 ms [2.303 ms, 2.348 ms] 1.154 ms (98.6%)
tracing 1.772 ms [1.758 ms, 1.787 ms] 600.907 µs (51.3%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bruce.bujon/backport-pr-10935
git_commit_date 1772492986 1774277700
git_commit_sha 0f5d84f 1de8729
release_version 1.60.0~0f5d84f2c4 1.61.0-SNAPSHOT~1de8729049
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1774280018 1774280018
ci_job_id 1530639257 1530639257
ci_pipeline_id 104003561 104003561
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-s6eonmsg 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-s6eonmsg 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~1de8729049, baseline=1.60.0~0f5d84f2c4
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.548 s) : 15548000, 15548000
.   : milestone, 15548000,
appsec (14.807 s) : 14807000, 14807000
.   : milestone, 14807000,
iast (18.374 s) : 18374000, 18374000
.   : milestone, 18374000,
iast_GLOBAL (17.72 s) : 17720000, 17720000
.   : milestone, 17720000,
profiling (14.926 s) : 14926000, 14926000
.   : milestone, 14926000,
tracing (14.45 s) : 14450000, 14450000
.   : milestone, 14450000,
section candidate
no_agent (14.915 s) : 14915000, 14915000
.   : milestone, 14915000,
appsec (15.004 s) : 15004000, 15004000
.   : milestone, 15004000,
iast (17.849 s) : 17849000, 17849000
.   : milestone, 17849000,
iast_GLOBAL (17.512 s) : 17512000, 17512000
.   : milestone, 17512000,
profiling (15.363 s) : 15363000, 15363000
.   : milestone, 15363000,
tracing (14.786 s) : 14786000, 14786000
.   : milestone, 14786000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.548 s [15.548 s, 15.548 s] -
appsec 14.807 s [14.807 s, 14.807 s] -741.0 ms (-4.8%)
iast 18.374 s [18.374 s, 18.374 s] 2.826 s (18.2%)
iast_GLOBAL 17.72 s [17.72 s, 17.72 s] 2.172 s (14.0%)
profiling 14.926 s [14.926 s, 14.926 s] -622.0 ms (-4.0%)
tracing 14.45 s [14.45 s, 14.45 s] -1.098 s (-7.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.915 s [14.915 s, 14.915 s] -
appsec 15.004 s [15.004 s, 15.004 s] 89.0 ms (0.6%)
iast 17.849 s [17.849 s, 17.849 s] 2.934 s (19.7%)
iast_GLOBAL 17.512 s [17.512 s, 17.512 s] 2.597 s (17.4%)
profiling 15.363 s [15.363 s, 15.363 s] 448.0 ms (3.0%)
tracing 14.786 s [14.786 s, 14.786 s] -129.0 ms (-0.9%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~1de8729049, baseline=1.60.0~0f5d84f2c4
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.469 ms) : 1458, 1481
.   : milestone, 1469,
appsec (3.717 ms) : 3501, 3934
.   : milestone, 3717,
iast (2.256 ms) : 2187, 2325
.   : milestone, 2256,
iast_GLOBAL (2.298 ms) : 2229, 2368
.   : milestone, 2298,
profiling (2.114 ms) : 2055, 2172
.   : milestone, 2114,
tracing (2.047 ms) : 1994, 2101
.   : milestone, 2047,
section candidate
no_agent (1.473 ms) : 1461, 1484
.   : milestone, 1473,
appsec (3.767 ms) : 3546, 3988
.   : milestone, 3767,
iast (2.248 ms) : 2179, 2317
.   : milestone, 2248,
iast_GLOBAL (2.287 ms) : 2218, 2356
.   : milestone, 2287,
profiling (2.098 ms) : 2042, 2154
.   : milestone, 2098,
tracing (2.058 ms) : 2004, 2111
.   : milestone, 2058,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.469 ms [1.458 ms, 1.481 ms] -
appsec 3.717 ms [3.501 ms, 3.934 ms] 2.248 ms (153.0%)
iast 2.256 ms [2.187 ms, 2.325 ms] 786.602 µs (53.5%)
iast_GLOBAL 2.298 ms [2.229 ms, 2.368 ms] 828.893 µs (56.4%)
profiling 2.114 ms [2.055 ms, 2.172 ms] 644.312 µs (43.9%)
tracing 2.047 ms [1.994 ms, 2.101 ms] 578.056 µs (39.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.473 ms [1.461 ms, 1.484 ms] -
appsec 3.767 ms [3.546 ms, 3.988 ms] 2.295 ms (155.8%)
iast 2.248 ms [2.179 ms, 2.317 ms] 775.6 µs (52.7%)
iast_GLOBAL 2.287 ms [2.218 ms, 2.356 ms] 813.987 µs (55.3%)
profiling 2.098 ms [2.042 ms, 2.154 ms] 625.303 µs (42.5%)
tracing 2.058 ms [2.004 ms, 2.111 ms] 585.234 µs (39.7%)