Home Original page

Make MemFDUnixWriterFFM compatible with early SegmentAllocator jdk implementations by amarziali · Pull Request #10602 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/ffm
git_commit_date 1771238676 1771263178
git_commit_sha ea612c8 9bac34b
release_version 1.60.0-SNAPSHOT~ea612c8e95 1.60.0-SNAPSHOT~9bac34bcd3
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1771265064 1771265064
ci_job_id 1429952178 1429952178
ci_pipeline_id 96785099 96785099
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-6f55i1l0 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-6f55i1l0 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 63 metrics, 8 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~9bac34bcd3, baseline=1.60.0-SNAPSHOT~ea612c8e95

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.065 s) : 0, 1064632
Total [baseline] (8.773 s) : 0, 8773258
Agent [candidate] (1.068 s) : 0, 1067852
Total [candidate] (8.813 s) : 0, 8813443
section iast
Agent [baseline] (1.238 s) : 0, 1237834
Total [baseline] (9.396 s) : 0, 9395624
Agent [candidate] (1.234 s) : 0, 1233712
Total [candidate] (9.439 s) : 0, 9438504
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.065 s -
Agent iast 1.238 s 173.202 ms (16.3%)
Total tracing 8.773 s -
Total iast 9.396 s 622.366 ms (7.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.068 s -
Agent iast 1.234 s 165.86 ms (15.5%)
Total tracing 8.813 s -
Total iast 9.439 s 625.061 ms (7.1%) 
gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~9bac34bcd3, baseline=1.60.0-SNAPSHOT~ea612c8e95

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.175 ms) : 0, 1175
crashtracking [candidate] (1.181 ms) : 0, 1181
BytebuddyAgent [baseline] (628.718 ms) : 0, 628718
BytebuddyAgent [candidate] (629.411 ms) : 0, 629411
AgentMeter [baseline] (28.95 ms) : 0, 28950
AgentMeter [candidate] (28.993 ms) : 0, 28993
GlobalTracer [baseline] (257.306 ms) : 0, 257306
GlobalTracer [candidate] (258.492 ms) : 0, 258492
AppSec [baseline] (32.875 ms) : 0, 32875
AppSec [candidate] (32.783 ms) : 0, 32783
Debugger [baseline] (60.405 ms) : 0, 60405
Debugger [candidate] (61.625 ms) : 0, 61625
Remote Config [baseline] (631.934 µs) : 0, 632
Remote Config [candidate] (640.349 µs) : 0, 640
Telemetry [baseline] (13.047 ms) : 0, 13047
Telemetry [candidate] (14.794 ms) : 0, 14794
Flare Poller [baseline] (6.117 ms) : 0, 6117
Flare Poller [candidate] (4.562 ms) : 0, 4562
section iast
crashtracking [baseline] (1.182 ms) : 0, 1182
crashtracking [candidate] (1.18 ms) : 0, 1180
BytebuddyAgent [baseline] (800.789 ms) : 0, 800789
BytebuddyAgent [candidate] (796.863 ms) : 0, 796863
AgentMeter [baseline] (11.486 ms) : 0, 11486
AgentMeter [candidate] (11.247 ms) : 0, 11247
GlobalTracer [baseline] (249.555 ms) : 0, 249555
GlobalTracer [candidate] (248.873 ms) : 0, 248873
IAST [baseline] (27.106 ms) : 0, 27106
IAST [candidate] (26.917 ms) : 0, 26917
AppSec [baseline] (34.043 ms) : 0, 34043
AppSec [candidate] (34.939 ms) : 0, 34939
Debugger [baseline] (65.683 ms) : 0, 65683
Debugger [candidate] (65.61 ms) : 0, 65610
Remote Config [baseline] (530.723 µs) : 0, 531
Remote Config [candidate] (560.082 µs) : 0, 560
Telemetry [baseline] (8.563 ms) : 0, 8563
Telemetry [candidate] (8.653 ms) : 0, 8653
Flare Poller [baseline] (3.454 ms) : 0, 3454
Flare Poller [candidate] (3.537 ms) : 0, 3537
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~9bac34bcd3, baseline=1.60.0-SNAPSHOT~ea612c8e95

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.066 s) : 0, 1066479
Total [baseline] (10.959 s) : 0, 10959207
Agent [candidate] (1.068 s) : 0, 1067852
Total [candidate] (10.907 s) : 0, 10906863
section appsec
Agent [baseline] (1.242 s) : 0, 1242054
Total [baseline] (11.111 s) : 0, 11111453
Agent [candidate] (1.256 s) : 0, 1255951
Total [candidate] (11.146 s) : 0, 11145572
section iast
Agent [baseline] (1.236 s) : 0, 1235895
Total [baseline] (11.367 s) : 0, 11367456
Agent [candidate] (1.234 s) : 0, 1234337
Total [candidate] (11.368 s) : 0, 11368295
section profiling
Agent [baseline] (1.193 s) : 0, 1192753
Total [baseline] (10.988 s) : 0, 10988152
Agent [candidate] (1.194 s) : 0, 1194036
Total [candidate] (11.014 s) : 0, 11014002
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.066 s -
Agent appsec 1.242 s 175.575 ms (16.5%)
Agent iast 1.236 s 169.416 ms (15.9%)
Agent profiling 1.193 s 126.274 ms (11.8%)
Total tracing 10.959 s -
Total appsec 11.111 s 152.246 ms (1.4%)
Total iast 11.367 s 408.249 ms (3.7%)
Total profiling 10.988 s 28.945 ms (0.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.068 s -
Agent appsec 1.256 s 188.099 ms (17.6%)
Agent iast 1.234 s 166.485 ms (15.6%)
Agent profiling 1.194 s 126.184 ms (11.8%)
Total tracing 10.907 s -
Total appsec 11.146 s 238.709 ms (2.2%)
Total iast 11.368 s 461.431 ms (4.2%)
Total profiling 11.014 s 107.139 ms (1.0%) 
gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~9bac34bcd3, baseline=1.60.0-SNAPSHOT~ea612c8e95

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.189 ms) : 0, 1189
crashtracking [candidate] (1.18 ms) : 0, 1180
BytebuddyAgent [baseline] (630.535 ms) : 0, 630535
BytebuddyAgent [candidate] (629.709 ms) : 0, 629709
AgentMeter [baseline] (29.093 ms) : 0, 29093
AgentMeter [candidate] (28.972 ms) : 0, 28972
GlobalTracer [baseline] (258.208 ms) : 0, 258208
GlobalTracer [candidate] (257.939 ms) : 0, 257939
AppSec [baseline] (32.673 ms) : 0, 32673
AppSec [candidate] (32.903 ms) : 0, 32903
Debugger [baseline] (62.315 ms) : 0, 62315
Debugger [candidate] (63.731 ms) : 0, 63731
Remote Config [baseline] (614.356 µs) : 0, 614
Remote Config [candidate] (609.737 µs) : 0, 610
Telemetry [baseline] (10.863 ms) : 0, 10863
Telemetry [candidate] (12.882 ms) : 0, 12882
Flare Poller [baseline] (5.489 ms) : 0, 5489
Flare Poller [candidate] (4.558 ms) : 0, 4558
section appsec
crashtracking [baseline] (1.207 ms) : 0, 1207
crashtracking [candidate] (1.198 ms) : 0, 1198
BytebuddyAgent [baseline] (659.067 ms) : 0, 659067
BytebuddyAgent [candidate] (667.892 ms) : 0, 667892
AgentMeter [baseline] (11.989 ms) : 0, 11989
AgentMeter [candidate] (12.164 ms) : 0, 12164
GlobalTracer [baseline] (259.041 ms) : 0, 259041
GlobalTracer [candidate] (261.469 ms) : 0, 261469
IAST [baseline] (25.128 ms) : 0, 25128
IAST [candidate] (25.788 ms) : 0, 25788
AppSec [baseline] (168.665 ms) : 0, 168665
AppSec [candidate] (169.373 ms) : 0, 169373
Debugger [baseline] (67.211 ms) : 0, 67211
Debugger [candidate] (68.183 ms) : 0, 68183
Remote Config [baseline] (656.39 µs) : 0, 656
Remote Config [candidate] (667.565 µs) : 0, 668
Telemetry [baseline] (9.77 ms) : 0, 9770
Telemetry [candidate] (9.798 ms) : 0, 9798
Flare Poller [baseline] (3.815 ms) : 0, 3815
Flare Poller [candidate] (3.757 ms) : 0, 3757
section iast
crashtracking [baseline] (1.181 ms) : 0, 1181
crashtracking [candidate] (1.187 ms) : 0, 1187
BytebuddyAgent [baseline] (798.163 ms) : 0, 798163
BytebuddyAgent [candidate] (796.854 ms) : 0, 796854
AgentMeter [baseline] (11.312 ms) : 0, 11312
AgentMeter [candidate] (11.292 ms) : 0, 11292
GlobalTracer [baseline] (249.279 ms) : 0, 249279
GlobalTracer [candidate] (248.938 ms) : 0, 248938
IAST [baseline] (26.906 ms) : 0, 26906
IAST [candidate] (26.842 ms) : 0, 26842
AppSec [baseline] (34.087 ms) : 0, 34087
AppSec [candidate] (32.897 ms) : 0, 32897
Debugger [baseline] (66.857 ms) : 0, 66857
Debugger [candidate] (68.19 ms) : 0, 68190
Remote Config [baseline] (545.747 µs) : 0, 546
Remote Config [candidate] (544.833 µs) : 0, 545
Telemetry [baseline] (8.682 ms) : 0, 8682
Telemetry [candidate] (8.639 ms) : 0, 8639
Flare Poller [baseline] (3.489 ms) : 0, 3489
Flare Poller [candidate] (3.499 ms) : 0, 3499
section profiling
crashtracking [baseline] (1.217 ms) : 0, 1217
crashtracking [candidate] (1.231 ms) : 0, 1231
BytebuddyAgent [baseline] (683.28 ms) : 0, 683280
BytebuddyAgent [candidate] (684.518 ms) : 0, 684518
AgentMeter [baseline] (8.633 ms) : 0, 8633
AgentMeter [candidate] (8.632 ms) : 0, 8632
GlobalTracer [baseline] (216.109 ms) : 0, 216109
GlobalTracer [candidate] (215.919 ms) : 0, 215919
AppSec [baseline] (32.588 ms) : 0, 32588
AppSec [candidate] (32.649 ms) : 0, 32649
Debugger [baseline] (67.707 ms) : 0, 67707
Debugger [candidate] (67.362 ms) : 0, 67362
Remote Config [baseline] (637.894 µs) : 0, 638
Remote Config [candidate] (632.548 µs) : 0, 633
Telemetry [baseline] (9.062 ms) : 0, 9062
Telemetry [candidate] (9.085 ms) : 0, 9085
Flare Poller [baseline] (3.794 ms) : 0, 3794
Flare Poller [candidate] (3.826 ms) : 0, 3826
ProfilingAgent [baseline] (99.745 ms) : 0, 99745
ProfilingAgent [candidate] (100.08 ms) : 0, 100080
Profiling [baseline] (100.327 ms) : 0, 100327
Profiling [candidate] (100.662 ms) : 0, 100662
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/ffm
git_commit_date 1771238676 1771263178
git_commit_sha ea612c8 9bac34b
release_version 1.60.0-SNAPSHOT~ea612c8e95 1.60.0-SNAPSHOT~9bac34bcd3
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1771265543 1771265543
ci_job_id 1429952179 1429952179
ci_pipeline_id 96785099 96785099
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-vjmia2ia 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-vjmia2ia 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 1 performance regressions! Performance is the same for 17 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load unsure
[-238.583µs; -5.995µs] or [-8.328%; -0.209%]		 better
[-970.849µs; -184.020µs] or [-11.928%; -2.261%]		 unstable
[-147.478op/s; +187.608op/s] or [-11.669%; +14.844%]		 2.743ms 7.562ms 1283.909op/s 2.865ms 8.139ms 1263.844op/s
scenario:load:petclinic:appsec:high_load worse
[+399.527µs; +783.660µs] or [+2.211%; +4.338%]		 same
[-60.212µs; +1209.377µs] or [-0.203%; +4.073%]		 unstable
[-28.715op/s; +18.590op/s] or [-11.405%; +7.383%]		 18.658ms 30.268ms 246.719op/s 18.066ms 29.693ms 251.781op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~9bac34bcd3, baseline=1.60.0-SNAPSHOT~ea612c8e95
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.248 ms) : 17076, 17419
.   : milestone, 17248,
appsec (18.536 ms) : 18351, 18720
.   : milestone, 18536,
code_origins (17.308 ms) : 17139, 17476
.   : milestone, 17308,
iast (17.723 ms) : 17546, 17899
.   : milestone, 17723,
profiling (18.581 ms) : 18395, 18767
.   : milestone, 18581,
tracing (17.579 ms) : 17405, 17753
.   : milestone, 17579,
section candidate
no_agent (17.373 ms) : 17200, 17546
.   : milestone, 17373,
appsec (18.918 ms) : 18727, 19109
.   : milestone, 18918,
code_origins (17.448 ms) : 17278, 17618
.   : milestone, 17448,
iast (17.619 ms) : 17444, 17794
.   : milestone, 17619,
profiling (18.664 ms) : 18479, 18848
.   : milestone, 18664,
tracing (18.013 ms) : 17831, 18195
.   : milestone, 18013,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.248 ms [17.076 ms, 17.419 ms] -
appsec 18.536 ms [18.351 ms, 18.72 ms] 1.288 ms (7.5%)
code_origins 17.308 ms [17.139 ms, 17.476 ms] 59.97 µs (0.3%)
iast 17.723 ms [17.546 ms, 17.899 ms] 475.019 µs (2.8%)
profiling 18.581 ms [18.395 ms, 18.767 ms] 1.333 ms (7.7%)
tracing 17.579 ms [17.405 ms, 17.753 ms] 331.119 µs (1.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.373 ms [17.2 ms, 17.546 ms] -
appsec 18.918 ms [18.727 ms, 19.109 ms] 1.545 ms (8.9%)
code_origins 17.448 ms [17.278 ms, 17.618 ms] 75.071 µs (0.4%)
iast 17.619 ms [17.444 ms, 17.794 ms] 246.373 µs (1.4%)
profiling 18.664 ms [18.479 ms, 18.848 ms] 1.291 ms (7.4%)
tracing 18.013 ms [17.831 ms, 18.195 ms] 640.1 µs (3.7%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~9bac34bcd3, baseline=1.60.0-SNAPSHOT~ea612c8e95
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.189 ms) : 1178, 1200
.   : milestone, 1189,
iast (3.158 ms) : 3119, 3196
.   : milestone, 3158,
iast_FULL (5.753 ms) : 5697, 5810
.   : milestone, 5753,
iast_GLOBAL (3.628 ms) : 3568, 3688
.   : milestone, 3628,
profiling (2.062 ms) : 2040, 2083
.   : milestone, 2062,
tracing (1.791 ms) : 1777, 1805
.   : milestone, 1791,
section candidate
no_agent (1.186 ms) : 1175, 1198
.   : milestone, 1186,
iast (3.155 ms) : 3108, 3203
.   : milestone, 3155,
iast_FULL (5.947 ms) : 5887, 6007
.   : milestone, 5947,
iast_GLOBAL (3.462 ms) : 3408, 3515
.   : milestone, 3462,
profiling (2.007 ms) : 1990, 2025
.   : milestone, 2007,
tracing (1.802 ms) : 1787, 1818
.   : milestone, 1802,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.189 ms [1.178 ms, 1.2 ms] -
iast 3.158 ms [3.119 ms, 3.196 ms] 1.968 ms (165.5%)
iast_FULL 5.753 ms [5.697 ms, 5.81 ms] 4.564 ms (383.8%)
iast_GLOBAL 3.628 ms [3.568 ms, 3.688 ms] 2.439 ms (205.1%)
profiling 2.062 ms [2.04 ms, 2.083 ms] 872.678 µs (73.4%)
tracing 1.791 ms [1.777 ms, 1.805 ms] 601.916 µs (50.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.186 ms [1.175 ms, 1.198 ms] -
iast 3.155 ms [3.108 ms, 3.203 ms] 1.969 ms (166.0%)
iast_FULL 5.947 ms [5.887 ms, 6.007 ms] 4.761 ms (401.4%)
iast_GLOBAL 3.462 ms [3.408 ms, 3.515 ms] 2.276 ms (191.9%)
profiling 2.007 ms [1.99 ms, 2.025 ms] 821.08 µs (69.2%)
tracing 1.802 ms [1.787 ms, 1.818 ms] 616.389 µs (52.0%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/ffm
git_commit_date 1771238676 1771263178
git_commit_sha ea612c8 9bac34b
release_version 1.60.0-SNAPSHOT~ea612c8e95 1.60.0-SNAPSHOT~9bac34bcd3
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1771265251 1771265251
ci_job_id 1429952182 1429952182
ci_pipeline_id 96785099 96785099
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-3-fdg3fnrj 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-3-fdg3fnrj 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 1 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:dacapo:tomcat:appsec better
[-1.464ms; -1.118ms] or [-38.533%; -29.433%]		 2.508ms 3.799ms
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~9bac34bcd3, baseline=1.60.0-SNAPSHOT~ea612c8e95
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.392 s) : 15392000, 15392000
.   : milestone, 15392000,
appsec (14.57 s) : 14570000, 14570000
.   : milestone, 14570000,
iast (18.439 s) : 18439000, 18439000
.   : milestone, 18439000,
iast_GLOBAL (17.772 s) : 17772000, 17772000
.   : milestone, 17772000,
profiling (15.091 s) : 15091000, 15091000
.   : milestone, 15091000,
tracing (14.898 s) : 14898000, 14898000
.   : milestone, 14898000,
section candidate
no_agent (15.534 s) : 15534000, 15534000
.   : milestone, 15534000,
appsec (15.022 s) : 15022000, 15022000
.   : milestone, 15022000,
iast (18.011 s) : 18011000, 18011000
.   : milestone, 18011000,
iast_GLOBAL (17.939 s) : 17939000, 17939000
.   : milestone, 17939000,
profiling (14.977 s) : 14977000, 14977000
.   : milestone, 14977000,
tracing (14.862 s) : 14862000, 14862000
.   : milestone, 14862000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.392 s [15.392 s, 15.392 s] -
appsec 14.57 s [14.57 s, 14.57 s] -822.0 ms (-5.3%)
iast 18.439 s [18.439 s, 18.439 s] 3.047 s (19.8%)
iast_GLOBAL 17.772 s [17.772 s, 17.772 s] 2.38 s (15.5%)
profiling 15.091 s [15.091 s, 15.091 s] -301.0 ms (-2.0%)
tracing 14.898 s [14.898 s, 14.898 s] -494.0 ms (-3.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.534 s [15.534 s, 15.534 s] -
appsec 15.022 s [15.022 s, 15.022 s] -512.0 ms (-3.3%)
iast 18.011 s [18.011 s, 18.011 s] 2.477 s (15.9%)
iast_GLOBAL 17.939 s [17.939 s, 17.939 s] 2.405 s (15.5%)
profiling 14.977 s [14.977 s, 14.977 s] -557.0 ms (-3.6%)
tracing 14.862 s [14.862 s, 14.862 s] -672.0 ms (-4.3%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~9bac34bcd3, baseline=1.60.0-SNAPSHOT~ea612c8e95
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.473 ms) : 1461, 1484
.   : milestone, 1473,
appsec (3.799 ms) : 3578, 4019
.   : milestone, 3799,
iast (2.244 ms) : 2175, 2313
.   : milestone, 2244,
iast_GLOBAL (2.296 ms) : 2227, 2365
.   : milestone, 2296,
profiling (2.067 ms) : 2013, 2121
.   : milestone, 2067,
tracing (2.071 ms) : 2017, 2124
.   : milestone, 2071,
section candidate
no_agent (1.474 ms) : 1463, 1486
.   : milestone, 1474,
appsec (2.508 ms) : 2453, 2562
.   : milestone, 2508,
iast (2.248 ms) : 2179, 2316
.   : milestone, 2248,
iast_GLOBAL (2.287 ms) : 2218, 2357
.   : milestone, 2287,
profiling (2.505 ms) : 2339, 2670
.   : milestone, 2505,
tracing (2.055 ms) : 2001, 2108
.   : milestone, 2055,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.473 ms [1.461 ms, 1.484 ms] -
appsec 3.799 ms [3.578 ms, 4.019 ms] 2.326 ms (157.9%)
iast 2.244 ms [2.175 ms, 2.313 ms] 770.866 µs (52.3%)
iast_GLOBAL 2.296 ms [2.227 ms, 2.365 ms] 823.264 µs (55.9%)
profiling 2.067 ms [2.013 ms, 2.121 ms] 593.863 µs (40.3%)
tracing 2.071 ms [2.017 ms, 2.124 ms] 597.813 µs (40.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.463 ms, 1.486 ms] -
appsec 2.508 ms [2.453 ms, 2.562 ms] 1.034 ms (70.1%)
iast 2.248 ms [2.179 ms, 2.316 ms] 773.776 µs (52.5%)
iast_GLOBAL 2.287 ms [2.218 ms, 2.357 ms] 813.468 µs (55.2%)
profiling 2.505 ms [2.339 ms, 2.67 ms] 1.031 ms (69.9%)
tracing 2.055 ms [2.001 ms, 2.108 ms] 580.754 µs (39.4%)