Upgrade to jctools 4.0.6 by amarziali · Pull Request #10691 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/upgrade-jctools
git_commit_date 1772150287 1772180169
git_commit_sha 81efdf7 1fa8492
release_version 1.60.0-SNAPSHOT~81efdf7f07 1.60.0-SNAPSHOT~1fa8492f79
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1772182079 1772182079
ci_job_id 1461614498 1461614498
ci_pipeline_id 99357078 99357078
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-jf6t54du 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-jf6t54du 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 1 performance regressions! Performance is the same for 61 metrics, 9 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:petclinic:iast:Debugger worse
[+3.596ms; +9.258ms] or [+5.407%; +13.921%]
72.934ms 66.506ms
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~1fa8492f79, baseline=1.60.0-SNAPSHOT~81efdf7f07

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.07 s) : 0, 1069617
Total [baseline] (8.708 s) : 0, 8707887
Agent [candidate] (1.073 s) : 0, 1072806
Total [candidate] (8.696 s) : 0, 8696451
section iast
Agent [baseline] (1.229 s) : 0, 1228975
Total [baseline] (9.393 s) : 0, 9393096
Agent [candidate] (1.239 s) : 0, 1238986
Total [candidate] (9.409 s) : 0, 9408880
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.07 s -
Agent iast 1.229 s 159.358 ms (14.9%)
Total tracing 8.708 s -
Total iast 9.393 s 685.21 ms (7.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.073 s -
Agent iast 1.239 s 166.18 ms (15.5%)
Total tracing 8.696 s -
Total iast 9.409 s 712.428 ms (8.2%)
gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~1fa8492f79, baseline=1.60.0-SNAPSHOT~81efdf7f07

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.197 ms) : 0, 1197
crashtracking [candidate] (1.201 ms) : 0, 1201
BytebuddyAgent [baseline] (631.952 ms) : 0, 631952
BytebuddyAgent [candidate] (635.106 ms) : 0, 635106
AgentMeter [baseline] (29.335 ms) : 0, 29335
AgentMeter [candidate] (29.043 ms) : 0, 29043
GlobalTracer [baseline] (257.456 ms) : 0, 257456
GlobalTracer [candidate] (257.322 ms) : 0, 257322
AppSec [baseline] (33.17 ms) : 0, 33170
AppSec [candidate] (32.884 ms) : 0, 32884
Debugger [baseline] (66.949 ms) : 0, 66949
Debugger [candidate] (65.97 ms) : 0, 65970
Remote Config [baseline] (613.244 µs) : 0, 613
Remote Config [candidate] (606.945 µs) : 0, 607
Telemetry [baseline] (9.036 ms) : 0, 9036
Telemetry [candidate] (8.998 ms) : 0, 8998
Flare Poller [baseline] (3.748 ms) : 0, 3748
Flare Poller [candidate] (5.384 ms) : 0, 5384
section iast
crashtracking [baseline] (1.184 ms) : 0, 1184
crashtracking [candidate] (1.192 ms) : 0, 1192
BytebuddyAgent [baseline] (794.168 ms) : 0, 794168
BytebuddyAgent [candidate] (801.982 ms) : 0, 801982
AgentMeter [baseline] (11.32 ms) : 0, 11320
AgentMeter [candidate] (11.544 ms) : 0, 11544
GlobalTracer [baseline] (246.894 ms) : 0, 246894
GlobalTracer [candidate] (248.756 ms) : 0, 248756
IAST [baseline] (26.869 ms) : 0, 26869
IAST [candidate] (27.325 ms) : 0, 27325
AppSec [baseline] (31.585 ms) : 0, 31585
AppSec [candidate] (35.09 ms) : 0, 35090
Debugger [baseline] (68.264 ms) : 0, 68264
Debugger [candidate] (64.448 ms) : 0, 64448
Remote Config [baseline] (557.336 µs) : 0, 557
Remote Config [candidate] (535.106 µs) : 0, 535
Telemetry [baseline] (8.713 ms) : 0, 8713
Telemetry [candidate] (8.555 ms) : 0, 8555
Flare Poller [baseline] (3.471 ms) : 0, 3471
Flare Poller [candidate] (3.468 ms) : 0, 3468
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~1fa8492f79, baseline=1.60.0-SNAPSHOT~81efdf7f07

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.071 s) : 0, 1071165
Total [baseline] (10.879 s) : 0, 10878666
Agent [candidate] (1.072 s) : 0, 1072457
Total [candidate] (10.987 s) : 0, 10986898
section appsec
Agent [baseline] (1.237 s) : 0, 1236571
Total [baseline] (11.001 s) : 0, 11000976
Agent [candidate] (1.247 s) : 0, 1247481
Total [candidate] (11.12 s) : 0, 11120107
section iast
Agent [baseline] (1.229 s) : 0, 1228804
Total [baseline] (11.164 s) : 0, 11164381
Agent [candidate] (1.237 s) : 0, 1237217
Total [candidate] (11.263 s) : 0, 11263137
section profiling
Agent [baseline] (1.19 s) : 0, 1189847
Total [baseline] (10.957 s) : 0, 10957116
Agent [candidate] (1.19 s) : 0, 1190465
Total [candidate] (10.978 s) : 0, 10978117
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.071 s -
Agent appsec 1.237 s 165.406 ms (15.4%)
Agent iast 1.229 s 157.639 ms (14.7%)
Agent profiling 1.19 s 118.682 ms (11.1%)
Total tracing 10.879 s -
Total appsec 11.001 s 122.309 ms (1.1%)
Total iast 11.164 s 285.715 ms (2.6%)
Total profiling 10.957 s 78.45 ms (0.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.072 s -
Agent appsec 1.247 s 175.024 ms (16.3%)
Agent iast 1.237 s 164.76 ms (15.4%)
Agent profiling 1.19 s 118.008 ms (11.0%)
Total tracing 10.987 s -
Total appsec 11.12 s 133.209 ms (1.2%)
Total iast 11.263 s 276.239 ms (2.5%)
Total profiling 10.978 s -8.781 ms (-0.1%)
gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~1fa8492f79, baseline=1.60.0-SNAPSHOT~81efdf7f07

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.188 ms) : 0, 1188
crashtracking [candidate] (1.193 ms) : 0, 1193
BytebuddyAgent [baseline] (631.877 ms) : 0, 631877
BytebuddyAgent [candidate] (631.466 ms) : 0, 631466
AgentMeter [baseline] (29.323 ms) : 0, 29323
AgentMeter [candidate] (29.222 ms) : 0, 29222
GlobalTracer [baseline] (258.966 ms) : 0, 258966
GlobalTracer [candidate] (259.077 ms) : 0, 259077
AppSec [baseline] (33.33 ms) : 0, 33330
AppSec [candidate] (33.115 ms) : 0, 33115
Debugger [baseline] (64.275 ms) : 0, 64275
Debugger [candidate] (66.455 ms) : 0, 66455
Remote Config [baseline] (634.603 µs) : 0, 635
Remote Config [candidate] (617.416 µs) : 0, 617
Telemetry [baseline] (10.828 ms) : 0, 10828
Telemetry [candidate] (10.581 ms) : 0, 10581
Flare Poller [baseline] (4.571 ms) : 0, 4571
Flare Poller [candidate] (4.604 ms) : 0, 4604
section appsec
crashtracking [baseline] (1.176 ms) : 0, 1176
crashtracking [candidate] (1.189 ms) : 0, 1189
BytebuddyAgent [baseline] (656.18 ms) : 0, 656180
BytebuddyAgent [candidate] (664.67 ms) : 0, 664670
AgentMeter [baseline] (11.98 ms) : 0, 11980
AgentMeter [candidate] (12.053 ms) : 0, 12053
GlobalTracer [baseline] (258.233 ms) : 0, 258233
GlobalTracer [candidate] (259.53 ms) : 0, 259530
IAST [baseline] (25.325 ms) : 0, 25325
IAST [candidate] (25.627 ms) : 0, 25627
AppSec [baseline] (167.535 ms) : 0, 167535
AppSec [candidate] (168.201 ms) : 0, 168201
Debugger [baseline] (66.53 ms) : 0, 66530
Debugger [candidate] (66.54 ms) : 0, 66540
Remote Config [baseline] (639.45 µs) : 0, 639
Remote Config [candidate] (672.669 µs) : 0, 673
Telemetry [baseline] (9.371 ms) : 0, 9371
Telemetry [candidate] (9.27 ms) : 0, 9270
Flare Poller [baseline] (3.669 ms) : 0, 3669
Flare Poller [candidate] (3.667 ms) : 0, 3667
section iast
crashtracking [baseline] (1.189 ms) : 0, 1189
crashtracking [candidate] (1.185 ms) : 0, 1185
BytebuddyAgent [baseline] (793.827 ms) : 0, 793827
BytebuddyAgent [candidate] (798.9 ms) : 0, 798900
AgentMeter [baseline] (11.267 ms) : 0, 11267
AgentMeter [candidate] (11.366 ms) : 0, 11366
GlobalTracer [baseline] (246.444 ms) : 0, 246444
GlobalTracer [candidate] (248.572 ms) : 0, 248572
IAST [baseline] (26.843 ms) : 0, 26843
IAST [candidate] (27.052 ms) : 0, 27052
AppSec [baseline] (34.17 ms) : 0, 34170
AppSec [candidate] (28.383 ms) : 0, 28383
Debugger [baseline] (66.506 ms) : 0, 66506
Debugger [candidate] (72.934 ms) : 0, 72934
Remote Config [baseline] (545.506 µs) : 0, 546
Remote Config [candidate] (539.49 µs) : 0, 539
Telemetry [baseline] (8.652 ms) : 0, 8652
Telemetry [candidate] (8.744 ms) : 0, 8744
Flare Poller [baseline] (3.498 ms) : 0, 3498
Flare Poller [candidate] (3.516 ms) : 0, 3516
section profiling
crashtracking [baseline] (1.167 ms) : 0, 1167
crashtracking [candidate] (1.165 ms) : 0, 1165
BytebuddyAgent [baseline] (681.695 ms) : 0, 681695
BytebuddyAgent [candidate] (682.157 ms) : 0, 682157
AgentMeter [baseline] (8.563 ms) : 0, 8563
AgentMeter [candidate] (8.631 ms) : 0, 8631
GlobalTracer [baseline] (215.957 ms) : 0, 215957
GlobalTracer [candidate] (216.513 ms) : 0, 216513
AppSec [baseline] (32.697 ms) : 0, 32697
AppSec [candidate] (32.447 ms) : 0, 32447
Debugger [baseline] (67.161 ms) : 0, 67161
Debugger [candidate] (66.8 ms) : 0, 66800
Remote Config [baseline] (631.125 µs) : 0, 631
Remote Config [candidate] (624.358 µs) : 0, 624
Telemetry [baseline] (8.905 ms) : 0, 8905
Telemetry [candidate] (8.938 ms) : 0, 8938
Flare Poller [baseline] (3.735 ms) : 0, 3735
Flare Poller [candidate] (3.731 ms) : 0, 3731
ProfilingAgent [baseline] (98.72 ms) : 0, 98720
ProfilingAgent [candidate] (98.583 ms) : 0, 98583
Profiling [baseline] (99.29 ms) : 0, 99290
Profiling [candidate] (99.15 ms) : 0, 99150
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/upgrade-jctools
git_commit_date 1772150287 1772180169
git_commit_sha 81efdf7 1fa8492
release_version 1.60.0-SNAPSHOT~81efdf7f07 1.60.0-SNAPSHOT~1fa8492f79
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1772182573 1772182573
ci_job_id 1461614499 1461614499
ci_pipeline_id 99357078 99357078
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-cbyhe5c4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-cbyhe5c4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 19 metrics, 17 unstable metrics.

Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~1fa8492f79, baseline=1.60.0-SNAPSHOT~81efdf7f07
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.317 ms) : 18133, 18501
.   : milestone, 18317,
appsec (18.575 ms) : 18385, 18765
.   : milestone, 18575,
code_origins (17.676 ms) : 17497, 17855
.   : milestone, 17676,
iast (17.578 ms) : 17402, 17755
.   : milestone, 17578,
profiling (18.791 ms) : 18604, 18979
.   : milestone, 18791,
tracing (17.71 ms) : 17536, 17884
.   : milestone, 17710,
section candidate
no_agent (18.048 ms) : 17865, 18230
.   : milestone, 18048,
appsec (18.834 ms) : 18641, 19027
.   : milestone, 18834,
code_origins (17.664 ms) : 17490, 17838
.   : milestone, 17664,
iast (17.863 ms) : 17684, 18043
.   : milestone, 17863,
profiling (18.433 ms) : 18248, 18617
.   : milestone, 18433,
tracing (17.765 ms) : 17589, 17941
.   : milestone, 17765,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.317 ms [18.133 ms, 18.501 ms] -
appsec 18.575 ms [18.385 ms, 18.765 ms] 257.601 µs (1.4%)
code_origins 17.676 ms [17.497 ms, 17.855 ms] -641.116 µs (-3.5%)
iast 17.578 ms [17.402 ms, 17.755 ms] -739.044 µs (-4.0%)
profiling 18.791 ms [18.604 ms, 18.979 ms] 474.17 µs (2.6%)
tracing 17.71 ms [17.536 ms, 17.884 ms] -607.122 µs (-3.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.048 ms [17.865 ms, 18.23 ms] -
appsec 18.834 ms [18.641 ms, 19.027 ms] 786.298 µs (4.4%)
code_origins 17.664 ms [17.49 ms, 17.838 ms] -383.9 µs (-2.1%)
iast 17.863 ms [17.684 ms, 18.043 ms] -184.445 µs (-1.0%)
profiling 18.433 ms [18.248 ms, 18.617 ms] 384.853 µs (2.1%)
tracing 17.765 ms [17.589 ms, 17.941 ms] -283.201 µs (-1.6%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~1fa8492f79, baseline=1.60.0-SNAPSHOT~81efdf7f07
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.21 ms) : 1198, 1221
.   : milestone, 1210,
iast (3.16 ms) : 3117, 3203
.   : milestone, 3160,
iast_FULL (5.936 ms) : 5877, 5996
.   : milestone, 5936,
iast_GLOBAL (3.497 ms) : 3442, 3552
.   : milestone, 3497,
profiling (2.126 ms) : 2107, 2146
.   : milestone, 2126,
tracing (1.855 ms) : 1838, 1872
.   : milestone, 1855,
section candidate
no_agent (1.18 ms) : 1168, 1191
.   : milestone, 1180,
iast (3.19 ms) : 3149, 3230
.   : milestone, 3190,
iast_FULL (5.899 ms) : 5840, 5959
.   : milestone, 5899,
iast_GLOBAL (3.619 ms) : 3554, 3684
.   : milestone, 3619,
profiling (2.108 ms) : 2089, 2127
.   : milestone, 2108,
tracing (1.762 ms) : 1748, 1777
.   : milestone, 1762,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.21 ms [1.198 ms, 1.221 ms] -
iast 3.16 ms [3.117 ms, 3.203 ms] 1.951 ms (161.3%)
iast_FULL 5.936 ms [5.877 ms, 5.996 ms] 4.727 ms (390.8%)
iast_GLOBAL 3.497 ms [3.442 ms, 3.552 ms] 2.288 ms (189.1%)
profiling 2.126 ms [2.107 ms, 2.146 ms] 916.684 µs (75.8%)
tracing 1.855 ms [1.838 ms, 1.872 ms] 645.363 µs (53.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.18 ms [1.168 ms, 1.191 ms] -
iast 3.19 ms [3.149 ms, 3.23 ms] 2.01 ms (170.4%)
iast_FULL 5.899 ms [5.84 ms, 5.959 ms] 4.72 ms (400.1%)
iast_GLOBAL 3.619 ms [3.554 ms, 3.684 ms] 2.44 ms (206.8%)
profiling 2.108 ms [2.089 ms, 2.127 ms] 928.462 µs (78.7%)
tracing 1.762 ms [1.748 ms, 1.777 ms] 582.424 µs (49.4%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/upgrade-jctools
git_commit_date 1772150287 1772180169
git_commit_sha 81efdf7 1fa8492
release_version 1.60.0-SNAPSHOT~81efdf7f07 1.60.0-SNAPSHOT~1fa8492f79
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1772182477 1772182477
ci_job_id 1461614500 1461614500
ci_pipeline_id 99357078 99357078
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-ymcmcj9b 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-ymcmcj9b 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:dacapo:tomcat:appsec better
[-1.495ms; -1.139ms] or [-39.254%; -29.915%]
2.492ms 3.809ms
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~1fa8492f79, baseline=1.60.0-SNAPSHOT~81efdf7f07
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.63 s) : 15630000, 15630000
.   : milestone, 15630000,
appsec (15.055 s) : 15055000, 15055000
.   : milestone, 15055000,
iast (18.001 s) : 18001000, 18001000
.   : milestone, 18001000,
iast_GLOBAL (17.681 s) : 17681000, 17681000
.   : milestone, 17681000,
profiling (14.722 s) : 14722000, 14722000
.   : milestone, 14722000,
tracing (14.639 s) : 14639000, 14639000
.   : milestone, 14639000,
section candidate
no_agent (15.403 s) : 15403000, 15403000
.   : milestone, 15403000,
appsec (14.716 s) : 14716000, 14716000
.   : milestone, 14716000,
iast (17.839 s) : 17839000, 17839000
.   : milestone, 17839000,
iast_GLOBAL (17.684 s) : 17684000, 17684000
.   : milestone, 17684000,
profiling (15.108 s) : 15108000, 15108000
.   : milestone, 15108000,
tracing (14.82 s) : 14820000, 14820000
.   : milestone, 14820000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.63 s [15.63 s, 15.63 s] -
appsec 15.055 s [15.055 s, 15.055 s] -575.0 ms (-3.7%)
iast 18.001 s [18.001 s, 18.001 s] 2.371 s (15.2%)
iast_GLOBAL 17.681 s [17.681 s, 17.681 s] 2.051 s (13.1%)
profiling 14.722 s [14.722 s, 14.722 s] -908.0 ms (-5.8%)
tracing 14.639 s [14.639 s, 14.639 s] -991.0 ms (-6.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.403 s [15.403 s, 15.403 s] -
appsec 14.716 s [14.716 s, 14.716 s] -687.0 ms (-4.5%)
iast 17.839 s [17.839 s, 17.839 s] 2.436 s (15.8%)
iast_GLOBAL 17.684 s [17.684 s, 17.684 s] 2.281 s (14.8%)
profiling 15.108 s [15.108 s, 15.108 s] -295.0 ms (-1.9%)
tracing 14.82 s [14.82 s, 14.82 s] -583.0 ms (-3.8%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~1fa8492f79, baseline=1.60.0-SNAPSHOT~81efdf7f07
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.471 ms) : 1460, 1483
.   : milestone, 1471,
appsec (3.809 ms) : 3581, 4036
.   : milestone, 3809,
iast (2.245 ms) : 2176, 2314
.   : milestone, 2245,
iast_GLOBAL (2.286 ms) : 2217, 2355
.   : milestone, 2286,
profiling (2.078 ms) : 2022, 2134
.   : milestone, 2078,
tracing (2.054 ms) : 2001, 2108
.   : milestone, 2054,
section candidate
no_agent (1.471 ms) : 1460, 1483
.   : milestone, 1471,
appsec (2.492 ms) : 2437, 2546
.   : milestone, 2492,
iast (2.245 ms) : 2176, 2314
.   : milestone, 2245,
iast_GLOBAL (2.288 ms) : 2219, 2358
.   : milestone, 2288,
profiling (2.069 ms) : 2015, 2124
.   : milestone, 2069,
tracing (2.047 ms) : 1994, 2100
.   : milestone, 2047,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.471 ms [1.46 ms, 1.483 ms] -
appsec 3.809 ms [3.581 ms, 4.036 ms] 2.337 ms (158.9%)
iast 2.245 ms [2.176 ms, 2.314 ms] 773.76 µs (52.6%)
iast_GLOBAL 2.286 ms [2.217 ms, 2.355 ms] 814.515 µs (55.4%)
profiling 2.078 ms [2.022 ms, 2.134 ms] 606.61 µs (41.2%)
tracing 2.054 ms [2.001 ms, 2.108 ms] 582.974 µs (39.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.471 ms [1.46 ms, 1.483 ms] -
appsec 2.492 ms [2.437 ms, 2.546 ms] 1.02 ms (69.3%)
iast 2.245 ms [2.176 ms, 2.314 ms] 773.456 µs (52.6%)
iast_GLOBAL 2.288 ms [2.219 ms, 2.358 ms] 816.867 µs (55.5%)
profiling 2.069 ms [2.015 ms, 2.124 ms] 597.823 µs (40.6%)
tracing 2.047 ms [1.994 ms, 2.1 ms] 575.681 µs (39.1%)