Add DD_OTLP_METRICS_COMPRESSION setting and map OTel env-vars to it by mcculls · Pull Request #10680 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/otlp-compression-config
git_commit_date 1772057559 1772057609
git_commit_sha ae623a8 477fe57
release_version 1.60.0-SNAPSHOT~ae623a861f 1.60.0-SNAPSHOT~477fe57e98
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1772059552 1772059552
ci_job_id 1457350229 1457350229
ci_pipeline_id 99017024 99017024
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-zzctk2s9 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-zzctk2s9 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 60 metrics, 11 unstable metrics.

Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~477fe57e98, baseline=1.60.0-SNAPSHOT~ae623a861f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.074 s) : 0, 1073899
Total [baseline] (8.764 s) : 0, 8764458
Agent [candidate] (1.064 s) : 0, 1063816
Total [candidate] (8.789 s) : 0, 8789432
section iast
Agent [baseline] (1.237 s) : 0, 1236728
Total [baseline] (9.387 s) : 0, 9386515
Agent [candidate] (1.251 s) : 0, 1251153
Total [candidate] (9.4 s) : 0, 9399737
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.074 s -
Agent iast 1.237 s 162.829 ms (15.2%)
Total tracing 8.764 s -
Total iast 9.387 s 622.057 ms (7.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.064 s -
Agent iast 1.251 s 187.337 ms (17.6%)
Total tracing 8.789 s -
Total iast 9.4 s 610.306 ms (6.9%)
gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~477fe57e98, baseline=1.60.0-SNAPSHOT~ae623a861f

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.22 ms) : 0, 1220
crashtracking [candidate] (1.189 ms) : 0, 1189
BytebuddyAgent [baseline] (633.642 ms) : 0, 633642
BytebuddyAgent [candidate] (627.65 ms) : 0, 627650
AgentMeter [baseline] (29.345 ms) : 0, 29345
AgentMeter [candidate] (29.024 ms) : 0, 29024
GlobalTracer [baseline] (259.589 ms) : 0, 259589
GlobalTracer [candidate] (257.178 ms) : 0, 257178
AppSec [baseline] (33.051 ms) : 0, 33051
AppSec [candidate] (32.811 ms) : 0, 32811
Debugger [baseline] (65.56 ms) : 0, 65560
Debugger [candidate] (64.04 ms) : 0, 64040
Remote Config [baseline] (622.675 µs) : 0, 623
Remote Config [candidate] (614.629 µs) : 0, 615
Telemetry [baseline] (9.895 ms) : 0, 9895
Telemetry [candidate] (9.909 ms) : 0, 9909
Flare Poller [baseline] (4.546 ms) : 0, 4546
Flare Poller [candidate] (5.392 ms) : 0, 5392
section iast
crashtracking [baseline] (1.201 ms) : 0, 1201
crashtracking [candidate] (1.225 ms) : 0, 1225
BytebuddyAgent [baseline] (800.037 ms) : 0, 800037
BytebuddyAgent [candidate] (810.217 ms) : 0, 810217
AgentMeter [baseline] (11.542 ms) : 0, 11542
AgentMeter [candidate] (11.872 ms) : 0, 11872
GlobalTracer [baseline] (248.581 ms) : 0, 248581
GlobalTracer [candidate] (250.92 ms) : 0, 250920
AppSec [baseline] (33.387 ms) : 0, 33387
AppSec [candidate] (33.604 ms) : 0, 33604
Debugger [baseline] (66.158 ms) : 0, 66158
Debugger [candidate] (66.847 ms) : 0, 66847
Remote Config [baseline] (540.179 µs) : 0, 540
Remote Config [candidate] (528.991 µs) : 0, 529
Telemetry [baseline] (8.541 ms) : 0, 8541
Telemetry [candidate] (8.589 ms) : 0, 8589
Flare Poller [baseline] (3.398 ms) : 0, 3398
Flare Poller [candidate] (3.424 ms) : 0, 3424
IAST [baseline] (27.093 ms) : 0, 27093
IAST [candidate] (27.492 ms) : 0, 27492
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~477fe57e98, baseline=1.60.0-SNAPSHOT~ae623a861f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.068 s) : 0, 1068445
Total [baseline] (10.885 s) : 0, 10884649
Agent [candidate] (1.066 s) : 0, 1065525
Total [candidate] (10.962 s) : 0, 10962105
section appsec
Agent [baseline] (1.239 s) : 0, 1239007
Total [baseline] (11.131 s) : 0, 11130512
Agent [candidate] (1.237 s) : 0, 1237099
Total [candidate] (10.941 s) : 0, 10941044
section iast
Agent [baseline] (1.233 s) : 0, 1233266
Total [baseline] (11.258 s) : 0, 11258030
Agent [candidate] (1.239 s) : 0, 1238687
Total [candidate] (11.167 s) : 0, 11167026
section profiling
Agent [baseline] (1.194 s) : 0, 1193858
Total [baseline] (10.942 s) : 0, 10941749
Agent [candidate] (1.198 s) : 0, 1197770
Total [candidate] (10.942 s) : 0, 10941715
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.068 s -
Agent appsec 1.239 s 170.562 ms (16.0%)
Agent iast 1.233 s 164.821 ms (15.4%)
Agent profiling 1.194 s 125.414 ms (11.7%)
Total tracing 10.885 s -
Total appsec 11.131 s 245.863 ms (2.3%)
Total iast 11.258 s 373.381 ms (3.4%)
Total profiling 10.942 s 57.1 ms (0.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.066 s -
Agent appsec 1.237 s 171.573 ms (16.1%)
Agent iast 1.239 s 173.162 ms (16.3%)
Agent profiling 1.198 s 132.245 ms (12.4%)
Total tracing 10.962 s -
Total appsec 10.941 s -21.061 ms (-0.2%)
Total iast 11.167 s 204.921 ms (1.9%)
Total profiling 10.942 s -20.39 ms (-0.2%)
gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~477fe57e98, baseline=1.60.0-SNAPSHOT~ae623a861f

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.188 ms) : 0, 1188
crashtracking [candidate] (1.185 ms) : 0, 1185
BytebuddyAgent [baseline] (629.251 ms) : 0, 629251
BytebuddyAgent [candidate] (628.302 ms) : 0, 628302
AgentMeter [baseline] (29.213 ms) : 0, 29213
AgentMeter [candidate] (29.147 ms) : 0, 29147
GlobalTracer [baseline] (258.469 ms) : 0, 258469
GlobalTracer [candidate] (257.632 ms) : 0, 257632
AppSec [baseline] (32.923 ms) : 0, 32923
AppSec [candidate] (32.942 ms) : 0, 32942
Debugger [baseline] (63.781 ms) : 0, 63781
Debugger [candidate] (66.039 ms) : 0, 66039
Remote Config [baseline] (619.926 µs) : 0, 620
Remote Config [candidate] (605.815 µs) : 0, 606
Telemetry [baseline] (12.37 ms) : 0, 12370
Telemetry [candidate] (9.087 ms) : 0, 9087
Flare Poller [baseline] (4.531 ms) : 0, 4531
Flare Poller [candidate] (4.52 ms) : 0, 4520
section appsec
crashtracking [baseline] (1.192 ms) : 0, 1192
crashtracking [candidate] (1.18 ms) : 0, 1180
BytebuddyAgent [baseline] (657.249 ms) : 0, 657249
BytebuddyAgent [candidate] (655.98 ms) : 0, 655980
AgentMeter [baseline] (11.864 ms) : 0, 11864
AgentMeter [candidate] (11.921 ms) : 0, 11921
GlobalTracer [baseline] (258.375 ms) : 0, 258375
GlobalTracer [candidate] (258.174 ms) : 0, 258174
AppSec [baseline] (168.082 ms) : 0, 168082
AppSec [candidate] (167.635 ms) : 0, 167635
Debugger [baseline] (66.866 ms) : 0, 66866
Debugger [candidate] (66.991 ms) : 0, 66991
Remote Config [baseline] (660.701 µs) : 0, 661
Remote Config [candidate] (646.931 µs) : 0, 647
Telemetry [baseline] (9.372 ms) : 0, 9372
Telemetry [candidate] (9.526 ms) : 0, 9526
Flare Poller [baseline] (3.758 ms) : 0, 3758
Flare Poller [candidate] (3.712 ms) : 0, 3712
IAST [baseline] (25.533 ms) : 0, 25533
IAST [candidate] (25.359 ms) : 0, 25359
section iast
crashtracking [baseline] (1.193 ms) : 0, 1193
crashtracking [candidate] (1.198 ms) : 0, 1198
BytebuddyAgent [baseline] (795.789 ms) : 0, 795789
BytebuddyAgent [candidate] (801.303 ms) : 0, 801303
AgentMeter [baseline] (11.242 ms) : 0, 11242
AgentMeter [candidate] (11.561 ms) : 0, 11561
GlobalTracer [baseline] (248.119 ms) : 0, 248119
GlobalTracer [candidate] (248.089 ms) : 0, 248089
AppSec [baseline] (34.781 ms) : 0, 34781
AppSec [candidate] (34.229 ms) : 0, 34229
Debugger [baseline] (66.233 ms) : 0, 66233
Debugger [candidate] (66.531 ms) : 0, 66531
Remote Config [baseline] (542.484 µs) : 0, 542
Remote Config [candidate] (532.248 µs) : 0, 532
Telemetry [baseline] (8.734 ms) : 0, 8734
Telemetry [candidate] (8.646 ms) : 0, 8646
Flare Poller [baseline] (3.511 ms) : 0, 3511
Flare Poller [candidate] (3.454 ms) : 0, 3454
IAST [baseline] (27.03 ms) : 0, 27030
IAST [candidate] (26.983 ms) : 0, 26983
section profiling
crashtracking [baseline] (1.177 ms) : 0, 1177
crashtracking [candidate] (1.179 ms) : 0, 1179
BytebuddyAgent [baseline] (684.394 ms) : 0, 684394
BytebuddyAgent [candidate] (685.995 ms) : 0, 685995
AgentMeter [baseline] (8.641 ms) : 0, 8641
AgentMeter [candidate] (8.613 ms) : 0, 8613
GlobalTracer [baseline] (216.641 ms) : 0, 216641
GlobalTracer [candidate] (217.243 ms) : 0, 217243
AppSec [baseline] (32.516 ms) : 0, 32516
AppSec [candidate] (32.705 ms) : 0, 32705
Debugger [baseline] (67.453 ms) : 0, 67453
Debugger [candidate] (67.576 ms) : 0, 67576
Remote Config [baseline] (637.896 µs) : 0, 638
Remote Config [candidate] (626.757 µs) : 0, 627
Telemetry [baseline] (9.14 ms) : 0, 9140
Telemetry [candidate] (8.949 ms) : 0, 8949
Flare Poller [baseline] (3.747 ms) : 0, 3747
Flare Poller [candidate] (3.715 ms) : 0, 3715
ProfilingAgent [baseline] (98.8 ms) : 0, 98800
ProfilingAgent [candidate] (100.085 ms) : 0, 100085
Profiling [baseline] (99.381 ms) : 0, 99381
Profiling [candidate] (100.652 ms) : 0, 100652
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/otlp-compression-config
git_commit_date 1772057559 1772057609
git_commit_sha ae623a8 477fe57
release_version 1.60.0-SNAPSHOT~ae623a861f 1.60.0-SNAPSHOT~477fe57e98
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1772060044 1772060044
ci_job_id 1457350230 1457350230
ci_pipeline_id 99017024 99017024
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-arrgsn57 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-arrgsn57 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 1 performance regressions! Performance is the same for 19 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:petclinic:no_agent:high_load worse
[+0.778ms; +2.340ms] or [+4.745%; +14.272%]
unstable
[+0.586ms; +4.040ms] or [+2.100%; +14.474%]
unstable
[-46.638op/s; +9.138op/s] or [-16.971%; +3.325%]
17.957ms 30.229ms 256.062op/s 16.398ms 27.915ms 274.812op/s
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~477fe57e98, baseline=1.60.0-SNAPSHOT~ae623a861f
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.232 ms) : 1219, 1245
.   : milestone, 1232,
iast (3.209 ms) : 3167, 3252
.   : milestone, 3209,
iast_FULL (5.644 ms) : 5589, 5699
.   : milestone, 5644,
iast_GLOBAL (3.551 ms) : 3492, 3611
.   : milestone, 3551,
profiling (2.18 ms) : 2158, 2202
.   : milestone, 2180,
tracing (1.798 ms) : 1784, 1813
.   : milestone, 1798,
section candidate
no_agent (1.176 ms) : 1164, 1187
.   : milestone, 1176,
iast (3.205 ms) : 3161, 3249
.   : milestone, 3205,
iast_FULL (5.742 ms) : 5685, 5798
.   : milestone, 5742,
iast_GLOBAL (3.496 ms) : 3441, 3552
.   : milestone, 3496,
profiling (2.069 ms) : 2050, 2089
.   : milestone, 2069,
tracing (1.767 ms) : 1754, 1781
.   : milestone, 1767,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.232 ms [1.219 ms, 1.245 ms] -
iast 3.209 ms [3.167 ms, 3.252 ms] 1.978 ms (160.6%)
iast_FULL 5.644 ms [5.589 ms, 5.699 ms] 4.412 ms (358.2%)
iast_GLOBAL 3.551 ms [3.492 ms, 3.611 ms] 2.32 ms (188.3%)
profiling 2.18 ms [2.158 ms, 2.202 ms] 948.618 µs (77.0%)
tracing 1.798 ms [1.784 ms, 1.813 ms] 566.615 µs (46.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.176 ms [1.164 ms, 1.187 ms] -
iast 3.205 ms [3.161 ms, 3.249 ms] 2.03 ms (172.7%)
iast_FULL 5.742 ms [5.685 ms, 5.798 ms] 4.566 ms (388.4%)
iast_GLOBAL 3.496 ms [3.441 ms, 3.552 ms] 2.321 ms (197.4%)
profiling 2.069 ms [2.05 ms, 2.089 ms] 893.836 µs (76.0%)
tracing 1.767 ms [1.754 ms, 1.781 ms] 591.735 µs (50.3%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~477fe57e98, baseline=1.60.0-SNAPSHOT~ae623a861f
    dateFormat X
    axisFormat %s
section baseline
no_agent (16.98 ms) : 16813, 17148
.   : milestone, 16980,
appsec (18.602 ms) : 18414, 18789
.   : milestone, 18602,
code_origins (17.55 ms) : 17377, 17724
.   : milestone, 17550,
iast (17.652 ms) : 17478, 17827
.   : milestone, 17652,
profiling (19.113 ms) : 18925, 19302
.   : milestone, 19113,
tracing (17.779 ms) : 17603, 17955
.   : milestone, 17779,
section candidate
no_agent (18.227 ms) : 18038, 18417
.   : milestone, 18227,
appsec (18.506 ms) : 18323, 18688
.   : milestone, 18506,
code_origins (17.602 ms) : 17427, 17777
.   : milestone, 17602,
iast (17.78 ms) : 17601, 17958
.   : milestone, 17780,
profiling (18.662 ms) : 18478, 18846
.   : milestone, 18662,
tracing (17.736 ms) : 17560, 17912
.   : milestone, 17736,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 16.98 ms [16.813 ms, 17.148 ms] -
appsec 18.602 ms [18.414 ms, 18.789 ms] 1.621 ms (9.5%)
code_origins 17.55 ms [17.377 ms, 17.724 ms] 569.914 µs (3.4%)
iast 17.652 ms [17.478 ms, 17.827 ms] 671.945 µs (4.0%)
profiling 19.113 ms [18.925 ms, 19.302 ms] 2.133 ms (12.6%)
tracing 17.779 ms [17.603 ms, 17.955 ms] 798.438 µs (4.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.227 ms [18.038 ms, 18.417 ms] -
appsec 18.506 ms [18.323 ms, 18.688 ms] 278.256 µs (1.5%)
code_origins 17.602 ms [17.427 ms, 17.777 ms] -625.179 µs (-3.4%)
iast 17.78 ms [17.601 ms, 17.958 ms] -447.648 µs (-2.5%)
profiling 18.662 ms [18.478 ms, 18.846 ms] 434.653 µs (2.4%)
tracing 17.736 ms [17.56 ms, 17.912 ms] -491.207 µs (-2.7%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/otlp-compression-config
git_commit_date 1772057559 1772057609
git_commit_sha ae623a8 477fe57
release_version 1.60.0-SNAPSHOT~ae623a861f 1.60.0-SNAPSHOT~477fe57e98
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1772059777 1772059777
ci_job_id 1457350231 1457350231
ci_pipeline_id 99017024 99017024
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-cv22p4bh 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-cv22p4bh 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~477fe57e98, baseline=1.60.0-SNAPSHOT~ae623a861f
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.93 s) : 14930000, 14930000
.   : milestone, 14930000,
appsec (14.884 s) : 14884000, 14884000
.   : milestone, 14884000,
iast (17.954 s) : 17954000, 17954000
.   : milestone, 17954000,
iast_GLOBAL (17.602 s) : 17602000, 17602000
.   : milestone, 17602000,
profiling (14.834 s) : 14834000, 14834000
.   : milestone, 14834000,
tracing (14.755 s) : 14755000, 14755000
.   : milestone, 14755000,
section candidate
no_agent (14.927 s) : 14927000, 14927000
.   : milestone, 14927000,
appsec (14.943 s) : 14943000, 14943000
.   : milestone, 14943000,
iast (18.265 s) : 18265000, 18265000
.   : milestone, 18265000,
iast_GLOBAL (17.763 s) : 17763000, 17763000
.   : milestone, 17763000,
profiling (14.813 s) : 14813000, 14813000
.   : milestone, 14813000,
tracing (14.704 s) : 14704000, 14704000
.   : milestone, 14704000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.93 s [14.93 s, 14.93 s] -
appsec 14.884 s [14.884 s, 14.884 s] -46.0 ms (-0.3%)
iast 17.954 s [17.954 s, 17.954 s] 3.024 s (20.3%)
iast_GLOBAL 17.602 s [17.602 s, 17.602 s] 2.672 s (17.9%)
profiling 14.834 s [14.834 s, 14.834 s] -96.0 ms (-0.6%)
tracing 14.755 s [14.755 s, 14.755 s] -175.0 ms (-1.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.927 s [14.927 s, 14.927 s] -
appsec 14.943 s [14.943 s, 14.943 s] 16.0 ms (0.1%)
iast 18.265 s [18.265 s, 18.265 s] 3.338 s (22.4%)
iast_GLOBAL 17.763 s [17.763 s, 17.763 s] 2.836 s (19.0%)
profiling 14.813 s [14.813 s, 14.813 s] -114.0 ms (-0.8%)
tracing 14.704 s [14.704 s, 14.704 s] -223.0 ms (-1.5%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~477fe57e98, baseline=1.60.0-SNAPSHOT~ae623a861f
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.473 ms) : 1461, 1484
.   : milestone, 1473,
appsec (3.781 ms) : 3560, 4002
.   : milestone, 3781,
iast (2.252 ms) : 2183, 2321
.   : milestone, 2252,
iast_GLOBAL (2.296 ms) : 2227, 2366
.   : milestone, 2296,
profiling (2.086 ms) : 2030, 2142
.   : milestone, 2086,
tracing (2.07 ms) : 2016, 2124
.   : milestone, 2070,
section candidate
no_agent (1.472 ms) : 1460, 1483
.   : milestone, 1472,
appsec (3.763 ms) : 3542, 3984
.   : milestone, 3763,
iast (2.246 ms) : 2178, 2315
.   : milestone, 2246,
iast_GLOBAL (2.285 ms) : 2216, 2354
.   : milestone, 2285,
profiling (2.069 ms) : 2015, 2123
.   : milestone, 2069,
tracing (2.054 ms) : 2001, 2107
.   : milestone, 2054,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.473 ms [1.461 ms, 1.484 ms] -
appsec 3.781 ms [3.56 ms, 4.002 ms] 2.308 ms (156.8%)
iast 2.252 ms [2.183 ms, 2.321 ms] 779.245 µs (52.9%)
iast_GLOBAL 2.296 ms [2.227 ms, 2.366 ms] 823.503 µs (55.9%)
profiling 2.086 ms [2.03 ms, 2.142 ms] 613.592 µs (41.7%)
tracing 2.07 ms [2.016 ms, 2.124 ms] 597.658 µs (40.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.472 ms [1.46 ms, 1.483 ms] -
appsec 3.763 ms [3.542 ms, 3.984 ms] 2.291 ms (155.7%)
iast 2.246 ms [2.178 ms, 2.315 ms] 774.718 µs (52.6%)
iast_GLOBAL 2.285 ms [2.216 ms, 2.354 ms] 813.143 µs (55.3%)
profiling 2.069 ms [2.015 ms, 2.123 ms] 597.195 µs (40.6%)
tracing 2.054 ms [2.001 ms, 2.107 ms] 582.293 µs (39.6%)