Bump aircompressor to 2.0.3 by jbachorik · Pull Request #10673 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jb/aircompressor
git_commit_date 1771954806 1771956063
git_commit_sha f453b4e 8dc7084
release_version 1.60.0-SNAPSHOT~f453b4e500 1.60.0-SNAPSHOT~8dc708493c
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1771957980 1771957980
ci_job_id 1452674377 1452674377
ci_pipeline_id 98639189 98639189
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-2xbsr1jk 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-2xbsr1jk 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 62 metrics, 9 unstable metrics.

Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~8dc708493c, baseline=1.60.0-SNAPSHOT~f453b4e500

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.071 s) : 0, 1070788
Total [baseline] (10.895 s) : 0, 10894858
Agent [candidate] (1.074 s) : 0, 1074159
Total [candidate] (10.902 s) : 0, 10902150
section appsec
Agent [baseline] (1.25 s) : 0, 1250295
Total [baseline] (11.079 s) : 0, 11079127
Agent [candidate] (1.236 s) : 0, 1235955
Total [candidate] (10.909 s) : 0, 10909128
section iast
Agent [baseline] (1.229 s) : 0, 1229474
Total [baseline] (11.189 s) : 0, 11189020
Agent [candidate] (1.228 s) : 0, 1228076
Total [candidate] (11.129 s) : 0, 11128601
section profiling
Agent [baseline] (1.19 s) : 0, 1189515
Total [baseline] (10.976 s) : 0, 10975903
Agent [candidate] (1.198 s) : 0, 1198402
Total [candidate] (10.953 s) : 0, 10952878
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.071 s -
Agent appsec 1.25 s 179.508 ms (16.8%)
Agent iast 1.229 s 158.687 ms (14.8%)
Agent profiling 1.19 s 118.727 ms (11.1%)
Total tracing 10.895 s -
Total appsec 11.079 s 184.269 ms (1.7%)
Total iast 11.189 s 294.162 ms (2.7%)
Total profiling 10.976 s 81.045 ms (0.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.074 s -
Agent appsec 1.236 s 161.797 ms (15.1%)
Agent iast 1.228 s 153.917 ms (14.3%)
Agent profiling 1.198 s 124.243 ms (11.6%)
Total tracing 10.902 s -
Total appsec 10.909 s 6.978 ms (0.1%)
Total iast 11.129 s 226.451 ms (2.1%)
Total profiling 10.953 s 50.728 ms (0.5%)
gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~8dc708493c, baseline=1.60.0-SNAPSHOT~f453b4e500

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.212 ms) : 0, 1212
crashtracking [candidate] (1.218 ms) : 0, 1218
BytebuddyAgent [baseline] (631.569 ms) : 0, 631569
BytebuddyAgent [candidate] (632.491 ms) : 0, 632491
AgentMeter [baseline] (29.283 ms) : 0, 29283
AgentMeter [candidate] (29.331 ms) : 0, 29331
GlobalTracer [baseline] (258.543 ms) : 0, 258543
GlobalTracer [candidate] (260.355 ms) : 0, 260355
AppSec [baseline] (33.189 ms) : 0, 33189
AppSec [candidate] (33.515 ms) : 0, 33515
Debugger [baseline] (64.941 ms) : 0, 64941
Debugger [candidate] (64.021 ms) : 0, 64021
Remote Config [baseline] (607.356 µs) : 0, 607
Remote Config [candidate] (626.862 µs) : 0, 627
Telemetry [baseline] (9.862 ms) : 0, 9862
Telemetry [candidate] (12.478 ms) : 0, 12478
Flare Poller [baseline] (5.355 ms) : 0, 5355
Flare Poller [candidate] (3.791 ms) : 0, 3791
section appsec
crashtracking [baseline] (1.206 ms) : 0, 1206
crashtracking [candidate] (1.206 ms) : 0, 1206
BytebuddyAgent [baseline] (665.096 ms) : 0, 665096
BytebuddyAgent [candidate] (656.11 ms) : 0, 656110
AgentMeter [baseline] (12.055 ms) : 0, 12055
AgentMeter [candidate] (11.844 ms) : 0, 11844
GlobalTracer [baseline] (260.374 ms) : 0, 260374
GlobalTracer [candidate] (257.347 ms) : 0, 257347
IAST [baseline] (25.713 ms) : 0, 25713
IAST [candidate] (25.568 ms) : 0, 25568
AppSec [baseline] (168.69 ms) : 0, 168690
AppSec [candidate] (167.877 ms) : 0, 167877
Debugger [baseline] (66.983 ms) : 0, 66983
Debugger [candidate] (66.366 ms) : 0, 66366
Remote Config [baseline] (642.248 µs) : 0, 642
Remote Config [candidate] (637.884 µs) : 0, 638
Telemetry [baseline] (9.513 ms) : 0, 9513
Telemetry [candidate] (9.421 ms) : 0, 9421
Flare Poller [baseline] (3.674 ms) : 0, 3674
Flare Poller [candidate] (3.558 ms) : 0, 3558
section iast
crashtracking [baseline] (1.199 ms) : 0, 1199
crashtracking [candidate] (1.2 ms) : 0, 1200
BytebuddyAgent [baseline] (794.241 ms) : 0, 794241
BytebuddyAgent [candidate] (793.542 ms) : 0, 793542
AgentMeter [baseline] (11.271 ms) : 0, 11271
AgentMeter [candidate] (11.262 ms) : 0, 11262
GlobalTracer [baseline] (246.743 ms) : 0, 246743
GlobalTracer [candidate] (246.714 ms) : 0, 246714
IAST [baseline] (27.084 ms) : 0, 27084
IAST [candidate] (26.791 ms) : 0, 26791
AppSec [baseline] (34.871 ms) : 0, 34871
AppSec [candidate] (33.773 ms) : 0, 33773
Debugger [baseline] (65.53 ms) : 0, 65530
Debugger [candidate] (66.255 ms) : 0, 66255
Remote Config [baseline] (560.631 µs) : 0, 561
Remote Config [candidate] (525.755 µs) : 0, 526
Telemetry [baseline] (8.58 ms) : 0, 8580
Telemetry [candidate] (8.592 ms) : 0, 8592
Flare Poller [baseline] (3.437 ms) : 0, 3437
Flare Poller [candidate] (3.399 ms) : 0, 3399
section profiling
crashtracking [baseline] (1.185 ms) : 0, 1185
crashtracking [candidate] (1.185 ms) : 0, 1185
BytebuddyAgent [baseline] (680.393 ms) : 0, 680393
BytebuddyAgent [candidate] (686.044 ms) : 0, 686044
AgentMeter [baseline] (8.599 ms) : 0, 8599
AgentMeter [candidate] (8.622 ms) : 0, 8622
GlobalTracer [baseline] (215.618 ms) : 0, 215618
GlobalTracer [candidate] (217.258 ms) : 0, 217258
AppSec [baseline] (32.504 ms) : 0, 32504
AppSec [candidate] (32.863 ms) : 0, 32863
Debugger [baseline] (67.315 ms) : 0, 67315
Debugger [candidate] (67.864 ms) : 0, 67864
Remote Config [baseline] (632.364 µs) : 0, 632
Remote Config [candidate] (641.849 µs) : 0, 642
Telemetry [baseline] (9.04 ms) : 0, 9040
Telemetry [candidate] (8.99 ms) : 0, 8990
Flare Poller [baseline] (3.778 ms) : 0, 3778
Flare Poller [candidate] (3.816 ms) : 0, 3816
ProfilingAgent [baseline] (99.818 ms) : 0, 99818
ProfilingAgent [candidate] (100.159 ms) : 0, 100159
Profiling [baseline] (100.397 ms) : 0, 100397
Profiling [candidate] (100.742 ms) : 0, 100742
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~8dc708493c, baseline=1.60.0-SNAPSHOT~f453b4e500

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.076 s) : 0, 1075868
Total [baseline] (8.818 s) : 0, 8817606
Agent [candidate] (1.065 s) : 0, 1065307
Total [candidate] (8.717 s) : 0, 8716786
section iast
Agent [baseline] (1.236 s) : 0, 1235835
Total [baseline] (9.365 s) : 0, 9365027
Agent [candidate] (1.23 s) : 0, 1229701
Total [candidate] (9.343 s) : 0, 9342977
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.076 s -
Agent iast 1.236 s 159.967 ms (14.9%)
Total tracing 8.818 s -
Total iast 9.365 s 547.421 ms (6.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.065 s -
Agent iast 1.23 s 164.394 ms (15.4%)
Total tracing 8.717 s -
Total iast 9.343 s 626.191 ms (7.2%)
gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~8dc708493c, baseline=1.60.0-SNAPSHOT~f453b4e500

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.24 ms) : 0, 1240
crashtracking [candidate] (1.203 ms) : 0, 1203
BytebuddyAgent [baseline] (634.787 ms) : 0, 634787
BytebuddyAgent [candidate] (627.787 ms) : 0, 627787
AgentMeter [baseline] (29.442 ms) : 0, 29442
AgentMeter [candidate] (29.053 ms) : 0, 29053
GlobalTracer [baseline] (259.676 ms) : 0, 259676
GlobalTracer [candidate] (257.212 ms) : 0, 257212
AppSec [baseline] (33.35 ms) : 0, 33350
AppSec [candidate] (32.928 ms) : 0, 32928
Debugger [baseline] (64.234 ms) : 0, 64234
Debugger [candidate] (65.09 ms) : 0, 65090
Remote Config [baseline] (615.078 µs) : 0, 615
Remote Config [candidate] (600.173 µs) : 0, 600
Telemetry [baseline] (10.011 ms) : 0, 10011
Telemetry [candidate] (9.124 ms) : 0, 9124
Flare Poller [baseline] (6.157 ms) : 0, 6157
Flare Poller [candidate] (6.149 ms) : 0, 6149
section iast
crashtracking [baseline] (1.214 ms) : 0, 1214
crashtracking [candidate] (1.205 ms) : 0, 1205
BytebuddyAgent [baseline] (799.017 ms) : 0, 799017
BytebuddyAgent [candidate] (794.744 ms) : 0, 794744
AgentMeter [baseline] (11.509 ms) : 0, 11509
AgentMeter [candidate] (11.307 ms) : 0, 11307
GlobalTracer [baseline] (247.877 ms) : 0, 247877
GlobalTracer [candidate] (247.253 ms) : 0, 247253
IAST [baseline] (26.989 ms) : 0, 26989
IAST [candidate] (27.005 ms) : 0, 27005
AppSec [baseline] (34.221 ms) : 0, 34221
AppSec [candidate] (33.943 ms) : 0, 33943
Debugger [baseline] (66.124 ms) : 0, 66124
Debugger [candidate] (65.61 ms) : 0, 65610
Remote Config [baseline] (538.454 µs) : 0, 538
Remote Config [candidate] (530.215 µs) : 0, 530
Telemetry [baseline] (8.701 ms) : 0, 8701
Telemetry [candidate] (8.575 ms) : 0, 8575
Flare Poller [baseline] (3.495 ms) : 0, 3495
Flare Poller [candidate] (3.472 ms) : 0, 3472
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jb/aircompressor
git_commit_date 1771954806 1771956063
git_commit_sha f453b4e 8dc7084
release_version 1.60.0-SNAPSHOT~f453b4e500 1.60.0-SNAPSHOT~8dc708493c
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1771958379 1771958379
ci_job_id 1452674379 1452674379
ci_pipeline_id 98639189 98639189
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-pia5ly9y 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-pia5ly9y 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 4 performance regressions! Performance is the same for 14 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load worse
[+150.437µs; +277.690µs] or [+5.597%; +10.331%]
worse
[+252.178µs; +694.715µs] or [+3.339%; +9.197%]
unstable
[-229.314op/s; +64.314op/s] or [-17.122%; +4.802%]
2.902ms 8.027ms 1256.812op/s 2.688ms 7.553ms 1339.312op/s
scenario:load:petclinic:tracing:high_load better
[-1.456ms; -0.784ms] or [-7.859%; -4.231%]
better
[-2.906ms; -1.518ms] or [-9.555%; -4.990%]
unstable
[-7.605op/s; +39.918op/s] or [-3.078%; +16.157%]
17.405ms 28.201ms 263.219op/s 18.525ms 30.413ms 247.062op/s
scenario:load:petclinic:appsec:high_load worse
[+1.054ms; +1.923ms] or [+5.867%; +10.703%]
worse
[+0.840ms; +2.336ms] or [+2.830%; +7.873%]
unstable
[-39.437op/s; +6.312op/s] or [-15.551%; +2.489%]
19.457ms 31.267ms 237.031op/s 17.968ms 29.678ms 253.594op/s
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~8dc708493c, baseline=1.60.0-SNAPSHOT~f453b4e500
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.081 ms) : 18881, 19281
.   : milestone, 19081,
appsec (18.405 ms) : 18219, 18591
.   : milestone, 18405,
code_origins (17.683 ms) : 17511, 17856
.   : milestone, 17683,
iast (17.377 ms) : 17203, 17551
.   : milestone, 17377,
profiling (18.532 ms) : 18343, 18720
.   : milestone, 18532,
tracing (18.894 ms) : 18702, 19086
.   : milestone, 18894,
section candidate
no_agent (19.282 ms) : 19084, 19480
.   : milestone, 19282,
appsec (19.696 ms) : 19495, 19897
.   : milestone, 19696,
code_origins (17.645 ms) : 17473, 17818
.   : milestone, 17645,
iast (17.584 ms) : 17408, 17760
.   : milestone, 17584,
profiling (18.613 ms) : 18425, 18800
.   : milestone, 18613,
tracing (17.726 ms) : 17554, 17899
.   : milestone, 17726,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.081 ms [18.881 ms, 19.281 ms] -
appsec 18.405 ms [18.219 ms, 18.591 ms] -676.292 µs (-3.5%)
code_origins 17.683 ms [17.511 ms, 17.856 ms] -1.398 ms (-7.3%)
iast 17.377 ms [17.203 ms, 17.551 ms] -1.704 ms (-8.9%)
profiling 18.532 ms [18.343 ms, 18.72 ms] -549.262 µs (-2.9%)
tracing 18.894 ms [18.702 ms, 19.086 ms] -186.794 µs (-1.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.282 ms [19.084 ms, 19.48 ms] -
appsec 19.696 ms [19.495 ms, 19.897 ms] 414.443 µs (2.1%)
code_origins 17.645 ms [17.473 ms, 17.818 ms] -1.636 ms (-8.5%)
iast 17.584 ms [17.408 ms, 17.76 ms] -1.698 ms (-8.8%)
profiling 18.613 ms [18.425 ms, 18.8 ms] -669.024 µs (-3.5%)
tracing 17.726 ms [17.554 ms, 17.899 ms] -1.555 ms (-8.1%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~8dc708493c, baseline=1.60.0-SNAPSHOT~f453b4e500
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.188 ms) : 1176, 1199
.   : milestone, 1188,
iast (3.338 ms) : 3293, 3383
.   : milestone, 3338,
iast_FULL (5.846 ms) : 5787, 5905
.   : milestone, 5846,
iast_GLOBAL (3.421 ms) : 3363, 3478
.   : milestone, 3421,
profiling (1.984 ms) : 1966, 2003
.   : milestone, 1984,
tracing (1.787 ms) : 1772, 1802
.   : milestone, 1787,
section candidate
no_agent (1.201 ms) : 1187, 1216
.   : milestone, 1201,
iast (3.181 ms) : 3141, 3221
.   : milestone, 3181,
iast_FULL (5.973 ms) : 5913, 6032
.   : milestone, 5973,
iast_GLOBAL (3.65 ms) : 3594, 3707
.   : milestone, 3650,
profiling (2.126 ms) : 2107, 2146
.   : milestone, 2126,
tracing (1.823 ms) : 1808, 1839
.   : milestone, 1823,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.188 ms [1.176 ms, 1.199 ms] -
iast 3.338 ms [3.293 ms, 3.383 ms] 2.15 ms (181.1%)
iast_FULL 5.846 ms [5.787 ms, 5.905 ms] 4.658 ms (392.2%)
iast_GLOBAL 3.421 ms [3.363 ms, 3.478 ms] 2.233 ms (188.0%)
profiling 1.984 ms [1.966 ms, 2.003 ms] 796.821 µs (67.1%)
tracing 1.787 ms [1.772 ms, 1.802 ms] 599.02 µs (50.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.201 ms [1.187 ms, 1.216 ms] -
iast 3.181 ms [3.141 ms, 3.221 ms] 1.979 ms (164.7%)
iast_FULL 5.973 ms [5.913 ms, 6.032 ms] 4.771 ms (397.1%)
iast_GLOBAL 3.65 ms [3.594 ms, 3.707 ms] 2.449 ms (203.8%)
profiling 2.126 ms [2.107 ms, 2.146 ms] 924.938 µs (77.0%)
tracing 1.823 ms [1.808 ms, 1.839 ms] 622.018 µs (51.8%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jb/aircompressor
git_commit_date 1771954806 1771956063
git_commit_sha f453b4e 8dc7084
release_version 1.60.0-SNAPSHOT~f453b4e500 1.60.0-SNAPSHOT~8dc708493c
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1771958136 1771958136
ci_job_id 1452674381 1452674381
ci_pipeline_id 98639189 98639189
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-xto48jr0 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-xto48jr0 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~8dc708493c, baseline=1.60.0-SNAPSHOT~f453b4e500
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.973 s) : 14973000, 14973000
.   : milestone, 14973000,
appsec (15.096 s) : 15096000, 15096000
.   : milestone, 15096000,
iast (17.94 s) : 17940000, 17940000
.   : milestone, 17940000,
iast_GLOBAL (17.885 s) : 17885000, 17885000
.   : milestone, 17885000,
profiling (14.824 s) : 14824000, 14824000
.   : milestone, 14824000,
tracing (14.718 s) : 14718000, 14718000
.   : milestone, 14718000,
section candidate
no_agent (15.287 s) : 15287000, 15287000
.   : milestone, 15287000,
appsec (14.996 s) : 14996000, 14996000
.   : milestone, 14996000,
iast (18.388 s) : 18388000, 18388000
.   : milestone, 18388000,
iast_GLOBAL (17.754 s) : 17754000, 17754000
.   : milestone, 17754000,
profiling (15.0 s) : 15000000, 15000000
.   : milestone, 15000000,
tracing (14.758 s) : 14758000, 14758000
.   : milestone, 14758000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.973 s [14.973 s, 14.973 s] -
appsec 15.096 s [15.096 s, 15.096 s] 123.0 ms (0.8%)
iast 17.94 s [17.94 s, 17.94 s] 2.967 s (19.8%)
iast_GLOBAL 17.885 s [17.885 s, 17.885 s] 2.912 s (19.4%)
profiling 14.824 s [14.824 s, 14.824 s] -149.0 ms (-1.0%)
tracing 14.718 s [14.718 s, 14.718 s] -255.0 ms (-1.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.287 s [15.287 s, 15.287 s] -
appsec 14.996 s [14.996 s, 14.996 s] -291.0 ms (-1.9%)
iast 18.388 s [18.388 s, 18.388 s] 3.101 s (20.3%)
iast_GLOBAL 17.754 s [17.754 s, 17.754 s] 2.467 s (16.1%)
profiling 15.0 s [15.0 s, 15.0 s] -287.0 ms (-1.9%)
tracing 14.758 s [14.758 s, 14.758 s] -529.0 ms (-3.5%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~8dc708493c, baseline=1.60.0-SNAPSHOT~f453b4e500
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.471 ms) : 1459, 1482
.   : milestone, 1471,
appsec (3.773 ms) : 3551, 3996
.   : milestone, 3773,
iast (2.252 ms) : 2183, 2321
.   : milestone, 2252,
iast_GLOBAL (2.298 ms) : 2229, 2367
.   : milestone, 2298,
profiling (2.081 ms) : 2026, 2136
.   : milestone, 2081,
tracing (2.083 ms) : 2029, 2137
.   : milestone, 2083,
section candidate
no_agent (1.47 ms) : 1458, 1481
.   : milestone, 1470,
appsec (3.73 ms) : 3513, 3947
.   : milestone, 3730,
iast (2.245 ms) : 2176, 2314
.   : milestone, 2245,
iast_GLOBAL (2.299 ms) : 2229, 2368
.   : milestone, 2299,
profiling (2.079 ms) : 2024, 2134
.   : milestone, 2079,
tracing (2.058 ms) : 2005, 2112
.   : milestone, 2058,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.471 ms [1.459 ms, 1.482 ms] -
appsec 3.773 ms [3.551 ms, 3.996 ms] 2.302 ms (156.5%)
iast 2.252 ms [2.183 ms, 2.321 ms] 781.122 µs (53.1%)
iast_GLOBAL 2.298 ms [2.229 ms, 2.367 ms] 827.247 µs (56.2%)
profiling 2.081 ms [2.026 ms, 2.136 ms] 609.915 µs (41.5%)
tracing 2.083 ms [2.029 ms, 2.137 ms] 612.407 µs (41.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.47 ms [1.458 ms, 1.481 ms] -
appsec 3.73 ms [3.513 ms, 3.947 ms] 2.26 ms (153.8%)
iast 2.245 ms [2.176 ms, 2.314 ms] 774.906 µs (52.7%)
iast_GLOBAL 2.299 ms [2.229 ms, 2.368 ms] 828.844 µs (56.4%)
profiling 2.079 ms [2.024 ms, 2.134 ms] 609.392 µs (41.5%)
tracing 2.058 ms [2.005 ms, 2.112 ms] 588.446 µs (40.0%)