Home Original page

Remove native libraries for unsupported environment by PerfectSlayer · Pull Request #10079 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/trim-native-deps
git_commit_date 1764811148 1764833315
git_commit_sha c426f8c d949d86
release_version 1.57.0-SNAPSHOT~c426f8c01f 1.57.0-SNAPSHOT~d949d860f9
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1764835408 1764835408
ci_job_id 1269598643 1269598643
ci_pipeline_id 84851719 84851719
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-74ro8mfe 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-74ro8mfe 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 55 metrics, 10 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.57.0-SNAPSHOT~d949d860f9, baseline=1.57.0-SNAPSHOT~c426f8c01f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.056 s) : 0, 1055727
Total [baseline] (10.827 s) : 0, 10827395
Agent [candidate] (1.068 s) : 0, 1067723
Total [candidate] (10.885 s) : 0, 10884956
section appsec
Agent [baseline] (1.234 s) : 0, 1234245
Total [baseline] (10.963 s) : 0, 10962659
Agent [candidate] (1.231 s) : 0, 1230679
Total [candidate] (10.869 s) : 0, 10868740
section iast
Agent [baseline] (1.195 s) : 0, 1195498
Total [baseline] (11.18 s) : 0, 11179745
Agent [candidate] (1.198 s) : 0, 1198124
Total [candidate] (11.245 s) : 0, 11245205
section profiling
Agent [baseline] (1.203 s) : 0, 1202720
Total [baseline] (10.871 s) : 0, 10871335
Agent [candidate] (1.197 s) : 0, 1197443
Total [candidate] (10.877 s) : 0, 10877233
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.056 s -
Agent appsec 1.234 s 178.518 ms (16.9%)
Agent iast 1.195 s 139.771 ms (13.2%)
Agent profiling 1.203 s 146.993 ms (13.9%)
Total tracing 10.827 s -
Total appsec 10.963 s 135.264 ms (1.2%)
Total iast 11.18 s 352.35 ms (3.3%)
Total profiling 10.871 s 43.94 ms (0.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.068 s -
Agent appsec 1.231 s 162.956 ms (15.3%)
Agent iast 1.198 s 130.401 ms (12.2%)
Agent profiling 1.197 s 129.72 ms (12.1%)
Total tracing 10.885 s -
Total appsec 10.869 s -16.216 ms (-0.1%)
Total iast 11.245 s 360.249 ms (3.3%)
Total profiling 10.877 s -7.723 ms (-0.1%) 
gantt
    title petclinic - break down per module: candidate=1.57.0-SNAPSHOT~d949d860f9, baseline=1.57.0-SNAPSHOT~c426f8c01f

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.481 ms) : 0, 1481
crashtracking [candidate] (1.504 ms) : 0, 1504
BytebuddyAgent [baseline] (709.972 ms) : 0, 709972
BytebuddyAgent [candidate] (718.086 ms) : 0, 718086
GlobalTracer [baseline] (249.855 ms) : 0, 249855
GlobalTracer [candidate] (252.57 ms) : 0, 252570
AppSec [baseline] (32.189 ms) : 0, 32189
AppSec [candidate] (32.67 ms) : 0, 32670
Debugger [baseline] (6.409 ms) : 0, 6409
Debugger [candidate] (6.537 ms) : 0, 6537
Remote Config [baseline] (668.817 µs) : 0, 669
Remote Config [candidate] (679.801 µs) : 0, 680
Telemetry [baseline] (16.179 ms) : 0, 16179
Telemetry [candidate] (14.882 ms) : 0, 14882
Flare Poller [baseline] (4.15 ms) : 0, 4150
Flare Poller [candidate] (5.73 ms) : 0, 5730
section appsec
crashtracking [baseline] (1.504 ms) : 0, 1504
crashtracking [candidate] (1.508 ms) : 0, 1508
BytebuddyAgent [baseline] (735.772 ms) : 0, 735772
BytebuddyAgent [candidate] (732.494 ms) : 0, 732494
GlobalTracer [baseline] (242.196 ms) : 0, 242196
GlobalTracer [candidate] (242.287 ms) : 0, 242287
IAST [baseline] (25.124 ms) : 0, 25124
IAST [candidate] (25.174 ms) : 0, 25174
AppSec [baseline] (175.597 ms) : 0, 175597
AppSec [candidate] (175.026 ms) : 0, 175026
Debugger [baseline] (6.244 ms) : 0, 6244
Debugger [candidate] (6.316 ms) : 0, 6316
Remote Config [baseline] (687.055 µs) : 0, 687
Remote Config [candidate] (694.319 µs) : 0, 694
Telemetry [baseline] (8.143 ms) : 0, 8143
Telemetry [candidate] (8.221 ms) : 0, 8221
Flare Poller [baseline] (3.965 ms) : 0, 3965
Flare Poller [candidate] (4.054 ms) : 0, 4054
section iast
crashtracking [baseline] (1.485 ms) : 0, 1485
crashtracking [candidate] (1.484 ms) : 0, 1484
BytebuddyAgent [baseline] (833.898 ms) : 0, 833898
BytebuddyAgent [candidate] (835.608 ms) : 0, 835608
GlobalTracer [baseline] (238.247 ms) : 0, 238247
GlobalTracer [candidate] (238.96 ms) : 0, 238960
IAST [baseline] (31.2 ms) : 0, 31200
IAST [candidate] (31.066 ms) : 0, 31066
AppSec [baseline] (30.309 ms) : 0, 30309
AppSec [candidate] (30.598 ms) : 0, 30598
Debugger [baseline] (6.088 ms) : 0, 6088
Debugger [candidate] (6.136 ms) : 0, 6136
Remote Config [baseline] (609.863 µs) : 0, 610
Remote Config [candidate] (609.153 µs) : 0, 609
Telemetry [baseline] (8.035 ms) : 0, 8035
Telemetry [candidate] (8.053 ms) : 0, 8053
Flare Poller [baseline] (10.798 ms) : 0, 10798
Flare Poller [candidate] (10.719 ms) : 0, 10719
section profiling
crashtracking [baseline] (1.451 ms) : 0, 1451
crashtracking [candidate] (1.435 ms) : 0, 1435
BytebuddyAgent [baseline] (737.636 ms) : 0, 737636
BytebuddyAgent [candidate] (733.721 ms) : 0, 733721
GlobalTracer [baseline] (222.783 ms) : 0, 222783
GlobalTracer [candidate] (222.186 ms) : 0, 222186
AppSec [baseline] (32.197 ms) : 0, 32197
AppSec [candidate] (32.142 ms) : 0, 32142
Debugger [baseline] (8.45 ms) : 0, 8450
Debugger [candidate] (7.584 ms) : 0, 7584
Remote Config [baseline] (671.638 µs) : 0, 672
Remote Config [candidate] (676.797 µs) : 0, 677
Telemetry [baseline] (14.723 ms) : 0, 14723
Telemetry [candidate] (15.539 ms) : 0, 15539
Flare Poller [baseline] (4.134 ms) : 0, 4134
Flare Poller [candidate] (4.134 ms) : 0, 4134
ProfilingAgent [baseline] (110.838 ms) : 0, 110838
ProfilingAgent [candidate] (110.892 ms) : 0, 110892
Profiling [baseline] (111.481 ms) : 0, 111481
Profiling [candidate] (111.532 ms) : 0, 111532
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.57.0-SNAPSHOT~d949d860f9, baseline=1.57.0-SNAPSHOT~c426f8c01f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.066 s) : 0, 1066495
Total [baseline] (8.706 s) : 0, 8705510
Agent [candidate] (1.056 s) : 0, 1055950
Total [candidate] (8.683 s) : 0, 8683135
section iast
Agent [baseline] (1.201 s) : 0, 1201430
Total [baseline] (9.35 s) : 0, 9349702
Agent [candidate] (1.191 s) : 0, 1191351
Total [candidate] (9.29 s) : 0, 9290020
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.066 s -
Agent iast 1.201 s 134.935 ms (12.7%)
Total tracing 8.706 s -
Total iast 9.35 s 644.192 ms (7.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.056 s -
Agent iast 1.191 s 135.401 ms (12.8%)
Total tracing 8.683 s -
Total iast 9.29 s 606.885 ms (7.0%) 
gantt
    title insecure-bank - break down per module: candidate=1.57.0-SNAPSHOT~d949d860f9, baseline=1.57.0-SNAPSHOT~c426f8c01f

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.496 ms) : 0, 1496
crashtracking [candidate] (1.481 ms) : 0, 1481
BytebuddyAgent [baseline] (717.658 ms) : 0, 717658
BytebuddyAgent [candidate] (710.395 ms) : 0, 710395
GlobalTracer [baseline] (251.924 ms) : 0, 251924
GlobalTracer [candidate] (249.677 ms) : 0, 249677
AppSec [baseline] (32.673 ms) : 0, 32673
AppSec [candidate] (32.145 ms) : 0, 32145
Debugger [baseline] (6.578 ms) : 0, 6578
Debugger [candidate] (6.401 ms) : 0, 6401
Remote Config [baseline] (692.192 µs) : 0, 692
Remote Config [candidate] (689.691 µs) : 0, 690
Telemetry [baseline] (15.471 ms) : 0, 15471
Telemetry [candidate] (16.193 ms) : 0, 16193
Flare Poller [baseline] (4.91 ms) : 0, 4910
Flare Poller [candidate] (4.189 ms) : 0, 4189
section iast
crashtracking [baseline] (1.491 ms) : 0, 1491
crashtracking [candidate] (1.482 ms) : 0, 1482
BytebuddyAgent [baseline] (839.276 ms) : 0, 839276
BytebuddyAgent [candidate] (831.376 ms) : 0, 831376
GlobalTracer [baseline] (238.745 ms) : 0, 238745
GlobalTracer [candidate] (237.189 ms) : 0, 237189
IAST [baseline] (31.779 ms) : 0, 31779
IAST [candidate] (30.641 ms) : 0, 30641
AppSec [baseline] (29.565 ms) : 0, 29565
AppSec [candidate] (30.491 ms) : 0, 30491
Debugger [baseline] (6.064 ms) : 0, 6064
Debugger [candidate] (6.031 ms) : 0, 6031
Remote Config [baseline] (614.642 µs) : 0, 615
Remote Config [candidate] (600.03 µs) : 0, 600
Telemetry [baseline] (8.029 ms) : 0, 8029
Telemetry [candidate] (7.939 ms) : 0, 7939
Flare Poller [baseline] (10.761 ms) : 0, 10761
Flare Poller [candidate] (10.865 ms) : 0, 10865
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/trim-native-deps
git_commit_date 1764811148 1764833315
git_commit_sha c426f8c d949d86
release_version 1.57.0-SNAPSHOT~c426f8c01f 1.57.0-SNAPSHOT~d949d860f9
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1764835890 1764835890
ci_job_id 1269598644 1269598644
ci_pipeline_id 84851719 84851719
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-k1ztcidb 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-k1ztcidb 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 2 performance regressions! Performance is the same for 16 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load worse
[+73.782µs; +207.289µs] or [+2.607%; +7.325%]		 unsure
[+40.555µs; +404.794µs] or [+0.506%; +5.051%]		 unstable
[-179.337op/s; +98.149op/s] or [-14.101%; +7.717%]		 2.970ms 8.237ms 1231.219op/s 2.830ms 8.014ms 1271.812op/s
scenario:load:petclinic:profiling:high_load worse
[+535.563µs; +1328.523µs] or [+2.953%; +7.326%]		 unsure
[+0.164ms; +1.853ms] or [+0.547%; +6.192%]		 unstable
[-39.110op/s; +13.922op/s] or [-15.524%; +5.526%]		 19.065ms 30.932ms 239.344op/s 18.133ms 29.923ms 251.938op/s
scenario:load:petclinic:no_agent:high_load better
[-2.091ms; -0.713ms] or [-11.168%; -3.808%]		 better
[-3.718ms; -0.785ms] or [-11.941%; -2.522%]		 unstable
[-10.954op/s; +46.954op/s] or [-4.491%; +19.251%]		 17.324ms 28.887ms 261.906op/s 18.726ms 31.139ms 243.906op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~d949d860f9, baseline=1.57.0-SNAPSHOT~c426f8c01f
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.201 ms) : 1190, 1212
.   : milestone, 1201,
iast (3.26 ms) : 3211, 3308
.   : milestone, 3260,
iast_FULL (5.829 ms) : 5771, 5888
.   : milestone, 5829,
iast_GLOBAL (3.606 ms) : 3554, 3659
.   : milestone, 3606,
profiling (1.976 ms) : 1958, 1995
.   : milestone, 1976,
tracing (1.796 ms) : 1782, 1810
.   : milestone, 1796,
section candidate
no_agent (1.22 ms) : 1208, 1232
.   : milestone, 1220,
iast (3.315 ms) : 3269, 3360
.   : milestone, 3315,
iast_FULL (5.774 ms) : 5717, 5831
.   : milestone, 5774,
iast_GLOBAL (3.727 ms) : 3671, 3783
.   : milestone, 3727,
profiling (2.183 ms) : 2163, 2204
.   : milestone, 2183,
tracing (1.809 ms) : 1793, 1824
.   : milestone, 1809,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.201 ms [1.19 ms, 1.212 ms] -
iast 3.26 ms [3.211 ms, 3.308 ms] 2.059 ms (171.4%)
iast_FULL 5.829 ms [5.771 ms, 5.888 ms] 4.628 ms (385.4%)
iast_GLOBAL 3.606 ms [3.554 ms, 3.659 ms] 2.405 ms (200.3%)
profiling 1.976 ms [1.958 ms, 1.995 ms] 775.162 µs (64.5%)
tracing 1.796 ms [1.782 ms, 1.81 ms] 594.792 µs (49.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.22 ms [1.208 ms, 1.232 ms] -
iast 3.315 ms [3.269 ms, 3.36 ms] 2.095 ms (171.7%)
iast_FULL 5.774 ms [5.717 ms, 5.831 ms] 4.554 ms (373.2%)
iast_GLOBAL 3.727 ms [3.671 ms, 3.783 ms] 2.507 ms (205.5%)
profiling 2.183 ms [2.163 ms, 2.204 ms] 963.323 µs (79.0%)
tracing 1.809 ms [1.793 ms, 1.824 ms] 588.399 µs (48.2%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~d949d860f9, baseline=1.57.0-SNAPSHOT~c426f8c01f
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.141 ms) : 18945, 19338
.   : milestone, 19141,
appsec (18.551 ms) : 18362, 18739
.   : milestone, 18551,
code_origins (17.757 ms) : 17580, 17933
.   : milestone, 17757,
iast (17.749 ms) : 17572, 17926
.   : milestone, 17749,
profiling (18.524 ms) : 18339, 18708
.   : milestone, 18524,
tracing (17.657 ms) : 17479, 17836
.   : milestone, 17657,
section candidate
no_agent (17.817 ms) : 17637, 17997
.   : milestone, 17817,
appsec (18.842 ms) : 18654, 19031
.   : milestone, 18842,
code_origins (17.716 ms) : 17538, 17893
.   : milestone, 17716,
iast (17.798 ms) : 17621, 17974
.   : milestone, 17798,
profiling (19.501 ms) : 19302, 19700
.   : milestone, 19501,
tracing (17.985 ms) : 17803, 18168
.   : milestone, 17985,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.141 ms [18.945 ms, 19.338 ms] -
appsec 18.551 ms [18.362 ms, 18.739 ms] -590.806 µs (-3.1%)
code_origins 17.757 ms [17.58 ms, 17.933 ms] -1.385 ms (-7.2%)
iast 17.749 ms [17.572 ms, 17.926 ms] -1.392 ms (-7.3%)
profiling 18.524 ms [18.339 ms, 18.708 ms] -617.82 µs (-3.2%)
tracing 17.657 ms [17.479 ms, 17.836 ms] -1.484 ms (-7.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.817 ms [17.637 ms, 17.997 ms] -
appsec 18.842 ms [18.654 ms, 19.031 ms] 1.025 ms (5.8%)
code_origins 17.716 ms [17.538 ms, 17.893 ms] -101.273 µs (-0.6%)
iast 17.798 ms [17.621 ms, 17.974 ms] -19.473 µs (-0.1%)
profiling 19.501 ms [19.302 ms, 19.7 ms] 1.684 ms (9.5%)
tracing 17.985 ms [17.803 ms, 18.168 ms] 168.117 µs (0.9%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/trim-native-deps
git_commit_date 1764811148 1764833315
git_commit_sha c426f8c d949d86
release_version 1.57.0-SNAPSHOT~c426f8c01f 1.57.0-SNAPSHOT~d949d860f9
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1764835551 1764835551
ci_job_id 1269598645 1269598645
ci_pipeline_id 84851719 84851719
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-eevzlywo 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-eevzlywo 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~d949d860f9, baseline=1.57.0-SNAPSHOT~c426f8c01f
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.469 ms) : 1457, 1480
.   : milestone, 1469,
appsec (3.693 ms) : 3475, 3910
.   : milestone, 3693,
iast (2.209 ms) : 2145, 2274
.   : milestone, 2209,
iast_GLOBAL (2.254 ms) : 2189, 2319
.   : milestone, 2254,
profiling (2.062 ms) : 2009, 2114
.   : milestone, 2062,
tracing (2.044 ms) : 1993, 2095
.   : milestone, 2044,
section candidate
no_agent (1.476 ms) : 1464, 1488
.   : milestone, 1476,
appsec (3.624 ms) : 3411, 3837
.   : milestone, 3624,
iast (2.215 ms) : 2149, 2280
.   : milestone, 2215,
iast_GLOBAL (2.263 ms) : 2197, 2328
.   : milestone, 2263,
profiling (2.069 ms) : 2017, 2122
.   : milestone, 2069,
tracing (2.047 ms) : 1995, 2098
.   : milestone, 2047,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.469 ms [1.457 ms, 1.48 ms] -
appsec 3.693 ms [3.475 ms, 3.91 ms] 2.224 ms (151.4%)
iast 2.209 ms [2.145 ms, 2.274 ms] 740.55 µs (50.4%)
iast_GLOBAL 2.254 ms [2.189 ms, 2.319 ms] 785.284 µs (53.5%)
profiling 2.062 ms [2.009 ms, 2.114 ms] 593.138 µs (40.4%)
tracing 2.044 ms [1.993 ms, 2.095 ms] 575.536 µs (39.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.464 ms, 1.488 ms] -
appsec 3.624 ms [3.411 ms, 3.837 ms] 2.148 ms (145.5%)
iast 2.215 ms [2.149 ms, 2.28 ms] 738.527 µs (50.0%)
iast_GLOBAL 2.263 ms [2.197 ms, 2.328 ms] 786.691 µs (53.3%)
profiling 2.069 ms [2.017 ms, 2.122 ms] 593.404 µs (40.2%)
tracing 2.047 ms [1.995 ms, 2.098 ms] 570.583 µs (38.7%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~d949d860f9, baseline=1.57.0-SNAPSHOT~c426f8c01f
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.358 s) : 15358000, 15358000
.   : milestone, 15358000,
appsec (14.555 s) : 14555000, 14555000
.   : milestone, 14555000,
iast (18.49 s) : 18490000, 18490000
.   : milestone, 18490000,
iast_GLOBAL (18.028 s) : 18028000, 18028000
.   : milestone, 18028000,
profiling (14.436 s) : 14436000, 14436000
.   : milestone, 14436000,
tracing (14.733 s) : 14733000, 14733000
.   : milestone, 14733000,
section candidate
no_agent (15.265 s) : 15265000, 15265000
.   : milestone, 15265000,
appsec (14.584 s) : 14584000, 14584000
.   : milestone, 14584000,
iast (18.579 s) : 18579000, 18579000
.   : milestone, 18579000,
iast_GLOBAL (18.081 s) : 18081000, 18081000
.   : milestone, 18081000,
profiling (14.723 s) : 14723000, 14723000
.   : milestone, 14723000,
tracing (14.81 s) : 14810000, 14810000
.   : milestone, 14810000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.358 s [15.358 s, 15.358 s] -
appsec 14.555 s [14.555 s, 14.555 s] -803.0 ms (-5.2%)
iast 18.49 s [18.49 s, 18.49 s] 3.132 s (20.4%)
iast_GLOBAL 18.028 s [18.028 s, 18.028 s] 2.67 s (17.4%)
profiling 14.436 s [14.436 s, 14.436 s] -922.0 ms (-6.0%)
tracing 14.733 s [14.733 s, 14.733 s] -625.0 ms (-4.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.265 s [15.265 s, 15.265 s] -
appsec 14.584 s [14.584 s, 14.584 s] -681.0 ms (-4.5%)
iast 18.579 s [18.579 s, 18.579 s] 3.314 s (21.7%)
iast_GLOBAL 18.081 s [18.081 s, 18.081 s] 2.816 s (18.4%)
profiling 14.723 s [14.723 s, 14.723 s] -542.0 ms (-3.6%)
tracing 14.81 s [14.81 s, 14.81 s] -455.0 ms (-3.0%)