Home Original page

Add rate limit on span decoration probe errors by jpbempel · Pull Request #10529 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/fix-span-deco-error-rate-limit
git_commit_date 1770237481 1770298666
git_commit_sha 9c3d035 84ab56b
release_version 1.60.0-SNAPSHOT~9c3d035f5f 1.60.0-SNAPSHOT~84ab56b1f9
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1770300428 1770300428
ci_job_id 1403862416 1403862416
ci_pipeline_id 94861663 94861663
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-r8c0u2cy 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-r8c0u2cy 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 66 metrics, 5 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~84ab56b1f9, baseline=1.60.0-SNAPSHOT~9c3d035f5f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.06 s) : 0, 1060201
Total [baseline] (8.717 s) : 0, 8717261
Agent [candidate] (1.062 s) : 0, 1062428
Total [candidate] (8.71 s) : 0, 8709515
section iast
Agent [baseline] (1.23 s) : 0, 1230162
Total [baseline] (9.348 s) : 0, 9348204
Agent [candidate] (1.229 s) : 0, 1228816
Total [candidate] (9.341 s) : 0, 9341254
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.06 s -
Agent iast 1.23 s 169.961 ms (16.0%)
Total tracing 8.717 s -
Total iast 9.348 s 630.943 ms (7.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.062 s -
Agent iast 1.229 s 166.388 ms (15.7%)
Total tracing 8.71 s -
Total iast 9.341 s 631.739 ms (7.3%) 
gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~84ab56b1f9, baseline=1.60.0-SNAPSHOT~9c3d035f5f

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.186 ms) : 0, 1186
crashtracking [candidate] (1.189 ms) : 0, 1189
BytebuddyAgent [baseline] (626.685 ms) : 0, 626685
BytebuddyAgent [candidate] (627.14 ms) : 0, 627140
AgentMeter [baseline] (28.832 ms) : 0, 28832
AgentMeter [candidate] (28.753 ms) : 0, 28753
GlobalTracer [baseline] (257.124 ms) : 0, 257124
GlobalTracer [candidate] (257.298 ms) : 0, 257298
AppSec [baseline] (32.863 ms) : 0, 32863
AppSec [candidate] (32.726 ms) : 0, 32726
Debugger [baseline] (63.144 ms) : 0, 63144
Debugger [candidate] (60.936 ms) : 0, 60936
Remote Config [baseline] (610.402 µs) : 0, 610
Remote Config [candidate] (623.402 µs) : 0, 623
Telemetry [baseline] (10.666 ms) : 0, 10666
Telemetry [candidate] (11.481 ms) : 0, 11481
Flare Poller [baseline] (3.793 ms) : 0, 3793
Flare Poller [candidate] (6.943 ms) : 0, 6943
section iast
crashtracking [baseline] (1.178 ms) : 0, 1178
crashtracking [candidate] (1.193 ms) : 0, 1193
BytebuddyAgent [baseline] (794.903 ms) : 0, 794903
BytebuddyAgent [candidate] (795.126 ms) : 0, 795126
AgentMeter [baseline] (11.28 ms) : 0, 11280
AgentMeter [candidate] (11.257 ms) : 0, 11257
GlobalTracer [baseline] (247.834 ms) : 0, 247834
GlobalTracer [candidate] (247.185 ms) : 0, 247185
IAST [baseline] (27.061 ms) : 0, 27061
IAST [candidate] (26.849 ms) : 0, 26849
AppSec [baseline] (33.166 ms) : 0, 33166
AppSec [candidate] (35.517 ms) : 0, 35517
Debugger [baseline] (66.809 ms) : 0, 66809
Debugger [candidate] (63.757 ms) : 0, 63757
Remote Config [baseline] (543.925 µs) : 0, 544
Remote Config [candidate] (534.09 µs) : 0, 534
Telemetry [baseline] (8.639 ms) : 0, 8639
Telemetry [candidate] (8.696 ms) : 0, 8696
Flare Poller [baseline] (3.498 ms) : 0, 3498
Flare Poller [candidate] (3.481 ms) : 0, 3481
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~84ab56b1f9, baseline=1.60.0-SNAPSHOT~9c3d035f5f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.066 s) : 0, 1066234
Total [baseline] (10.917 s) : 0, 10916564
Agent [candidate] (1.066 s) : 0, 1066366
Total [candidate] (10.913 s) : 0, 10913236
section appsec
Agent [baseline] (1.233 s) : 0, 1232677
Total [baseline] (10.907 s) : 0, 10907066
Agent [candidate] (1.239 s) : 0, 1238805
Total [candidate] (10.924 s) : 0, 10923997
section iast
Agent [baseline] (1.232 s) : 0, 1231786
Total [baseline] (11.153 s) : 0, 11152643
Agent [candidate] (1.24 s) : 0, 1239886
Total [candidate] (11.162 s) : 0, 11162047
section profiling
Agent [baseline] (1.194 s) : 0, 1194473
Total [baseline] (10.867 s) : 0, 10866914
Agent [candidate] (1.193 s) : 0, 1193373
Total [candidate] (10.99 s) : 0, 10989757
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.066 s -
Agent appsec 1.233 s 166.443 ms (15.6%)
Agent iast 1.232 s 165.552 ms (15.5%)
Agent profiling 1.194 s 128.24 ms (12.0%)
Total tracing 10.917 s -
Total appsec 10.907 s -9.498 ms (-0.1%)
Total iast 11.153 s 236.079 ms (2.2%)
Total profiling 10.867 s -49.65 ms (-0.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.066 s -
Agent appsec 1.239 s 172.439 ms (16.2%)
Agent iast 1.24 s 173.519 ms (16.3%)
Agent profiling 1.193 s 127.007 ms (11.9%)
Total tracing 10.913 s -
Total appsec 10.924 s 10.762 ms (0.1%)
Total iast 11.162 s 248.811 ms (2.3%)
Total profiling 10.99 s 76.521 ms (0.7%) 
gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~84ab56b1f9, baseline=1.60.0-SNAPSHOT~9c3d035f5f

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.192 ms) : 0, 1192
crashtracking [candidate] (1.187 ms) : 0, 1187
BytebuddyAgent [baseline] (628.058 ms) : 0, 628058
BytebuddyAgent [candidate] (629.014 ms) : 0, 629014
AgentMeter [baseline] (28.855 ms) : 0, 28855
AgentMeter [candidate] (28.853 ms) : 0, 28853
GlobalTracer [baseline] (257.551 ms) : 0, 257551
GlobalTracer [candidate] (258.247 ms) : 0, 258247
AppSec [baseline] (32.779 ms) : 0, 32779
AppSec [candidate] (32.773 ms) : 0, 32773
Debugger [baseline] (62.638 ms) : 0, 62638
Debugger [candidate] (61.773 ms) : 0, 61773
Remote Config [baseline] (630.239 µs) : 0, 630
Remote Config [candidate] (608.814 µs) : 0, 609
Telemetry [baseline] (12.37 ms) : 0, 12370
Telemetry [candidate] (12.395 ms) : 0, 12395
Flare Poller [baseline] (6.79 ms) : 0, 6790
Flare Poller [candidate] (6.2 ms) : 0, 6200
section appsec
crashtracking [baseline] (1.17 ms) : 0, 1170
crashtracking [candidate] (1.179 ms) : 0, 1179
BytebuddyAgent [baseline] (654.977 ms) : 0, 654977
BytebuddyAgent [candidate] (658.316 ms) : 0, 658316
AgentMeter [baseline] (11.795 ms) : 0, 11795
AgentMeter [candidate] (11.869 ms) : 0, 11869
GlobalTracer [baseline] (256.752 ms) : 0, 256752
GlobalTracer [candidate] (258.404 ms) : 0, 258404
AppSec [baseline] (167.254 ms) : 0, 167254
AppSec [candidate] (167.765 ms) : 0, 167765
Debugger [baseline] (67.001 ms) : 0, 67001
Debugger [candidate] (67.08 ms) : 0, 67080
Remote Config [baseline] (666.445 µs) : 0, 666
Remote Config [candidate] (667.273 µs) : 0, 667
Telemetry [baseline] (9.092 ms) : 0, 9092
Telemetry [candidate] (9.213 ms) : 0, 9213
Flare Poller [baseline] (3.601 ms) : 0, 3601
Flare Poller [candidate] (3.688 ms) : 0, 3688
IAST [baseline] (25.221 ms) : 0, 25221
IAST [candidate] (25.334 ms) : 0, 25334
section iast
crashtracking [baseline] (1.186 ms) : 0, 1186
crashtracking [candidate] (1.194 ms) : 0, 1194
BytebuddyAgent [baseline] (796.771 ms) : 0, 796771
BytebuddyAgent [candidate] (802.235 ms) : 0, 802235
AgentMeter [baseline] (11.256 ms) : 0, 11256
AgentMeter [candidate] (11.517 ms) : 0, 11517
GlobalTracer [baseline] (247.774 ms) : 0, 247774
GlobalTracer [candidate] (248.918 ms) : 0, 248918
AppSec [baseline] (34.839 ms) : 0, 34839
AppSec [candidate] (35.647 ms) : 0, 35647
Debugger [baseline] (65.237 ms) : 0, 65237
Debugger [candidate] (65.161 ms) : 0, 65161
Remote Config [baseline] (537.096 µs) : 0, 537
Remote Config [candidate] (552.055 µs) : 0, 552
Telemetry [baseline] (8.737 ms) : 0, 8737
Telemetry [candidate] (8.73 ms) : 0, 8730
Flare Poller [baseline] (3.44 ms) : 0, 3440
Flare Poller [candidate] (3.428 ms) : 0, 3428
IAST [baseline] (26.801 ms) : 0, 26801
IAST [candidate] (27.146 ms) : 0, 27146
section profiling
ProfilingAgent [baseline] (99.32 ms) : 0, 99320
ProfilingAgent [candidate] (99.996 ms) : 0, 99996
crashtracking [baseline] (1.219 ms) : 0, 1219
crashtracking [candidate] (1.214 ms) : 0, 1214
BytebuddyAgent [baseline] (685.612 ms) : 0, 685612
BytebuddyAgent [candidate] (682.962 ms) : 0, 682962
AgentMeter [baseline] (8.854 ms) : 0, 8854
AgentMeter [candidate] (8.748 ms) : 0, 8748
GlobalTracer [baseline] (215.763 ms) : 0, 215763
GlobalTracer [candidate] (216.598 ms) : 0, 216598
AppSec [baseline] (32.456 ms) : 0, 32456
AppSec [candidate] (32.776 ms) : 0, 32776
Debugger [baseline] (67.983 ms) : 0, 67983
Debugger [candidate] (68.026 ms) : 0, 68026
Remote Config [baseline] (602.32 µs) : 0, 602
Remote Config [candidate] (612.684 µs) : 0, 613
Telemetry [baseline] (8.817 ms) : 0, 8817
Telemetry [candidate] (8.828 ms) : 0, 8828
Flare Poller [baseline] (3.816 ms) : 0, 3816
Flare Poller [candidate] (3.784 ms) : 0, 3784
Profiling [baseline] (99.886 ms) : 0, 99886
Profiling [candidate] (100.57 ms) : 0, 100570
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/fix-span-deco-error-rate-limit
git_commit_date 1770237481 1770298666
git_commit_sha 9c3d035 84ab56b
release_version 1.60.0-SNAPSHOT~9c3d035f5f 1.60.0-SNAPSHOT~84ab56b1f9
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1770300929 1770300929
ci_job_id 1403862419 1403862419
ci_pipeline_id 94861663 94861663
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-eb79i6gh 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-eb79i6gh 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 2 performance regressions! Performance is the same for 16 metrics, 15 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:profiling:high_load worse
[+81.584µs; +207.321µs] or [+5.080%; +12.909%]		 unstable
[+252.162µs; +1102.349µs] or [+5.508%; +24.081%]		 unstable
[-499.884op/s; +18.196op/s] or [-21.936%; +0.798%]		 1.750ms 5.255ms 2038.031op/s 1.606ms 4.578ms 2278.875op/s
scenario:load:insecure-bank:iast_FULL:high_load better
[-349.752µs; -129.266µs] or [-6.430%; -2.376%]		 better
[-1058.991µs; -343.213µs] or [-8.025%; -2.601%]		 unstable
[-51.914op/s; +112.664op/s] or [-6.877%; +14.925%]		 5.200ms 12.496ms 785.250op/s 5.440ms 13.197ms 754.875op/s
scenario:load:petclinic:tracing:high_load better
[-789.339µs; -392.450µs] or [-4.522%; -2.248%]		 unsure
[-1036.847µs; -19.827µs] or [-3.642%; -0.070%]		 unstable
[-18.854op/s; +31.042op/s] or [-7.173%; +11.810%]		 16.865ms 27.941ms 268.938op/s 17.456ms 28.469ms 262.844op/s
scenario:load:petclinic:appsec:high_load worse
[+547.286µs; +1442.934µs] or [+3.001%; +7.912%]		 unsure
[+187.323µs; +1643.951µs] or [+0.626%; +5.494%]		 unstable
[-35.237op/s; +11.862op/s] or [-14.042%; +4.727%]		 19.233ms 30.840ms 239.250op/s 18.238ms 29.925ms 250.938op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~84ab56b1f9, baseline=1.60.0-SNAPSHOT~9c3d035f5f
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.273 ms) : 19072, 19475
.   : milestone, 19273,
appsec (18.597 ms) : 18407, 18788
.   : milestone, 18597,
code_origins (17.649 ms) : 17473, 17824
.   : milestone, 17649,
iast (17.753 ms) : 17578, 17927
.   : milestone, 17753,
profiling (18.468 ms) : 18283, 18653
.   : milestone, 18468,
tracing (17.755 ms) : 17578, 17932
.   : milestone, 17755,
section candidate
no_agent (18.948 ms) : 18756, 19140
.   : milestone, 18948,
appsec (19.514 ms) : 19315, 19712
.   : milestone, 19514,
code_origins (17.538 ms) : 17363, 17712
.   : milestone, 17538,
iast (17.609 ms) : 17432, 17785
.   : milestone, 17609,
profiling (18.417 ms) : 18233, 18602
.   : milestone, 18417,
tracing (17.348 ms) : 17180, 17516
.   : milestone, 17348,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.273 ms [19.072 ms, 19.475 ms] -
appsec 18.597 ms [18.407 ms, 18.788 ms] -675.711 µs (-3.5%)
code_origins 17.649 ms [17.473 ms, 17.824 ms] -1.625 ms (-8.4%)
iast 17.753 ms [17.578 ms, 17.927 ms] -1.52 ms (-7.9%)
profiling 18.468 ms [18.283 ms, 18.653 ms] -804.929 µs (-4.2%)
tracing 17.755 ms [17.578 ms, 17.932 ms] -1.518 ms (-7.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.948 ms [18.756 ms, 19.14 ms] -
appsec 19.514 ms [19.315 ms, 19.712 ms] 565.928 µs (3.0%)
code_origins 17.538 ms [17.363 ms, 17.712 ms] -1.41 ms (-7.4%)
iast 17.609 ms [17.432 ms, 17.785 ms] -1.339 ms (-7.1%)
profiling 18.417 ms [18.233 ms, 18.602 ms] -530.558 µs (-2.8%)
tracing 17.348 ms [17.18 ms, 17.516 ms] -1.6 ms (-8.4%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~84ab56b1f9, baseline=1.60.0-SNAPSHOT~9c3d035f5f
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.19 ms) : 1179, 1202
.   : milestone, 1190,
iast (3.206 ms) : 3162, 3251
.   : milestone, 3206,
iast_FULL (6.129 ms) : 6065, 6193
.   : milestone, 6129,
iast_GLOBAL (3.563 ms) : 3497, 3628
.   : milestone, 3563,
profiling (1.98 ms) : 1963, 1998
.   : milestone, 1980,
tracing (1.769 ms) : 1754, 1783
.   : milestone, 1769,
section candidate
no_agent (1.183 ms) : 1171, 1196
.   : milestone, 1183,
iast (3.15 ms) : 3107, 3192
.   : milestone, 3150,
iast_FULL (5.888 ms) : 5829, 5946
.   : milestone, 5888,
iast_GLOBAL (3.585 ms) : 3525, 3644
.   : milestone, 3585,
profiling (2.223 ms) : 2201, 2245
.   : milestone, 2223,
tracing (1.754 ms) : 1739, 1768
.   : milestone, 1754,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.19 ms [1.179 ms, 1.202 ms] -
iast 3.206 ms [3.162 ms, 3.251 ms] 2.016 ms (169.3%)
iast_FULL 6.129 ms [6.065 ms, 6.193 ms] 4.939 ms (414.9%)
iast_GLOBAL 3.563 ms [3.497 ms, 3.628 ms] 2.372 ms (199.3%)
profiling 1.98 ms [1.963 ms, 1.998 ms] 789.854 µs (66.3%)
tracing 1.769 ms [1.754 ms, 1.783 ms] 578.284 µs (48.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.183 ms [1.171 ms, 1.196 ms] -
iast 3.15 ms [3.107 ms, 3.192 ms] 1.966 ms (166.1%)
iast_FULL 5.888 ms [5.829 ms, 5.946 ms] 4.704 ms (397.5%)
iast_GLOBAL 3.585 ms [3.525 ms, 3.644 ms] 2.401 ms (202.9%)
profiling 2.223 ms [2.201 ms, 2.245 ms] 1.04 ms (87.8%)
tracing 1.754 ms [1.739 ms, 1.768 ms] 570.107 µs (48.2%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/fix-span-deco-error-rate-limit
git_commit_date 1770237481 1770298666
git_commit_sha 9c3d035 84ab56b
release_version 1.60.0-SNAPSHOT~9c3d035f5f 1.60.0-SNAPSHOT~84ab56b1f9
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1770300587 1770300587
ci_job_id 1403862421 1403862421
ci_pipeline_id 94861663 94861663
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-egsw59e5 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-egsw59e5 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~84ab56b1f9, baseline=1.60.0-SNAPSHOT~9c3d035f5f
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.476 ms) : 1464, 1487
.   : milestone, 1476,
appsec (2.502 ms) : 2447, 2556
.   : milestone, 2502,
iast (2.253 ms) : 2184, 2322
.   : milestone, 2253,
iast_GLOBAL (2.292 ms) : 2223, 2361
.   : milestone, 2292,
profiling (2.107 ms) : 2050, 2163
.   : milestone, 2107,
tracing (2.07 ms) : 2017, 2124
.   : milestone, 2070,
section candidate
no_agent (1.477 ms) : 1465, 1489
.   : milestone, 1477,
appsec (3.766 ms) : 3544, 3989
.   : milestone, 3766,
iast (2.257 ms) : 2188, 2325
.   : milestone, 2257,
iast_GLOBAL (2.307 ms) : 2237, 2376
.   : milestone, 2307,
profiling (2.079 ms) : 2025, 2134
.   : milestone, 2079,
tracing (2.065 ms) : 2012, 2118
.   : milestone, 2065,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.464 ms, 1.487 ms] -
appsec 2.502 ms [2.447 ms, 2.556 ms] 1.026 ms (69.5%)
iast 2.253 ms [2.184 ms, 2.322 ms] 777.041 µs (52.7%)
iast_GLOBAL 2.292 ms [2.223 ms, 2.361 ms] 816.323 µs (55.3%)
profiling 2.107 ms [2.05 ms, 2.163 ms] 630.699 µs (42.7%)
tracing 2.07 ms [2.017 ms, 2.124 ms] 594.203 µs (40.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.477 ms [1.465 ms, 1.489 ms] -
appsec 3.766 ms [3.544 ms, 3.989 ms] 2.289 ms (155.0%)
iast 2.257 ms [2.188 ms, 2.325 ms] 779.532 µs (52.8%)
iast_GLOBAL 2.307 ms [2.237 ms, 2.376 ms] 829.817 µs (56.2%)
profiling 2.079 ms [2.025 ms, 2.134 ms] 602.298 µs (40.8%)
tracing 2.065 ms [2.012 ms, 2.118 ms] 587.872 µs (39.8%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~84ab56b1f9, baseline=1.60.0-SNAPSHOT~9c3d035f5f
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.08 s) : 15080000, 15080000
.   : milestone, 15080000,
appsec (15.135 s) : 15135000, 15135000
.   : milestone, 15135000,
iast (17.918 s) : 17918000, 17918000
.   : milestone, 17918000,
iast_GLOBAL (17.981 s) : 17981000, 17981000
.   : milestone, 17981000,
profiling (14.871 s) : 14871000, 14871000
.   : milestone, 14871000,
tracing (14.865 s) : 14865000, 14865000
.   : milestone, 14865000,
section candidate
no_agent (15.126 s) : 15126000, 15126000
.   : milestone, 15126000,
appsec (14.863 s) : 14863000, 14863000
.   : milestone, 14863000,
iast (18.357 s) : 18357000, 18357000
.   : milestone, 18357000,
iast_GLOBAL (17.951 s) : 17951000, 17951000
.   : milestone, 17951000,
profiling (15.007 s) : 15007000, 15007000
.   : milestone, 15007000,
tracing (14.601 s) : 14601000, 14601000
.   : milestone, 14601000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.08 s [15.08 s, 15.08 s] -
appsec 15.135 s [15.135 s, 15.135 s] 55.0 ms (0.4%)
iast 17.918 s [17.918 s, 17.918 s] 2.838 s (18.8%)
iast_GLOBAL 17.981 s [17.981 s, 17.981 s] 2.901 s (19.2%)
profiling 14.871 s [14.871 s, 14.871 s] -209.0 ms (-1.4%)
tracing 14.865 s [14.865 s, 14.865 s] -215.0 ms (-1.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.126 s [15.126 s, 15.126 s] -
appsec 14.863 s [14.863 s, 14.863 s] -263.0 ms (-1.7%)
iast 18.357 s [18.357 s, 18.357 s] 3.231 s (21.4%)
iast_GLOBAL 17.951 s [17.951 s, 17.951 s] 2.825 s (18.7%)
profiling 15.007 s [15.007 s, 15.007 s] -119.0 ms (-0.8%)
tracing 14.601 s [14.601 s, 14.601 s] -525.0 ms (-3.5%)