Home Original page

Propagate response body in case of non 200 status code. by AlexeyKuznetsov-DD · Pull Request #10593 · DataDog/dd-trace-java

Benchmarks

⚠️ Warning: Baseline build not found for merge-base commit. Comparing against the latest commit on master instead.

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/propagate-response-body-for-non-200
git_commit_date 1771016879 1771016017
git_commit_sha 4d6eb0e fd7d4e6
release_version 1.60.0-SNAPSHOT~4d6eb0ee6d 1.60.0-SNAPSHOT~fd7d4e6e17
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1771018669 1771018669
ci_job_id 1426416611 1426416611
ci_pipeline_id 96532361 96532361
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-a5y53d3c 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-a5y53d3c 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 61 metrics, 9 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:petclinic:tracing:Debugger better
[-7.460ms; -2.800ms] or [-11.356%; -4.262%]		 60.564ms 65.694ms
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~fd7d4e6e17, baseline=1.60.0-SNAPSHOT~4d6eb0ee6d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.066 s) : 0, 1065767
Total [baseline] (8.741 s) : 0, 8741075
Agent [candidate] (1.064 s) : 0, 1064209
Total [candidate] (8.762 s) : 0, 8761510
section iast
Agent [baseline] (1.24 s) : 0, 1239589
Total [baseline] (9.371 s) : 0, 9371309
Agent [candidate] (1.231 s) : 0, 1230849
Total [candidate] (9.34 s) : 0, 9340277
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.066 s -
Agent iast 1.24 s 173.822 ms (16.3%)
Total tracing 8.741 s -
Total iast 9.371 s 630.233 ms (7.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.064 s -
Agent iast 1.231 s 166.64 ms (15.7%)
Total tracing 8.762 s -
Total iast 9.34 s 578.768 ms (6.6%) 
gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~fd7d4e6e17, baseline=1.60.0-SNAPSHOT~4d6eb0ee6d

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.179 ms) : 0, 1179
crashtracking [candidate] (1.183 ms) : 0, 1183
BytebuddyAgent [baseline] (629.053 ms) : 0, 629053
BytebuddyAgent [candidate] (629.311 ms) : 0, 629311
AgentMeter [baseline] (28.961 ms) : 0, 28961
AgentMeter [candidate] (29.03 ms) : 0, 29030
GlobalTracer [baseline] (257.316 ms) : 0, 257316
GlobalTracer [candidate] (258.271 ms) : 0, 258271
AppSec [baseline] (32.921 ms) : 0, 32921
AppSec [candidate] (32.615 ms) : 0, 32615
Debugger [baseline] (61.394 ms) : 0, 61394
Debugger [candidate] (60.311 ms) : 0, 60311
Remote Config [baseline] (625.257 µs) : 0, 625
Remote Config [candidate] (619.567 µs) : 0, 620
Telemetry [baseline] (11.392 ms) : 0, 11392
Telemetry [candidate] (12.159 ms) : 0, 12159
Flare Poller [baseline] (7.612 ms) : 0, 7612
Flare Poller [candidate] (5.377 ms) : 0, 5377
section iast
crashtracking [baseline] (1.186 ms) : 0, 1186
crashtracking [candidate] (1.173 ms) : 0, 1173
BytebuddyAgent [baseline] (801.666 ms) : 0, 801666
BytebuddyAgent [candidate] (795.981 ms) : 0, 795981
AgentMeter [baseline] (11.477 ms) : 0, 11477
AgentMeter [candidate] (11.246 ms) : 0, 11246
GlobalTracer [baseline] (249.549 ms) : 0, 249549
GlobalTracer [candidate] (248.209 ms) : 0, 248209
IAST [baseline] (27.174 ms) : 0, 27174
IAST [candidate] (26.842 ms) : 0, 26842
AppSec [baseline] (33.268 ms) : 0, 33268
AppSec [candidate] (33.924 ms) : 0, 33924
Debugger [baseline] (67.06 ms) : 0, 67060
Debugger [candidate] (65.554 ms) : 0, 65554
Remote Config [baseline] (539.493 µs) : 0, 539
Remote Config [candidate] (540.321 µs) : 0, 540
Telemetry [baseline] (8.739 ms) : 0, 8739
Telemetry [candidate] (8.62 ms) : 0, 8620
Flare Poller [baseline] (3.558 ms) : 0, 3558
Flare Poller [candidate] (3.482 ms) : 0, 3482
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~fd7d4e6e17, baseline=1.60.0-SNAPSHOT~4d6eb0ee6d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.073 s) : 0, 1073310
Total [baseline] (10.905 s) : 0, 10904907
Agent [candidate] (1.062 s) : 0, 1061752
Total [candidate] (10.844 s) : 0, 10843699
section appsec
Agent [baseline] (1.24 s) : 0, 1240098
Total [baseline] (11.025 s) : 0, 11024590
Agent [candidate] (1.244 s) : 0, 1243631
Total [candidate] (10.968 s) : 0, 10968037
section iast
Agent [baseline] (1.234 s) : 0, 1233996
Total [baseline] (11.225 s) : 0, 11224846
Agent [candidate] (1.242 s) : 0, 1242073
Total [candidate] (11.239 s) : 0, 11239077
section profiling
Agent [baseline] (1.198 s) : 0, 1198012
Total [baseline] (11.039 s) : 0, 11039421
Agent [candidate] (1.188 s) : 0, 1187787
Total [candidate] (10.911 s) : 0, 10910801
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.073 s -
Agent appsec 1.24 s 166.788 ms (15.5%)
Agent iast 1.234 s 160.686 ms (15.0%)
Agent profiling 1.198 s 124.702 ms (11.6%)
Total tracing 10.905 s -
Total appsec 11.025 s 119.683 ms (1.1%)
Total iast 11.225 s 319.939 ms (2.9%)
Total profiling 11.039 s 134.514 ms (1.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.062 s -
Agent appsec 1.244 s 181.879 ms (17.1%)
Agent iast 1.242 s 180.321 ms (17.0%)
Agent profiling 1.188 s 126.035 ms (11.9%)
Total tracing 10.844 s -
Total appsec 10.968 s 124.337 ms (1.1%)
Total iast 11.239 s 395.377 ms (3.6%)
Total profiling 10.911 s 67.101 ms (0.6%) 
gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~fd7d4e6e17, baseline=1.60.0-SNAPSHOT~4d6eb0ee6d

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.186 ms) : 0, 1186
crashtracking [candidate] (1.178 ms) : 0, 1178
BytebuddyAgent [baseline] (633.352 ms) : 0, 633352
BytebuddyAgent [candidate] (627.208 ms) : 0, 627208
AgentMeter [baseline] (29.102 ms) : 0, 29102
AgentMeter [candidate] (28.947 ms) : 0, 28947
GlobalTracer [baseline] (258.734 ms) : 0, 258734
GlobalTracer [candidate] (256.918 ms) : 0, 256918
AppSec [baseline] (33.096 ms) : 0, 33096
AppSec [candidate] (32.717 ms) : 0, 32717
Debugger [baseline] (65.694 ms) : 0, 65694
Debugger [candidate] (60.564 ms) : 0, 60564
Remote Config [baseline] (613.837 µs) : 0, 614
Remote Config [candidate] (619.626 µs) : 0, 620
Telemetry [baseline] (10.704 ms) : 0, 10704
Telemetry [candidate] (12.226 ms) : 0, 12226
Flare Poller [baseline] (5.423 ms) : 0, 5423
Flare Poller [candidate] (6.078 ms) : 0, 6078
section appsec
crashtracking [baseline] (1.198 ms) : 0, 1198
crashtracking [candidate] (1.169 ms) : 0, 1169
BytebuddyAgent [baseline] (658.452 ms) : 0, 658452
BytebuddyAgent [candidate] (660.398 ms) : 0, 660398
AgentMeter [baseline] (12.02 ms) : 0, 12020
AgentMeter [candidate] (12.0 ms) : 0, 12000
GlobalTracer [baseline] (258.338 ms) : 0, 258338
GlobalTracer [candidate] (259.465 ms) : 0, 259465
IAST [baseline] (25.17 ms) : 0, 25170
IAST [candidate] (25.329 ms) : 0, 25329
AppSec [baseline] (168.238 ms) : 0, 168238
AppSec [candidate] (168.056 ms) : 0, 168056
Debugger [baseline] (67.239 ms) : 0, 67239
Debugger [candidate] (67.665 ms) : 0, 67665
Remote Config [baseline] (659.759 µs) : 0, 660
Remote Config [candidate] (679.64 µs) : 0, 680
Telemetry [baseline] (9.703 ms) : 0, 9703
Telemetry [candidate] (9.788 ms) : 0, 9788
Flare Poller [baseline] (3.73 ms) : 0, 3730
Flare Poller [candidate] (3.815 ms) : 0, 3815
section iast
crashtracking [baseline] (1.188 ms) : 0, 1188
crashtracking [candidate] (1.188 ms) : 0, 1188
BytebuddyAgent [baseline] (796.707 ms) : 0, 796707
BytebuddyAgent [candidate] (804.226 ms) : 0, 804226
AgentMeter [baseline] (11.257 ms) : 0, 11257
AgentMeter [candidate] (11.547 ms) : 0, 11547
GlobalTracer [baseline] (249.008 ms) : 0, 249008
GlobalTracer [candidate] (250.304 ms) : 0, 250304
IAST [baseline] (26.996 ms) : 0, 26996
IAST [candidate] (26.717 ms) : 0, 26717
AppSec [baseline] (33.21 ms) : 0, 33210
AppSec [candidate] (32.01 ms) : 0, 32010
Debugger [baseline] (67.736 ms) : 0, 67736
Debugger [candidate] (68.174 ms) : 0, 68174
Remote Config [baseline] (540.406 µs) : 0, 540
Remote Config [candidate] (543.733 µs) : 0, 544
Telemetry [baseline] (8.591 ms) : 0, 8591
Telemetry [candidate] (8.53 ms) : 0, 8530
Flare Poller [baseline] (3.506 ms) : 0, 3506
Flare Poller [candidate] (3.389 ms) : 0, 3389
section profiling
crashtracking [baseline] (1.22 ms) : 0, 1220
crashtracking [candidate] (1.208 ms) : 0, 1208
BytebuddyAgent [baseline] (687.448 ms) : 0, 687448
BytebuddyAgent [candidate] (681.3 ms) : 0, 681300
AgentMeter [baseline] (8.717 ms) : 0, 8717
AgentMeter [candidate] (8.571 ms) : 0, 8571
GlobalTracer [baseline] (217.374 ms) : 0, 217374
GlobalTracer [candidate] (215.422 ms) : 0, 215422
AppSec [baseline] (32.846 ms) : 0, 32846
AppSec [candidate] (32.396 ms) : 0, 32396
Debugger [baseline] (67.419 ms) : 0, 67419
Debugger [candidate] (66.845 ms) : 0, 66845
Remote Config [baseline] (621.077 µs) : 0, 621
Remote Config [candidate] (623.646 µs) : 0, 624
Telemetry [baseline] (8.889 ms) : 0, 8889
Telemetry [candidate] (8.857 ms) : 0, 8857
Flare Poller [baseline] (3.763 ms) : 0, 3763
Flare Poller [candidate] (3.748 ms) : 0, 3748
ProfilingAgent [baseline] (99.33 ms) : 0, 99330
ProfilingAgent [candidate] (99.001 ms) : 0, 99001
Profiling [baseline] (99.904 ms) : 0, 99904
Profiling [candidate] (99.567 ms) : 0, 99567
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/propagate-response-body-for-non-200
git_commit_date 1771016879 1771016017
git_commit_sha 4d6eb0e fd7d4e6
release_version 1.60.0-SNAPSHOT~4d6eb0ee6d 1.60.0-SNAPSHOT~fd7d4e6e17
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1771019160 1771019160
ci_job_id 1426416612 1426416612
ci_pipeline_id 96532361 96532361
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-ipwwjuvn 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-ipwwjuvn 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 4 performance regressions! Performance is the same for 14 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:profiling:high_load worse
[+84.767µs; +229.796µs] or [+5.271%; +14.291%]		 unstable
[+0.422ms; +1.648ms] or [+9.187%; +35.878%]		 unstable
[-542.589op/s; -24.036op/s] or [-23.671%; -1.049%]		 1.765ms 5.630ms 2008.875op/s 1.608ms 4.594ms 2292.188op/s
scenario:load:petclinic:code_origins:high_load better
[-1.437ms; -0.615ms] or [-7.841%; -3.354%]		 better
[-2.090ms; -0.792ms] or [-7.005%; -2.655%]		 unstable
[-11.685op/s; +45.185op/s] or [-4.724%; +18.266%]		 17.304ms 28.387ms 264.125op/s 18.330ms 29.828ms 247.375op/s
scenario:load:petclinic:profiling:high_load worse
[+0.901ms; +1.775ms] or [+4.977%; +9.800%]		 unsure
[+0.196ms; +1.989ms] or [+0.655%; +6.657%]		 unstable
[-42.063op/s; +12.813op/s] or [-16.727%; +5.095%]		 19.447ms 30.972ms 236.844op/s 18.109ms 29.880ms 251.469op/s
scenario:load:petclinic:tracing:high_load worse
[+0.855ms; +1.773ms] or [+5.030%; +10.424%]		 worse
[+1.121ms; +2.731ms] or [+4.010%; +9.773%]		 unstable
[-46.287op/s; +12.099op/s] or [-17.271%; +4.515%]		 18.320ms 29.871ms 250.906op/s 17.006ms 27.945ms 268.000op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~fd7d4e6e17, baseline=1.60.0-SNAPSHOT~4d6eb0ee6d
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.177 ms) : 1165, 1188
.   : milestone, 1177,
iast (3.197 ms) : 3152, 3241
.   : milestone, 3197,
iast_FULL (5.965 ms) : 5905, 6026
.   : milestone, 5965,
iast_GLOBAL (3.548 ms) : 3491, 3605
.   : milestone, 3548,
profiling (1.968 ms) : 1952, 1985
.   : milestone, 1968,
tracing (1.794 ms) : 1778, 1809
.   : milestone, 1794,
section candidate
no_agent (1.212 ms) : 1200, 1224
.   : milestone, 1212,
iast (3.068 ms) : 3032, 3105
.   : milestone, 3068,
iast_FULL (5.9 ms) : 5841, 5959
.   : milestone, 5900,
iast_GLOBAL (3.684 ms) : 3623, 3745
.   : milestone, 3684,
profiling (2.256 ms) : 2232, 2279
.   : milestone, 2256,
tracing (1.811 ms) : 1796, 1825
.   : milestone, 1811,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.177 ms [1.165 ms, 1.188 ms] -
iast 3.197 ms [3.152 ms, 3.241 ms] 2.02 ms (171.7%)
iast_FULL 5.965 ms [5.905 ms, 6.026 ms] 4.788 ms (406.9%)
iast_GLOBAL 3.548 ms [3.491 ms, 3.605 ms] 2.371 ms (201.5%)
profiling 1.968 ms [1.952 ms, 1.985 ms] 791.509 µs (67.3%)
tracing 1.794 ms [1.778 ms, 1.809 ms] 616.837 µs (52.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.212 ms [1.2 ms, 1.224 ms] -
iast 3.068 ms [3.032 ms, 3.105 ms] 1.856 ms (153.2%)
iast_FULL 5.9 ms [5.841 ms, 5.959 ms] 4.688 ms (386.9%)
iast_GLOBAL 3.684 ms [3.623 ms, 3.745 ms] 2.472 ms (204.0%)
profiling 2.256 ms [2.232 ms, 2.279 ms] 1.044 ms (86.1%)
tracing 1.811 ms [1.796 ms, 1.825 ms] 598.73 µs (49.4%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~fd7d4e6e17, baseline=1.60.0-SNAPSHOT~4d6eb0ee6d
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.316 ms) : 19119, 19513
.   : milestone, 19316,
appsec (18.751 ms) : 18564, 18938
.   : milestone, 18751,
code_origins (18.867 ms) : 18676, 19058
.   : milestone, 18867,
iast (17.527 ms) : 17354, 17699
.   : milestone, 17527,
profiling (18.556 ms) : 18368, 18745
.   : milestone, 18556,
tracing (17.411 ms) : 17240, 17582
.   : milestone, 17411,
section candidate
no_agent (19.067 ms) : 18873, 19261
.   : milestone, 19067,
appsec (18.688 ms) : 18498, 18877
.   : milestone, 18688,
code_origins (17.665 ms) : 17487, 17843
.   : milestone, 17665,
iast (17.569 ms) : 17391, 17746
.   : milestone, 17569,
profiling (19.71 ms) : 19511, 19909
.   : milestone, 19710,
tracing (18.603 ms) : 18412, 18794
.   : milestone, 18603,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.316 ms [19.119 ms, 19.513 ms] -
appsec 18.751 ms [18.564 ms, 18.938 ms] -564.824 µs (-2.9%)
code_origins 18.867 ms [18.676 ms, 19.058 ms] -448.955 µs (-2.3%)
iast 17.527 ms [17.354 ms, 17.699 ms] -1.79 ms (-9.3%)
profiling 18.556 ms [18.368 ms, 18.745 ms] -759.849 µs (-3.9%)
tracing 17.411 ms [17.24 ms, 17.582 ms] -1.905 ms (-9.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.067 ms [18.873 ms, 19.261 ms] -
appsec 18.688 ms [18.498 ms, 18.877 ms] -379.255 µs (-2.0%)
code_origins 17.665 ms [17.487 ms, 17.843 ms] -1.402 ms (-7.4%)
iast 17.569 ms [17.391 ms, 17.746 ms] -1.498 ms (-7.9%)
profiling 19.71 ms [19.511 ms, 19.909 ms] 643.322 µs (3.4%)
tracing 18.603 ms [18.412 ms, 18.794 ms] -464.228 µs (-2.4%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/propagate-response-body-for-non-200
git_commit_date 1771016879 1771016017
git_commit_sha 4d6eb0e fd7d4e6
release_version 1.60.0-SNAPSHOT~4d6eb0ee6d 1.60.0-SNAPSHOT~fd7d4e6e17
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1771018936 1771018936
ci_job_id 1426416614 1426416614
ci_pipeline_id 96532361 96532361
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-sgk5d4p4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-sgk5d4p4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~fd7d4e6e17, baseline=1.60.0-SNAPSHOT~4d6eb0ee6d
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.472 ms) : 1461, 1484
.   : milestone, 1472,
appsec (2.569 ms) : 2511, 2626
.   : milestone, 2569,
iast (2.238 ms) : 2170, 2306
.   : milestone, 2238,
iast_GLOBAL (2.284 ms) : 2215, 2353
.   : milestone, 2284,
profiling (2.11 ms) : 2054, 2166
.   : milestone, 2110,
tracing (2.067 ms) : 2013, 2120
.   : milestone, 2067,
section candidate
no_agent (1.471 ms) : 1460, 1483
.   : milestone, 1471,
appsec (3.776 ms) : 3555, 3996
.   : milestone, 3776,
iast (2.238 ms) : 2169, 2307
.   : milestone, 2238,
iast_GLOBAL (2.284 ms) : 2215, 2352
.   : milestone, 2284,
profiling (2.07 ms) : 2016, 2125
.   : milestone, 2070,
tracing (2.048 ms) : 1995, 2101
.   : milestone, 2048,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.472 ms [1.461 ms, 1.484 ms] -
appsec 2.569 ms [2.511 ms, 2.626 ms] 1.097 ms (74.5%)
iast 2.238 ms [2.17 ms, 2.306 ms] 765.91 µs (52.0%)
iast_GLOBAL 2.284 ms [2.215 ms, 2.353 ms] 811.909 µs (55.2%)
profiling 2.11 ms [2.054 ms, 2.166 ms] 638.103 µs (43.3%)
tracing 2.067 ms [2.013 ms, 2.12 ms] 594.381 µs (40.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.471 ms [1.46 ms, 1.483 ms] -
appsec 3.776 ms [3.555 ms, 3.996 ms] 2.304 ms (156.6%)
iast 2.238 ms [2.169 ms, 2.307 ms] 766.602 µs (52.1%)
iast_GLOBAL 2.284 ms [2.215 ms, 2.352 ms] 812.425 µs (55.2%)
profiling 2.07 ms [2.016 ms, 2.125 ms] 599.231 µs (40.7%)
tracing 2.048 ms [1.995 ms, 2.101 ms] 576.765 µs (39.2%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~fd7d4e6e17, baseline=1.60.0-SNAPSHOT~4d6eb0ee6d
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.892 s) : 14892000, 14892000
.   : milestone, 14892000,
appsec (14.746 s) : 14746000, 14746000
.   : milestone, 14746000,
iast (17.776 s) : 17776000, 17776000
.   : milestone, 17776000,
iast_GLOBAL (17.913 s) : 17913000, 17913000
.   : milestone, 17913000,
profiling (14.673 s) : 14673000, 14673000
.   : milestone, 14673000,
tracing (14.522 s) : 14522000, 14522000
.   : milestone, 14522000,
section candidate
no_agent (15.34 s) : 15340000, 15340000
.   : milestone, 15340000,
appsec (14.641 s) : 14641000, 14641000
.   : milestone, 14641000,
iast (18.636 s) : 18636000, 18636000
.   : milestone, 18636000,
iast_GLOBAL (17.88 s) : 17880000, 17880000
.   : milestone, 17880000,
profiling (14.794 s) : 14794000, 14794000
.   : milestone, 14794000,
tracing (14.718 s) : 14718000, 14718000
.   : milestone, 14718000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.892 s [14.892 s, 14.892 s] -
appsec 14.746 s [14.746 s, 14.746 s] -146.0 ms (-1.0%)
iast 17.776 s [17.776 s, 17.776 s] 2.884 s (19.4%)
iast_GLOBAL 17.913 s [17.913 s, 17.913 s] 3.021 s (20.3%)
profiling 14.673 s [14.673 s, 14.673 s] -219.0 ms (-1.5%)
tracing 14.522 s [14.522 s, 14.522 s] -370.0 ms (-2.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.34 s [15.34 s, 15.34 s] -
appsec 14.641 s [14.641 s, 14.641 s] -699.0 ms (-4.6%)
iast 18.636 s [18.636 s, 18.636 s] 3.296 s (21.5%)
iast_GLOBAL 17.88 s [17.88 s, 17.88 s] 2.54 s (16.6%)
profiling 14.794 s [14.794 s, 14.794 s] -546.0 ms (-3.6%)
tracing 14.718 s [14.718 s, 14.718 s] -622.0 ms (-4.1%)