Home Original page

Combine play spans with surrounding framework context before attaching them by mcculls · Pull Request #10554 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/merge-play-spans-with-framework-context
git_commit_date 1770730700 1770735545
git_commit_sha b90494a 0af0e1d
release_version 1.60.0-SNAPSHOT~b90494a942 1.60.0-SNAPSHOT~0af0e1dfe8
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1770737528 1770737528
ci_job_id 1413537607 1413537607
ci_pipeline_id 95529830 95529830
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-b70zyhv6 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-b70zyhv6 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 62 metrics, 9 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~0af0e1dfe8, baseline=1.60.0-SNAPSHOT~b90494a942

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.065 s) : 0, 1064700
Total [baseline] (8.739 s) : 0, 8738929
Agent [candidate] (1.064 s) : 0, 1063527
Total [candidate] (8.721 s) : 0, 8720817
section iast
Agent [baseline] (1.229 s) : 0, 1228605
Total [baseline] (9.365 s) : 0, 9364830
Agent [candidate] (1.24 s) : 0, 1240120
Total [candidate] (9.353 s) : 0, 9352949
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.065 s -
Agent iast 1.229 s 163.905 ms (15.4%)
Total tracing 8.739 s -
Total iast 9.365 s 625.902 ms (7.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.064 s -
Agent iast 1.24 s 176.592 ms (16.6%)
Total tracing 8.721 s -
Total iast 9.353 s 632.131 ms (7.2%) 
gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~0af0e1dfe8, baseline=1.60.0-SNAPSHOT~b90494a942

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.187 ms) : 0, 1187
crashtracking [candidate] (1.174 ms) : 0, 1174
BytebuddyAgent [baseline] (628.859 ms) : 0, 628859
BytebuddyAgent [candidate] (629.462 ms) : 0, 629462
AgentMeter [baseline] (28.874 ms) : 0, 28874
AgentMeter [candidate] (28.916 ms) : 0, 28916
GlobalTracer [baseline] (257.322 ms) : 0, 257322
GlobalTracer [candidate] (257.909 ms) : 0, 257909
AppSec [baseline] (32.866 ms) : 0, 32866
AppSec [candidate] (32.897 ms) : 0, 32897
Debugger [baseline] (60.451 ms) : 0, 60451
Debugger [candidate] (62.004 ms) : 0, 62004
Remote Config [baseline] (616.81 µs) : 0, 617
Remote Config [candidate] (633.169 µs) : 0, 633
Telemetry [baseline] (13.066 ms) : 0, 13066
Telemetry [candidate] (11.482 ms) : 0, 11482
Flare Poller [baseline] (6.143 ms) : 0, 6143
Flare Poller [candidate] (3.75 ms) : 0, 3750
section iast
crashtracking [baseline] (1.178 ms) : 0, 1178
crashtracking [candidate] (1.185 ms) : 0, 1185
BytebuddyAgent [baseline] (794.009 ms) : 0, 794009
BytebuddyAgent [candidate] (802.406 ms) : 0, 802406
AgentMeter [baseline] (11.253 ms) : 0, 11253
AgentMeter [candidate] (11.51 ms) : 0, 11510
GlobalTracer [baseline] (247.736 ms) : 0, 247736
GlobalTracer [candidate] (249.827 ms) : 0, 249827
IAST [baseline] (26.938 ms) : 0, 26938
IAST [candidate] (27.135 ms) : 0, 27135
AppSec [baseline] (30.55 ms) : 0, 30550
AppSec [candidate] (34.594 ms) : 0, 34594
Debugger [baseline] (68.946 ms) : 0, 68946
Debugger [candidate] (65.245 ms) : 0, 65245
Remote Config [baseline] (545.367 µs) : 0, 545
Remote Config [candidate] (539.282 µs) : 0, 539
Telemetry [baseline] (8.69 ms) : 0, 8690
Telemetry [candidate] (8.78 ms) : 0, 8780
Flare Poller [baseline] (3.496 ms) : 0, 3496
Flare Poller [candidate] (3.498 ms) : 0, 3498
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~0af0e1dfe8, baseline=1.60.0-SNAPSHOT~b90494a942

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.067 s) : 0, 1066774
Total [baseline] (10.839 s) : 0, 10838821
Agent [candidate] (1.065 s) : 0, 1065277
Total [candidate] (10.921 s) : 0, 10920654
section appsec
Agent [baseline] (1.238 s) : 0, 1238080
Total [baseline] (10.975 s) : 0, 10974533
Agent [candidate] (1.237 s) : 0, 1237330
Total [candidate] (11.019 s) : 0, 11019401
section iast
Agent [baseline] (1.237 s) : 0, 1236758
Total [baseline] (11.201 s) : 0, 11200888
Agent [candidate] (1.235 s) : 0, 1235195
Total [candidate] (11.101 s) : 0, 11101248
section profiling
Agent [baseline] (1.189 s) : 0, 1188798
Total [baseline] (10.873 s) : 0, 10872813
Agent [candidate] (1.19 s) : 0, 1190244
Total [candidate] (10.889 s) : 0, 10889127
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.067 s -
Agent appsec 1.238 s 171.306 ms (16.1%)
Agent iast 1.237 s 169.984 ms (15.9%)
Agent profiling 1.189 s 122.024 ms (11.4%)
Total tracing 10.839 s -
Total appsec 10.975 s 135.711 ms (1.3%)
Total iast 11.201 s 362.066 ms (3.3%)
Total profiling 10.873 s 33.992 ms (0.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.065 s -
Agent appsec 1.237 s 172.054 ms (16.2%)
Agent iast 1.235 s 169.919 ms (16.0%)
Agent profiling 1.19 s 124.967 ms (11.7%)
Total tracing 10.921 s -
Total appsec 11.019 s 98.747 ms (0.9%)
Total iast 11.101 s 180.594 ms (1.7%)
Total profiling 10.889 s -31.527 ms (-0.3%) 
gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~0af0e1dfe8, baseline=1.60.0-SNAPSHOT~b90494a942

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.181 ms) : 0, 1181
crashtracking [candidate] (1.175 ms) : 0, 1175
BytebuddyAgent [baseline] (628.919 ms) : 0, 628919
BytebuddyAgent [candidate] (627.886 ms) : 0, 627886
AgentMeter [baseline] (28.792 ms) : 0, 28792
AgentMeter [candidate] (29.079 ms) : 0, 29079
GlobalTracer [baseline] (257.554 ms) : 0, 257554
GlobalTracer [candidate] (258.642 ms) : 0, 258642
AppSec [baseline] (32.6 ms) : 0, 32600
AppSec [candidate] (33.114 ms) : 0, 33114
Debugger [baseline] (61.374 ms) : 0, 61374
Debugger [candidate] (61.675 ms) : 0, 61675
Remote Config [baseline] (608.736 µs) : 0, 609
Remote Config [candidate] (631.001 µs) : 0, 631
Telemetry [baseline] (12.514 ms) : 0, 12514
Telemetry [candidate] (11.628 ms) : 0, 11628
Flare Poller [baseline] (7.763 ms) : 0, 7763
Flare Poller [candidate] (6.19 ms) : 0, 6190
section appsec
crashtracking [baseline] (1.179 ms) : 0, 1179
crashtracking [candidate] (1.203 ms) : 0, 1203
BytebuddyAgent [baseline] (657.638 ms) : 0, 657638
BytebuddyAgent [candidate] (657.267 ms) : 0, 657267
AgentMeter [baseline] (11.95 ms) : 0, 11950
AgentMeter [candidate] (11.983 ms) : 0, 11983
GlobalTracer [baseline] (258.046 ms) : 0, 258046
GlobalTracer [candidate] (258.139 ms) : 0, 258139
AppSec [baseline] (167.734 ms) : 0, 167734
AppSec [candidate] (167.692 ms) : 0, 167692
Debugger [baseline] (67.035 ms) : 0, 67035
Debugger [candidate] (66.859 ms) : 0, 66859
Remote Config [baseline] (653.302 µs) : 0, 653
Remote Config [candidate] (654.812 µs) : 0, 655
Telemetry [baseline] (9.583 ms) : 0, 9583
Telemetry [candidate] (9.456 ms) : 0, 9456
Flare Poller [baseline] (3.754 ms) : 0, 3754
Flare Poller [candidate] (3.688 ms) : 0, 3688
IAST [baseline] (25.211 ms) : 0, 25211
IAST [candidate] (25.071 ms) : 0, 25071
section iast
crashtracking [baseline] (1.2 ms) : 0, 1200
crashtracking [candidate] (1.195 ms) : 0, 1195
BytebuddyAgent [baseline] (799.043 ms) : 0, 799043
BytebuddyAgent [candidate] (798.983 ms) : 0, 798983
AgentMeter [baseline] (11.477 ms) : 0, 11477
AgentMeter [candidate] (11.515 ms) : 0, 11515
GlobalTracer [baseline] (248.557 ms) : 0, 248557
GlobalTracer [candidate] (247.816 ms) : 0, 247816
AppSec [baseline] (34.132 ms) : 0, 34132
AppSec [candidate] (30.487 ms) : 0, 30487
Debugger [baseline] (67.094 ms) : 0, 67094
Debugger [candidate] (70.358 ms) : 0, 70358
Remote Config [baseline] (542.389 µs) : 0, 542
Remote Config [candidate] (597.601 µs) : 0, 598
Telemetry [baseline] (8.666 ms) : 0, 8666
Telemetry [candidate] (8.65 ms) : 0, 8650
Flare Poller [baseline] (3.523 ms) : 0, 3523
Flare Poller [candidate] (3.472 ms) : 0, 3472
IAST [baseline] (27.161 ms) : 0, 27161
IAST [candidate] (26.82 ms) : 0, 26820
section profiling
ProfilingAgent [baseline] (98.928 ms) : 0, 98928
ProfilingAgent [candidate] (99.788 ms) : 0, 99788
crashtracking [baseline] (1.213 ms) : 0, 1213
crashtracking [candidate] (1.209 ms) : 0, 1209
BytebuddyAgent [baseline] (681.233 ms) : 0, 681233
BytebuddyAgent [candidate] (681.534 ms) : 0, 681534
AgentMeter [baseline] (8.547 ms) : 0, 8547
AgentMeter [candidate] (8.555 ms) : 0, 8555
GlobalTracer [baseline] (215.258 ms) : 0, 215258
GlobalTracer [candidate] (215.501 ms) : 0, 215501
AppSec [baseline] (32.514 ms) : 0, 32514
AppSec [candidate] (32.613 ms) : 0, 32613
Debugger [baseline] (67.923 ms) : 0, 67923
Debugger [candidate] (67.757 ms) : 0, 67757
Remote Config [baseline] (621.789 µs) : 0, 622
Remote Config [candidate] (637.086 µs) : 0, 637
Telemetry [baseline] (9.025 ms) : 0, 9025
Telemetry [candidate] (9.053 ms) : 0, 9053
Flare Poller [baseline] (3.758 ms) : 0, 3758
Flare Poller [candidate] (3.751 ms) : 0, 3751
Profiling [baseline] (99.495 ms) : 0, 99495
Profiling [candidate] (100.366 ms) : 0, 100366
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/merge-play-spans-with-framework-context
git_commit_date 1770730700 1770735545
git_commit_sha b90494a 0af0e1d
release_version 1.60.0-SNAPSHOT~b90494a942 1.60.0-SNAPSHOT~0af0e1dfe8
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1770738040 1770738040
ci_job_id 1413537608 1413537608
ci_pipeline_id 95529830 95529830
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-kwn4kz4k 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-kwn4kz4k 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 3 performance regressions! Performance is the same for 16 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:profiling:high_load worse
[+113.179µs; +237.437µs] or [+7.206%; +15.118%]		 unstable
[+0.688ms; +1.523ms] or [+16.125%; +35.682%]		 unstable
[-583.985op/s; -94.390op/s] or [-24.681%; -3.989%]		 1.746ms 5.373ms 2026.969op/s 1.571ms 4.267ms 2366.156op/s
scenario:load:petclinic:no_agent:high_load better
[-2.014ms; -0.584ms] or [-10.791%; -3.130%]		 unstable
[-3.397ms; +0.296ms] or [-10.890%; +0.950%]		 unstable
[-12.629op/s; +43.629op/s] or [-5.162%; +17.833%]		 17.366ms 29.639ms 260.156op/s 18.665ms 31.190ms 244.656op/s
scenario:load:petclinic:profiling:high_load worse
[+0.793ms; +2.004ms] or [+4.312%; +10.890%]		 unsure
[+0.516ms; +2.554ms] or [+1.718%; +8.511%]		 unstable
[-40.586op/s; +9.399op/s] or [-16.296%; +3.774%]		 19.796ms 31.542ms 233.469op/s 18.398ms 30.007ms 249.062op/s
scenario:load:petclinic:tracing:high_load worse
[+415.849µs; +941.010µs] or [+2.457%; +5.560%]		 same
[-76.712µs; +1153.187µs] or [-0.271%; +4.068%]		 unstable
[-32.619op/s; +21.244op/s] or [-12.245%; +7.975%]		 17.605ms 28.889ms 260.688op/s 16.926ms 28.351ms 266.375op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~0af0e1dfe8, baseline=1.60.0-SNAPSHOT~b90494a942
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.177 ms) : 1166, 1189
.   : milestone, 1177,
iast (3.151 ms) : 3110, 3192
.   : milestone, 3151,
iast_FULL (5.838 ms) : 5780, 5896
.   : milestone, 5838,
iast_GLOBAL (3.528 ms) : 3482, 3574
.   : milestone, 3528,
profiling (1.903 ms) : 1886, 1920
.   : milestone, 1903,
tracing (1.828 ms) : 1813, 1843
.   : milestone, 1828,
section candidate
no_agent (1.206 ms) : 1194, 1218
.   : milestone, 1206,
iast (3.247 ms) : 3202, 3292
.   : milestone, 3247,
iast_FULL (6.027 ms) : 5965, 6089
.   : milestone, 6027,
iast_GLOBAL (3.525 ms) : 3467, 3583
.   : milestone, 3525,
profiling (2.235 ms) : 2215, 2256
.   : milestone, 2235,
tracing (1.806 ms) : 1791, 1822
.   : milestone, 1806,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.177 ms [1.166 ms, 1.189 ms] -
iast 3.151 ms [3.11 ms, 3.192 ms] 1.974 ms (167.7%)
iast_FULL 5.838 ms [5.78 ms, 5.896 ms] 4.661 ms (396.0%)
iast_GLOBAL 3.528 ms [3.482 ms, 3.574 ms] 2.351 ms (199.7%)
profiling 1.903 ms [1.886 ms, 1.92 ms] 726.167 µs (61.7%)
tracing 1.828 ms [1.813 ms, 1.843 ms] 651.034 µs (55.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.206 ms [1.194 ms, 1.218 ms] -
iast 3.247 ms [3.202 ms, 3.292 ms] 2.041 ms (169.3%)
iast_FULL 6.027 ms [5.965 ms, 6.089 ms] 4.821 ms (399.8%)
iast_GLOBAL 3.525 ms [3.467 ms, 3.583 ms] 2.319 ms (192.3%)
profiling 2.235 ms [2.215 ms, 2.256 ms] 1.029 ms (85.3%)
tracing 1.806 ms [1.791 ms, 1.822 ms] 600.469 µs (49.8%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~0af0e1dfe8, baseline=1.60.0-SNAPSHOT~b90494a942
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.076 ms) : 18881, 19272
.   : milestone, 19076,
appsec (18.409 ms) : 18222, 18596
.   : milestone, 18409,
code_origins (17.819 ms) : 17639, 17998
.   : milestone, 17819,
iast (17.842 ms) : 17663, 18021
.   : milestone, 17842,
profiling (18.74 ms) : 18550, 18930
.   : milestone, 18740,
tracing (17.519 ms) : 17344, 17695
.   : milestone, 17519,
section candidate
no_agent (17.933 ms) : 17747, 18120
.   : milestone, 17933,
appsec (18.409 ms) : 18226, 18592
.   : milestone, 18409,
code_origins (17.764 ms) : 17589, 17939
.   : milestone, 17764,
iast (17.605 ms) : 17431, 17779
.   : milestone, 17605,
profiling (20.0 ms) : 19794, 20206
.   : milestone, 20000,
tracing (17.905 ms) : 17728, 18082
.   : milestone, 17905,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.076 ms [18.881 ms, 19.272 ms] -
appsec 18.409 ms [18.222 ms, 18.596 ms] -667.294 µs (-3.5%)
code_origins 17.819 ms [17.639 ms, 17.998 ms] -1.258 ms (-6.6%)
iast 17.842 ms [17.663 ms, 18.021 ms] -1.234 ms (-6.5%)
profiling 18.74 ms [18.55 ms, 18.93 ms] -336.429 µs (-1.8%)
tracing 17.519 ms [17.344 ms, 17.695 ms] -1.557 ms (-8.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.933 ms [17.747 ms, 18.12 ms] -
appsec 18.409 ms [18.226 ms, 18.592 ms] 476.278 µs (2.7%)
code_origins 17.764 ms [17.589 ms, 17.939 ms] -168.816 µs (-0.9%)
iast 17.605 ms [17.431 ms, 17.779 ms] -328.01 µs (-1.8%)
profiling 20.0 ms [19.794 ms, 20.206 ms] 2.067 ms (11.5%)
tracing 17.905 ms [17.728 ms, 18.082 ms] -28.352 µs (-0.2%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/merge-play-spans-with-framework-context
git_commit_date 1770730700 1770735545
git_commit_sha b90494a 0af0e1d
release_version 1.60.0-SNAPSHOT~b90494a942 1.60.0-SNAPSHOT~0af0e1dfe8
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1770737770 1770737770
ci_job_id 1413537610 1413537610
ci_pipeline_id 95529830 95529830
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-mwejwrp4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-mwejwrp4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:dacapo:tomcat:appsec better
[-1.378ms; -1.030ms] or [-36.514%; -27.279%]		 2.570ms 3.774ms
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~0af0e1dfe8, baseline=1.60.0-SNAPSHOT~b90494a942
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.472 ms) : 1461, 1484
.   : milestone, 1472,
appsec (3.774 ms) : 3553, 3996
.   : milestone, 3774,
iast (2.249 ms) : 2180, 2318
.   : milestone, 2249,
iast_GLOBAL (2.292 ms) : 2222, 2361
.   : milestone, 2292,
profiling (2.097 ms) : 2041, 2154
.   : milestone, 2097,
tracing (2.069 ms) : 2016, 2123
.   : milestone, 2069,
section candidate
no_agent (1.473 ms) : 1461, 1484
.   : milestone, 1473,
appsec (2.57 ms) : 2512, 2628
.   : milestone, 2570,
iast (2.25 ms) : 2181, 2319
.   : milestone, 2250,
iast_GLOBAL (2.286 ms) : 2217, 2356
.   : milestone, 2286,
profiling (2.086 ms) : 2031, 2141
.   : milestone, 2086,
tracing (2.065 ms) : 2012, 2119
.   : milestone, 2065,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.472 ms [1.461 ms, 1.484 ms] -
appsec 3.774 ms [3.553 ms, 3.996 ms] 2.302 ms (156.3%)
iast 2.249 ms [2.18 ms, 2.318 ms] 776.546 µs (52.7%)
iast_GLOBAL 2.292 ms [2.222 ms, 2.361 ms] 819.177 µs (55.6%)
profiling 2.097 ms [2.041 ms, 2.154 ms] 624.867 µs (42.4%)
tracing 2.069 ms [2.016 ms, 2.123 ms] 596.998 µs (40.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.473 ms [1.461 ms, 1.484 ms] -
appsec 2.57 ms [2.512 ms, 2.628 ms] 1.097 ms (74.5%)
iast 2.25 ms [2.181 ms, 2.319 ms] 777.374 µs (52.8%)
iast_GLOBAL 2.286 ms [2.217 ms, 2.356 ms] 813.265 µs (55.2%)
profiling 2.086 ms [2.031 ms, 2.141 ms] 613.323 µs (41.6%)
tracing 2.065 ms [2.012 ms, 2.119 ms] 592.403 µs (40.2%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~0af0e1dfe8, baseline=1.60.0-SNAPSHOT~b90494a942
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.006 s) : 15006000, 15006000
.   : milestone, 15006000,
appsec (14.968 s) : 14968000, 14968000
.   : milestone, 14968000,
iast (18.662 s) : 18662000, 18662000
.   : milestone, 18662000,
iast_GLOBAL (17.899 s) : 17899000, 17899000
.   : milestone, 17899000,
profiling (14.651 s) : 14651000, 14651000
.   : milestone, 14651000,
tracing (14.747 s) : 14747000, 14747000
.   : milestone, 14747000,
section candidate
no_agent (15.414 s) : 15414000, 15414000
.   : milestone, 15414000,
appsec (14.627 s) : 14627000, 14627000
.   : milestone, 14627000,
iast (17.987 s) : 17987000, 17987000
.   : milestone, 17987000,
iast_GLOBAL (17.976 s) : 17976000, 17976000
.   : milestone, 17976000,
profiling (14.97 s) : 14970000, 14970000
.   : milestone, 14970000,
tracing (14.596 s) : 14596000, 14596000
.   : milestone, 14596000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.006 s [15.006 s, 15.006 s] -
appsec 14.968 s [14.968 s, 14.968 s] -38.0 ms (-0.3%)
iast 18.662 s [18.662 s, 18.662 s] 3.656 s (24.4%)
iast_GLOBAL 17.899 s [17.899 s, 17.899 s] 2.893 s (19.3%)
profiling 14.651 s [14.651 s, 14.651 s] -355.0 ms (-2.4%)
tracing 14.747 s [14.747 s, 14.747 s] -259.0 ms (-1.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.414 s [15.414 s, 15.414 s] -
appsec 14.627 s [14.627 s, 14.627 s] -787.0 ms (-5.1%)
iast 17.987 s [17.987 s, 17.987 s] 2.573 s (16.7%)
iast_GLOBAL 17.976 s [17.976 s, 17.976 s] 2.562 s (16.6%)
profiling 14.97 s [14.97 s, 14.97 s] -444.0 ms (-2.9%)
tracing 14.596 s [14.596 s, 14.596 s] -818.0 ms (-5.3%)