Home Original page

Provide canned resource message for OpenTelemetry's "resource.proto" wire protocol by mcculls · Pull Request #10957 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/otlp-resource-proto
git_commit_date 1774458906 1774459762
git_commit_sha e4c4150 3672038
release_version 1.61.0-SNAPSHOT~e4c4150593 1.61.0-SNAPSHOT~36720385eb
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1774461681 1774461681
ci_job_id 1538536489 1538536489
ci_pipeline_id 104387488 104387488
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-knd8t4de 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-knd8t4de 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 63 metrics, 8 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.61.0-SNAPSHOT~36720385eb, baseline=1.61.0-SNAPSHOT~e4c4150593

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.068 s) : 0, 1068139
Total [baseline] (8.878 s) : 0, 8877507
Agent [candidate] (1.059 s) : 0, 1058854
Total [candidate] (8.885 s) : 0, 8884519
section iast
Agent [baseline] (1.226 s) : 0, 1225894
Total [baseline] (9.573 s) : 0, 9572739
Agent [candidate] (1.234 s) : 0, 1234313
Total [candidate] (9.629 s) : 0, 9628956
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.068 s -
Agent iast 1.226 s 157.755 ms (14.8%)
Total tracing 8.878 s -
Total iast 9.573 s 695.232 ms (7.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.059 s -
Agent iast 1.234 s 175.459 ms (16.6%)
Total tracing 8.885 s -
Total iast 9.629 s 744.437 ms (8.4%) 
gantt
    title insecure-bank - break down per module: candidate=1.61.0-SNAPSHOT~36720385eb, baseline=1.61.0-SNAPSHOT~e4c4150593

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.23 ms) : 0, 1230
crashtracking [candidate] (1.196 ms) : 0, 1196
BytebuddyAgent [baseline] (635.293 ms) : 0, 635293
BytebuddyAgent [candidate] (628.388 ms) : 0, 628388
AgentMeter [baseline] (29.777 ms) : 0, 29777
AgentMeter [candidate] (29.643 ms) : 0, 29643
GlobalTracer [baseline] (258.934 ms) : 0, 258934
GlobalTracer [candidate] (258.169 ms) : 0, 258169
AppSec [baseline] (32.052 ms) : 0, 32052
AppSec [candidate] (31.891 ms) : 0, 31891
Debugger [baseline] (60.018 ms) : 0, 60018
Debugger [candidate] (59.777 ms) : 0, 59777
Remote Config [baseline] (590.74 µs) : 0, 591
Remote Config [candidate] (586.6 µs) : 0, 587
Telemetry [baseline] (8.806 ms) : 0, 8806
Telemetry [candidate] (8.824 ms) : 0, 8824
Flare Poller [baseline] (4.954 ms) : 0, 4954
Flare Poller [candidate] (4.299 ms) : 0, 4299
section iast
crashtracking [baseline] (1.202 ms) : 0, 1202
crashtracking [candidate] (1.201 ms) : 0, 1201
BytebuddyAgent [baseline] (795.26 ms) : 0, 795260
BytebuddyAgent [candidate] (800.389 ms) : 0, 800389
AgentMeter [baseline] (11.378 ms) : 0, 11378
AgentMeter [candidate] (11.45 ms) : 0, 11450
GlobalTracer [baseline] (246.93 ms) : 0, 246930
GlobalTracer [candidate] (249.276 ms) : 0, 249276
AppSec [baseline] (26.496 ms) : 0, 26496
AppSec [candidate] (26.756 ms) : 0, 26756
Debugger [baseline] (69.411 ms) : 0, 69411
Debugger [candidate] (67.41 ms) : 0, 67410
Remote Config [baseline] (528.345 µs) : 0, 528
Remote Config [candidate] (524.608 µs) : 0, 525
Telemetry [baseline] (9.71 ms) : 0, 9710
Telemetry [candidate] (11.88 ms) : 0, 11880
Flare Poller [baseline] (3.485 ms) : 0, 3485
Flare Poller [candidate] (3.794 ms) : 0, 3794
IAST [baseline] (25.352 ms) : 0, 25352
IAST [candidate] (25.514 ms) : 0, 25514
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.61.0-SNAPSHOT~36720385eb, baseline=1.61.0-SNAPSHOT~e4c4150593

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.071 s) : 0, 1071124
Total [baseline] (11.233 s) : 0, 11232776
Agent [candidate] (1.058 s) : 0, 1058404
Total [candidate] (11.15 s) : 0, 11149585
section appsec
Agent [baseline] (1.248 s) : 0, 1248475
Total [baseline] (11.111 s) : 0, 11110868
Agent [candidate] (1.247 s) : 0, 1247235
Total [candidate] (11.187 s) : 0, 11187495
section iast
Agent [baseline] (1.233 s) : 0, 1232728
Total [baseline] (11.396 s) : 0, 11395614
Agent [candidate] (1.236 s) : 0, 1235580
Total [candidate] (11.329 s) : 0, 11329095
section profiling
Agent [baseline] (1.185 s) : 0, 1185153
Total [baseline] (11.041 s) : 0, 11041174
Agent [candidate] (1.189 s) : 0, 1188561
Total [candidate] (11.096 s) : 0, 11095783
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.071 s -
Agent appsec 1.248 s 177.35 ms (16.6%)
Agent iast 1.233 s 161.604 ms (15.1%)
Agent profiling 1.185 s 114.028 ms (10.6%)
Total tracing 11.233 s -
Total appsec 11.111 s -121.908 ms (-1.1%)
Total iast 11.396 s 162.837 ms (1.4%)
Total profiling 11.041 s -191.602 ms (-1.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.058 s -
Agent appsec 1.247 s 188.831 ms (17.8%)
Agent iast 1.236 s 177.176 ms (16.7%)
Agent profiling 1.189 s 130.156 ms (12.3%)
Total tracing 11.15 s -
Total appsec 11.187 s 37.91 ms (0.3%)
Total iast 11.329 s 179.51 ms (1.6%)
Total profiling 11.096 s -53.802 ms (-0.5%) 
gantt
    title petclinic - break down per module: candidate=1.61.0-SNAPSHOT~36720385eb, baseline=1.61.0-SNAPSHOT~e4c4150593

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.219 ms) : 0, 1219
crashtracking [candidate] (1.196 ms) : 0, 1196
BytebuddyAgent [baseline] (637.613 ms) : 0, 637613
BytebuddyAgent [candidate] (629.49 ms) : 0, 629490
AgentMeter [baseline] (29.834 ms) : 0, 29834
AgentMeter [candidate] (29.554 ms) : 0, 29554
GlobalTracer [baseline] (260.327 ms) : 0, 260327
GlobalTracer [candidate] (257.937 ms) : 0, 257937
AppSec [baseline] (32.261 ms) : 0, 32261
AppSec [candidate] (31.757 ms) : 0, 31757
Debugger [baseline] (61.052 ms) : 0, 61052
Debugger [candidate] (60.281 ms) : 0, 60281
Remote Config [baseline] (606.322 µs) : 0, 606
Remote Config [candidate] (597.503 µs) : 0, 598
Telemetry [baseline] (8.136 ms) : 0, 8136
Telemetry [candidate] (7.962 ms) : 0, 7962
Flare Poller [baseline] (3.64 ms) : 0, 3640
Flare Poller [candidate] (3.486 ms) : 0, 3486
section appsec
crashtracking [baseline] (1.192 ms) : 0, 1192
crashtracking [candidate] (1.202 ms) : 0, 1202
BytebuddyAgent [baseline] (659.175 ms) : 0, 659175
BytebuddyAgent [candidate] (659.07 ms) : 0, 659070
AgentMeter [baseline] (12.127 ms) : 0, 12127
AgentMeter [candidate] (12.127 ms) : 0, 12127
GlobalTracer [baseline] (258.514 ms) : 0, 258514
GlobalTracer [candidate] (257.856 ms) : 0, 257856
AppSec [baseline] (177.918 ms) : 0, 177918
AppSec [candidate] (177.872 ms) : 0, 177872
Debugger [baseline] (66.488 ms) : 0, 66488
Debugger [candidate] (66.204 ms) : 0, 66204
Remote Config [baseline] (635.482 µs) : 0, 635
Remote Config [candidate] (625.22 µs) : 0, 625
Telemetry [baseline] (8.375 ms) : 0, 8375
Telemetry [candidate] (8.29 ms) : 0, 8290
Flare Poller [baseline] (3.58 ms) : 0, 3580
Flare Poller [candidate] (3.507 ms) : 0, 3507
IAST [baseline] (24.165 ms) : 0, 24165
IAST [candidate] (24.135 ms) : 0, 24135
section iast
crashtracking [baseline] (1.213 ms) : 0, 1213
crashtracking [candidate] (1.193 ms) : 0, 1193
BytebuddyAgent [baseline] (799.174 ms) : 0, 799174
BytebuddyAgent [candidate] (801.937 ms) : 0, 801937
AgentMeter [baseline] (11.414 ms) : 0, 11414
AgentMeter [candidate] (11.514 ms) : 0, 11514
GlobalTracer [baseline] (248.591 ms) : 0, 248591
GlobalTracer [candidate] (248.808 ms) : 0, 248808
AppSec [baseline] (26.619 ms) : 0, 26619
AppSec [candidate] (26.672 ms) : 0, 26672
Debugger [baseline] (70.357 ms) : 0, 70357
Debugger [candidate] (70.116 ms) : 0, 70116
Remote Config [baseline] (536.643 µs) : 0, 537
Remote Config [candidate] (523.124 µs) : 0, 523
Telemetry [baseline] (9.796 ms) : 0, 9796
Telemetry [candidate] (9.572 ms) : 0, 9572
Flare Poller [baseline] (3.493 ms) : 0, 3493
Flare Poller [candidate] (3.477 ms) : 0, 3477
IAST [baseline] (25.381 ms) : 0, 25381
IAST [candidate] (25.432 ms) : 0, 25432
section profiling
ProfilingAgent [baseline] (94.515 ms) : 0, 94515
ProfilingAgent [candidate] (93.669 ms) : 0, 93669
crashtracking [baseline] (1.196 ms) : 0, 1196
crashtracking [candidate] (1.176 ms) : 0, 1176
BytebuddyAgent [baseline] (684.191 ms) : 0, 684191
BytebuddyAgent [candidate] (687.868 ms) : 0, 687868
AgentMeter [baseline] (9.005 ms) : 0, 9005
AgentMeter [candidate] (9.049 ms) : 0, 9049
GlobalTracer [baseline] (215.201 ms) : 0, 215201
GlobalTracer [candidate] (215.469 ms) : 0, 215469
AppSec [baseline] (32.375 ms) : 0, 32375
AppSec [candidate] (32.257 ms) : 0, 32257
Debugger [baseline] (65.915 ms) : 0, 65915
Debugger [candidate] (65.36 ms) : 0, 65360
Remote Config [baseline] (563.025 µs) : 0, 563
Remote Config [candidate] (559.296 µs) : 0, 559
Telemetry [baseline] (7.747 ms) : 0, 7747
Telemetry [candidate] (8.504 ms) : 0, 8504
Flare Poller [baseline] (3.492 ms) : 0, 3492
Flare Poller [candidate] (3.471 ms) : 0, 3471
Profiling [baseline] (95.082 ms) : 0, 95082
Profiling [candidate] (94.22 ms) : 0, 94220
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/otlp-resource-proto
git_commit_date 1774458906 1774459762
git_commit_sha e4c4150 3672038
release_version 1.61.0-SNAPSHOT~e4c4150593 1.61.0-SNAPSHOT~36720385eb
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1774462213 1774462213
ci_job_id 1538536490 1538536490
ci_pipeline_id 104387488 104387488
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-3-diqn5wh4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-3-diqn5wh4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 5 performance regressions! Performance is the same for 16 metrics, 15 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:profiling:high_load worse
[+65.236µs; +213.168µs] or [+3.845%; +12.563%]		 unstable
[+129.307µs; +1123.805µs] or [+2.525%; +21.944%]		 unstable
[-483.019op/s; +54.394op/s] or [-22.892%; +2.578%]		 1.836ms 5.748ms 1895.719op/s 1.697ms 5.121ms 2110.031op/s
scenario:load:insecure-bank:iast_FULL:high_load worse
[+126.439µs; +363.435µs] or [+2.446%; +7.031%]		 unsure
[+103.663µs; +769.232µs] or [+0.844%; +6.263%]		 unstable
[-121.295op/s; +58.482op/s] or [-15.203%; +7.330%]		 5.414ms 12.719ms 766.406op/s 5.169ms 12.283ms 797.812op/s
scenario:load:petclinic:profiling:high_load worse
[+492.348µs; +1490.424µs] or [+2.714%; +8.215%]		 unsure
[+0.331ms; +1.896ms] or [+1.129%; +6.466%]		 unstable
[-39.037op/s; +15.412op/s] or [-15.477%; +6.110%]		 19.134ms 30.430ms 240.406op/s 18.143ms 29.317ms 252.219op/s
scenario:load:petclinic:code_origins:high_load worse
[+1.019ms; +1.959ms] or [+5.874%; +11.291%]		 worse
[+0.619ms; +2.009ms] or [+2.156%; +7.001%]		 unstable
[-46.444op/s; +9.007op/s] or [-17.661%; +3.425%]		 18.837ms 30.017ms 244.250op/s 17.348ms 28.702ms 262.969op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~36720385eb, baseline=1.61.0-SNAPSHOT~e4c4150593
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.174 ms) : 1162, 1186
.   : milestone, 1174,
iast (3.127 ms) : 3085, 3168
.   : milestone, 3127,
iast_FULL (5.796 ms) : 5739, 5854
.   : milestone, 5796,
iast_GLOBAL (3.583 ms) : 3531, 3635
.   : milestone, 3583,
profiling (2.144 ms) : 2124, 2164
.   : milestone, 2144,
tracing (1.794 ms) : 1779, 1810
.   : milestone, 1794,
section candidate
no_agent (1.174 ms) : 1160, 1188
.   : milestone, 1174,
iast (3.23 ms) : 3187, 3273
.   : milestone, 3230,
iast_FULL (6.036 ms) : 5976, 6097
.   : milestone, 6036,
iast_GLOBAL (3.516 ms) : 3461, 3571
.   : milestone, 3516,
profiling (2.395 ms) : 2368, 2421
.   : milestone, 2395,
tracing (1.79 ms) : 1775, 1804
.   : milestone, 1790,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.174 ms [1.162 ms, 1.186 ms] -
iast 3.127 ms [3.085 ms, 3.168 ms] 1.953 ms (166.4%)
iast_FULL 5.796 ms [5.739 ms, 5.854 ms] 4.623 ms (393.8%)
iast_GLOBAL 3.583 ms [3.531 ms, 3.635 ms] 2.41 ms (205.3%)
profiling 2.144 ms [2.124 ms, 2.164 ms] 970.073 µs (82.6%)
tracing 1.794 ms [1.779 ms, 1.81 ms] 620.48 µs (52.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.174 ms [1.16 ms, 1.188 ms] -
iast 3.23 ms [3.187 ms, 3.273 ms] 2.056 ms (175.1%)
iast_FULL 6.036 ms [5.976 ms, 6.097 ms] 4.862 ms (414.1%)
iast_GLOBAL 3.516 ms [3.461 ms, 3.571 ms] 2.342 ms (199.5%)
profiling 2.395 ms [2.368 ms, 2.421 ms] 1.221 ms (104.0%)
tracing 1.79 ms [1.775 ms, 1.804 ms] 615.624 µs (52.4%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~36720385eb, baseline=1.61.0-SNAPSHOT~e4c4150593
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.558 ms) : 17381, 17735
.   : milestone, 17558,
appsec (18.173 ms) : 17989, 18356
.   : milestone, 18173,
code_origins (17.745 ms) : 17569, 17921
.   : milestone, 17745,
iast (18.719 ms) : 18531, 18908
.   : milestone, 18719,
profiling (18.504 ms) : 18323, 18686
.   : milestone, 18504,
tracing (18.347 ms) : 18165, 18529
.   : milestone, 18347,
section candidate
no_agent (18.119 ms) : 17937, 18300
.   : milestone, 18119,
appsec (18.497 ms) : 18309, 18686
.   : milestone, 18497,
code_origins (19.11 ms) : 18920, 19300
.   : milestone, 19110,
iast (18.235 ms) : 18049, 18420
.   : milestone, 18235,
profiling (19.413 ms) : 19220, 19606
.   : milestone, 19413,
tracing (18.33 ms) : 18148, 18513
.   : milestone, 18330,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.558 ms [17.381 ms, 17.735 ms] -
appsec 18.173 ms [17.989 ms, 18.356 ms] 614.189 µs (3.5%)
code_origins 17.745 ms [17.569 ms, 17.921 ms] 186.558 µs (1.1%)
iast 18.719 ms [18.531 ms, 18.908 ms] 1.161 ms (6.6%)
profiling 18.504 ms [18.323 ms, 18.686 ms] 945.915 µs (5.4%)
tracing 18.347 ms [18.165 ms, 18.529 ms] 788.645 µs (4.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.119 ms [17.937 ms, 18.3 ms] -
appsec 18.497 ms [18.309 ms, 18.686 ms] 378.744 µs (2.1%)
code_origins 19.11 ms [18.92 ms, 19.3 ms] 991.624 µs (5.5%)
iast 18.235 ms [18.049 ms, 18.42 ms] 116.441 µs (0.6%)
profiling 19.413 ms [19.22 ms, 19.606 ms] 1.294 ms (7.1%)
tracing 18.33 ms [18.148 ms, 18.513 ms] 211.83 µs (1.2%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/otlp-resource-proto
git_commit_date 1774458906 1774459762
git_commit_sha e4c4150 3672038
release_version 1.61.0-SNAPSHOT~e4c4150593 1.61.0-SNAPSHOT~36720385eb
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1774461912 1774461912
ci_job_id 1538536491 1538536491
ci_pipeline_id 104387488 104387488
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-kwaxl2nf 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-kwaxl2nf 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:dacapo:tomcat:appsec better
[-1.464ms; -1.117ms] or [-38.383%; -29.283%]		 2.524ms 3.814ms
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~36720385eb, baseline=1.61.0-SNAPSHOT~e4c4150593
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.473 ms) : 1461, 1484
.   : milestone, 1473,
appsec (3.814 ms) : 3593, 4036
.   : milestone, 3814,
iast (2.255 ms) : 2187, 2324
.   : milestone, 2255,
iast_GLOBAL (2.299 ms) : 2230, 2369
.   : milestone, 2299,
profiling (2.121 ms) : 2064, 2177
.   : milestone, 2121,
tracing (2.064 ms) : 2011, 2116
.   : milestone, 2064,
section candidate
no_agent (1.477 ms) : 1465, 1488
.   : milestone, 1477,
appsec (2.524 ms) : 2469, 2578
.   : milestone, 2524,
iast (2.251 ms) : 2182, 2320
.   : milestone, 2251,
iast_GLOBAL (2.289 ms) : 2220, 2358
.   : milestone, 2289,
profiling (2.121 ms) : 2065, 2177
.   : milestone, 2121,
tracing (2.068 ms) : 2015, 2122
.   : milestone, 2068,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.473 ms [1.461 ms, 1.484 ms] -
appsec 3.814 ms [3.593 ms, 4.036 ms] 2.341 ms (159.0%)
iast 2.255 ms [2.187 ms, 2.324 ms] 782.561 µs (53.1%)
iast_GLOBAL 2.299 ms [2.23 ms, 2.369 ms] 826.462 µs (56.1%)
profiling 2.121 ms [2.064 ms, 2.177 ms] 647.761 µs (44.0%)
tracing 2.064 ms [2.011 ms, 2.116 ms] 590.574 µs (40.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.477 ms [1.465 ms, 1.488 ms] -
appsec 2.524 ms [2.469 ms, 2.578 ms] 1.047 ms (70.9%)
iast 2.251 ms [2.182 ms, 2.32 ms] 774.549 µs (52.5%)
iast_GLOBAL 2.289 ms [2.22 ms, 2.358 ms] 811.916 µs (55.0%)
profiling 2.121 ms [2.065 ms, 2.177 ms] 644.326 µs (43.6%)
tracing 2.068 ms [2.015 ms, 2.122 ms] 591.539 µs (40.1%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~36720385eb, baseline=1.61.0-SNAPSHOT~e4c4150593
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.784 s) : 14784000, 14784000
.   : milestone, 14784000,
appsec (14.769 s) : 14769000, 14769000
.   : milestone, 14769000,
iast (18.533 s) : 18533000, 18533000
.   : milestone, 18533000,
iast_GLOBAL (18.112 s) : 18112000, 18112000
.   : milestone, 18112000,
profiling (15.478 s) : 15478000, 15478000
.   : milestone, 15478000,
tracing (14.784 s) : 14784000, 14784000
.   : milestone, 14784000,
section candidate
no_agent (15.412 s) : 15412000, 15412000
.   : milestone, 15412000,
appsec (15.079 s) : 15079000, 15079000
.   : milestone, 15079000,
iast (18.06 s) : 18060000, 18060000
.   : milestone, 18060000,
iast_GLOBAL (17.956 s) : 17956000, 17956000
.   : milestone, 17956000,
profiling (15.329 s) : 15329000, 15329000
.   : milestone, 15329000,
tracing (15.177 s) : 15177000, 15177000
.   : milestone, 15177000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.784 s [14.784 s, 14.784 s] -
appsec 14.769 s [14.769 s, 14.769 s] -15.0 ms (-0.1%)
iast 18.533 s [18.533 s, 18.533 s] 3.749 s (25.4%)
iast_GLOBAL 18.112 s [18.112 s, 18.112 s] 3.328 s (22.5%)
profiling 15.478 s [15.478 s, 15.478 s] 694.0 ms (4.7%)
tracing 14.784 s [14.784 s, 14.784 s] 0.0 µs (0.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.412 s [15.412 s, 15.412 s] -
appsec 15.079 s [15.079 s, 15.079 s] -333.0 ms (-2.2%)
iast 18.06 s [18.06 s, 18.06 s] 2.648 s (17.2%)
iast_GLOBAL 17.956 s [17.956 s, 17.956 s] 2.544 s (16.5%)
profiling 15.329 s [15.329 s, 15.329 s] -83.0 ms (-0.5%)
tracing 15.177 s [15.177 s, 15.177 s] -235.0 ms (-1.5%)