Home Original page

Fix SymDB jar processing by jpbempel · Pull Request #10592 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/symdb-catch-ex-class-level
git_commit_date 1770902831 1771005552
git_commit_sha 2ebc964 ceb0edd
release_version 1.60.0-SNAPSHOT~2ebc964340 1.60.0-SNAPSHOT~ceb0edde56
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1771007344 1771007344
ci_job_id 1425772567 1425772567
ci_pipeline_id 96463380 96463380
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-cporjd1e 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-cporjd1e 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 59 metrics, 12 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~ceb0edde56, baseline=1.60.0-SNAPSHOT~2ebc964340

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.061 s) : 0, 1061022
Total [baseline] (8.802 s) : 0, 8801601
Agent [candidate] (1.064 s) : 0, 1063571
Total [candidate] (8.713 s) : 0, 8713411
section iast
Agent [baseline] (1.239 s) : 0, 1238697
Total [baseline] (9.409 s) : 0, 9409381
Agent [candidate] (1.249 s) : 0, 1248596
Total [candidate] (9.44 s) : 0, 9440450
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.061 s -
Agent iast 1.239 s 177.676 ms (16.7%)
Total tracing 8.802 s -
Total iast 9.409 s 607.78 ms (6.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.064 s -
Agent iast 1.249 s 185.025 ms (17.4%)
Total tracing 8.713 s -
Total iast 9.44 s 727.039 ms (8.3%) 
gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~ceb0edde56, baseline=1.60.0-SNAPSHOT~2ebc964340

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.181 ms) : 0, 1181
crashtracking [candidate] (1.19 ms) : 0, 1190
BytebuddyAgent [baseline] (626.71 ms) : 0, 626710
BytebuddyAgent [candidate] (628.38 ms) : 0, 628380
AgentMeter [baseline] (28.83 ms) : 0, 28830
AgentMeter [candidate] (28.937 ms) : 0, 28937
GlobalTracer [baseline] (256.495 ms) : 0, 256495
GlobalTracer [candidate] (257.702 ms) : 0, 257702
AppSec [baseline] (32.571 ms) : 0, 32571
AppSec [candidate] (32.703 ms) : 0, 32703
Debugger [baseline] (61.618 ms) : 0, 61618
Debugger [candidate] (62.8 ms) : 0, 62800
Remote Config [baseline] (611.631 µs) : 0, 612
Remote Config [candidate] (617.529 µs) : 0, 618
Telemetry [baseline] (12.257 ms) : 0, 12257
Telemetry [candidate] (10.58 ms) : 0, 10580
Flare Poller [baseline] (5.426 ms) : 0, 5426
Flare Poller [candidate] (5.314 ms) : 0, 5314
section iast
crashtracking [baseline] (1.187 ms) : 0, 1187
crashtracking [candidate] (1.186 ms) : 0, 1186
BytebuddyAgent [baseline] (801.477 ms) : 0, 801477
BytebuddyAgent [candidate] (807.107 ms) : 0, 807107
AgentMeter [baseline] (11.459 ms) : 0, 11459
AgentMeter [candidate] (11.549 ms) : 0, 11549
GlobalTracer [baseline] (248.536 ms) : 0, 248536
GlobalTracer [candidate] (251.044 ms) : 0, 251044
AppSec [baseline] (32.297 ms) : 0, 32297
AppSec [candidate] (33.786 ms) : 0, 33786
Debugger [baseline] (68.255 ms) : 0, 68255
Debugger [candidate] (68.188 ms) : 0, 68188
Remote Config [baseline] (546.999 µs) : 0, 547
Remote Config [candidate] (538.554 µs) : 0, 539
Telemetry [baseline] (8.765 ms) : 0, 8765
Telemetry [candidate] (8.75 ms) : 0, 8750
Flare Poller [baseline] (3.599 ms) : 0, 3599
Flare Poller [candidate] (3.579 ms) : 0, 3579
IAST [baseline] (27.175 ms) : 0, 27175
IAST [candidate] (27.468 ms) : 0, 27468
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~ceb0edde56, baseline=1.60.0-SNAPSHOT~2ebc964340

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.068 s) : 0, 1068011
Total [baseline] (10.907 s) : 0, 10906900
Agent [candidate] (1.07 s) : 0, 1069996
Total [candidate] (11.015 s) : 0, 11015332
section appsec
Agent [baseline] (1.236 s) : 0, 1235740
Total [baseline] (11.083 s) : 0, 11082665
Agent [candidate] (1.237 s) : 0, 1237303
Total [candidate] (11.056 s) : 0, 11056271
section iast
Agent [baseline] (1.24 s) : 0, 1239532
Total [baseline] (11.213 s) : 0, 11212825
Agent [candidate] (1.232 s) : 0, 1232278
Total [candidate] (11.171 s) : 0, 11170558
section profiling
Agent [baseline] (1.189 s) : 0, 1188778
Total [baseline] (10.971 s) : 0, 10971219
Agent [candidate] (1.187 s) : 0, 1187494
Total [candidate] (11.003 s) : 0, 11003265
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.068 s -
Agent appsec 1.236 s 167.728 ms (15.7%)
Agent iast 1.24 s 171.521 ms (16.1%)
Agent profiling 1.189 s 120.767 ms (11.3%)
Total tracing 10.907 s -
Total appsec 11.083 s 175.764 ms (1.6%)
Total iast 11.213 s 305.925 ms (2.8%)
Total profiling 10.971 s 64.319 ms (0.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.07 s -
Agent appsec 1.237 s 167.307 ms (15.6%)
Agent iast 1.232 s 162.282 ms (15.2%)
Agent profiling 1.187 s 117.498 ms (11.0%)
Total tracing 11.015 s -
Total appsec 11.056 s 40.939 ms (0.4%)
Total iast 11.171 s 155.226 ms (1.4%)
Total profiling 11.003 s -12.067 ms (-0.1%) 
gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~ceb0edde56, baseline=1.60.0-SNAPSHOT~2ebc964340

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.185 ms) : 0, 1185
crashtracking [candidate] (1.186 ms) : 0, 1186
BytebuddyAgent [baseline] (631.44 ms) : 0, 631440
BytebuddyAgent [candidate] (632.23 ms) : 0, 632230
AgentMeter [baseline] (29.179 ms) : 0, 29179
AgentMeter [candidate] (29.079 ms) : 0, 29079
GlobalTracer [baseline] (258.535 ms) : 0, 258535
GlobalTracer [candidate] (258.614 ms) : 0, 258614
AppSec [baseline] (33.164 ms) : 0, 33164
AppSec [candidate] (32.934 ms) : 0, 32934
Debugger [baseline] (64.093 ms) : 0, 64093
Debugger [candidate] (62.239 ms) : 0, 62239
Remote Config [baseline] (615.334 µs) : 0, 615
Remote Config [candidate] (627.582 µs) : 0, 628
Telemetry [baseline] (9.92 ms) : 0, 9920
Telemetry [candidate] (13.077 ms) : 0, 13077
Flare Poller [baseline] (4.524 ms) : 0, 4524
Flare Poller [candidate] (4.573 ms) : 0, 4573
section appsec
crashtracking [baseline] (1.184 ms) : 0, 1184
crashtracking [candidate] (1.186 ms) : 0, 1186
BytebuddyAgent [baseline] (656.907 ms) : 0, 656907
BytebuddyAgent [candidate] (657.792 ms) : 0, 657792
AgentMeter [baseline] (11.938 ms) : 0, 11938
AgentMeter [candidate] (11.973 ms) : 0, 11973
GlobalTracer [baseline] (257.583 ms) : 0, 257583
GlobalTracer [candidate] (257.576 ms) : 0, 257576
AppSec [baseline] (167.268 ms) : 0, 167268
AppSec [candidate] (167.342 ms) : 0, 167342
Debugger [baseline] (66.637 ms) : 0, 66637
Debugger [candidate] (66.918 ms) : 0, 66918
Remote Config [baseline] (654.789 µs) : 0, 655
Remote Config [candidate] (686.998 µs) : 0, 687
Telemetry [baseline] (9.575 ms) : 0, 9575
Telemetry [candidate] (9.706 ms) : 0, 9706
Flare Poller [baseline] (3.743 ms) : 0, 3743
Flare Poller [candidate] (3.757 ms) : 0, 3757
IAST [baseline] (25.068 ms) : 0, 25068
IAST [candidate] (25.141 ms) : 0, 25141
section iast
crashtracking [baseline] (1.18 ms) : 0, 1180
crashtracking [candidate] (1.177 ms) : 0, 1177
BytebuddyAgent [baseline] (801.489 ms) : 0, 801489
BytebuddyAgent [candidate] (796.75 ms) : 0, 796750
AgentMeter [baseline] (11.505 ms) : 0, 11505
AgentMeter [candidate] (11.248 ms) : 0, 11248
GlobalTracer [baseline] (249.163 ms) : 0, 249163
GlobalTracer [candidate] (248.635 ms) : 0, 248635
AppSec [baseline] (34.934 ms) : 0, 34934
AppSec [candidate] (35.204 ms) : 0, 35204
Debugger [baseline] (66.012 ms) : 0, 66012
Debugger [candidate] (64.572 ms) : 0, 64572
Remote Config [baseline] (533.563 µs) : 0, 534
Remote Config [candidate] (535.915 µs) : 0, 536
Telemetry [baseline] (8.627 ms) : 0, 8627
Telemetry [candidate] (8.612 ms) : 0, 8612
Flare Poller [baseline] (3.528 ms) : 0, 3528
Flare Poller [candidate] (3.452 ms) : 0, 3452
IAST [baseline] (27.192 ms) : 0, 27192
IAST [candidate] (26.926 ms) : 0, 26926
section profiling
crashtracking [baseline] (1.219 ms) : 0, 1219
crashtracking [candidate] (1.211 ms) : 0, 1211
BytebuddyAgent [baseline] (681.512 ms) : 0, 681512
BytebuddyAgent [candidate] (680.091 ms) : 0, 680091
AgentMeter [baseline] (8.641 ms) : 0, 8641
AgentMeter [candidate] (8.646 ms) : 0, 8646
GlobalTracer [baseline] (215.43 ms) : 0, 215430
GlobalTracer [candidate] (215.619 ms) : 0, 215619
AppSec [baseline] (32.398 ms) : 0, 32398
AppSec [candidate] (32.377 ms) : 0, 32377
Debugger [baseline] (66.964 ms) : 0, 66964
Debugger [candidate] (67.389 ms) : 0, 67389
Remote Config [baseline] (621.62 µs) : 0, 622
Remote Config [candidate] (618.172 µs) : 0, 618
Telemetry [baseline] (8.958 ms) : 0, 8958
Telemetry [candidate] (8.869 ms) : 0, 8869
Flare Poller [baseline] (3.774 ms) : 0, 3774
Flare Poller [candidate] (3.745 ms) : 0, 3745
ProfilingAgent [baseline] (99.34 ms) : 0, 99340
ProfilingAgent [candidate] (99.149 ms) : 0, 99149
Profiling [baseline] (99.944 ms) : 0, 99944
Profiling [candidate] (99.733 ms) : 0, 99733
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/symdb-catch-ex-class-level
git_commit_date 1770902831 1771005552
git_commit_sha 2ebc964 ceb0edd
release_version 1.60.0-SNAPSHOT~2ebc964340 1.60.0-SNAPSHOT~ceb0edde56
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1771007743 1771007743
ci_job_id 1425772570 1425772570
ci_pipeline_id 96463380 96463380
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-jwaa22km 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-jwaa22km 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 2 performance regressions! Performance is the same for 16 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast:high_load worse
[+166.659µs; +253.542µs] or [+6.974%; +10.610%]		 worse
[+334.812µs; +754.048µs] or [+4.760%; +10.719%]		 unstable
[-276.802op/s; +38.865op/s] or [-18.608%; +2.613%]		 2.600ms 7.579ms 1368.562op/s 2.390ms 7.034ms 1487.531op/s
scenario:load:petclinic:appsec:high_load better
[-1268.026µs; -703.618µs] or [-6.757%; -3.749%]		 unsure
[-1.675ms; -0.387ms] or [-5.468%; -1.265%]		 unstable
[-14.613op/s; +35.738op/s] or [-5.985%; +14.637%]		 17.781ms 29.600ms 254.719op/s 18.767ms 30.631ms 244.156op/s
scenario:load:petclinic:no_agent:high_load better
[-1.921ms; -0.494ms] or [-10.207%; -2.626%]		 unstable
[-3.480ms; -0.195ms] or [-11.094%; -0.621%]		 unstable
[-9.583op/s; +45.083op/s] or [-3.980%; +18.726%]		 17.610ms 29.533ms 258.500op/s 18.818ms 31.371ms 240.750op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~ceb0edde56, baseline=1.60.0-SNAPSHOT~2ebc964340
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.181 ms) : 1169, 1192
.   : milestone, 1181,
iast (3.072 ms) : 3034, 3111
.   : milestone, 3072,
iast_FULL (5.702 ms) : 5645, 5759
.   : milestone, 5702,
iast_GLOBAL (3.563 ms) : 3505, 3621
.   : milestone, 3563,
profiling (1.98 ms) : 1963, 1997
.   : milestone, 1980,
tracing (1.853 ms) : 1835, 1870
.   : milestone, 1853,
section candidate
no_agent (1.274 ms) : 1260, 1289
.   : milestone, 1274,
iast (3.347 ms) : 3299, 3395
.   : milestone, 3347,
iast_FULL (5.852 ms) : 5793, 5911
.   : milestone, 5852,
iast_GLOBAL (3.541 ms) : 3487, 3594
.   : milestone, 3541,
profiling (2.094 ms) : 2075, 2113
.   : milestone, 2094,
tracing (1.834 ms) : 1818, 1851
.   : milestone, 1834,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.181 ms [1.169 ms, 1.192 ms] -
iast 3.072 ms [3.034 ms, 3.111 ms] 1.892 ms (160.2%)
iast_FULL 5.702 ms [5.645 ms, 5.759 ms] 4.521 ms (382.9%)
iast_GLOBAL 3.563 ms [3.505 ms, 3.621 ms] 2.383 ms (201.8%)
profiling 1.98 ms [1.963 ms, 1.997 ms] 799.476 µs (67.7%)
tracing 1.853 ms [1.835 ms, 1.87 ms] 672.037 µs (56.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.274 ms [1.26 ms, 1.289 ms] -
iast 3.347 ms [3.299 ms, 3.395 ms] 2.072 ms (162.6%)
iast_FULL 5.852 ms [5.793 ms, 5.911 ms] 4.578 ms (359.2%)
iast_GLOBAL 3.541 ms [3.487 ms, 3.594 ms] 2.266 ms (177.8%)
profiling 2.094 ms [2.075 ms, 2.113 ms] 819.377 µs (64.3%)
tracing 1.834 ms [1.818 ms, 1.851 ms] 559.912 µs (43.9%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~ceb0edde56, baseline=1.60.0-SNAPSHOT~2ebc964340
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.393 ms) : 19192, 19594
.   : milestone, 19393,
appsec (19.124 ms) : 18929, 19318
.   : milestone, 19124,
code_origins (17.793 ms) : 17618, 17968
.   : milestone, 17793,
iast (17.59 ms) : 17414, 17766
.   : milestone, 17590,
profiling (19.253 ms) : 19058, 19448
.   : milestone, 19253,
tracing (17.641 ms) : 17466, 17816
.   : milestone, 17641,
section candidate
no_agent (18.054 ms) : 17871, 18237
.   : milestone, 18054,
appsec (18.323 ms) : 18138, 18508
.   : milestone, 18323,
code_origins (17.792 ms) : 17615, 17969
.   : milestone, 17792,
iast (17.529 ms) : 17357, 17702
.   : milestone, 17529,
profiling (18.567 ms) : 18382, 18753
.   : milestone, 18567,
tracing (17.539 ms) : 17365, 17712
.   : milestone, 17539,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.393 ms [19.192 ms, 19.594 ms] -
appsec 19.124 ms [18.929 ms, 19.318 ms] -269.008 µs (-1.4%)
code_origins 17.793 ms [17.618 ms, 17.968 ms] -1.6 ms (-8.2%)
iast 17.59 ms [17.414 ms, 17.766 ms] -1.802 ms (-9.3%)
profiling 19.253 ms [19.058 ms, 19.448 ms] -139.763 µs (-0.7%)
tracing 17.641 ms [17.466 ms, 17.816 ms] -1.752 ms (-9.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.054 ms [17.871 ms, 18.237 ms] -
appsec 18.323 ms [18.138 ms, 18.508 ms] 268.534 µs (1.5%)
code_origins 17.792 ms [17.615 ms, 17.969 ms] -261.882 µs (-1.5%)
iast 17.529 ms [17.357 ms, 17.702 ms] -524.845 µs (-2.9%)
profiling 18.567 ms [18.382 ms, 18.753 ms] 513.142 µs (2.8%)
tracing 17.539 ms [17.365 ms, 17.712 ms] -515.527 µs (-2.9%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/symdb-catch-ex-class-level
git_commit_date 1770902831 1771005552
git_commit_sha 2ebc964 ceb0edd
release_version 1.60.0-SNAPSHOT~2ebc964340 1.60.0-SNAPSHOT~ceb0edde56
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1771007575 1771007575
ci_job_id 1425772577 1425772577
ci_pipeline_id 96463380 96463380
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-b0bti370 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-b0bti370 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~ceb0edde56, baseline=1.60.0-SNAPSHOT~2ebc964340
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.474 ms) : 1463, 1486
.   : milestone, 1474,
appsec (3.721 ms) : 3503, 3939
.   : milestone, 3721,
iast (2.257 ms) : 2188, 2326
.   : milestone, 2257,
iast_GLOBAL (2.307 ms) : 2237, 2377
.   : milestone, 2307,
profiling (2.11 ms) : 2053, 2166
.   : milestone, 2110,
tracing (2.067 ms) : 2013, 2120
.   : milestone, 2067,
section candidate
no_agent (1.477 ms) : 1465, 1489
.   : milestone, 1477,
appsec (3.771 ms) : 3547, 3994
.   : milestone, 3771,
iast (2.269 ms) : 2199, 2338
.   : milestone, 2269,
iast_GLOBAL (2.312 ms) : 2242, 2381
.   : milestone, 2312,
profiling (2.119 ms) : 2063, 2176
.   : milestone, 2119,
tracing (2.085 ms) : 2031, 2139
.   : milestone, 2085,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.463 ms, 1.486 ms] -
appsec 3.721 ms [3.503 ms, 3.939 ms] 2.247 ms (152.4%)
iast 2.257 ms [2.188 ms, 2.326 ms] 782.588 µs (53.1%)
iast_GLOBAL 2.307 ms [2.237 ms, 2.377 ms] 832.539 µs (56.5%)
profiling 2.11 ms [2.053 ms, 2.166 ms] 635.182 µs (43.1%)
tracing 2.067 ms [2.013 ms, 2.12 ms] 592.101 µs (40.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.477 ms [1.465 ms, 1.489 ms] -
appsec 3.771 ms [3.547 ms, 3.994 ms] 2.294 ms (155.3%)
iast 2.269 ms [2.199 ms, 2.338 ms] 791.975 µs (53.6%)
iast_GLOBAL 2.312 ms [2.242 ms, 2.381 ms] 834.697 µs (56.5%)
profiling 2.119 ms [2.063 ms, 2.176 ms] 642.299 µs (43.5%)
tracing 2.085 ms [2.031 ms, 2.139 ms] 608.065 µs (41.2%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~ceb0edde56, baseline=1.60.0-SNAPSHOT~2ebc964340
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.483 s) : 15483000, 15483000
.   : milestone, 15483000,
appsec (14.966 s) : 14966000, 14966000
.   : milestone, 14966000,
iast (18.047 s) : 18047000, 18047000
.   : milestone, 18047000,
iast_GLOBAL (17.698 s) : 17698000, 17698000
.   : milestone, 17698000,
profiling (15.022 s) : 15022000, 15022000
.   : milestone, 15022000,
tracing (14.858 s) : 14858000, 14858000
.   : milestone, 14858000,
section candidate
no_agent (14.959 s) : 14959000, 14959000
.   : milestone, 14959000,
appsec (14.629 s) : 14629000, 14629000
.   : milestone, 14629000,
iast (17.742 s) : 17742000, 17742000
.   : milestone, 17742000,
iast_GLOBAL (17.678 s) : 17678000, 17678000
.   : milestone, 17678000,
profiling (14.726 s) : 14726000, 14726000
.   : milestone, 14726000,
tracing (15.048 s) : 15048000, 15048000
.   : milestone, 15048000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.483 s [15.483 s, 15.483 s] -
appsec 14.966 s [14.966 s, 14.966 s] -517.0 ms (-3.3%)
iast 18.047 s [18.047 s, 18.047 s] 2.564 s (16.6%)
iast_GLOBAL 17.698 s [17.698 s, 17.698 s] 2.215 s (14.3%)
profiling 15.022 s [15.022 s, 15.022 s] -461.0 ms (-3.0%)
tracing 14.858 s [14.858 s, 14.858 s] -625.0 ms (-4.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.959 s [14.959 s, 14.959 s] -
appsec 14.629 s [14.629 s, 14.629 s] -330.0 ms (-2.2%)
iast 17.742 s [17.742 s, 17.742 s] 2.783 s (18.6%)
iast_GLOBAL 17.678 s [17.678 s, 17.678 s] 2.719 s (18.2%)
profiling 14.726 s [14.726 s, 14.726 s] -233.0 ms (-1.6%)
tracing 15.048 s [15.048 s, 15.048 s] 89.0 ms (0.6%)