Home Original page

Fix flaky tracer tests on Semeru JDK caused by NPE in TracerHealthMetrics by mcculls · Pull Request #10567 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/fix-flaky-health-metrics-test
git_commit_date 1770808413 1770813175
git_commit_sha 6d44cf9 30ea3b3
release_version 1.60.0-SNAPSHOT~6d44cf9e09 1.60.0-SNAPSHOT~30ea3b333e
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1770815133 1770815133
ci_job_id 1416937879 1416937879
ci_pipeline_id 95788146 95788146
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-aldpl9kh 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-aldpl9kh 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 64 metrics, 7 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~30ea3b333e, baseline=1.60.0-SNAPSHOT~6d44cf9e09

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.066 s) : 0, 1065759
Total [baseline] (8.778 s) : 0, 8778406
Agent [candidate] (1.062 s) : 0, 1062015
Total [candidate] (8.695 s) : 0, 8694938
section iast
Agent [baseline] (1.228 s) : 0, 1228116
Total [baseline] (9.33 s) : 0, 9330166
Agent [candidate] (1.23 s) : 0, 1230320
Total [candidate] (9.378 s) : 0, 9378261
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.066 s -
Agent iast 1.228 s 162.357 ms (15.2%)
Total tracing 8.778 s -
Total iast 9.33 s 551.759 ms (6.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.062 s -
Agent iast 1.23 s 168.305 ms (15.8%)
Total tracing 8.695 s -
Total iast 9.378 s 683.322 ms (7.9%) 
gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~30ea3b333e, baseline=1.60.0-SNAPSHOT~6d44cf9e09

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.182 ms) : 0, 1182
crashtracking [candidate] (1.18 ms) : 0, 1180
BytebuddyAgent [baseline] (629.377 ms) : 0, 629377
BytebuddyAgent [candidate] (628.57 ms) : 0, 628570
AgentMeter [baseline] (29.08 ms) : 0, 29080
AgentMeter [candidate] (28.916 ms) : 0, 28916
GlobalTracer [baseline] (257.78 ms) : 0, 257780
GlobalTracer [candidate] (257.823 ms) : 0, 257823
AppSec [baseline] (32.81 ms) : 0, 32810
AppSec [candidate] (32.394 ms) : 0, 32394
Debugger [baseline] (60.456 ms) : 0, 60456
Debugger [candidate] (59.652 ms) : 0, 59652
Remote Config [baseline] (631.404 µs) : 0, 631
Remote Config [candidate] (630.219 µs) : 0, 630
Telemetry [baseline] (12.953 ms) : 0, 12953
Telemetry [candidate] (12.148 ms) : 0, 12148
Flare Poller [baseline] (6.15 ms) : 0, 6150
Flare Poller [candidate] (5.366 ms) : 0, 5366
section iast
crashtracking [baseline] (1.172 ms) : 0, 1172
crashtracking [candidate] (1.169 ms) : 0, 1169
BytebuddyAgent [baseline] (794.608 ms) : 0, 794608
BytebuddyAgent [candidate] (795.765 ms) : 0, 795765
AgentMeter [baseline] (11.236 ms) : 0, 11236
AgentMeter [candidate] (11.276 ms) : 0, 11276
GlobalTracer [baseline] (247.291 ms) : 0, 247291
GlobalTracer [candidate] (248.057 ms) : 0, 248057
AppSec [baseline] (33.722 ms) : 0, 33722
AppSec [candidate] (33.833 ms) : 0, 33833
Debugger [baseline] (65.335 ms) : 0, 65335
Debugger [candidate] (65.585 ms) : 0, 65585
Remote Config [baseline] (544.557 µs) : 0, 545
Remote Config [candidate] (532.039 µs) : 0, 532
Telemetry [baseline] (8.56 ms) : 0, 8560
Telemetry [candidate] (8.623 ms) : 0, 8623
Flare Poller [baseline] (3.459 ms) : 0, 3459
Flare Poller [candidate] (3.485 ms) : 0, 3485
IAST [baseline] (26.901 ms) : 0, 26901
IAST [candidate] (26.774 ms) : 0, 26774
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~30ea3b333e, baseline=1.60.0-SNAPSHOT~6d44cf9e09

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.065 s) : 0, 1064852
Total [baseline] (11.012 s) : 0, 11012009
Agent [candidate] (1.071 s) : 0, 1071007
Total [candidate] (10.952 s) : 0, 10952160
section appsec
Agent [baseline] (1.239 s) : 0, 1239047
Total [baseline] (10.973 s) : 0, 10972762
Agent [candidate] (1.251 s) : 0, 1250692
Total [candidate] (11.045 s) : 0, 11045161
section iast
Agent [baseline] (1.23 s) : 0, 1230016
Total [baseline] (11.131 s) : 0, 11130784
Agent [candidate] (1.247 s) : 0, 1247394
Total [candidate] (11.209 s) : 0, 11209285
section profiling
Agent [baseline] (1.191 s) : 0, 1190727
Total [baseline] (10.945 s) : 0, 10945147
Agent [candidate] (1.191 s) : 0, 1191188
Total [candidate] (11.009 s) : 0, 11008931
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.065 s -
Agent appsec 1.239 s 174.195 ms (16.4%)
Agent iast 1.23 s 165.164 ms (15.5%)
Agent profiling 1.191 s 125.875 ms (11.8%)
Total tracing 11.012 s -
Total appsec 10.973 s -39.247 ms (-0.4%)
Total iast 11.131 s 118.774 ms (1.1%)
Total profiling 10.945 s -66.862 ms (-0.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.071 s -
Agent appsec 1.251 s 179.685 ms (16.8%)
Agent iast 1.247 s 176.387 ms (16.5%)
Agent profiling 1.191 s 120.181 ms (11.2%)
Total tracing 10.952 s -
Total appsec 11.045 s 93.001 ms (0.8%)
Total iast 11.209 s 257.126 ms (2.3%)
Total profiling 11.009 s 56.772 ms (0.5%) 
gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~30ea3b333e, baseline=1.60.0-SNAPSHOT~6d44cf9e09

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.186 ms) : 0, 1186
crashtracking [candidate] (1.187 ms) : 0, 1187
BytebuddyAgent [baseline] (629.944 ms) : 0, 629944
BytebuddyAgent [candidate] (633.713 ms) : 0, 633713
AgentMeter [baseline] (28.91 ms) : 0, 28910
AgentMeter [candidate] (29.199 ms) : 0, 29199
GlobalTracer [baseline] (257.166 ms) : 0, 257166
GlobalTracer [candidate] (259.407 ms) : 0, 259407
AppSec [baseline] (32.686 ms) : 0, 32686
AppSec [candidate] (33.254 ms) : 0, 33254
Debugger [baseline] (61.972 ms) : 0, 61972
Debugger [candidate] (62.088 ms) : 0, 62088
Remote Config [baseline] (628.11 µs) : 0, 628
Remote Config [candidate] (631.25 µs) : 0, 631
Telemetry [baseline] (12.296 ms) : 0, 12296
Telemetry [candidate] (11.565 ms) : 0, 11565
Flare Poller [baseline] (4.627 ms) : 0, 4627
Flare Poller [candidate] (4.51 ms) : 0, 4510
section appsec
crashtracking [baseline] (1.171 ms) : 0, 1171
crashtracking [candidate] (1.186 ms) : 0, 1186
BytebuddyAgent [baseline] (658.227 ms) : 0, 658227
BytebuddyAgent [candidate] (665.131 ms) : 0, 665131
AgentMeter [baseline] (11.949 ms) : 0, 11949
AgentMeter [candidate] (12.067 ms) : 0, 12067
GlobalTracer [baseline] (257.667 ms) : 0, 257667
GlobalTracer [candidate] (260.733 ms) : 0, 260733
AppSec [baseline] (168.106 ms) : 0, 168106
AppSec [candidate] (169.015 ms) : 0, 169015
Debugger [baseline] (67.383 ms) : 0, 67383
Debugger [candidate] (67.345 ms) : 0, 67345
Remote Config [baseline] (650.386 µs) : 0, 650
Remote Config [candidate] (643.54 µs) : 0, 644
Telemetry [baseline] (9.587 ms) : 0, 9587
Telemetry [candidate] (9.705 ms) : 0, 9705
Flare Poller [baseline] (3.803 ms) : 0, 3803
Flare Poller [candidate] (3.763 ms) : 0, 3763
IAST [baseline] (25.21 ms) : 0, 25210
IAST [candidate] (25.556 ms) : 0, 25556
section iast
crashtracking [baseline] (1.167 ms) : 0, 1167
crashtracking [candidate] (1.179 ms) : 0, 1179
BytebuddyAgent [baseline] (794.482 ms) : 0, 794482
BytebuddyAgent [candidate] (806.14 ms) : 0, 806140
AgentMeter [baseline] (11.212 ms) : 0, 11212
AgentMeter [candidate] (11.61 ms) : 0, 11610
GlobalTracer [baseline] (247.948 ms) : 0, 247948
GlobalTracer [candidate] (251.668 ms) : 0, 251668
AppSec [baseline] (32.924 ms) : 0, 32924
AppSec [candidate] (35.92 ms) : 0, 35920
Debugger [baseline] (67.616 ms) : 0, 67616
Debugger [candidate] (65.383 ms) : 0, 65383
Remote Config [baseline] (543.498 µs) : 0, 543
Remote Config [candidate] (542.565 µs) : 0, 543
Telemetry [baseline] (8.57 ms) : 0, 8570
Telemetry [candidate] (8.602 ms) : 0, 8602
Flare Poller [baseline] (3.473 ms) : 0, 3473
Flare Poller [candidate] (3.448 ms) : 0, 3448
IAST [baseline] (26.921 ms) : 0, 26921
IAST [candidate] (27.422 ms) : 0, 27422
section profiling
ProfilingAgent [baseline] (98.893 ms) : 0, 98893
ProfilingAgent [candidate] (98.888 ms) : 0, 98888
crashtracking [baseline] (1.201 ms) : 0, 1201
crashtracking [candidate] (1.222 ms) : 0, 1222
BytebuddyAgent [baseline] (682.564 ms) : 0, 682564
BytebuddyAgent [candidate] (683.109 ms) : 0, 683109
AgentMeter [baseline] (8.643 ms) : 0, 8643
AgentMeter [candidate] (8.625 ms) : 0, 8625
GlobalTracer [baseline] (216.372 ms) : 0, 216372
GlobalTracer [candidate] (216.528 ms) : 0, 216528
AppSec [baseline] (32.655 ms) : 0, 32655
AppSec [candidate] (32.506 ms) : 0, 32506
Debugger [baseline] (67.309 ms) : 0, 67309
Debugger [candidate] (67.206 ms) : 0, 67206
Remote Config [baseline] (624.145 µs) : 0, 624
Remote Config [candidate] (620.768 µs) : 0, 621
Telemetry [baseline] (8.871 ms) : 0, 8871
Telemetry [candidate] (8.887 ms) : 0, 8887
Flare Poller [baseline] (3.733 ms) : 0, 3733
Flare Poller [candidate] (3.763 ms) : 0, 3763
Profiling [baseline] (99.453 ms) : 0, 99453
Profiling [candidate] (99.457 ms) : 0, 99457
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/fix-flaky-health-metrics-test
git_commit_date 1770808413 1770813175
git_commit_sha 6d44cf9 30ea3b3
release_version 1.60.0-SNAPSHOT~6d44cf9e09 1.60.0-SNAPSHOT~30ea3b333e
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1770815526 1770815526
ci_job_id 1416937883 1416937883
ci_pipeline_id 95788146 95788146
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-fy8hluyn 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-fy8hluyn 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 3 performance regressions! Performance is the same for 16 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast:high_load worse
[+93.453µs; +153.840µs] or [+3.986%; +6.561%]		 same
[-1.588µs; +344.725µs] or [-0.023%; +4.891%]		 unstable
[-204.230op/s; +88.355op/s] or [-13.636%; +5.899%]		 2.468ms 7.220ms 1439.812op/s 2.345ms 7.049ms 1497.750op/s
scenario:load:insecure-bank:iast_FULL:high_load unsure
[-362.204µs; -93.120µs] or [-6.962%; -1.790%]		 better
[-963.156µs; -347.169µs] or [-7.743%; -2.791%]		 unstable
[-47.534op/s; +114.097op/s] or [-5.990%; +14.379%]		 4.975ms 11.784ms 826.781op/s 5.203ms 12.440ms 793.500op/s
scenario:load:petclinic:code_origins:high_load worse
[+0.999ms; +2.112ms] or [+5.957%; +12.597%]		 worse
[+1.367ms; +3.424ms] or [+5.005%; +12.539%]		 unstable
[-45.735op/s; +11.235op/s] or [-17.030%; +4.183%]		 18.317ms 29.703ms 251.312op/s 16.762ms 27.308ms 268.562op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~30ea3b333e, baseline=1.60.0-SNAPSHOT~6d44cf9e09
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.732 ms) : 17552, 17912
.   : milestone, 17732,
appsec (18.51 ms) : 18323, 18697
.   : milestone, 18510,
code_origins (17.369 ms) : 17203, 17535
.   : milestone, 17369,
iast (17.684 ms) : 17504, 17864
.   : milestone, 17684,
profiling (19.409 ms) : 19217, 19602
.   : milestone, 19409,
tracing (17.791 ms) : 17612, 17969
.   : milestone, 17791,
section candidate
no_agent (17.955 ms) : 17772, 18138
.   : milestone, 17955,
appsec (18.667 ms) : 18475, 18859
.   : milestone, 18667,
code_origins (18.572 ms) : 18386, 18758
.   : milestone, 18572,
iast (17.748 ms) : 17571, 17924
.   : milestone, 17748,
profiling (18.598 ms) : 18412, 18784
.   : milestone, 18598,
tracing (17.977 ms) : 17798, 18157
.   : milestone, 17977,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.732 ms [17.552 ms, 17.912 ms] -
appsec 18.51 ms [18.323 ms, 18.697 ms] 778.088 µs (4.4%)
code_origins 17.369 ms [17.203 ms, 17.535 ms] -362.637 µs (-2.0%)
iast 17.684 ms [17.504 ms, 17.864 ms] -48.222 µs (-0.3%)
profiling 19.409 ms [19.217 ms, 19.602 ms] 1.678 ms (9.5%)
tracing 17.791 ms [17.612 ms, 17.969 ms] 58.91 µs (0.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.955 ms [17.772 ms, 18.138 ms] -
appsec 18.667 ms [18.475 ms, 18.859 ms] 712.761 µs (4.0%)
code_origins 18.572 ms [18.386 ms, 18.758 ms] 617.39 µs (3.4%)
iast 17.748 ms [17.571 ms, 17.924 ms] -206.878 µs (-1.2%)
profiling 18.598 ms [18.412 ms, 18.784 ms] 643.512 µs (3.6%)
tracing 17.977 ms [17.798 ms, 18.157 ms] 22.812 µs (0.1%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~30ea3b333e, baseline=1.60.0-SNAPSHOT~6d44cf9e09
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.175 ms) : 1164, 1186
.   : milestone, 1175,
iast (3.05 ms) : 3011, 3090
.   : milestone, 3050,
iast_FULL (5.828 ms) : 5770, 5886
.   : milestone, 5828,
iast_GLOBAL (3.566 ms) : 3511, 3620
.   : milestone, 3566,
profiling (2.12 ms) : 2102, 2139
.   : milestone, 2120,
tracing (1.772 ms) : 1757, 1787
.   : milestone, 1772,
section candidate
no_agent (1.175 ms) : 1164, 1187
.   : milestone, 1175,
iast (3.176 ms) : 3133, 3219
.   : milestone, 3176,
iast_FULL (5.588 ms) : 5532, 5643
.   : milestone, 5588,
iast_GLOBAL (3.539 ms) : 3477, 3600
.   : milestone, 3539,
profiling (2.133 ms) : 2114, 2152
.   : milestone, 2133,
tracing (1.765 ms) : 1750, 1780
.   : milestone, 1765,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.175 ms [1.164 ms, 1.186 ms] -
iast 3.05 ms [3.011 ms, 3.09 ms] 1.875 ms (159.6%)
iast_FULL 5.828 ms [5.77 ms, 5.886 ms] 4.653 ms (396.0%)
iast_GLOBAL 3.566 ms [3.511 ms, 3.62 ms] 2.391 ms (203.5%)
profiling 2.12 ms [2.102 ms, 2.139 ms] 945.333 µs (80.5%)
tracing 1.772 ms [1.757 ms, 1.787 ms] 597.051 µs (50.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.175 ms [1.164 ms, 1.187 ms] -
iast 3.176 ms [3.133 ms, 3.219 ms] 2.001 ms (170.2%)
iast_FULL 5.588 ms [5.532 ms, 5.643 ms] 4.413 ms (375.4%)
iast_GLOBAL 3.539 ms [3.477 ms, 3.6 ms] 2.363 ms (201.1%)
profiling 2.133 ms [2.114 ms, 2.152 ms] 957.736 µs (81.5%)
tracing 1.765 ms [1.75 ms, 1.78 ms] 589.535 µs (50.2%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/fix-flaky-health-metrics-test
git_commit_date 1770808413 1770813175
git_commit_sha 6d44cf9 30ea3b3
release_version 1.60.0-SNAPSHOT~6d44cf9e09 1.60.0-SNAPSHOT~30ea3b333e
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1770815208 1770815208
ci_job_id 1416937886 1416937886
ci_pipeline_id 95788146 95788146
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-7yecekwu 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-7yecekwu 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~30ea3b333e, baseline=1.60.0-SNAPSHOT~6d44cf9e09
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.483 ms) : 1471, 1494
.   : milestone, 1483,
appsec (2.523 ms) : 2467, 2578
.   : milestone, 2523,
iast (2.277 ms) : 2207, 2346
.   : milestone, 2277,
iast_GLOBAL (2.312 ms) : 2242, 2382
.   : milestone, 2312,
profiling (2.53 ms) : 2364, 2696
.   : milestone, 2530,
tracing (2.078 ms) : 2024, 2132
.   : milestone, 2078,
section candidate
no_agent (1.479 ms) : 1468, 1491
.   : milestone, 1479,
appsec (3.776 ms) : 3556, 3996
.   : milestone, 3776,
iast (2.266 ms) : 2197, 2336
.   : milestone, 2266,
iast_GLOBAL (2.306 ms) : 2236, 2376
.   : milestone, 2306,
profiling (2.083 ms) : 2029, 2138
.   : milestone, 2083,
tracing (2.08 ms) : 2025, 2134
.   : milestone, 2080,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.483 ms [1.471 ms, 1.494 ms] -
appsec 2.523 ms [2.467 ms, 2.578 ms] 1.04 ms (70.1%)
iast 2.277 ms [2.207 ms, 2.346 ms] 793.961 µs (53.5%)
iast_GLOBAL 2.312 ms [2.242 ms, 2.382 ms] 829.105 µs (55.9%)
profiling 2.53 ms [2.364 ms, 2.696 ms] 1.047 ms (70.6%)
tracing 2.078 ms [2.024 ms, 2.132 ms] 595.488 µs (40.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.479 ms [1.468 ms, 1.491 ms] -
appsec 3.776 ms [3.556 ms, 3.996 ms] 2.297 ms (155.3%)
iast 2.266 ms [2.197 ms, 2.336 ms] 787.035 µs (53.2%)
iast_GLOBAL 2.306 ms [2.236 ms, 2.376 ms] 826.68 µs (55.9%)
profiling 2.083 ms [2.029 ms, 2.138 ms] 604.143 µs (40.8%)
tracing 2.08 ms [2.025 ms, 2.134 ms] 600.461 µs (40.6%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~30ea3b333e, baseline=1.60.0-SNAPSHOT~6d44cf9e09
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.653 s) : 15653000, 15653000
.   : milestone, 15653000,
appsec (14.84 s) : 14840000, 14840000
.   : milestone, 14840000,
iast (18.515 s) : 18515000, 18515000
.   : milestone, 18515000,
iast_GLOBAL (17.848 s) : 17848000, 17848000
.   : milestone, 17848000,
profiling (15.407 s) : 15407000, 15407000
.   : milestone, 15407000,
tracing (15.207 s) : 15207000, 15207000
.   : milestone, 15207000,
section candidate
no_agent (15.014 s) : 15014000, 15014000
.   : milestone, 15014000,
appsec (14.959 s) : 14959000, 14959000
.   : milestone, 14959000,
iast (18.226 s) : 18226000, 18226000
.   : milestone, 18226000,
iast_GLOBAL (17.843 s) : 17843000, 17843000
.   : milestone, 17843000,
profiling (14.917 s) : 14917000, 14917000
.   : milestone, 14917000,
tracing (14.638 s) : 14638000, 14638000
.   : milestone, 14638000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.653 s [15.653 s, 15.653 s] -
appsec 14.84 s [14.84 s, 14.84 s] -813.0 ms (-5.2%)
iast 18.515 s [18.515 s, 18.515 s] 2.862 s (18.3%)
iast_GLOBAL 17.848 s [17.848 s, 17.848 s] 2.195 s (14.0%)
profiling 15.407 s [15.407 s, 15.407 s] -246.0 ms (-1.6%)
tracing 15.207 s [15.207 s, 15.207 s] -446.0 ms (-2.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.014 s [15.014 s, 15.014 s] -
appsec 14.959 s [14.959 s, 14.959 s] -55.0 ms (-0.4%)
iast 18.226 s [18.226 s, 18.226 s] 3.212 s (21.4%)
iast_GLOBAL 17.843 s [17.843 s, 17.843 s] 2.829 s (18.8%)
profiling 14.917 s [14.917 s, 14.917 s] -97.0 ms (-0.6%)
tracing 14.638 s [14.638 s, 14.638 s] -376.0 ms (-2.5%)