Home Original page

Bump ddprof to 1.37.0 by jbachorik · Pull Request #10487 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jb/ddprof_1.37.0
git_commit_date 1769794378 1769798433
git_commit_sha 38e69eb 1bc9881
release_version 1.59.0-SNAPSHOT~38e69eb9ad 1.59.0-SNAPSHOT~1bc9881f3a
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1769800193 1769800193
ci_job_id 1390836806 1390836806
ci_pipeline_id 93881372 93881372
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-4z0xlrqy 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-4z0xlrqy 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 64 metrics, 7 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.59.0-SNAPSHOT~1bc9881f3a, baseline=1.59.0-SNAPSHOT~38e69eb9ad

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.062 s) : 0, 1062386
Total [baseline] (8.705 s) : 0, 8705192
Agent [candidate] (1.059 s) : 0, 1058571
Total [candidate] (8.715 s) : 0, 8715054
section iast
Agent [baseline] (1.224 s) : 0, 1224156
Total [baseline] (9.339 s) : 0, 9338848
Agent [candidate] (1.24 s) : 0, 1240005
Total [candidate] (9.386 s) : 0, 9385614
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.062 s -
Agent iast 1.224 s 161.77 ms (15.2%)
Total tracing 8.705 s -
Total iast 9.339 s 633.656 ms (7.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.059 s -
Agent iast 1.24 s 181.434 ms (17.1%)
Total tracing 8.715 s -
Total iast 9.386 s 670.56 ms (7.7%) 
gantt
    title insecure-bank - break down per module: candidate=1.59.0-SNAPSHOT~1bc9881f3a, baseline=1.59.0-SNAPSHOT~38e69eb9ad

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.185 ms) : 0, 1185
crashtracking [candidate] (1.182 ms) : 0, 1182
BytebuddyAgent [baseline] (626.701 ms) : 0, 626701
BytebuddyAgent [candidate] (623.623 ms) : 0, 623623
AgentMeter [baseline] (28.979 ms) : 0, 28979
AgentMeter [candidate] (28.721 ms) : 0, 28721
GlobalTracer [baseline] (257.606 ms) : 0, 257606
GlobalTracer [candidate] (257.345 ms) : 0, 257345
AppSec [baseline] (33.072 ms) : 0, 33072
AppSec [candidate] (32.919 ms) : 0, 32919
Debugger [baseline] (59.627 ms) : 0, 59627
Debugger [candidate] (60.959 ms) : 0, 60959
Remote Config [baseline] (626.692 µs) : 0, 627
Remote Config [candidate] (615.423 µs) : 0, 615
Telemetry [baseline] (9.982 ms) : 0, 9982
Telemetry [candidate] (11.607 ms) : 0, 11607
Flare Poller [baseline] (9.053 ms) : 0, 9053
Flare Poller [candidate] (6.039 ms) : 0, 6039
section iast
crashtracking [baseline] (1.191 ms) : 0, 1191
crashtracking [candidate] (1.2 ms) : 0, 1200
BytebuddyAgent [baseline] (789.414 ms) : 0, 789414
BytebuddyAgent [candidate] (801.893 ms) : 0, 801893
AgentMeter [baseline] (11.226 ms) : 0, 11226
AgentMeter [candidate] (11.399 ms) : 0, 11399
GlobalTracer [baseline] (247.786 ms) : 0, 247786
GlobalTracer [candidate] (250.73 ms) : 0, 250730
IAST [baseline] (26.915 ms) : 0, 26915
IAST [candidate] (27.179 ms) : 0, 27179
AppSec [baseline] (34.731 ms) : 0, 34731
AppSec [candidate] (35.649 ms) : 0, 35649
Debugger [baseline] (65.036 ms) : 0, 65036
Debugger [candidate] (63.853 ms) : 0, 63853
Remote Config [baseline] (546.149 µs) : 0, 546
Remote Config [candidate] (539.278 µs) : 0, 539
Telemetry [baseline] (8.494 ms) : 0, 8494
Telemetry [candidate] (8.502 ms) : 0, 8502
Flare Poller [baseline] (3.515 ms) : 0, 3515
Flare Poller [candidate] (3.492 ms) : 0, 3492
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.59.0-SNAPSHOT~1bc9881f3a, baseline=1.59.0-SNAPSHOT~38e69eb9ad

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.059 s) : 0, 1059246
Total [baseline] (10.967 s) : 0, 10966931
Agent [candidate] (1.059 s) : 0, 1058749
Total [candidate] (10.945 s) : 0, 10944825
section appsec
Agent [baseline] (1.236 s) : 0, 1236355
Total [baseline] (10.947 s) : 0, 10946810
Agent [candidate] (1.232 s) : 0, 1231692
Total [candidate] (11.04 s) : 0, 11040298
section iast
Agent [baseline] (1.224 s) : 0, 1224296
Total [baseline] (11.118 s) : 0, 11117757
Agent [candidate] (1.227 s) : 0, 1227388
Total [candidate] (11.163 s) : 0, 11163485
section profiling
Agent [baseline] (1.182 s) : 0, 1182415
Total [baseline] (10.848 s) : 0, 10848289
Agent [candidate] (1.194 s) : 0, 1193755
Total [candidate] (10.971 s) : 0, 10971272
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.059 s -
Agent appsec 1.236 s 177.108 ms (16.7%)
Agent iast 1.224 s 165.05 ms (15.6%)
Agent profiling 1.182 s 123.169 ms (11.6%)
Total tracing 10.967 s -
Total appsec 10.947 s -20.121 ms (-0.2%)
Total iast 11.118 s 150.826 ms (1.4%)
Total profiling 10.848 s -118.643 ms (-1.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.059 s -
Agent appsec 1.232 s 172.943 ms (16.3%)
Agent iast 1.227 s 168.639 ms (15.9%)
Agent profiling 1.194 s 135.006 ms (12.8%)
Total tracing 10.945 s -
Total appsec 11.04 s 95.473 ms (0.9%)
Total iast 11.163 s 218.66 ms (2.0%)
Total profiling 10.971 s 26.447 ms (0.2%) 
gantt
    title petclinic - break down per module: candidate=1.59.0-SNAPSHOT~1bc9881f3a, baseline=1.59.0-SNAPSHOT~38e69eb9ad

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.178 ms) : 0, 1178
crashtracking [candidate] (1.181 ms) : 0, 1181
BytebuddyAgent [baseline] (623.623 ms) : 0, 623623
BytebuddyAgent [candidate] (623.557 ms) : 0, 623557
AgentMeter [baseline] (28.875 ms) : 0, 28875
AgentMeter [candidate] (28.672 ms) : 0, 28672
GlobalTracer [baseline] (256.871 ms) : 0, 256871
GlobalTracer [candidate] (256.943 ms) : 0, 256943
AppSec [baseline] (32.98 ms) : 0, 32980
AppSec [candidate] (32.818 ms) : 0, 32818
Debugger [baseline] (61.152 ms) : 0, 61152
Debugger [candidate] (61.728 ms) : 0, 61728
Remote Config [baseline] (623.598 µs) : 0, 624
Remote Config [candidate] (628.696 µs) : 0, 629
Telemetry [baseline] (10.736 ms) : 0, 10736
Telemetry [candidate] (11.662 ms) : 0, 11662
Flare Poller [baseline] (7.745 ms) : 0, 7745
Flare Poller [candidate] (6.137 ms) : 0, 6137
section appsec
crashtracking [baseline] (1.181 ms) : 0, 1181
crashtracking [candidate] (1.175 ms) : 0, 1175
BytebuddyAgent [baseline] (654.558 ms) : 0, 654558
BytebuddyAgent [candidate] (652.192 ms) : 0, 652192
AgentMeter [baseline] (11.902 ms) : 0, 11902
AgentMeter [candidate] (11.83 ms) : 0, 11830
GlobalTracer [baseline] (258.606 ms) : 0, 258606
GlobalTracer [candidate] (257.454 ms) : 0, 257454
AppSec [baseline] (167.662 ms) : 0, 167662
AppSec [candidate] (167.404 ms) : 0, 167404
Debugger [baseline] (68.149 ms) : 0, 68149
Debugger [candidate] (67.393 ms) : 0, 67393
Remote Config [baseline] (671.974 µs) : 0, 672
Remote Config [candidate] (662.75 µs) : 0, 663
Telemetry [baseline] (9.252 ms) : 0, 9252
Telemetry [candidate] (9.403 ms) : 0, 9403
Flare Poller [baseline] (3.6 ms) : 0, 3600
Flare Poller [candidate] (3.642 ms) : 0, 3642
IAST [baseline] (25.492 ms) : 0, 25492
IAST [candidate] (25.307 ms) : 0, 25307
section iast
crashtracking [baseline] (1.174 ms) : 0, 1174
crashtracking [candidate] (1.177 ms) : 0, 1177
BytebuddyAgent [baseline] (788.784 ms) : 0, 788784
BytebuddyAgent [candidate] (791.558 ms) : 0, 791558
AgentMeter [baseline] (11.183 ms) : 0, 11183
AgentMeter [candidate] (11.216 ms) : 0, 11216
GlobalTracer [baseline] (247.673 ms) : 0, 247673
GlobalTracer [candidate] (248.396 ms) : 0, 248396
AppSec [baseline] (34.111 ms) : 0, 34111
AppSec [candidate] (33.858 ms) : 0, 33858
Debugger [baseline] (66.746 ms) : 0, 66746
Debugger [candidate] (66.45 ms) : 0, 66450
Remote Config [baseline] (549.791 µs) : 0, 550
Remote Config [candidate] (538.555 µs) : 0, 539
Telemetry [baseline] (8.588 ms) : 0, 8588
Telemetry [candidate] (8.581 ms) : 0, 8581
Flare Poller [baseline] (3.518 ms) : 0, 3518
Flare Poller [candidate] (3.427 ms) : 0, 3427
IAST [baseline] (26.726 ms) : 0, 26726
IAST [candidate] (26.823 ms) : 0, 26823
section profiling
ProfilingAgent [baseline] (98.081 ms) : 0, 98081
ProfilingAgent [candidate] (99.586 ms) : 0, 99586
crashtracking [baseline] (1.212 ms) : 0, 1212
crashtracking [candidate] (1.217 ms) : 0, 1217
BytebuddyAgent [baseline] (675.719 ms) : 0, 675719
BytebuddyAgent [candidate] (682.182 ms) : 0, 682182
AgentMeter [baseline] (8.635 ms) : 0, 8635
AgentMeter [candidate] (8.712 ms) : 0, 8712
GlobalTracer [baseline] (216.318 ms) : 0, 216318
GlobalTracer [candidate] (217.888 ms) : 0, 217888
AppSec [baseline] (32.226 ms) : 0, 32226
AppSec [candidate] (32.718 ms) : 0, 32718
Debugger [baseline] (67.459 ms) : 0, 67459
Debugger [candidate] (68.23 ms) : 0, 68230
Remote Config [baseline] (588.613 µs) : 0, 589
Remote Config [candidate] (590.234 µs) : 0, 590
Telemetry [baseline] (8.716 ms) : 0, 8716
Telemetry [candidate] (8.699 ms) : 0, 8699
Flare Poller [baseline] (3.722 ms) : 0, 3722
Flare Poller [candidate] (3.785 ms) : 0, 3785
Profiling [baseline] (98.639 ms) : 0, 98639
Profiling [candidate] (100.17 ms) : 0, 100170
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jb/ddprof_1.37.0
git_commit_date 1769794378 1769798433
git_commit_sha 38e69eb 1bc9881
release_version 1.59.0-SNAPSHOT~38e69eb9ad 1.59.0-SNAPSHOT~1bc9881f3a
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1769800687 1769800687
ci_job_id 1390836807 1390836807
ci_pipeline_id 93881372 93881372
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-c5wttrpl 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-c5wttrpl 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 5 performance improvements and 2 performance regressions! Performance is the same for 14 metrics, 15 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:profiling:high_load worse
[+40.147µs; +183.965µs] or [+2.386%; +10.934%]		 unstable
[+39.782µs; +977.802µs] or [+0.823%; +20.218%]		 unstable
[-428.710op/s; +127.023op/s] or [-19.764%; +5.856%]		 1.795ms 5.345ms 2018.344op/s 1.682ms 4.836ms 2169.188op/s
scenario:load:insecure-bank:iast_FULL:high_load better
[-357.071µs; -113.160µs] or [-6.741%; -2.136%]		 better
[-826.254µs; -257.329µs] or [-6.552%; -2.041%]		 unstable
[-65.166op/s; +116.728op/s] or [-8.363%; +14.980%]		 5.062ms 12.069ms 805.031op/s 5.297ms 12.611ms 779.250op/s
scenario:load:petclinic:iast:high_load better
[-1.751ms; -0.798ms] or [-9.493%; -4.328%]		 same
[-1456.198µs; +103.750µs] or [-4.939%; +0.352%]		 unstable
[-10.620op/s; +39.370op/s] or [-4.237%; +15.707%]		 17.172ms 28.810ms 265.031op/s 18.447ms 29.486ms 250.656op/s
scenario:load:petclinic:code_origins:high_load better
[-1.711ms; -0.795ms] or [-9.387%; -4.360%]		 better
[-2.391ms; -0.739ms] or [-8.023%; -2.480%]		 unstable
[-10.270op/s; +40.332op/s] or [-4.078%; +16.015%]		 16.977ms 28.233ms 266.875op/s 18.230ms 29.798ms 251.844op/s
scenario:load:petclinic:no_agent:high_load worse
[+0.498ms; +1.814ms] or [+2.871%; +10.462%]		 unsure
[+0.007ms; +2.817ms] or [+0.024%; +9.624%]		 unstable
[-41.729op/s; +10.292op/s] or [-15.927%; +3.928%]		 18.494ms 30.682ms 246.281op/s 17.338ms 29.270ms 262.000op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~1bc9881f3a, baseline=1.59.0-SNAPSHOT~38e69eb9ad
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.194 ms) : 1182, 1205
.   : milestone, 1194,
iast (3.288 ms) : 3243, 3333
.   : milestone, 3288,
iast_FULL (5.933 ms) : 5873, 5993
.   : milestone, 5933,
iast_GLOBAL (3.548 ms) : 3492, 3603
.   : milestone, 3548,
profiling (2.083 ms) : 2064, 2101
.   : milestone, 2083,
tracing (1.835 ms) : 1820, 1850
.   : milestone, 1835,
section candidate
no_agent (1.183 ms) : 1172, 1195
.   : milestone, 1183,
iast (3.236 ms) : 3193, 3279
.   : milestone, 3236,
iast_FULL (5.741 ms) : 5685, 5797
.   : milestone, 5741,
iast_GLOBAL (3.573 ms) : 3518, 3629
.   : milestone, 3573,
profiling (2.244 ms) : 2223, 2264
.   : milestone, 2244,
tracing (1.774 ms) : 1757, 1791
.   : milestone, 1774,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.194 ms [1.182 ms, 1.205 ms] -
iast 3.288 ms [3.243 ms, 3.333 ms] 2.095 ms (175.5%)
iast_FULL 5.933 ms [5.873 ms, 5.993 ms] 4.739 ms (397.0%)
iast_GLOBAL 3.548 ms [3.492 ms, 3.603 ms] 2.354 ms (197.2%)
profiling 2.083 ms [2.064 ms, 2.101 ms] 888.91 µs (74.5%)
tracing 1.835 ms [1.82 ms, 1.85 ms] 641.538 µs (53.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.183 ms [1.172 ms, 1.195 ms] -
iast 3.236 ms [3.193 ms, 3.279 ms] 2.053 ms (173.5%)
iast_FULL 5.741 ms [5.685 ms, 5.797 ms] 4.558 ms (385.1%)
iast_GLOBAL 3.573 ms [3.518 ms, 3.629 ms] 2.39 ms (201.9%)
profiling 2.244 ms [2.223 ms, 2.264 ms] 1.06 ms (89.6%)
tracing 1.774 ms [1.757 ms, 1.791 ms] 590.85 µs (49.9%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~1bc9881f3a, baseline=1.59.0-SNAPSHOT~38e69eb9ad
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.804 ms) : 17626, 17983
.   : milestone, 17804,
appsec (18.424 ms) : 18239, 18609
.   : milestone, 18424,
code_origins (18.534 ms) : 18343, 18725
.   : milestone, 18534,
iast (18.617 ms) : 18429, 18805
.   : milestone, 18617,
profiling (18.385 ms) : 18202, 18569
.   : milestone, 18385,
tracing (17.505 ms) : 17332, 17677
.   : milestone, 17505,
section candidate
no_agent (18.951 ms) : 18760, 19142
.   : milestone, 18951,
appsec (18.676 ms) : 18487, 18864
.   : milestone, 18676,
code_origins (17.481 ms) : 17309, 17652
.   : milestone, 17481,
iast (17.603 ms) : 17425, 17780
.   : milestone, 17603,
profiling (18.819 ms) : 18626, 19012
.   : milestone, 18819,
tracing (17.482 ms) : 17309, 17654
.   : milestone, 17482,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.804 ms [17.626 ms, 17.983 ms] -
appsec 18.424 ms [18.239 ms, 18.609 ms] 619.73 µs (3.5%)
code_origins 18.534 ms [18.343 ms, 18.725 ms] 729.747 µs (4.1%)
iast 18.617 ms [18.429 ms, 18.805 ms] 812.759 µs (4.6%)
profiling 18.385 ms [18.202 ms, 18.569 ms] 581.17 µs (3.3%)
tracing 17.505 ms [17.332 ms, 17.677 ms] -299.716 µs (-1.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.951 ms [18.76 ms, 19.142 ms] -
appsec 18.676 ms [18.487 ms, 18.864 ms] -275.652 µs (-1.5%)
code_origins 17.481 ms [17.309 ms, 17.652 ms] -1.471 ms (-7.8%)
iast 17.603 ms [17.425 ms, 17.78 ms] -1.349 ms (-7.1%)
profiling 18.819 ms [18.626 ms, 19.012 ms] -132.832 µs (-0.7%)
tracing 17.482 ms [17.309 ms, 17.654 ms] -1.47 ms (-7.8%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jb/ddprof_1.37.0
git_commit_date 1769794378 1769798433
git_commit_sha 38e69eb 1bc9881
release_version 1.59.0-SNAPSHOT~38e69eb9ad 1.59.0-SNAPSHOT~1bc9881f3a
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1769800477 1769800477
ci_job_id 1390836808 1390836808
ci_pipeline_id 93881372 93881372
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-69r9gy2o 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-69r9gy2o 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~1bc9881f3a, baseline=1.59.0-SNAPSHOT~38e69eb9ad
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.483 ms) : 1472, 1495
.   : milestone, 1483,
appsec (3.796 ms) : 3575, 4018
.   : milestone, 3796,
iast (2.27 ms) : 2201, 2339
.   : milestone, 2270,
iast_GLOBAL (2.311 ms) : 2241, 2380
.   : milestone, 2311,
profiling (2.111 ms) : 2054, 2168
.   : milestone, 2111,
tracing (2.077 ms) : 2023, 2131
.   : milestone, 2077,
section candidate
no_agent (1.482 ms) : 1470, 1493
.   : milestone, 1482,
appsec (3.776 ms) : 3553, 3999
.   : milestone, 3776,
iast (2.267 ms) : 2197, 2337
.   : milestone, 2267,
iast_GLOBAL (2.315 ms) : 2245, 2385
.   : milestone, 2315,
profiling (2.084 ms) : 2029, 2139
.   : milestone, 2084,
tracing (2.071 ms) : 2017, 2126
.   : milestone, 2071,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.483 ms [1.472 ms, 1.495 ms] -
appsec 3.796 ms [3.575 ms, 4.018 ms] 2.313 ms (156.0%)
iast 2.27 ms [2.201 ms, 2.339 ms] 786.98 µs (53.1%)
iast_GLOBAL 2.311 ms [2.241 ms, 2.38 ms] 827.611 µs (55.8%)
profiling 2.111 ms [2.054 ms, 2.168 ms] 627.861 µs (42.3%)
tracing 2.077 ms [2.023 ms, 2.131 ms] 593.775 µs (40.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.482 ms [1.47 ms, 1.493 ms] -
appsec 3.776 ms [3.553 ms, 3.999 ms] 2.294 ms (154.8%)
iast 2.267 ms [2.197 ms, 2.337 ms] 785.323 µs (53.0%)
iast_GLOBAL 2.315 ms [2.245 ms, 2.385 ms] 832.86 µs (56.2%)
profiling 2.084 ms [2.029 ms, 2.139 ms] 602.064 µs (40.6%)
tracing 2.071 ms [2.017 ms, 2.126 ms] 589.697 µs (39.8%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~1bc9881f3a, baseline=1.59.0-SNAPSHOT~38e69eb9ad
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.708 s) : 15708000, 15708000
.   : milestone, 15708000,
appsec (14.883 s) : 14883000, 14883000
.   : milestone, 14883000,
iast (18.268 s) : 18268000, 18268000
.   : milestone, 18268000,
iast_GLOBAL (17.859 s) : 17859000, 17859000
.   : milestone, 17859000,
profiling (15.28 s) : 15280000, 15280000
.   : milestone, 15280000,
tracing (14.756 s) : 14756000, 14756000
.   : milestone, 14756000,
section candidate
no_agent (14.911 s) : 14911000, 14911000
.   : milestone, 14911000,
appsec (14.933 s) : 14933000, 14933000
.   : milestone, 14933000,
iast (18.159 s) : 18159000, 18159000
.   : milestone, 18159000,
iast_GLOBAL (17.667 s) : 17667000, 17667000
.   : milestone, 17667000,
profiling (14.888 s) : 14888000, 14888000
.   : milestone, 14888000,
tracing (14.63 s) : 14630000, 14630000
.   : milestone, 14630000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.708 s [15.708 s, 15.708 s] -
appsec 14.883 s [14.883 s, 14.883 s] -825.0 ms (-5.3%)
iast 18.268 s [18.268 s, 18.268 s] 2.56 s (16.3%)
iast_GLOBAL 17.859 s [17.859 s, 17.859 s] 2.151 s (13.7%)
profiling 15.28 s [15.28 s, 15.28 s] -428.0 ms (-2.7%)
tracing 14.756 s [14.756 s, 14.756 s] -952.0 ms (-6.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.911 s [14.911 s, 14.911 s] -
appsec 14.933 s [14.933 s, 14.933 s] 22.0 ms (0.1%)
iast 18.159 s [18.159 s, 18.159 s] 3.248 s (21.8%)
iast_GLOBAL 17.667 s [17.667 s, 17.667 s] 2.756 s (18.5%)
profiling 14.888 s [14.888 s, 14.888 s] -23.0 ms (-0.2%)
tracing 14.63 s [14.63 s, 14.63 s] -281.0 ms (-1.9%)