Home Original page

Set sampling decision maker for AI Guard by smola · Pull Request #10702 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/ai-guard-dm
git_commit_date 1772193726 1772195840
git_commit_sha deab2cd 904e6fd
release_version 1.60.0-SNAPSHOT~deab2cd6e1 1.60.0-SNAPSHOT~904e6fd4ba
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1772197602 1772197602
ci_job_id 1462309646 1462309646
ci_pipeline_id 99401540 99401540
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-w9cq68xb 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-w9cq68xb 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 62 metrics, 9 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~904e6fd4ba, baseline=1.60.0-SNAPSHOT~deab2cd6e1

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.066 s) : 0, 1065690
Total [baseline] (8.744 s) : 0, 8743596
Agent [candidate] (1.063 s) : 0, 1062869
Total [candidate] (8.694 s) : 0, 8693736
section iast
Agent [baseline] (1.233 s) : 0, 1232706
Total [baseline] (9.362 s) : 0, 9361642
Agent [candidate] (1.23 s) : 0, 1229612
Total [candidate] (9.353 s) : 0, 9352807
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.066 s -
Agent iast 1.233 s 167.016 ms (15.7%)
Total tracing 8.744 s -
Total iast 9.362 s 618.047 ms (7.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.063 s -
Agent iast 1.23 s 166.744 ms (15.7%)
Total tracing 8.694 s -
Total iast 9.353 s 659.071 ms (7.6%) 
gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~904e6fd4ba, baseline=1.60.0-SNAPSHOT~deab2cd6e1

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.19 ms) : 0, 1190
crashtracking [candidate] (1.188 ms) : 0, 1188
BytebuddyAgent [baseline] (627.801 ms) : 0, 627801
BytebuddyAgent [candidate] (627.372 ms) : 0, 627372
AgentMeter [baseline] (29.073 ms) : 0, 29073
AgentMeter [candidate] (29.155 ms) : 0, 29155
GlobalTracer [baseline] (257.735 ms) : 0, 257735
GlobalTracer [candidate] (257.155 ms) : 0, 257155
AppSec [baseline] (32.965 ms) : 0, 32965
AppSec [candidate] (32.948 ms) : 0, 32948
Debugger [baseline] (64.182 ms) : 0, 64182
Debugger [candidate] (64.126 ms) : 0, 64126
Remote Config [baseline] (631.927 µs) : 0, 632
Remote Config [candidate] (611.355 µs) : 0, 611
Telemetry [baseline] (11.463 ms) : 0, 11463
Telemetry [candidate] (9.812 ms) : 0, 9812
Flare Poller [baseline] (4.595 ms) : 0, 4595
Flare Poller [candidate] (4.51 ms) : 0, 4510
section iast
crashtracking [baseline] (1.19 ms) : 0, 1190
crashtracking [candidate] (1.187 ms) : 0, 1187
BytebuddyAgent [baseline] (798.277 ms) : 0, 798277
BytebuddyAgent [candidate] (795.442 ms) : 0, 795442
AgentMeter [baseline] (11.291 ms) : 0, 11291
AgentMeter [candidate] (11.301 ms) : 0, 11301
GlobalTracer [baseline] (247.072 ms) : 0, 247072
GlobalTracer [candidate] (247.435 ms) : 0, 247435
AppSec [baseline] (34.603 ms) : 0, 34603
AppSec [candidate] (33.014 ms) : 0, 33014
Debugger [baseline] (64.659 ms) : 0, 64659
Debugger [candidate] (65.778 ms) : 0, 65778
Remote Config [baseline] (533.669 µs) : 0, 534
Remote Config [candidate] (536.945 µs) : 0, 537
Telemetry [baseline] (8.578 ms) : 0, 8578
Telemetry [candidate] (8.652 ms) : 0, 8652
Flare Poller [baseline] (3.42 ms) : 0, 3420
Flare Poller [candidate] (3.413 ms) : 0, 3413
IAST [baseline] (26.986 ms) : 0, 26986
IAST [candidate] (26.886 ms) : 0, 26886
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~904e6fd4ba, baseline=1.60.0-SNAPSHOT~deab2cd6e1

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.065 s) : 0, 1065201
Total [baseline] (10.897 s) : 0, 10896864
Agent [candidate] (1.064 s) : 0, 1063727
Total [candidate] (10.899 s) : 0, 10899418
section appsec
Agent [baseline] (1.237 s) : 0, 1236839
Total [baseline] (11.021 s) : 0, 11020862
Agent [candidate] (1.24 s) : 0, 1239678
Total [candidate] (10.971 s) : 0, 10971407
section iast
Agent [baseline] (1.23 s) : 0, 1229837
Total [baseline] (11.227 s) : 0, 11227123
Agent [candidate] (1.232 s) : 0, 1232145
Total [candidate] (11.188 s) : 0, 11188135
section profiling
Agent [baseline] (1.189 s) : 0, 1188930
Total [baseline] (10.836 s) : 0, 10836389
Agent [candidate] (1.19 s) : 0, 1189953
Total [candidate] (10.904 s) : 0, 10903664
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.065 s -
Agent appsec 1.237 s 171.639 ms (16.1%)
Agent iast 1.23 s 164.636 ms (15.5%)
Agent profiling 1.189 s 123.729 ms (11.6%)
Total tracing 10.897 s -
Total appsec 11.021 s 123.997 ms (1.1%)
Total iast 11.227 s 330.258 ms (3.0%)
Total profiling 10.836 s -60.475 ms (-0.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.064 s -
Agent appsec 1.24 s 175.951 ms (16.5%)
Agent iast 1.232 s 168.418 ms (15.8%)
Agent profiling 1.19 s 126.226 ms (11.9%)
Total tracing 10.899 s -
Total appsec 10.971 s 71.989 ms (0.7%)
Total iast 11.188 s 288.716 ms (2.6%)
Total profiling 10.904 s 4.246 ms (0.0%) 
gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~904e6fd4ba, baseline=1.60.0-SNAPSHOT~deab2cd6e1

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.183 ms) : 0, 1183
crashtracking [candidate] (1.181 ms) : 0, 1181
BytebuddyAgent [baseline] (627.62 ms) : 0, 627620
BytebuddyAgent [candidate] (626.505 ms) : 0, 626505
AgentMeter [baseline] (29.19 ms) : 0, 29190
AgentMeter [candidate] (29.119 ms) : 0, 29119
GlobalTracer [baseline] (257.319 ms) : 0, 257319
GlobalTracer [candidate] (257.199 ms) : 0, 257199
AppSec [baseline] (32.91 ms) : 0, 32910
AppSec [candidate] (32.842 ms) : 0, 32842
Debugger [baseline] (65.133 ms) : 0, 65133
Debugger [candidate] (64.304 ms) : 0, 64304
Remote Config [baseline] (617.971 µs) : 0, 618
Remote Config [candidate] (610.136 µs) : 0, 610
Telemetry [baseline] (9.911 ms) : 0, 9911
Telemetry [candidate] (10.631 ms) : 0, 10631
Flare Poller [baseline] (5.27 ms) : 0, 5270
Flare Poller [candidate] (5.339 ms) : 0, 5339
section appsec
crashtracking [baseline] (1.181 ms) : 0, 1181
crashtracking [candidate] (1.188 ms) : 0, 1188
BytebuddyAgent [baseline] (657.093 ms) : 0, 657093
BytebuddyAgent [candidate] (658.625 ms) : 0, 658625
AgentMeter [baseline] (12.008 ms) : 0, 12008
AgentMeter [candidate] (11.986 ms) : 0, 11986
GlobalTracer [baseline] (257.899 ms) : 0, 257899
GlobalTracer [candidate] (258.52 ms) : 0, 258520
AppSec [baseline] (167.288 ms) : 0, 167288
AppSec [candidate] (167.524 ms) : 0, 167524
Debugger [baseline] (66.435 ms) : 0, 66435
Debugger [candidate] (66.791 ms) : 0, 66791
Remote Config [baseline] (718.708 µs) : 0, 719
Remote Config [candidate] (675.184 µs) : 0, 675
Telemetry [baseline] (9.223 ms) : 0, 9223
Telemetry [candidate] (9.356 ms) : 0, 9356
Flare Poller [baseline] (3.664 ms) : 0, 3664
Flare Poller [candidate] (3.632 ms) : 0, 3632
IAST [baseline] (25.366 ms) : 0, 25366
IAST [candidate] (25.389 ms) : 0, 25389
section iast
crashtracking [baseline] (1.184 ms) : 0, 1184
crashtracking [candidate] (1.188 ms) : 0, 1188
BytebuddyAgent [baseline] (793.615 ms) : 0, 793615
BytebuddyAgent [candidate] (795.564 ms) : 0, 795564
AgentMeter [baseline] (11.305 ms) : 0, 11305
AgentMeter [candidate] (11.289 ms) : 0, 11289
GlobalTracer [baseline] (246.926 ms) : 0, 246926
GlobalTracer [candidate] (247.508 ms) : 0, 247508
AppSec [baseline] (34.989 ms) : 0, 34989
AppSec [candidate] (34.995 ms) : 0, 34995
Debugger [baseline] (66.086 ms) : 0, 66086
Debugger [candidate] (65.881 ms) : 0, 65881
Remote Config [baseline] (527.511 µs) : 0, 528
Remote Config [candidate] (547.333 µs) : 0, 547
Telemetry [baseline] (8.733 ms) : 0, 8733
Telemetry [candidate] (8.635 ms) : 0, 8635
Flare Poller [baseline] (3.473 ms) : 0, 3473
Flare Poller [candidate] (3.473 ms) : 0, 3473
IAST [baseline] (26.97 ms) : 0, 26970
IAST [candidate] (27.112 ms) : 0, 27112
section profiling
crashtracking [baseline] (1.156 ms) : 0, 1156
crashtracking [candidate] (1.169 ms) : 0, 1169
BytebuddyAgent [baseline] (681.003 ms) : 0, 681003
BytebuddyAgent [candidate] (682.232 ms) : 0, 682232
AgentMeter [baseline] (8.622 ms) : 0, 8622
AgentMeter [candidate] (8.583 ms) : 0, 8583
GlobalTracer [baseline] (216.036 ms) : 0, 216036
GlobalTracer [candidate] (215.992 ms) : 0, 215992
AppSec [baseline] (32.47 ms) : 0, 32470
AppSec [candidate] (32.462 ms) : 0, 32462
Debugger [baseline] (66.791 ms) : 0, 66791
Debugger [candidate] (66.965 ms) : 0, 66965
Remote Config [baseline] (629.775 µs) : 0, 630
Remote Config [candidate] (640.147 µs) : 0, 640
Telemetry [baseline] (8.93 ms) : 0, 8930
Telemetry [candidate] (8.911 ms) : 0, 8911
Flare Poller [baseline] (3.732 ms) : 0, 3732
Flare Poller [candidate] (3.766 ms) : 0, 3766
ProfilingAgent [baseline] (98.932 ms) : 0, 98932
ProfilingAgent [candidate] (98.476 ms) : 0, 98476
Profiling [baseline] (99.512 ms) : 0, 99512
Profiling [candidate] (99.051 ms) : 0, 99051
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/ai-guard-dm
git_commit_date 1772193726 1772195840
git_commit_sha deab2cd 904e6fd
release_version 1.60.0-SNAPSHOT~deab2cd6e1 1.60.0-SNAPSHOT~904e6fd4ba
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1772198249 1772198249
ci_job_id 1462309648 1462309648
ci_pipeline_id 99401540 99401540
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-fuzxm0ls 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-fuzxm0ls 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 2 performance regressions! Performance is the same for 15 metrics, 18 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast:high_load worse
[+86.668µs; +214.661µs] or [+3.636%; +9.006%]		 unstable
[+32.507µs; +756.856µs] or [+0.467%; +10.869%]		 unstable
[-226.353op/s; +101.291op/s] or [-15.449%; +6.913%]		 2.534ms 7.358ms 1402.594op/s 2.384ms 6.964ms 1465.125op/s
scenario:load:petclinic:appsec:high_load better
[-1.714ms; -0.703ms] or [-8.775%; -3.598%]		 unsure
[-1.892ms; -0.287ms] or [-6.093%; -0.926%]		 unstable
[-11.827op/s; +36.327op/s] or [-4.986%; +15.316%]		 18.325ms 29.963ms 249.438op/s 19.534ms 31.052ms 237.188op/s
scenario:load:petclinic:no_agent:high_load worse
[+0.543ms; +2.180ms] or [+3.255%; +13.072%]		 unstable
[-0.045ms; +2.881ms] or [-0.156%; +10.073%]		 unstable
[-42.061op/s; +13.311op/s] or [-15.629%; +4.946%]		 18.035ms 30.019ms 254.750op/s 16.674ms 28.600ms 269.125op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~904e6fd4ba, baseline=1.60.0-SNAPSHOT~deab2cd6e1
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.336 ms) : 17163, 17509
.   : milestone, 17336,
appsec (19.684 ms) : 19484, 19884
.   : milestone, 19684,
code_origins (17.637 ms) : 17462, 17813
.   : milestone, 17637,
iast (17.503 ms) : 17331, 17675
.   : milestone, 17503,
profiling (18.588 ms) : 18406, 18770
.   : milestone, 18588,
tracing (17.568 ms) : 17395, 17742
.   : milestone, 17568,
section candidate
no_agent (18.321 ms) : 18131, 18511
.   : milestone, 18321,
appsec (18.711 ms) : 18521, 18901
.   : milestone, 18711,
code_origins (17.411 ms) : 17238, 17585
.   : milestone, 17411,
iast (17.493 ms) : 17320, 17665
.   : milestone, 17493,
profiling (18.497 ms) : 18312, 18683
.   : milestone, 18497,
tracing (17.825 ms) : 17649, 18000
.   : milestone, 17825,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.336 ms [17.163 ms, 17.509 ms] -
appsec 19.684 ms [19.484 ms, 19.884 ms] 2.348 ms (13.5%)
code_origins 17.637 ms [17.462 ms, 17.813 ms] 301.156 µs (1.7%)
iast 17.503 ms [17.331 ms, 17.675 ms] 166.95 µs (1.0%)
profiling 18.588 ms [18.406 ms, 18.77 ms] 1.252 ms (7.2%)
tracing 17.568 ms [17.395 ms, 17.742 ms] 232.415 µs (1.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.321 ms [18.131 ms, 18.511 ms] -
appsec 18.711 ms [18.521 ms, 18.901 ms] 390.466 µs (2.1%)
code_origins 17.411 ms [17.238 ms, 17.585 ms] -909.354 µs (-5.0%)
iast 17.493 ms [17.32 ms, 17.665 ms] -827.919 µs (-4.5%)
profiling 18.497 ms [18.312 ms, 18.683 ms] 176.738 µs (1.0%)
tracing 17.825 ms [17.649 ms, 18.0 ms] -495.636 µs (-2.7%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~904e6fd4ba, baseline=1.60.0-SNAPSHOT~deab2cd6e1
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.174 ms) : 1162, 1185
.   : milestone, 1174,
iast (3.12 ms) : 3078, 3163
.   : milestone, 3120,
iast_FULL (5.967 ms) : 5907, 6028
.   : milestone, 5967,
iast_GLOBAL (3.644 ms) : 3597, 3691
.   : milestone, 3644,
profiling (2.188 ms) : 2167, 2209
.   : milestone, 2188,
tracing (1.819 ms) : 1804, 1834
.   : milestone, 1819,
section candidate
no_agent (1.191 ms) : 1179, 1202
.   : milestone, 1191,
iast (3.263 ms) : 3214, 3311
.   : milestone, 3263,
iast_FULL (5.991 ms) : 5931, 6052
.   : milestone, 5991,
iast_GLOBAL (3.73 ms) : 3664, 3796
.   : milestone, 3730,
profiling (2.075 ms) : 2057, 2093
.   : milestone, 2075,
tracing (1.812 ms) : 1797, 1826
.   : milestone, 1812,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.174 ms [1.162 ms, 1.185 ms] -
iast 3.12 ms [3.078 ms, 3.163 ms] 1.947 ms (165.9%)
iast_FULL 5.967 ms [5.907 ms, 6.028 ms] 4.794 ms (408.5%)
iast_GLOBAL 3.644 ms [3.597 ms, 3.691 ms] 2.47 ms (210.5%)
profiling 2.188 ms [2.167 ms, 2.209 ms] 1.014 ms (86.4%)
tracing 1.819 ms [1.804 ms, 1.834 ms] 645.676 µs (55.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.191 ms [1.179 ms, 1.202 ms] -
iast 3.263 ms [3.214 ms, 3.311 ms] 2.072 ms (174.0%)
iast_FULL 5.991 ms [5.931 ms, 6.052 ms] 4.801 ms (403.2%)
iast_GLOBAL 3.73 ms [3.664 ms, 3.796 ms] 2.539 ms (213.3%)
profiling 2.075 ms [2.057 ms, 2.093 ms] 884.366 µs (74.3%)
tracing 1.812 ms [1.797 ms, 1.826 ms] 621.253 µs (52.2%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/ai-guard-dm
git_commit_date 1772193726 1772195840
git_commit_sha deab2cd 904e6fd
release_version 1.60.0-SNAPSHOT~deab2cd6e1 1.60.0-SNAPSHOT~904e6fd4ba
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1772197752 1772197752
ci_job_id 1462309650 1462309650
ci_pipeline_id 99401540 99401540
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-cl7xvh8j 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-cl7xvh8j 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:dacapo:tomcat:appsec better
[-1.463ms; -1.117ms] or [-38.614%; -29.463%]		 2.500ms 3.790ms
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~904e6fd4ba, baseline=1.60.0-SNAPSHOT~deab2cd6e1
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.468 ms) : 1456, 1479
.   : milestone, 1468,
appsec (3.79 ms) : 3568, 4011
.   : milestone, 3790,
iast (2.254 ms) : 2185, 2324
.   : milestone, 2254,
iast_GLOBAL (2.283 ms) : 2213, 2352
.   : milestone, 2283,
profiling (2.077 ms) : 2022, 2131
.   : milestone, 2077,
tracing (2.048 ms) : 1995, 2102
.   : milestone, 2048,
section candidate
no_agent (1.471 ms) : 1460, 1483
.   : milestone, 1471,
appsec (2.5 ms) : 2445, 2554
.   : milestone, 2500,
iast (2.253 ms) : 2183, 2322
.   : milestone, 2253,
iast_GLOBAL (2.289 ms) : 2220, 2358
.   : milestone, 2289,
profiling (2.067 ms) : 2012, 2121
.   : milestone, 2067,
tracing (2.048 ms) : 1994, 2101
.   : milestone, 2048,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.468 ms [1.456 ms, 1.479 ms] -
appsec 3.79 ms [3.568 ms, 4.011 ms] 2.322 ms (158.2%)
iast 2.254 ms [2.185 ms, 2.324 ms] 786.726 µs (53.6%)
iast_GLOBAL 2.283 ms [2.213 ms, 2.352 ms] 815.168 µs (55.5%)
profiling 2.077 ms [2.022 ms, 2.131 ms] 608.886 µs (41.5%)
tracing 2.048 ms [1.995 ms, 2.102 ms] 580.513 µs (39.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.471 ms [1.46 ms, 1.483 ms] -
appsec 2.5 ms [2.445 ms, 2.554 ms] 1.029 ms (69.9%)
iast 2.253 ms [2.183 ms, 2.322 ms] 781.601 µs (53.1%)
iast_GLOBAL 2.289 ms [2.22 ms, 2.358 ms] 817.911 µs (55.6%)
profiling 2.067 ms [2.012 ms, 2.121 ms] 595.575 µs (40.5%)
tracing 2.048 ms [1.994 ms, 2.101 ms] 576.492 µs (39.2%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~904e6fd4ba, baseline=1.60.0-SNAPSHOT~deab2cd6e1
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.287 s) : 15287000, 15287000
.   : milestone, 15287000,
appsec (14.814 s) : 14814000, 14814000
.   : milestone, 14814000,
iast (18.109 s) : 18109000, 18109000
.   : milestone, 18109000,
iast_GLOBAL (17.659 s) : 17659000, 17659000
.   : milestone, 17659000,
profiling (15.36 s) : 15360000, 15360000
.   : milestone, 15360000,
tracing (14.799 s) : 14799000, 14799000
.   : milestone, 14799000,
section candidate
no_agent (14.802 s) : 14802000, 14802000
.   : milestone, 14802000,
appsec (14.98 s) : 14980000, 14980000
.   : milestone, 14980000,
iast (18.149 s) : 18149000, 18149000
.   : milestone, 18149000,
iast_GLOBAL (17.929 s) : 17929000, 17929000
.   : milestone, 17929000,
profiling (15.425 s) : 15425000, 15425000
.   : milestone, 15425000,
tracing (14.835 s) : 14835000, 14835000
.   : milestone, 14835000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.287 s [15.287 s, 15.287 s] -
appsec 14.814 s [14.814 s, 14.814 s] -473.0 ms (-3.1%)
iast 18.109 s [18.109 s, 18.109 s] 2.822 s (18.5%)
iast_GLOBAL 17.659 s [17.659 s, 17.659 s] 2.372 s (15.5%)
profiling 15.36 s [15.36 s, 15.36 s] 73.0 ms (0.5%)
tracing 14.799 s [14.799 s, 14.799 s] -488.0 ms (-3.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.802 s [14.802 s, 14.802 s] -
appsec 14.98 s [14.98 s, 14.98 s] 178.0 ms (1.2%)
iast 18.149 s [18.149 s, 18.149 s] 3.347 s (22.6%)
iast_GLOBAL 17.929 s [17.929 s, 17.929 s] 3.127 s (21.1%)
profiling 15.425 s [15.425 s, 15.425 s] 623.0 ms (4.2%)
tracing 14.835 s [14.835 s, 14.835 s] 33.0 ms (0.2%)