Home Original page

Support Spark 4.1 by removing mention to StreamExecution class by aboitreaud · Pull Request #10228 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master adrien.boitreaud/fix-muzzle-spark-4.1
git_commit_date 1765921510 1765955289
git_commit_sha 0204feb 1357168
release_version 1.57.0-SNAPSHOT~0204febb4b 1.57.0-SNAPSHOT~1357168231
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1765957218 1765957218
ci_job_id 1301421560 1301421560
ci_pipeline_id 87220404 87220404
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-wkj2emba 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-wkj2emba 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 54 metrics, 11 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.57.0-SNAPSHOT~1357168231, baseline=1.57.0-SNAPSHOT~0204febb4b

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.082 s) : 0, 1081919
Total [baseline] (10.778 s) : 0, 10777759
Agent [candidate] (1.08 s) : 0, 1080288
Total [candidate] (10.969 s) : 0, 10968973
section appsec
Agent [baseline] (1.262 s) : 0, 1261990
Total [baseline] (11.091 s) : 0, 11090514
Agent [candidate] (1.271 s) : 0, 1270971
Total [candidate] (10.971 s) : 0, 10971184
section iast
Agent [baseline] (1.221 s) : 0, 1220890
Total [baseline] (11.199 s) : 0, 11198992
Agent [candidate] (1.227 s) : 0, 1227005
Total [candidate] (11.135 s) : 0, 11135493
section profiling
Agent [baseline] (1.2 s) : 0, 1200026
Total [baseline] (10.992 s) : 0, 10992135
Agent [candidate] (1.212 s) : 0, 1212409
Total [candidate] (11.062 s) : 0, 11061508
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.082 s -
Agent appsec 1.262 s 180.071 ms (16.6%)
Agent iast 1.221 s 138.971 ms (12.8%)
Agent profiling 1.2 s 118.107 ms (10.9%)
Total tracing 10.778 s -
Total appsec 11.091 s 312.756 ms (2.9%)
Total iast 11.199 s 421.234 ms (3.9%)
Total profiling 10.992 s 214.376 ms (2.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.08 s -
Agent appsec 1.271 s 190.683 ms (17.7%)
Agent iast 1.227 s 146.717 ms (13.6%)
Agent profiling 1.212 s 132.121 ms (12.2%)
Total tracing 10.969 s -
Total appsec 10.971 s 2.211 ms (0.0%)
Total iast 11.135 s 166.521 ms (1.5%)
Total profiling 11.062 s 92.535 ms (0.8%) 
gantt
    title petclinic - break down per module: candidate=1.57.0-SNAPSHOT~1357168231, baseline=1.57.0-SNAPSHOT~0204febb4b

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.178 ms) : 0, 1178
crashtracking [candidate] (1.183 ms) : 0, 1183
BytebuddyAgent [baseline] (649.331 ms) : 0, 649331
BytebuddyAgent [candidate] (647.914 ms) : 0, 647914
GlobalTracer [baseline] (282.83 ms) : 0, 282830
GlobalTracer [candidate] (282.253 ms) : 0, 282253
AppSec [baseline] (32.186 ms) : 0, 32186
AppSec [candidate] (32.204 ms) : 0, 32204
Debugger [baseline] (66.996 ms) : 0, 66996
Debugger [candidate] (68.055 ms) : 0, 68055
Remote Config [baseline] (605.205 µs) : 0, 605
Remote Config [candidate] (643.642 µs) : 0, 644
Telemetry [baseline] (8.91 ms) : 0, 8910
Telemetry [candidate] (9.003 ms) : 0, 9003
Flare Poller [baseline] (4.501 ms) : 0, 4501
Flare Poller [candidate] (3.738 ms) : 0, 3738
section appsec
crashtracking [baseline] (1.178 ms) : 0, 1178
crashtracking [candidate] (1.186 ms) : 0, 1186
BytebuddyAgent [baseline] (686.837 ms) : 0, 686837
BytebuddyAgent [candidate] (693.041 ms) : 0, 693041
GlobalTracer [baseline] (258.622 ms) : 0, 258622
GlobalTracer [candidate] (259.735 ms) : 0, 259735
IAST [baseline] (24.549 ms) : 0, 24549
IAST [candidate] (24.881 ms) : 0, 24881
AppSec [baseline] (172.63 ms) : 0, 172630
AppSec [candidate] (171.278 ms) : 0, 171278
Debugger [baseline] (68.924 ms) : 0, 68924
Debugger [candidate] (71.392 ms) : 0, 71392
Remote Config [baseline] (727.813 µs) : 0, 728
Remote Config [candidate] (704.961 µs) : 0, 705
Telemetry [baseline] (9.049 ms) : 0, 9049
Telemetry [candidate] (9.081 ms) : 0, 9081
Flare Poller [baseline] (4.011 ms) : 0, 4011
Flare Poller [candidate] (3.918 ms) : 0, 3918
section iast
crashtracking [baseline] (1.183 ms) : 0, 1183
crashtracking [candidate] (1.195 ms) : 0, 1195
BytebuddyAgent [baseline] (788.655 ms) : 0, 788655
BytebuddyAgent [candidate] (793.977 ms) : 0, 793977
GlobalTracer [baseline] (255.712 ms) : 0, 255712
GlobalTracer [candidate] (256.448 ms) : 0, 256448
IAST [baseline] (26.974 ms) : 0, 26974
IAST [candidate] (27.124 ms) : 0, 27124
AppSec [baseline] (33.436 ms) : 0, 33436
AppSec [candidate] (32.805 ms) : 0, 32805
Debugger [baseline] (67.057 ms) : 0, 67057
Debugger [candidate] (67.634 ms) : 0, 67634
Remote Config [baseline] (598.098 µs) : 0, 598
Remote Config [candidate] (604.477 µs) : 0, 604
Telemetry [baseline] (8.46 ms) : 0, 8460
Telemetry [candidate] (8.407 ms) : 0, 8407
Flare Poller [baseline] (3.521 ms) : 0, 3521
Flare Poller [candidate] (3.412 ms) : 0, 3412
section profiling
crashtracking [baseline] (1.209 ms) : 0, 1209
crashtracking [candidate] (1.225 ms) : 0, 1225
BytebuddyAgent [baseline] (699.155 ms) : 0, 699155
BytebuddyAgent [candidate] (707.525 ms) : 0, 707525
GlobalTracer [baseline] (220.135 ms) : 0, 220135
GlobalTracer [candidate] (222.316 ms) : 0, 222316
AppSec [baseline] (32.031 ms) : 0, 32031
AppSec [candidate] (32.296 ms) : 0, 32296
Debugger [baseline] (67.932 ms) : 0, 67932
Debugger [candidate] (68.274 ms) : 0, 68274
Remote Config [baseline] (620.831 µs) : 0, 621
Remote Config [candidate] (640.932 µs) : 0, 641
Telemetry [baseline] (8.777 ms) : 0, 8777
Telemetry [candidate] (8.858 ms) : 0, 8858
Flare Poller [baseline] (3.709 ms) : 0, 3709
Flare Poller [candidate] (3.714 ms) : 0, 3714
ProfilingAgent [baseline] (96.977 ms) : 0, 96977
ProfilingAgent [candidate] (97.445 ms) : 0, 97445
Profiling [baseline] (97.559 ms) : 0, 97559
Profiling [candidate] (98.02 ms) : 0, 98020
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.57.0-SNAPSHOT~1357168231, baseline=1.57.0-SNAPSHOT~0204febb4b

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.079 s) : 0, 1078531
Total [baseline] (8.739 s) : 0, 8738964
Agent [candidate] (1.088 s) : 0, 1088203
Total [candidate] (8.742 s) : 0, 8741713
section iast
Agent [baseline] (1.225 s) : 0, 1225086
Total [baseline] (9.361 s) : 0, 9360771
Agent [candidate] (1.218 s) : 0, 1218210
Total [candidate] (9.36 s) : 0, 9360065
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.079 s -
Agent iast 1.225 s 146.555 ms (13.6%)
Total tracing 8.739 s -
Total iast 9.361 s 621.807 ms (7.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.088 s -
Agent iast 1.218 s 130.007 ms (11.9%)
Total tracing 8.742 s -
Total iast 9.36 s 618.352 ms (7.1%) 
gantt
    title insecure-bank - break down per module: candidate=1.57.0-SNAPSHOT~1357168231, baseline=1.57.0-SNAPSHOT~0204febb4b

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.181 ms) : 0, 1181
crashtracking [candidate] (1.194 ms) : 0, 1194
BytebuddyAgent [baseline] (647.824 ms) : 0, 647824
BytebuddyAgent [candidate] (653.702 ms) : 0, 653702
GlobalTracer [baseline] (281.486 ms) : 0, 281486
GlobalTracer [candidate] (284.243 ms) : 0, 284243
AppSec [baseline] (32.253 ms) : 0, 32253
AppSec [candidate] (32.556 ms) : 0, 32556
Debugger [baseline] (66.895 ms) : 0, 66895
Debugger [candidate] (67.726 ms) : 0, 67726
Remote Config [baseline] (623.304 µs) : 0, 623
Remote Config [candidate] (602.567 µs) : 0, 603
Telemetry [baseline] (9.119 ms) : 0, 9119
Telemetry [candidate] (8.913 ms) : 0, 8913
Flare Poller [baseline] (3.76 ms) : 0, 3760
Flare Poller [candidate] (3.685 ms) : 0, 3685
section iast
crashtracking [baseline] (1.2 ms) : 0, 1200
crashtracking [candidate] (1.179 ms) : 0, 1179
BytebuddyAgent [baseline] (792.371 ms) : 0, 792371
BytebuddyAgent [candidate] (788.566 ms) : 0, 788566
GlobalTracer [baseline] (256.223 ms) : 0, 256223
GlobalTracer [candidate] (254.814 ms) : 0, 254814
IAST [baseline] (27.082 ms) : 0, 27082
IAST [candidate] (26.987 ms) : 0, 26987
AppSec [baseline] (32.816 ms) : 0, 32816
AppSec [candidate] (33.343 ms) : 0, 33343
Debugger [baseline] (67.408 ms) : 0, 67408
Debugger [candidate] (65.603 ms) : 0, 65603
Remote Config [baseline] (596.028 µs) : 0, 596
Remote Config [candidate] (608.669 µs) : 0, 609
Telemetry [baseline] (8.498 ms) : 0, 8498
Telemetry [candidate] (8.389 ms) : 0, 8389
Flare Poller [baseline] (3.5 ms) : 0, 3500
Flare Poller [candidate] (3.478 ms) : 0, 3478
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master adrien.boitreaud/fix-muzzle-spark-4.1
git_commit_date 1765921510 1765955289
git_commit_sha 0204feb 1357168
release_version 1.57.0-SNAPSHOT~0204febb4b 1.57.0-SNAPSHOT~1357168231
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1765957713 1765957713
ci_job_id 1301421561 1301421561
ci_pipeline_id 87220404 87220404
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-6vkggvbs 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-6vkggvbs 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 6 performance regressions! Performance is the same for 14 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:tracing:high_load worse
[+55.310µs; +139.075µs] or [+3.748%; +9.424%]		 unstable
[+316.524µs; +1040.626µs] or [+8.163%; +26.837%]		 unstable
[-499.235op/s; +11.548op/s] or [-19.541%; +0.452%]		 1.573ms 4.556ms 2310.938op/s 1.476ms 3.878ms 2554.781op/s
scenario:load:insecure-bank:iast:high_load worse
[+216.524µs; +309.506µs] or [+9.514%; +13.600%]		 worse
[+240.129µs; +641.083µs] or [+3.450%; +9.212%]		 unstable
[-255.158op/s; +16.845op/s] or [-16.702%; +1.103%]		 2.539ms 7.400ms 1408.594op/s 2.276ms 6.959ms 1527.750op/s
scenario:load:insecure-bank:iast_GLOBAL:high_load worse
[+95.083µs; +192.298µs] or [+3.546%; +7.171%]		 unsure
[+83.935µs; +528.739µs] or [+1.088%; +6.851%]		 unstable
[-169.593op/s; +79.031op/s] or [-12.755%; +5.944%]		 2.825ms 8.024ms 1284.375op/s 2.682ms 7.718ms 1329.656op/s
scenario:load:petclinic:appsec:high_load worse
[+0.813ms; +1.672ms] or [+4.404%; +9.058%]		 worse
[+0.696ms; +2.648ms] or [+2.309%; +8.787%]		 unstable
[-37.902op/s; +9.964op/s] or [-15.243%; +4.007%]		 19.706ms 31.813ms 234.688op/s 18.463ms 30.140ms 248.656op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~1357168231, baseline=1.57.0-SNAPSHOT~0204febb4b
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.951 ms) : 17766, 18136
.   : milestone, 17951,
appsec (18.766 ms) : 18576, 18956
.   : milestone, 18766,
code_origins (17.758 ms) : 17583, 17933
.   : milestone, 17758,
iast (18.111 ms) : 17926, 18295
.   : milestone, 18111,
profiling (19.163 ms) : 18969, 19357
.   : milestone, 19163,
tracing (17.607 ms) : 17431, 17783
.   : milestone, 17607,
section candidate
no_agent (18.966 ms) : 18774, 19159
.   : milestone, 18966,
appsec (19.892 ms) : 19689, 20096
.   : milestone, 19892,
code_origins (17.697 ms) : 17523, 17870
.   : milestone, 17697,
iast (18.027 ms) : 17844, 18209
.   : milestone, 18027,
profiling (18.578 ms) : 18393, 18763
.   : milestone, 18578,
tracing (17.571 ms) : 17398, 17744
.   : milestone, 17571,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.951 ms [17.766 ms, 18.136 ms] -
appsec 18.766 ms [18.576 ms, 18.956 ms] 815.229 µs (4.5%)
code_origins 17.758 ms [17.583 ms, 17.933 ms] -193.305 µs (-1.1%)
iast 18.111 ms [17.926 ms, 18.295 ms] 159.868 µs (0.9%)
profiling 19.163 ms [18.969 ms, 19.357 ms] 1.212 ms (6.8%)
tracing 17.607 ms [17.431 ms, 17.783 ms] -344.029 µs (-1.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.966 ms [18.774 ms, 19.159 ms] -
appsec 19.892 ms [19.689 ms, 20.096 ms] 926.142 µs (4.9%)
code_origins 17.697 ms [17.523 ms, 17.87 ms] -1.269 ms (-6.7%)
iast 18.027 ms [17.844 ms, 18.209 ms] -939.336 µs (-5.0%)
profiling 18.578 ms [18.393 ms, 18.763 ms] -387.998 µs (-2.0%)
tracing 17.571 ms [17.398 ms, 17.744 ms] -1.395 ms (-7.4%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~1357168231, baseline=1.57.0-SNAPSHOT~0204febb4b
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.188 ms) : 1176, 1199
.   : milestone, 1188,
iast (2.989 ms) : 2953, 3025
.   : milestone, 2989,
iast_FULL (5.587 ms) : 5531, 5642
.   : milestone, 5587,
iast_GLOBAL (3.446 ms) : 3393, 3500
.   : milestone, 3446,
profiling (1.978 ms) : 1960, 1996
.   : milestone, 1978,
tracing (1.758 ms) : 1744, 1772
.   : milestone, 1758,
section candidate
no_agent (1.182 ms) : 1170, 1193
.   : milestone, 1182,
iast (3.249 ms) : 3206, 3292
.   : milestone, 3249,
iast_FULL (5.644 ms) : 5587, 5702
.   : milestone, 5644,
iast_GLOBAL (3.571 ms) : 3518, 3623
.   : milestone, 3571,
profiling (2.013 ms) : 1995, 2031
.   : milestone, 2013,
tracing (1.951 ms) : 1932, 1970
.   : milestone, 1951,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.188 ms [1.176 ms, 1.199 ms] -
iast 2.989 ms [2.953 ms, 3.025 ms] 1.801 ms (151.7%)
iast_FULL 5.587 ms [5.531 ms, 5.642 ms] 4.399 ms (370.3%)
iast_GLOBAL 3.446 ms [3.393 ms, 3.5 ms] 2.259 ms (190.1%)
profiling 1.978 ms [1.96 ms, 1.996 ms] 789.978 µs (66.5%)
tracing 1.758 ms [1.744 ms, 1.772 ms] 570.122 µs (48.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.182 ms [1.17 ms, 1.193 ms] -
iast 3.249 ms [3.206 ms, 3.292 ms] 2.068 ms (175.0%)
iast_FULL 5.644 ms [5.587 ms, 5.702 ms] 4.463 ms (377.7%)
iast_GLOBAL 3.571 ms [3.518 ms, 3.623 ms] 2.389 ms (202.2%)
profiling 2.013 ms [1.995 ms, 2.031 ms] 831.531 µs (70.4%)
tracing 1.951 ms [1.932 ms, 1.97 ms] 769.374 µs (65.1%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master adrien.boitreaud/fix-muzzle-spark-4.1
git_commit_date 1765921510 1765955289
git_commit_sha 0204feb 1357168
release_version 1.57.0-SNAPSHOT~0204febb4b 1.57.0-SNAPSHOT~1357168231
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1765957500 1765957500
ci_job_id 1301421562 1301421562
ci_pipeline_id 87220404 87220404
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-sl1b4w82 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-sl1b4w82 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:dacapo:tomcat:appsec better
[-1.353ms; -1.010ms] or [-36.477%; -27.234%]		 2.528ms 3.710ms
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~1357168231, baseline=1.57.0-SNAPSHOT~0204febb4b
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.48 s) : 15480000, 15480000
.   : milestone, 15480000,
appsec (15.089 s) : 15089000, 15089000
.   : milestone, 15089000,
iast (18.311 s) : 18311000, 18311000
.   : milestone, 18311000,
iast_GLOBAL (17.995 s) : 17995000, 17995000
.   : milestone, 17995000,
profiling (15.262 s) : 15262000, 15262000
.   : milestone, 15262000,
tracing (14.597 s) : 14597000, 14597000
.   : milestone, 14597000,
section candidate
no_agent (14.987 s) : 14987000, 14987000
.   : milestone, 14987000,
appsec (14.736 s) : 14736000, 14736000
.   : milestone, 14736000,
iast (18.038 s) : 18038000, 18038000
.   : milestone, 18038000,
iast_GLOBAL (17.909 s) : 17909000, 17909000
.   : milestone, 17909000,
profiling (14.728 s) : 14728000, 14728000
.   : milestone, 14728000,
tracing (14.599 s) : 14599000, 14599000
.   : milestone, 14599000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.48 s [15.48 s, 15.48 s] -
appsec 15.089 s [15.089 s, 15.089 s] -391.0 ms (-2.5%)
iast 18.311 s [18.311 s, 18.311 s] 2.831 s (18.3%)
iast_GLOBAL 17.995 s [17.995 s, 17.995 s] 2.515 s (16.2%)
profiling 15.262 s [15.262 s, 15.262 s] -218.0 ms (-1.4%)
tracing 14.597 s [14.597 s, 14.597 s] -883.0 ms (-5.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.987 s [14.987 s, 14.987 s] -
appsec 14.736 s [14.736 s, 14.736 s] -251.0 ms (-1.7%)
iast 18.038 s [18.038 s, 18.038 s] 3.051 s (20.4%)
iast_GLOBAL 17.909 s [17.909 s, 17.909 s] 2.922 s (19.5%)
profiling 14.728 s [14.728 s, 14.728 s] -259.0 ms (-1.7%)
tracing 14.599 s [14.599 s, 14.599 s] -388.0 ms (-2.6%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~1357168231, baseline=1.57.0-SNAPSHOT~0204febb4b
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.474 ms) : 1462, 1485
.   : milestone, 1474,
appsec (3.71 ms) : 3491, 3928
.   : milestone, 3710,
iast (2.214 ms) : 2149, 2278
.   : milestone, 2214,
iast_GLOBAL (2.258 ms) : 2193, 2324
.   : milestone, 2258,
profiling (2.068 ms) : 2016, 2121
.   : milestone, 2068,
tracing (2.057 ms) : 2006, 2109
.   : milestone, 2057,
section candidate
no_agent (1.48 ms) : 1468, 1492
.   : milestone, 1480,
appsec (2.528 ms) : 2472, 2583
.   : milestone, 2528,
iast (2.224 ms) : 2159, 2290
.   : milestone, 2224,
iast_GLOBAL (2.267 ms) : 2201, 2333
.   : milestone, 2267,
profiling (2.082 ms) : 2028, 2137
.   : milestone, 2082,
tracing (2.067 ms) : 2014, 2119
.   : milestone, 2067,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.462 ms, 1.485 ms] -
appsec 3.71 ms [3.491 ms, 3.928 ms] 2.236 ms (151.7%)
iast 2.214 ms [2.149 ms, 2.278 ms] 739.818 µs (50.2%)
iast_GLOBAL 2.258 ms [2.193 ms, 2.324 ms] 784.316 µs (53.2%)
profiling 2.068 ms [2.016 ms, 2.121 ms] 594.354 µs (40.3%)
tracing 2.057 ms [2.006 ms, 2.109 ms] 583.219 µs (39.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.48 ms [1.468 ms, 1.492 ms] -
appsec 2.528 ms [2.472 ms, 2.583 ms] 1.048 ms (70.8%)
iast 2.224 ms [2.159 ms, 2.29 ms] 744.315 µs (50.3%)
iast_GLOBAL 2.267 ms [2.201 ms, 2.333 ms] 786.947 µs (53.2%)
profiling 2.082 ms [2.028 ms, 2.137 ms] 602.241 µs (40.7%)
tracing 2.067 ms [2.014 ms, 2.119 ms] 586.471 µs (39.6%)