initial spark launcher instrumentation by aboitreaud · Pull Request #10629 · DataDog/dd-trace-java
Benchmarks
Startup
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | adrien.boitreaud/spark-launcher-instrumentation |
| git_commit_date | 1771855016 | 1771855974 |
| git_commit_sha | a249dd3 | 7c0d7ee |
| release_version | 1.60.0-SNAPSHOT~a249dd3265 | 1.60.0-SNAPSHOT~7c0d7eeded |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | insecure-bank | insecure-bank |
| ci_job_date | 1771857755 | 1771857755 |
| ci_job_id | 1447622000 | 1447622000 |
| ci_pipeline_id | 98234747 | 98234747 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-1-zx6kxkwp 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-1-zx6kxkwp 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
| module | Agent | Agent |
| parent | None | None |
Summary
Found 0 performance improvements and 0 performance regressions! Performance is the same for 63 metrics, 8 unstable metrics.
Startup time reports for petclinic
gantt
title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~7c0d7eeded, baseline=1.60.0-SNAPSHOT~a249dd3265
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.063 s) : 0, 1063435
Total [baseline] (10.884 s) : 0, 10883665
Agent [candidate] (1.063 s) : 0, 1062621
Total [candidate] (10.908 s) : 0, 10908243
section appsec
Agent [baseline] (1.24 s) : 0, 1239925
Total [baseline] (10.988 s) : 0, 10987529
Agent [candidate] (1.241 s) : 0, 1240676
Total [candidate] (10.979 s) : 0, 10978688
section iast
Agent [baseline] (1.234 s) : 0, 1233604
Total [baseline] (11.185 s) : 0, 11185223
Agent [candidate] (1.245 s) : 0, 1244567
Total [candidate] (11.373 s) : 0, 11372889
section profiling
Agent [baseline] (1.189 s) : 0, 1189461
Total [baseline] (11.043 s) : 0, 11042680
Agent [candidate] (1.192 s) : 0, 1192495
Total [candidate] (10.927 s) : 0, 10926707
- baseline results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.063 s | - |
| Agent | appsec | 1.24 s | 176.49 ms (16.6%) |
| Agent | iast | 1.234 s | 170.169 ms (16.0%) |
| Agent | profiling | 1.189 s | 126.026 ms (11.9%) |
| Total | tracing | 10.884 s | - |
| Total | appsec | 10.988 s | 103.864 ms (1.0%) |
| Total | iast | 11.185 s | 301.558 ms (2.8%) |
| Total | profiling | 11.043 s | 159.015 ms (1.5%) |
- candidate results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.063 s | - |
| Agent | appsec | 1.241 s | 178.055 ms (16.8%) |
| Agent | iast | 1.245 s | 181.946 ms (17.1%) |
| Agent | profiling | 1.192 s | 129.875 ms (12.2%) |
| Total | tracing | 10.908 s | - |
| Total | appsec | 10.979 s | 70.445 ms (0.6%) |
| Total | iast | 11.373 s | 464.646 ms (4.3%) |
| Total | profiling | 10.927 s | 18.464 ms (0.2%) |
gantt
title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~7c0d7eeded, baseline=1.60.0-SNAPSHOT~a249dd3265
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.202 ms) : 0, 1202
crashtracking [candidate] (1.188 ms) : 0, 1188
BytebuddyAgent [baseline] (626.462 ms) : 0, 626462
BytebuddyAgent [candidate] (627.005 ms) : 0, 627005
AgentMeter [baseline] (29.062 ms) : 0, 29062
AgentMeter [candidate] (28.989 ms) : 0, 28989
GlobalTracer [baseline] (257.425 ms) : 0, 257425
GlobalTracer [candidate] (257.129 ms) : 0, 257129
AppSec [baseline] (33.051 ms) : 0, 33051
AppSec [candidate] (32.797 ms) : 0, 32797
Debugger [baseline] (64.349 ms) : 0, 64349
Debugger [candidate] (65.157 ms) : 0, 65157
Remote Config [baseline] (612.201 µs) : 0, 612
Remote Config [candidate] (631.497 µs) : 0, 631
Telemetry [baseline] (10.671 ms) : 0, 10671
Telemetry [candidate] (9.143 ms) : 0, 9143
Flare Poller [baseline] (4.478 ms) : 0, 4478
Flare Poller [candidate] (4.57 ms) : 0, 4570
section appsec
crashtracking [baseline] (1.21 ms) : 0, 1210
crashtracking [candidate] (1.196 ms) : 0, 1196
BytebuddyAgent [baseline] (659.271 ms) : 0, 659271
BytebuddyAgent [candidate] (658.405 ms) : 0, 658405
AgentMeter [baseline] (11.898 ms) : 0, 11898
AgentMeter [candidate] (11.919 ms) : 0, 11919
GlobalTracer [baseline] (257.625 ms) : 0, 257625
GlobalTracer [candidate] (258.818 ms) : 0, 258818
IAST [baseline] (25.37 ms) : 0, 25370
IAST [candidate] (25.346 ms) : 0, 25346
AppSec [baseline] (167.809 ms) : 0, 167809
AppSec [candidate] (168.171 ms) : 0, 168171
Debugger [baseline] (66.82 ms) : 0, 66820
Debugger [candidate] (66.853 ms) : 0, 66853
Remote Config [baseline] (651.257 µs) : 0, 651
Remote Config [candidate] (651.015 µs) : 0, 651
Telemetry [baseline] (9.435 ms) : 0, 9435
Telemetry [candidate] (9.506 ms) : 0, 9506
Flare Poller [baseline] (3.709 ms) : 0, 3709
Flare Poller [candidate] (3.692 ms) : 0, 3692
section iast
crashtracking [baseline] (1.202 ms) : 0, 1202
crashtracking [candidate] (1.218 ms) : 0, 1218
BytebuddyAgent [baseline] (796.514 ms) : 0, 796514
BytebuddyAgent [candidate] (806.433 ms) : 0, 806433
AgentMeter [baseline] (11.311 ms) : 0, 11311
AgentMeter [candidate] (11.557 ms) : 0, 11557
GlobalTracer [baseline] (248.136 ms) : 0, 248136
GlobalTracer [candidate] (248.555 ms) : 0, 248555
IAST [baseline] (26.941 ms) : 0, 26941
IAST [candidate] (27.115 ms) : 0, 27115
AppSec [baseline] (34.108 ms) : 0, 34108
AppSec [candidate] (35.631 ms) : 0, 35631
Debugger [baseline] (66.543 ms) : 0, 66543
Debugger [candidate] (65.013 ms) : 0, 65013
Remote Config [baseline] (533.458 µs) : 0, 533
Remote Config [candidate] (542.192 µs) : 0, 542
Telemetry [baseline] (8.724 ms) : 0, 8724
Telemetry [candidate] (8.711 ms) : 0, 8711
Flare Poller [baseline] (3.482 ms) : 0, 3482
Flare Poller [candidate] (3.471 ms) : 0, 3471
section profiling
crashtracking [baseline] (1.184 ms) : 0, 1184
crashtracking [candidate] (1.2 ms) : 0, 1200
BytebuddyAgent [baseline] (680.97 ms) : 0, 680970
BytebuddyAgent [candidate] (682.493 ms) : 0, 682493
AgentMeter [baseline] (8.563 ms) : 0, 8563
AgentMeter [candidate] (8.602 ms) : 0, 8602
GlobalTracer [baseline] (215.977 ms) : 0, 215977
GlobalTracer [candidate] (216.357 ms) : 0, 216357
AppSec [baseline] (32.399 ms) : 0, 32399
AppSec [candidate] (32.39 ms) : 0, 32390
Debugger [baseline] (67.211 ms) : 0, 67211
Debugger [candidate] (67.328 ms) : 0, 67328
Remote Config [baseline] (633.438 µs) : 0, 633
Remote Config [candidate] (644.467 µs) : 0, 644
Telemetry [baseline] (8.983 ms) : 0, 8983
Telemetry [candidate] (9.109 ms) : 0, 9109
Flare Poller [baseline] (3.728 ms) : 0, 3728
Flare Poller [candidate] (3.778 ms) : 0, 3778
ProfilingAgent [baseline] (99.192 ms) : 0, 99192
ProfilingAgent [candidate] (99.877 ms) : 0, 99877
Profiling [baseline] (99.774 ms) : 0, 99774
Profiling [candidate] (100.44 ms) : 0, 100440
Startup time reports for insecure-bank
gantt
title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~7c0d7eeded, baseline=1.60.0-SNAPSHOT~a249dd3265
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.073 s) : 0, 1072699
Total [baseline] (8.776 s) : 0, 8775549
Agent [candidate] (1.07 s) : 0, 1070437
Total [candidate] (8.749 s) : 0, 8748768
section iast
Agent [baseline] (1.231 s) : 0, 1231216
Total [baseline] (9.404 s) : 0, 9404433
Agent [candidate] (1.231 s) : 0, 1230717
Total [candidate] (9.383 s) : 0, 9383082
- baseline results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.073 s | - |
| Agent | iast | 1.231 s | 158.517 ms (14.8%) |
| Total | tracing | 8.776 s | - |
| Total | iast | 9.404 s | 628.883 ms (7.2%) |
- candidate results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.07 s | - |
| Agent | iast | 1.231 s | 160.28 ms (15.0%) |
| Total | tracing | 8.749 s | - |
| Total | iast | 9.383 s | 634.314 ms (7.3%) |
gantt
title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~7c0d7eeded, baseline=1.60.0-SNAPSHOT~a249dd3265
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.211 ms) : 0, 1211
crashtracking [candidate] (1.22 ms) : 0, 1220
BytebuddyAgent [baseline] (632.156 ms) : 0, 632156
BytebuddyAgent [candidate] (631.373 ms) : 0, 631373
AgentMeter [baseline] (29.379 ms) : 0, 29379
AgentMeter [candidate] (29.214 ms) : 0, 29214
GlobalTracer [baseline] (258.895 ms) : 0, 258895
GlobalTracer [candidate] (258.937 ms) : 0, 258937
AppSec [baseline] (33.195 ms) : 0, 33195
AppSec [candidate] (33.101 ms) : 0, 33101
Debugger [baseline] (61.693 ms) : 0, 61693
Debugger [candidate] (64.584 ms) : 0, 64584
Remote Config [baseline] (634.621 µs) : 0, 635
Remote Config [candidate] (612.066 µs) : 0, 612
Telemetry [baseline] (11.538 ms) : 0, 11538
Telemetry [candidate] (9.062 ms) : 0, 9062
Flare Poller [baseline] (7.579 ms) : 0, 7579
Flare Poller [candidate] (6.034 ms) : 0, 6034
section iast
crashtracking [baseline] (1.207 ms) : 0, 1207
crashtracking [candidate] (1.207 ms) : 0, 1207
BytebuddyAgent [baseline] (795.116 ms) : 0, 795116
BytebuddyAgent [candidate] (795.427 ms) : 0, 795427
AgentMeter [baseline] (11.34 ms) : 0, 11340
AgentMeter [candidate] (11.333 ms) : 0, 11333
GlobalTracer [baseline] (247.658 ms) : 0, 247658
GlobalTracer [candidate] (247.621 ms) : 0, 247621
IAST [baseline] (27.074 ms) : 0, 27074
IAST [candidate] (26.904 ms) : 0, 26904
AppSec [baseline] (33.98 ms) : 0, 33980
AppSec [candidate] (35.333 ms) : 0, 35333
Debugger [baseline] (65.989 ms) : 0, 65989
Debugger [candidate] (64.026 ms) : 0, 64026
Remote Config [baseline] (532.998 µs) : 0, 533
Remote Config [candidate] (539.665 µs) : 0, 540
Telemetry [baseline] (8.63 ms) : 0, 8630
Telemetry [candidate] (8.748 ms) : 0, 8748
Flare Poller [baseline] (3.468 ms) : 0, 3468
Flare Poller [candidate] (3.508 ms) : 0, 3508
Load
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | adrien.boitreaud/spark-launcher-instrumentation |
| git_commit_date | 1771855016 | 1771855974 |
| git_commit_sha | a249dd3 | 7c0d7ee |
| release_version | 1.60.0-SNAPSHOT~a249dd3265 | 1.60.0-SNAPSHOT~7c0d7eeded |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | insecure-bank | insecure-bank |
| ci_job_date | 1771858250 | 1771858250 |
| ci_job_id | 1447622002 | 1447622002 |
| ci_pipeline_id | 98234747 | 98234747 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-0-w9dpyyli 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-0-w9dpyyli 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
Summary
Found 0 performance improvements and 2 performance regressions! Performance is the same for 18 metrics, 16 unstable metrics.
| scenario | Δ mean agg_http_req_duration_p50 | Δ mean agg_http_req_duration_p95 | Δ mean throughput | candidate mean agg_http_req_duration_p50 | candidate mean agg_http_req_duration_p95 | candidate mean throughput | baseline mean agg_http_req_duration_p50 | baseline mean agg_http_req_duration_p95 | baseline mean throughput |
|---|---|---|---|---|---|---|---|---|---|
| scenario:load:petclinic:iast:high_load | worse [+371.597µs; +1248.584µs] or [+2.150%; +7.222%] |
same [-83.701µs; +1355.644µs] or [-0.289%; +4.681%] |
unstable [-35.030op/s; +15.530op/s] or [-13.330%; +5.910%] |
18.098ms | 29.599ms | 253.031op/s | 17.288ms | 28.963ms | 262.781op/s |
| scenario:load:petclinic:appsec:high_load | worse [+465.453µs; +841.602µs] or [+2.591%; +4.685%] |
unsure [+194.428µs; +1240.982µs] or [+0.659%; +4.208%] |
unstable [-31.673op/s; +16.110op/s] or [-12.473%; +6.344%] |
18.618ms | 30.206ms | 246.156op/s | 17.965ms | 29.489ms | 253.938op/s |
Request duration reports for petclinic
gantt
title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~7c0d7eeded, baseline=1.60.0-SNAPSHOT~a249dd3265
dateFormat X
axisFormat %s
section baseline
no_agent (18.999 ms) : 18808, 19191
. : milestone, 18999,
appsec (18.375 ms) : 18190, 18560
. : milestone, 18375,
code_origins (17.824 ms) : 17646, 18003
. : milestone, 17824,
iast (17.755 ms) : 17576, 17933
. : milestone, 17755,
profiling (19.193 ms) : 18996, 19390
. : milestone, 19193,
tracing (17.78 ms) : 17608, 17952
. : milestone, 17780,
section candidate
no_agent (18.698 ms) : 18503, 18894
. : milestone, 18698,
appsec (18.96 ms) : 18770, 19149
. : milestone, 18960,
code_origins (17.808 ms) : 17632, 17984
. : milestone, 17808,
iast (18.444 ms) : 18256, 18632
. : milestone, 18444,
profiling (18.535 ms) : 18350, 18720
. : milestone, 18535,
tracing (17.788 ms) : 17610, 17966
. : milestone, 17788,
- baseline results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 18.999 ms [18.808 ms, 19.191 ms] | - |
| appsec | 18.375 ms [18.19 ms, 18.56 ms] | -624.412 µs (-3.3%) |
| code_origins | 17.824 ms [17.646 ms, 18.003 ms] | -1.175 ms (-6.2%) |
| iast | 17.755 ms [17.576 ms, 17.933 ms] | -1.245 ms (-6.6%) |
| profiling | 19.193 ms [18.996 ms, 19.39 ms] | 193.51 µs (1.0%) |
| tracing | 17.78 ms [17.608 ms, 17.952 ms] | -1.219 ms (-6.4%) |
- candidate results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 18.698 ms [18.503 ms, 18.894 ms] | - |
| appsec | 18.96 ms [18.77 ms, 19.149 ms] | 261.555 µs (1.4%) |
| code_origins | 17.808 ms [17.632 ms, 17.984 ms] | -890.254 µs (-4.8%) |
| iast | 18.444 ms [18.256 ms, 18.632 ms] | -253.979 µs (-1.4%) |
| profiling | 18.535 ms [18.35 ms, 18.72 ms] | -163.463 µs (-0.9%) |
| tracing | 17.788 ms [17.61 ms, 17.966 ms] | -910.423 µs (-4.9%) |
Request duration reports for insecure-bank
gantt
title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~7c0d7eeded, baseline=1.60.0-SNAPSHOT~a249dd3265
dateFormat X
axisFormat %s
section baseline
no_agent (1.174 ms) : 1162, 1185
. : milestone, 1174,
iast (3.237 ms) : 3194, 3280
. : milestone, 3237,
iast_FULL (6.063 ms) : 6001, 6126
. : milestone, 6063,
iast_GLOBAL (3.459 ms) : 3409, 3509
. : milestone, 3459,
profiling (2.284 ms) : 2260, 2308
. : milestone, 2284,
tracing (1.817 ms) : 1802, 1831
. : milestone, 1817,
section candidate
no_agent (1.186 ms) : 1175, 1198
. : milestone, 1186,
iast (3.16 ms) : 3117, 3203
. : milestone, 3160,
iast_FULL (6.063 ms) : 6001, 6125
. : milestone, 6063,
iast_GLOBAL (3.605 ms) : 3544, 3666
. : milestone, 3605,
profiling (2.067 ms) : 2048, 2086
. : milestone, 2067,
tracing (1.752 ms) : 1738, 1766
. : milestone, 1752,
- baseline results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.174 ms [1.162 ms, 1.185 ms] | - |
| iast | 3.237 ms [3.194 ms, 3.28 ms] | 2.063 ms (175.8%) |
| iast_FULL | 6.063 ms [6.001 ms, 6.126 ms] | 4.89 ms (416.6%) |
| iast_GLOBAL | 3.459 ms [3.409 ms, 3.509 ms] | 2.285 ms (194.7%) |
| profiling | 2.284 ms [2.26 ms, 2.308 ms] | 1.11 ms (94.6%) |
| tracing | 1.817 ms [1.802 ms, 1.831 ms] | 643.093 µs (54.8%) |
- candidate results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.186 ms [1.175 ms, 1.198 ms] | - |
| iast | 3.16 ms [3.117 ms, 3.203 ms] | 1.973 ms (166.3%) |
| iast_FULL | 6.063 ms [6.001 ms, 6.125 ms] | 4.877 ms (411.0%) |
| iast_GLOBAL | 3.605 ms [3.544 ms, 3.666 ms] | 2.418 ms (203.8%) |
| profiling | 2.067 ms [2.048 ms, 2.086 ms] | 880.382 µs (74.2%) |
| tracing | 1.752 ms [1.738 ms, 1.766 ms] | 565.936 µs (47.7%) |
Dacapo
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | adrien.boitreaud/spark-launcher-instrumentation |
| git_commit_date | 1771855016 | 1771855974 |
| git_commit_sha | a249dd3 | 7c0d7ee |
| release_version | 1.60.0-SNAPSHOT~a249dd3265 | 1.60.0-SNAPSHOT~7c0d7eeded |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | biojava | biojava |
| ci_job_date | 1771858050 | 1771858050 |
| ci_job_id | 1447622003 | 1447622003 |
| ci_pipeline_id | 98234747 | 98234747 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-2-kt4lxrvy 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-2-kt4lxrvy 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
Summary
Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.
| scenario | Δ mean execution_time | candidate mean execution_time | baseline mean execution_time |
|---|---|---|---|
| scenario:dacapo:tomcat:appsec | better [-1.356ms; -1.014ms] or [-36.429%; -27.253%] |
2.537ms | 3.722ms |
Execution time for biojava
gantt
title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~7c0d7eeded, baseline=1.60.0-SNAPSHOT~a249dd3265
dateFormat X
axisFormat %s
section baseline
no_agent (15.624 s) : 15624000, 15624000
. : milestone, 15624000,
appsec (14.954 s) : 14954000, 14954000
. : milestone, 14954000,
iast (18.009 s) : 18009000, 18009000
. : milestone, 18009000,
iast_GLOBAL (18.006 s) : 18006000, 18006000
. : milestone, 18006000,
profiling (14.629 s) : 14629000, 14629000
. : milestone, 14629000,
tracing (14.528 s) : 14528000, 14528000
. : milestone, 14528000,
section candidate
no_agent (15.392 s) : 15392000, 15392000
. : milestone, 15392000,
appsec (14.912 s) : 14912000, 14912000
. : milestone, 14912000,
iast (17.819 s) : 17819000, 17819000
. : milestone, 17819000,
iast_GLOBAL (17.785 s) : 17785000, 17785000
. : milestone, 17785000,
profiling (14.95 s) : 14950000, 14950000
. : milestone, 14950000,
tracing (14.569 s) : 14569000, 14569000
. : milestone, 14569000,
- baseline results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 15.624 s [15.624 s, 15.624 s] | - |
| appsec | 14.954 s [14.954 s, 14.954 s] | -670.0 ms (-4.3%) |
| iast | 18.009 s [18.009 s, 18.009 s] | 2.385 s (15.3%) |
| iast_GLOBAL | 18.006 s [18.006 s, 18.006 s] | 2.382 s (15.2%) |
| profiling | 14.629 s [14.629 s, 14.629 s] | -995.0 ms (-6.4%) |
| tracing | 14.528 s [14.528 s, 14.528 s] | -1.096 s (-7.0%) |
- candidate results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 15.392 s [15.392 s, 15.392 s] | - |
| appsec | 14.912 s [14.912 s, 14.912 s] | -480.0 ms (-3.1%) |
| iast | 17.819 s [17.819 s, 17.819 s] | 2.427 s (15.8%) |
| iast_GLOBAL | 17.785 s [17.785 s, 17.785 s] | 2.393 s (15.5%) |
| profiling | 14.95 s [14.95 s, 14.95 s] | -442.0 ms (-2.9%) |
| tracing | 14.569 s [14.569 s, 14.569 s] | -823.0 ms (-5.3%) |
Execution time for tomcat
gantt
title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~7c0d7eeded, baseline=1.60.0-SNAPSHOT~a249dd3265
dateFormat X
axisFormat %s
section baseline
no_agent (1.476 ms) : 1465, 1488
. : milestone, 1476,
appsec (3.722 ms) : 3504, 3939
. : milestone, 3722,
iast (2.265 ms) : 2196, 2335
. : milestone, 2265,
iast_GLOBAL (2.309 ms) : 2239, 2379
. : milestone, 2309,
profiling (2.089 ms) : 2034, 2145
. : milestone, 2089,
tracing (2.072 ms) : 2018, 2126
. : milestone, 2072,
section candidate
no_agent (1.473 ms) : 1461, 1485
. : milestone, 1473,
appsec (2.537 ms) : 2481, 2592
. : milestone, 2537,
iast (2.256 ms) : 2187, 2326
. : milestone, 2256,
iast_GLOBAL (2.3 ms) : 2230, 2370
. : milestone, 2300,
profiling (2.097 ms) : 2042, 2153
. : milestone, 2097,
tracing (2.07 ms) : 2016, 2124
. : milestone, 2070,
- baseline results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.476 ms [1.465 ms, 1.488 ms] | - |
| appsec | 3.722 ms [3.504 ms, 3.939 ms] | 2.246 ms (152.2%) |
| iast | 2.265 ms [2.196 ms, 2.335 ms] | 789.07 µs (53.5%) |
| iast_GLOBAL | 2.309 ms [2.239 ms, 2.379 ms] | 832.848 µs (56.4%) |
| profiling | 2.089 ms [2.034 ms, 2.145 ms] | 613.304 µs (41.5%) |
| tracing | 2.072 ms [2.018 ms, 2.126 ms] | 596.28 µs (40.4%) |
- candidate results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.473 ms [1.461 ms, 1.485 ms] | - |
| appsec | 2.537 ms [2.481 ms, 2.592 ms] | 1.064 ms (72.2%) |
| iast | 2.256 ms [2.187 ms, 2.326 ms] | 783.283 µs (53.2%) |
| iast_GLOBAL | 2.3 ms [2.23 ms, 2.37 ms] | 827.331 µs (56.2%) |
| profiling | 2.097 ms [2.042 ms, 2.153 ms] | 624.168 µs (42.4%) |
| tracing | 2.07 ms [2.016 ms, 2.124 ms] | 596.797 µs (40.5%) |