Add Custom Exception Handler to Unwrap `CompletionException` for GraphQL Instrumentations by mhlidd · Pull Request #10389 · DataDog/dd-trace-java
Benchmarks
Startup
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | mhlidd/graphql_exception_handler |
| git_commit_date | 1769179884 | 1769425598 |
| git_commit_sha | c6c245f | 59f02f1 |
| release_version | 1.59.0-SNAPSHOT~c6c245fe4a | 1.59.0-SNAPSHOT~59f02f1399 |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | insecure-bank | insecure-bank |
| ci_job_date | 1769427538 | 1769427538 |
| ci_job_id | 1376213963 | 1376213963 |
| ci_pipeline_id | 92774111 | 92774111 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-0-692oohxn 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-0-692oohxn 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
| module | Agent | Agent |
| parent | None | None |
Summary
Found 0 performance improvements and 0 performance regressions! Performance is the same for 57 metrics, 8 unstable metrics.
Startup time reports for petclinic
gantt
title petclinic - global startup overhead: candidate=1.59.0-SNAPSHOT~59f02f1399, baseline=1.59.0-SNAPSHOT~c6c245fe4a
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.089 s) : 0, 1088759
Total [baseline] (10.794 s) : 0, 10794039
Agent [candidate] (1.09 s) : 0, 1090038
Total [candidate] (10.837 s) : 0, 10837303
section appsec
Agent [baseline] (1.278 s) : 0, 1278317
Total [baseline] (11.06 s) : 0, 11059588
Agent [candidate] (1.272 s) : 0, 1271610
Total [candidate] (10.962 s) : 0, 10962021
section iast
Agent [baseline] (1.232 s) : 0, 1232044
Total [baseline] (11.102 s) : 0, 11101600
Agent [candidate] (1.233 s) : 0, 1232870
Total [candidate] (11.234 s) : 0, 11233882
section profiling
Agent [baseline] (1.218 s) : 0, 1218451
Total [baseline] (10.977 s) : 0, 10977429
Agent [candidate] (1.21 s) : 0, 1210198
Total [candidate] (10.892 s) : 0, 10892250
- baseline results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.089 s | - |
| Agent | appsec | 1.278 s | 189.559 ms (17.4%) |
| Agent | iast | 1.232 s | 143.285 ms (13.2%) |
| Agent | profiling | 1.218 s | 129.692 ms (11.9%) |
| Total | tracing | 10.794 s | - |
| Total | appsec | 11.06 s | 265.549 ms (2.5%) |
| Total | iast | 11.102 s | 307.56 ms (2.8%) |
| Total | profiling | 10.977 s | 183.39 ms (1.7%) |
- candidate results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.09 s | - |
| Agent | appsec | 1.272 s | 181.572 ms (16.7%) |
| Agent | iast | 1.233 s | 142.832 ms (13.1%) |
| Agent | profiling | 1.21 s | 120.16 ms (11.0%) |
| Total | tracing | 10.837 s | - |
| Total | appsec | 10.962 s | 124.718 ms (1.2%) |
| Total | iast | 11.234 s | 396.578 ms (3.7%) |
| Total | profiling | 10.892 s | 54.947 ms (0.5%) |
gantt
title petclinic - break down per module: candidate=1.59.0-SNAPSHOT~59f02f1399, baseline=1.59.0-SNAPSHOT~c6c245fe4a
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.175 ms) : 0, 1175
crashtracking [candidate] (1.185 ms) : 0, 1185
BytebuddyAgent [baseline] (651.358 ms) : 0, 651358
BytebuddyAgent [candidate] (652.121 ms) : 0, 652121
GlobalTracer [baseline] (286.092 ms) : 0, 286092
GlobalTracer [candidate] (286.551 ms) : 0, 286551
AppSec [baseline] (32.928 ms) : 0, 32928
AppSec [candidate] (32.99 ms) : 0, 32990
Debugger [baseline] (66.808 ms) : 0, 66808
Debugger [candidate] (67.567 ms) : 0, 67567
Remote Config [baseline] (593.713 µs) : 0, 594
Remote Config [candidate] (607.85 µs) : 0, 608
Telemetry [baseline] (9.664 ms) : 0, 9664
Telemetry [candidate] (8.889 ms) : 0, 8889
Flare Poller [baseline] (4.489 ms) : 0, 4489
Flare Poller [candidate] (4.491 ms) : 0, 4491
section appsec
crashtracking [baseline] (1.175 ms) : 0, 1175
crashtracking [candidate] (1.174 ms) : 0, 1174
BytebuddyAgent [baseline] (695.383 ms) : 0, 695383
BytebuddyAgent [candidate] (692.311 ms) : 0, 692311
GlobalTracer [baseline] (265.461 ms) : 0, 265461
GlobalTracer [candidate] (262.515 ms) : 0, 262515
AppSec [baseline] (175.348 ms) : 0, 175348
AppSec [candidate] (174.074 ms) : 0, 174074
Debugger [baseline] (66.506 ms) : 0, 66506
Debugger [candidate] (67.493 ms) : 0, 67493
Remote Config [baseline] (709.157 µs) : 0, 709
Remote Config [candidate] (701.202 µs) : 0, 701
Telemetry [baseline] (9.348 ms) : 0, 9348
Telemetry [candidate] (9.316 ms) : 0, 9316
Flare Poller [baseline] (3.651 ms) : 0, 3651
Flare Poller [candidate] (3.588 ms) : 0, 3588
IAST [baseline] (25.139 ms) : 0, 25139
IAST [candidate] (24.878 ms) : 0, 24878
section iast
crashtracking [baseline] (1.179 ms) : 0, 1179
crashtracking [candidate] (1.181 ms) : 0, 1181
BytebuddyAgent [baseline] (794.856 ms) : 0, 794856
BytebuddyAgent [candidate] (794.32 ms) : 0, 794320
GlobalTracer [baseline] (260.235 ms) : 0, 260235
GlobalTracer [candidate] (261.025 ms) : 0, 261025
AppSec [baseline] (33.709 ms) : 0, 33709
AppSec [candidate] (33.784 ms) : 0, 33784
Debugger [baseline] (66.83 ms) : 0, 66830
Debugger [candidate] (66.814 ms) : 0, 66814
Remote Config [baseline] (539.527 µs) : 0, 540
Remote Config [candidate] (550.975 µs) : 0, 551
Telemetry [baseline] (8.434 ms) : 0, 8434
Telemetry [candidate] (8.767 ms) : 0, 8767
Flare Poller [baseline] (3.471 ms) : 0, 3471
Flare Poller [candidate] (3.595 ms) : 0, 3595
IAST [baseline] (27.292 ms) : 0, 27292
IAST [candidate] (27.364 ms) : 0, 27364
section profiling
crashtracking [baseline] (1.215 ms) : 0, 1215
crashtracking [candidate] (1.199 ms) : 0, 1199
BytebuddyAgent [baseline] (707.468 ms) : 0, 707468
BytebuddyAgent [candidate] (702.88 ms) : 0, 702880
GlobalTracer [baseline] (227.61 ms) : 0, 227610
GlobalTracer [candidate] (225.619 ms) : 0, 225619
AppSec [baseline] (32.943 ms) : 0, 32943
AppSec [candidate] (32.503 ms) : 0, 32503
Debugger [baseline] (68.249 ms) : 0, 68249
Debugger [candidate] (68.078 ms) : 0, 68078
Remote Config [baseline] (621.075 µs) : 0, 621
Remote Config [candidate] (608.007 µs) : 0, 608
Telemetry [baseline] (8.885 ms) : 0, 8885
Telemetry [candidate] (8.828 ms) : 0, 8828
Flare Poller [baseline] (3.654 ms) : 0, 3654
Flare Poller [candidate] (3.617 ms) : 0, 3617
ProfilingAgent [baseline] (97.492 ms) : 0, 97492
ProfilingAgent [candidate] (96.978 ms) : 0, 96978
Profiling [baseline] (98.071 ms) : 0, 98071
Profiling [candidate] (97.558 ms) : 0, 97558
Startup time reports for insecure-bank
gantt
title insecure-bank - global startup overhead: candidate=1.59.0-SNAPSHOT~59f02f1399, baseline=1.59.0-SNAPSHOT~c6c245fe4a
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.089 s) : 0, 1088709
Total [baseline] (8.768 s) : 0, 8767626
Agent [candidate] (1.09 s) : 0, 1089689
Total [candidate] (8.781 s) : 0, 8781196
section iast
Agent [baseline] (1.25 s) : 0, 1249559
Total [baseline] (9.398 s) : 0, 9398171
Agent [candidate] (1.241 s) : 0, 1240906
Total [candidate] (9.45 s) : 0, 9450175
- baseline results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.089 s | - |
| Agent | iast | 1.25 s | 160.85 ms (14.8%) |
| Total | tracing | 8.768 s | - |
| Total | iast | 9.398 s | 630.546 ms (7.2%) |
- candidate results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.09 s | - |
| Agent | iast | 1.241 s | 151.217 ms (13.9%) |
| Total | tracing | 8.781 s | - |
| Total | iast | 9.45 s | 668.979 ms (7.6%) |
gantt
title insecure-bank - break down per module: candidate=1.59.0-SNAPSHOT~59f02f1399, baseline=1.59.0-SNAPSHOT~c6c245fe4a
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.175 ms) : 0, 1175
crashtracking [candidate] (1.176 ms) : 0, 1176
BytebuddyAgent [baseline] (652.278 ms) : 0, 652278
BytebuddyAgent [candidate] (652.812 ms) : 0, 652812
GlobalTracer [baseline] (286.314 ms) : 0, 286314
GlobalTracer [candidate] (286.755 ms) : 0, 286755
AppSec [baseline] (32.885 ms) : 0, 32885
AppSec [candidate] (32.859 ms) : 0, 32859
Debugger [baseline] (67.25 ms) : 0, 67250
Debugger [candidate] (67.113 ms) : 0, 67113
Remote Config [baseline] (603.259 µs) : 0, 603
Remote Config [candidate] (601.324 µs) : 0, 601
Telemetry [baseline] (8.872 ms) : 0, 8872
Telemetry [candidate] (8.997 ms) : 0, 8997
Flare Poller [baseline] (3.738 ms) : 0, 3738
Flare Poller [candidate] (3.754 ms) : 0, 3754
section iast
crashtracking [baseline] (1.202 ms) : 0, 1202
crashtracking [candidate] (1.184 ms) : 0, 1184
BytebuddyAgent [baseline] (808.476 ms) : 0, 808476
BytebuddyAgent [candidate] (801.911 ms) : 0, 801911
GlobalTracer [baseline] (263.629 ms) : 0, 263629
GlobalTracer [candidate] (261.729 ms) : 0, 261729
AppSec [baseline] (33.457 ms) : 0, 33457
AppSec [candidate] (34.81 ms) : 0, 34810
Debugger [baseline] (66.968 ms) : 0, 66968
Debugger [candidate] (65.601 ms) : 0, 65601
Remote Config [baseline] (545.229 µs) : 0, 545
Remote Config [candidate] (547.062 µs) : 0, 547
Telemetry [baseline] (8.422 ms) : 0, 8422
Telemetry [candidate] (8.647 ms) : 0, 8647
Flare Poller [baseline] (3.47 ms) : 0, 3470
Flare Poller [candidate] (3.556 ms) : 0, 3556
IAST [baseline] (27.579 ms) : 0, 27579
IAST [candidate] (27.374 ms) : 0, 27374
Load
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | mhlidd/graphql_exception_handler |
| git_commit_date | 1769179884 | 1769425598 |
| git_commit_sha | c6c245f | 59f02f1 |
| release_version | 1.59.0-SNAPSHOT~c6c245fe4a | 1.59.0-SNAPSHOT~59f02f1399 |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | insecure-bank | insecure-bank |
| ci_job_date | 1769428027 | 1769428027 |
| ci_job_id | 1376213966 | 1376213966 |
| ci_pipeline_id | 92774111 | 92774111 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-0-b7t9iz6n 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-0-b7t9iz6n 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
Summary
Found 1 performance improvements and 2 performance regressions! Performance is the same for 16 metrics, 17 unstable metrics.
| scenario | Δ mean agg_http_req_duration_p50 | Δ mean agg_http_req_duration_p95 | Δ mean throughput | candidate mean agg_http_req_duration_p50 | candidate mean agg_http_req_duration_p95 | candidate mean throughput | baseline mean agg_http_req_duration_p50 | baseline mean agg_http_req_duration_p95 | baseline mean throughput |
|---|---|---|---|---|---|---|---|---|---|
| scenario:load:petclinic:profiling:high_load | worse [+378.475µs; +1369.838µs] or [+2.069%; +7.490%] |
same [-90.631µs; +1269.991µs] or [-0.301%; +4.220%] |
unstable [-34.272op/s; +13.647op/s] or [-13.680%; +5.447%] |
19.163ms | 30.685ms | 240.219op/s | 18.288ms | 30.096ms | 250.531op/s |
| scenario:load:petclinic:tracing:high_load | better [-819.367µs; -454.518µs] or [-4.554%; -2.526%] |
unsure [-1011.933µs; -22.354µs] or [-3.465%; -0.077%] |
unstable [-17.457op/s; +31.707op/s] or [-6.846%; +12.434%] |
17.357ms | 28.689ms | 262.125op/s | 17.994ms | 29.206ms | 255.000op/s |
| scenario:load:petclinic:no_agent:high_load | worse [+0.522ms; +1.891ms] or [+2.933%; +10.632%] |
unstable [+0.206ms; +3.241ms] or [+0.695%; +10.960%] |
unstable [-41.538op/s; +10.163op/s] or [-16.220%; +3.969%] |
18.996ms | 31.293ms | 240.406op/s | 17.789ms | 29.570ms | 256.094op/s |
Request duration reports for petclinic
gantt
title petclinic - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~59f02f1399, baseline=1.59.0-SNAPSHOT~c6c245fe4a
dateFormat X
axisFormat %s
section baseline
no_agent (18.225 ms) : 18040, 18409
. : milestone, 18225,
appsec (18.558 ms) : 18372, 18743
. : milestone, 18558,
code_origins (18.618 ms) : 18433, 18802
. : milestone, 18618,
iast (17.94 ms) : 17760, 18121
. : milestone, 17940,
profiling (18.632 ms) : 18441, 18823
. : milestone, 18632,
tracing (18.305 ms) : 18123, 18487
. : milestone, 18305,
section candidate
no_agent (19.416 ms) : 19216, 19616
. : milestone, 19416,
appsec (18.799 ms) : 18607, 18991
. : milestone, 18799,
code_origins (18.515 ms) : 18327, 18703
. : milestone, 18515,
iast (17.831 ms) : 17652, 18010
. : milestone, 17831,
profiling (19.436 ms) : 19240, 19632
. : milestone, 19436,
tracing (17.802 ms) : 17625, 17980
. : milestone, 17802,
- baseline results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 18.225 ms [18.04 ms, 18.409 ms] | - |
| appsec | 18.558 ms [18.372 ms, 18.743 ms] | 332.937 µs (1.8%) |
| code_origins | 18.618 ms [18.433 ms, 18.802 ms] | 392.982 µs (2.2%) |
| iast | 17.94 ms [17.76 ms, 18.121 ms] | -284.115 µs (-1.6%) |
| profiling | 18.632 ms [18.441 ms, 18.823 ms] | 407.379 µs (2.2%) |
| tracing | 18.305 ms [18.123 ms, 18.487 ms] | 80.118 µs (0.4%) |
- candidate results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 19.416 ms [19.216 ms, 19.616 ms] | - |
| appsec | 18.799 ms [18.607 ms, 18.991 ms] | -617.073 µs (-3.2%) |
| code_origins | 18.515 ms [18.327 ms, 18.703 ms] | -901.118 µs (-4.6%) |
| iast | 17.831 ms [17.652 ms, 18.01 ms] | -1.585 ms (-8.2%) |
| profiling | 19.436 ms [19.24 ms, 19.632 ms] | 19.881 µs (0.1%) |
| tracing | 17.802 ms [17.625 ms, 17.98 ms] | -1.614 ms (-8.3%) |
Request duration reports for insecure-bank
gantt
title insecure-bank - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~59f02f1399, baseline=1.59.0-SNAPSHOT~c6c245fe4a
dateFormat X
axisFormat %s
section baseline
no_agent (1.177 ms) : 1165, 1189
. : milestone, 1177,
iast (3.262 ms) : 3213, 3312
. : milestone, 3262,
iast_FULL (5.607 ms) : 5552, 5662
. : milestone, 5607,
iast_GLOBAL (3.653 ms) : 3599, 3706
. : milestone, 3653,
profiling (2.09 ms) : 2071, 2109
. : milestone, 2090,
tracing (1.769 ms) : 1755, 1784
. : milestone, 1769,
section candidate
no_agent (1.202 ms) : 1190, 1214
. : milestone, 1202,
iast (3.248 ms) : 3202, 3293
. : milestone, 3248,
iast_FULL (5.76 ms) : 5703, 5818
. : milestone, 5760,
iast_GLOBAL (3.609 ms) : 3559, 3659
. : milestone, 3609,
profiling (1.962 ms) : 1945, 1979
. : milestone, 1962,
tracing (1.805 ms) : 1790, 1821
. : milestone, 1805,
- baseline results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.177 ms [1.165 ms, 1.189 ms] | - |
| iast | 3.262 ms [3.213 ms, 3.312 ms] | 2.085 ms (177.1%) |
| iast_FULL | 5.607 ms [5.552 ms, 5.662 ms] | 4.43 ms (376.3%) |
| iast_GLOBAL | 3.653 ms [3.599 ms, 3.706 ms] | 2.475 ms (210.3%) |
| profiling | 2.09 ms [2.071 ms, 2.109 ms] | 912.872 µs (77.5%) |
| tracing | 1.769 ms [1.755 ms, 1.784 ms] | 592.338 µs (50.3%) |
- candidate results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.202 ms [1.19 ms, 1.214 ms] | - |
| iast | 3.248 ms [3.202 ms, 3.293 ms] | 2.046 ms (170.2%) |
| iast_FULL | 5.76 ms [5.703 ms, 5.818 ms] | 4.559 ms (379.3%) |
| iast_GLOBAL | 3.609 ms [3.559 ms, 3.659 ms] | 2.407 ms (200.3%) |
| profiling | 1.962 ms [1.945 ms, 1.979 ms] | 760.413 µs (63.3%) |
| tracing | 1.805 ms [1.79 ms, 1.821 ms] | 603.478 µs (50.2%) |
Dacapo
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | mhlidd/graphql_exception_handler |
| git_commit_date | 1769179884 | 1769425598 |
| git_commit_sha | c6c245f | 59f02f1 |
| release_version | 1.59.0-SNAPSHOT~c6c245fe4a | 1.59.0-SNAPSHOT~59f02f1399 |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | biojava | biojava |
| ci_job_date | 1769427682 | 1769427682 |
| ci_job_id | 1376213970 | 1376213970 |
| ci_pipeline_id | 92774111 | 92774111 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-1-r7qnjzxu 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-1-r7qnjzxu 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
Summary
Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics.
Execution time for biojava
gantt
title biojava - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~59f02f1399, baseline=1.59.0-SNAPSHOT~c6c245fe4a
dateFormat X
axisFormat %s
section baseline
no_agent (14.839 s) : 14839000, 14839000
. : milestone, 14839000,
appsec (14.78 s) : 14780000, 14780000
. : milestone, 14780000,
iast (18.087 s) : 18087000, 18087000
. : milestone, 18087000,
iast_GLOBAL (17.768 s) : 17768000, 17768000
. : milestone, 17768000,
profiling (14.717 s) : 14717000, 14717000
. : milestone, 14717000,
tracing (14.757 s) : 14757000, 14757000
. : milestone, 14757000,
section candidate
no_agent (15.495 s) : 15495000, 15495000
. : milestone, 15495000,
appsec (14.644 s) : 14644000, 14644000
. : milestone, 14644000,
iast (18.408 s) : 18408000, 18408000
. : milestone, 18408000,
iast_GLOBAL (17.821 s) : 17821000, 17821000
. : milestone, 17821000,
profiling (14.823 s) : 14823000, 14823000
. : milestone, 14823000,
tracing (14.991 s) : 14991000, 14991000
. : milestone, 14991000,
- baseline results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 14.839 s [14.839 s, 14.839 s] | - |
| appsec | 14.78 s [14.78 s, 14.78 s] | -59.0 ms (-0.4%) |
| iast | 18.087 s [18.087 s, 18.087 s] | 3.248 s (21.9%) |
| iast_GLOBAL | 17.768 s [17.768 s, 17.768 s] | 2.929 s (19.7%) |
| profiling | 14.717 s [14.717 s, 14.717 s] | -122.0 ms (-0.8%) |
| tracing | 14.757 s [14.757 s, 14.757 s] | -82.0 ms (-0.6%) |
- candidate results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 15.495 s [15.495 s, 15.495 s] | - |
| appsec | 14.644 s [14.644 s, 14.644 s] | -851.0 ms (-5.5%) |
| iast | 18.408 s [18.408 s, 18.408 s] | 2.913 s (18.8%) |
| iast_GLOBAL | 17.821 s [17.821 s, 17.821 s] | 2.326 s (15.0%) |
| profiling | 14.823 s [14.823 s, 14.823 s] | -672.0 ms (-4.3%) |
| tracing | 14.991 s [14.991 s, 14.991 s] | -504.0 ms (-3.3%) |
Execution time for tomcat
gantt
title tomcat - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~59f02f1399, baseline=1.59.0-SNAPSHOT~c6c245fe4a
dateFormat X
axisFormat %s
section baseline
no_agent (1.469 ms) : 1457, 1480
. : milestone, 1469,
appsec (2.465 ms) : 2412, 2517
. : milestone, 2465,
iast (2.205 ms) : 2140, 2270
. : milestone, 2205,
iast_GLOBAL (2.252 ms) : 2186, 2317
. : milestone, 2252,
profiling (2.48 ms) : 2318, 2642
. : milestone, 2480,
tracing (2.053 ms) : 2002, 2105
. : milestone, 2053,
section candidate
no_agent (1.472 ms) : 1461, 1484
. : milestone, 1472,
appsec (3.712 ms) : 3493, 3930
. : milestone, 3712,
iast (2.201 ms) : 2136, 2265
. : milestone, 2201,
iast_GLOBAL (2.253 ms) : 2188, 2319
. : milestone, 2253,
profiling (2.045 ms) : 1993, 2098
. : milestone, 2045,
tracing (2.046 ms) : 1994, 2098
. : milestone, 2046,
- baseline results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.469 ms [1.457 ms, 1.48 ms] | - |
| appsec | 2.465 ms [2.412 ms, 2.517 ms] | 995.81 µs (67.8%) |
| iast | 2.205 ms [2.14 ms, 2.27 ms] | 736.17 µs (50.1%) |
| iast_GLOBAL | 2.252 ms [2.186 ms, 2.317 ms] | 782.98 µs (53.3%) |
| profiling | 2.48 ms [2.318 ms, 2.642 ms] | 1.011 ms (68.8%) |
| tracing | 2.053 ms [2.002 ms, 2.105 ms] | 584.424 µs (39.8%) |
- candidate results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.472 ms [1.461 ms, 1.484 ms] | - |
| appsec | 3.712 ms [3.493 ms, 3.93 ms] | 2.24 ms (152.1%) |
| iast | 2.201 ms [2.136 ms, 2.265 ms] | 728.243 µs (49.5%) |
| iast_GLOBAL | 2.253 ms [2.188 ms, 2.319 ms] | 781.109 µs (53.1%) |
| profiling | 2.045 ms [1.993 ms, 2.098 ms] | 573.032 µs (38.9%) |
| tracing | 2.046 ms [1.994 ms, 2.098 ms] | 573.618 µs (39.0%) |