Make Code Origin fingerprint map concurrent by jpbempel · Pull Request #10043 · DataDog/dd-trace-java
Benchmarks
Startup
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | jpbempel/fix-co-map |
| git_commit_date | 1764141366 | 1764241695 |
| git_commit_sha | c69c2cd | 1eb7e8b |
| release_version | 1.57.0-SNAPSHOT~c69c2cd420 | 1.57.0-SNAPSHOT~1eb7e8b892 |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | insecure-bank | insecure-bank |
| ci_job_date | 1764243476 | 1764243476 |
| ci_job_id | 1260109737 | 1260109737 |
| ci_pipeline_id | 84232937 | 84232937 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-0-17ppyzl6 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-0-17ppyzl6 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
| module | Agent | Agent |
| parent | None | None |
Summary
Found 0 performance improvements and 0 performance regressions! Performance is the same for 53 metrics, 12 unstable metrics.
Startup time reports for insecure-bank
gantt
title insecure-bank - global startup overhead: candidate=1.57.0-SNAPSHOT~1eb7e8b892, baseline=1.57.0-SNAPSHOT~c69c2cd420
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.05 s) : 0, 1049672
Total [baseline] (8.698 s) : 0, 8697966
Agent [candidate] (1.057 s) : 0, 1056945
Total [candidate] (8.655 s) : 0, 8655348
section iast
Agent [baseline] (1.192 s) : 0, 1191804
Total [baseline] (9.308 s) : 0, 9308276
Agent [candidate] (1.193 s) : 0, 1192587
Total [candidate] (9.362 s) : 0, 9362141
- baseline results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.05 s | - |
| Agent | iast | 1.192 s | 142.132 ms (13.5%) |
| Total | tracing | 8.698 s | - |
| Total | iast | 9.308 s | 610.309 ms (7.0%) |
- candidate results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.057 s | - |
| Agent | iast | 1.193 s | 135.642 ms (12.8%) |
| Total | tracing | 8.655 s | - |
| Total | iast | 9.362 s | 706.793 ms (8.2%) |
gantt
title insecure-bank - break down per module: candidate=1.57.0-SNAPSHOT~1eb7e8b892, baseline=1.57.0-SNAPSHOT~c69c2cd420
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.486 ms) : 0, 1486
crashtracking [candidate] (1.493 ms) : 0, 1493
BytebuddyAgent [baseline] (706.159 ms) : 0, 706159
BytebuddyAgent [candidate] (710.974 ms) : 0, 710974
GlobalTracer [baseline] (248.019 ms) : 0, 248019
GlobalTracer [candidate] (250.029 ms) : 0, 250029
AppSec [baseline] (31.779 ms) : 0, 31779
AppSec [candidate] (32.226 ms) : 0, 32226
Debugger [baseline] (6.353 ms) : 0, 6353
Debugger [candidate] (6.412 ms) : 0, 6412
Remote Config [baseline] (668.598 µs) : 0, 669
Remote Config [candidate] (671.128 µs) : 0, 671
Telemetry [baseline] (15.593 ms) : 0, 15593
Telemetry [candidate] (15.976 ms) : 0, 15976
Flare Poller [baseline] (4.782 ms) : 0, 4782
Flare Poller [candidate] (4.109 ms) : 0, 4109
section iast
crashtracking [baseline] (1.485 ms) : 0, 1485
crashtracking [candidate] (1.484 ms) : 0, 1484
BytebuddyAgent [baseline] (831.053 ms) : 0, 831053
BytebuddyAgent [candidate] (831.6 ms) : 0, 831600
GlobalTracer [baseline] (237.289 ms) : 0, 237289
GlobalTracer [candidate] (237.731 ms) : 0, 237731
IAST [baseline] (30.799 ms) : 0, 30799
IAST [candidate] (31.657 ms) : 0, 31657
AppSec [baseline] (30.89 ms) : 0, 30890
AppSec [candidate] (29.689 ms) : 0, 29689
Debugger [baseline] (6.071 ms) : 0, 6071
Debugger [candidate] (6.057 ms) : 0, 6057
Remote Config [baseline] (620.737 µs) : 0, 621
Remote Config [candidate] (613.168 µs) : 0, 613
Telemetry [baseline] (7.952 ms) : 0, 7952
Telemetry [candidate] (7.967 ms) : 0, 7967
Flare Poller [baseline] (10.735 ms) : 0, 10735
Flare Poller [candidate] (10.88 ms) : 0, 10880
Startup time reports for petclinic
gantt
title petclinic - global startup overhead: candidate=1.57.0-SNAPSHOT~1eb7e8b892, baseline=1.57.0-SNAPSHOT~c69c2cd420
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.054 s) : 0, 1053627
Total [baseline] (10.81 s) : 0, 10810344
Agent [candidate] (1.054 s) : 0, 1053979
Total [candidate] (10.862 s) : 0, 10862245
section appsec
Agent [baseline] (1.231 s) : 0, 1230769
Total [baseline] (10.831 s) : 0, 10831176
Agent [candidate] (1.237 s) : 0, 1236581
Total [candidate] (11.054 s) : 0, 11053981
section iast
Agent [baseline] (1.196 s) : 0, 1195592
Total [baseline] (11.126 s) : 0, 11126078
Agent [candidate] (1.192 s) : 0, 1191777
Total [candidate] (11.167 s) : 0, 11167374
section profiling
Agent [baseline] (1.207 s) : 0, 1207241
Total [baseline] (10.874 s) : 0, 10873594
Agent [candidate] (1.2 s) : 0, 1199720
Total [candidate] (10.958 s) : 0, 10958207
- baseline results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.054 s | - |
| Agent | appsec | 1.231 s | 177.142 ms (16.8%) |
| Agent | iast | 1.196 s | 141.965 ms (13.5%) |
| Agent | profiling | 1.207 s | 153.614 ms (14.6%) |
| Total | tracing | 10.81 s | - |
| Total | appsec | 10.831 s | 20.832 ms (0.2%) |
| Total | iast | 11.126 s | 315.734 ms (2.9%) |
| Total | profiling | 10.874 s | 63.25 ms (0.6%) |
- candidate results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.054 s | - |
| Agent | appsec | 1.237 s | 182.603 ms (17.3%) |
| Agent | iast | 1.192 s | 137.799 ms (13.1%) |
| Agent | profiling | 1.2 s | 145.741 ms (13.8%) |
| Total | tracing | 10.862 s | - |
| Total | appsec | 11.054 s | 191.736 ms (1.8%) |
| Total | iast | 11.167 s | 305.129 ms (2.8%) |
| Total | profiling | 10.958 s | 95.961 ms (0.9%) |
gantt
title petclinic - break down per module: candidate=1.57.0-SNAPSHOT~1eb7e8b892, baseline=1.57.0-SNAPSHOT~c69c2cd420
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.498 ms) : 0, 1498
crashtracking [candidate] (1.506 ms) : 0, 1506
BytebuddyAgent [baseline] (708.33 ms) : 0, 708330
BytebuddyAgent [candidate] (708.577 ms) : 0, 708577
GlobalTracer [baseline] (249.534 ms) : 0, 249534
GlobalTracer [candidate] (249.332 ms) : 0, 249332
AppSec [baseline] (32.01 ms) : 0, 32010
AppSec [candidate] (32.032 ms) : 0, 32032
Debugger [baseline] (6.377 ms) : 0, 6377
Debugger [candidate] (6.38 ms) : 0, 6380
Remote Config [baseline] (676.96 µs) : 0, 677
Remote Config [candidate] (673.54 µs) : 0, 674
Telemetry [baseline] (15.383 ms) : 0, 15383
Telemetry [candidate] (14.21 ms) : 0, 14210
Flare Poller [baseline] (5.033 ms) : 0, 5033
Flare Poller [candidate] (6.407 ms) : 0, 6407
section appsec
crashtracking [baseline] (1.486 ms) : 0, 1486
crashtracking [candidate] (1.49 ms) : 0, 1490
BytebuddyAgent [baseline] (733.026 ms) : 0, 733026
BytebuddyAgent [candidate] (736.651 ms) : 0, 736651
GlobalTracer [baseline] (241.416 ms) : 0, 241416
GlobalTracer [candidate] (243.566 ms) : 0, 243566
AppSec [baseline] (175.866 ms) : 0, 175866
AppSec [candidate] (175.462 ms) : 0, 175462
Debugger [baseline] (6.289 ms) : 0, 6289
Debugger [candidate] (6.346 ms) : 0, 6346
Remote Config [baseline] (686.606 µs) : 0, 687
Remote Config [candidate] (708.431 µs) : 0, 708
Telemetry [baseline] (8.135 ms) : 0, 8135
Telemetry [candidate] (8.267 ms) : 0, 8267
Flare Poller [baseline] (3.971 ms) : 0, 3971
Flare Poller [candidate] (4.067 ms) : 0, 4067
IAST [baseline] (24.787 ms) : 0, 24787
IAST [candidate] (24.934 ms) : 0, 24934
section iast
crashtracking [baseline] (1.486 ms) : 0, 1486
crashtracking [candidate] (1.495 ms) : 0, 1495
BytebuddyAgent [baseline] (832.231 ms) : 0, 832231
BytebuddyAgent [candidate] (830.715 ms) : 0, 830715
GlobalTracer [baseline] (238.997 ms) : 0, 238997
GlobalTracer [candidate] (237.825 ms) : 0, 237825
AppSec [baseline] (31.024 ms) : 0, 31024
AppSec [candidate] (29.076 ms) : 0, 29076
Debugger [baseline] (6.145 ms) : 0, 6145
Debugger [candidate] (6.108 ms) : 0, 6108
Remote Config [baseline] (625.633 µs) : 0, 626
Remote Config [candidate] (617.716 µs) : 0, 618
Telemetry [baseline] (8.015 ms) : 0, 8015
Telemetry [candidate] (7.924 ms) : 0, 7924
Flare Poller [baseline] (11.091 ms) : 0, 11091
Flare Poller [candidate] (10.661 ms) : 0, 10661
IAST [baseline] (31.052 ms) : 0, 31052
IAST [candidate] (32.563 ms) : 0, 32563
section profiling
ProfilingAgent [baseline] (110.723 ms) : 0, 110723
ProfilingAgent [candidate] (111.192 ms) : 0, 111192
crashtracking [baseline] (1.462 ms) : 0, 1462
crashtracking [candidate] (1.44 ms) : 0, 1440
BytebuddyAgent [baseline] (740.194 ms) : 0, 740194
BytebuddyAgent [candidate] (734.4 ms) : 0, 734400
GlobalTracer [baseline] (224.843 ms) : 0, 224843
GlobalTracer [candidate] (223.468 ms) : 0, 223468
AppSec [baseline] (32.413 ms) : 0, 32413
AppSec [candidate] (32.152 ms) : 0, 32152
Debugger [baseline] (6.808 ms) : 0, 6808
Debugger [candidate] (7.558 ms) : 0, 7558
Remote Config [baseline] (717.334 µs) : 0, 717
Remote Config [candidate] (683.488 µs) : 0, 683
Telemetry [baseline] (16.219 ms) : 0, 16219
Telemetry [candidate] (15.427 ms) : 0, 15427
Flare Poller [baseline] (4.13 ms) : 0, 4130
Flare Poller [candidate] (4.194 ms) : 0, 4194
Profiling [baseline] (111.377 ms) : 0, 111377
Profiling [candidate] (111.832 ms) : 0, 111832
Load
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | jpbempel/fix-co-map |
| git_commit_date | 1764141366 | 1764241695 |
| git_commit_sha | c69c2cd | 1eb7e8b |
| release_version | 1.57.0-SNAPSHOT~c69c2cd420 | 1.57.0-SNAPSHOT~1eb7e8b892 |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | insecure-bank | insecure-bank |
| ci_job_date | 1764243965 | 1764243965 |
| ci_job_id | 1260109739 | 1260109739 |
| ci_pipeline_id | 84232937 | 84232937 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-0-7geetqqc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-0-7geetqqc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
Summary
Found 2 performance improvements and 5 performance regressions! Performance is the same for 14 metrics, 15 unstable metrics.
| scenario | Δ mean agg_http_req_duration_p50 | Δ mean agg_http_req_duration_p95 | Δ mean throughput | candidate mean agg_http_req_duration_p50 | candidate mean agg_http_req_duration_p95 | candidate mean throughput | baseline mean agg_http_req_duration_p50 | baseline mean agg_http_req_duration_p95 | baseline mean throughput |
|---|---|---|---|---|---|---|---|---|---|
| scenario:load:petclinic:tracing:high_load | worse [+0.656ms; +1.425ms] or [+3.764%; +8.178%] |
worse [+1.091ms; +2.283ms] or [+3.838%; +8.026%] |
unstable [-40.092op/s; +11.717op/s] or [-15.262%; +4.460%] |
18.459ms | 30.126ms | 248.500op/s | 17.419ms | 28.439ms | 262.688op/s |
| scenario:load:petclinic:code_origins:high_load | worse [+1.037ms; +1.808ms] or [+6.084%; +10.605%] |
unsure [+0.505ms; +2.017ms] or [+1.762%; +7.036%] |
unstable [-41.967op/s; +10.529op/s] or [-15.803%; +3.965%] |
18.476ms | 29.930ms | 249.844op/s | 17.053ms | 28.669ms | 265.562op/s |
| scenario:load:petclinic:appsec:high_load | better [-1.668ms; -0.902ms] or [-8.599%; -4.649%] |
unsure [-1.800ms; -0.354ms] or [-5.804%; -1.141%] |
unstable [-11.392op/s; +38.392op/s] or [-4.792%; +16.150%] |
18.116ms | 29.932ms | 251.219op/s | 19.401ms | 31.008ms | 237.719op/s |
| scenario:load:petclinic:profiling:high_load | worse [+2.342ms; +3.111ms] or [+12.816%; +17.019%] |
worse [+2.508ms; +4.069ms] or [+8.384%; +13.602%] |
unstable [-53.067op/s; -6.058op/s] or [-21.269%; -2.428%] |
21.003ms | 33.203ms | 219.938op/s | 18.277ms | 29.914ms | 249.500op/s |
| scenario:load:petclinic:no_agent:high_load | better [-2.092ms; -0.695ms] or [-11.034%; -3.668%] |
unsure [-3.286ms; -0.448ms] or [-10.549%; -1.438%] |
unstable [-7.086op/s; +47.336op/s] or [-2.946%; +19.682%] |
17.566ms | 29.287ms | 260.625op/s | 18.959ms | 31.154ms | 240.500op/s |
Request duration reports for insecure-bank
gantt
title insecure-bank - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~1eb7e8b892, baseline=1.57.0-SNAPSHOT~c69c2cd420
dateFormat X
axisFormat %s
section baseline
no_agent (1.224 ms) : 1213, 1236
. : milestone, 1224,
iast (3.215 ms) : 3173, 3257
. : milestone, 3215,
iast_FULL (5.839 ms) : 5781, 5898
. : milestone, 5839,
iast_GLOBAL (3.64 ms) : 3588, 3692
. : milestone, 3640,
profiling (1.974 ms) : 1958, 1991
. : milestone, 1974,
tracing (1.833 ms) : 1818, 1848
. : milestone, 1833,
section candidate
no_agent (1.223 ms) : 1211, 1234
. : milestone, 1223,
iast (3.177 ms) : 3136, 3218
. : milestone, 3177,
iast_FULL (5.637 ms) : 5581, 5692
. : milestone, 5637,
iast_GLOBAL (3.552 ms) : 3501, 3603
. : milestone, 3552,
profiling (1.955 ms) : 1939, 1972
. : milestone, 1955,
tracing (1.797 ms) : 1783, 1811
. : milestone, 1797,
- baseline results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.224 ms [1.213 ms, 1.236 ms] | - |
| iast | 3.215 ms [3.173 ms, 3.257 ms] | 1.99 ms (162.6%) |
| iast_FULL | 5.839 ms [5.781 ms, 5.898 ms] | 4.615 ms (376.9%) |
| iast_GLOBAL | 3.64 ms [3.588 ms, 3.692 ms] | 2.415 ms (197.2%) |
| profiling | 1.974 ms [1.958 ms, 1.991 ms] | 749.756 µs (61.2%) |
| tracing | 1.833 ms [1.818 ms, 1.848 ms] | 608.378 µs (49.7%) |
- candidate results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.223 ms [1.211 ms, 1.234 ms] | - |
| iast | 3.177 ms [3.136 ms, 3.218 ms] | 1.954 ms (159.8%) |
| iast_FULL | 5.637 ms [5.581 ms, 5.692 ms] | 4.414 ms (361.0%) |
| iast_GLOBAL | 3.552 ms [3.501 ms, 3.603 ms] | 2.329 ms (190.5%) |
| profiling | 1.955 ms [1.939 ms, 1.972 ms] | 732.552 µs (59.9%) |
| tracing | 1.797 ms [1.783 ms, 1.811 ms] | 574.425 µs (47.0%) |
Request duration reports for petclinic
gantt
title petclinic - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~1eb7e8b892, baseline=1.57.0-SNAPSHOT~c69c2cd420
dateFormat X
axisFormat %s
section baseline
no_agent (19.408 ms) : 19210, 19607
. : milestone, 19408,
appsec (19.638 ms) : 19437, 19839
. : milestone, 19638,
code_origins (17.567 ms) : 17391, 17743
. : milestone, 17567,
iast (17.63 ms) : 17452, 17807
. : milestone, 17630,
profiling (18.709 ms) : 18522, 18897
. : milestone, 18709,
tracing (17.758 ms) : 17583, 17933
. : milestone, 17758,
section candidate
no_agent (17.904 ms) : 17725, 18083
. : milestone, 17904,
appsec (18.573 ms) : 18383, 18763
. : milestone, 18573,
code_origins (18.677 ms) : 18487, 18866
. : milestone, 18677,
iast (17.727 ms) : 17552, 17901
. : milestone, 17727,
profiling (21.232 ms) : 21014, 21451
. : milestone, 21232,
tracing (18.783 ms) : 18594, 18973
. : milestone, 18783,
- baseline results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 19.408 ms [19.21 ms, 19.607 ms] | - |
| appsec | 19.638 ms [19.437 ms, 19.839 ms] | 229.644 µs (1.2%) |
| code_origins | 17.567 ms [17.391 ms, 17.743 ms] | -1.841 ms (-9.5%) |
| iast | 17.63 ms [17.452 ms, 17.807 ms] | -1.778 ms (-9.2%) |
| profiling | 18.709 ms [18.522 ms, 18.897 ms] | -698.728 µs (-3.6%) |
| tracing | 17.758 ms [17.583 ms, 17.933 ms] | -1.65 ms (-8.5%) |
- candidate results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 17.904 ms [17.725 ms, 18.083 ms] | - |
| appsec | 18.573 ms [18.383 ms, 18.763 ms] | 668.389 µs (3.7%) |
| code_origins | 18.677 ms [18.487 ms, 18.866 ms] | 772.199 µs (4.3%) |
| iast | 17.727 ms [17.552 ms, 17.901 ms] | -177.77 µs (-1.0%) |
| profiling | 21.232 ms [21.014 ms, 21.451 ms] | 3.328 ms (18.6%) |
| tracing | 18.783 ms [18.594 ms, 18.973 ms] | 879.022 µs (4.9%) |
Dacapo
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | jpbempel/fix-co-map |
| git_commit_date | 1764141366 | 1764241695 |
| git_commit_sha | c69c2cd | 1eb7e8b |
| release_version | 1.57.0-SNAPSHOT~c69c2cd420 | 1.57.0-SNAPSHOT~1eb7e8b892 |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | biojava | biojava |
| ci_job_date | 1764243783 | 1764243783 |
| ci_job_id | 1260109741 | 1260109741 |
| ci_pipeline_id | 84232937 | 84232937 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-1-xi4smibx 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-1-xi4smibx 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
Summary
Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.
Execution time for biojava
gantt
title biojava - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~1eb7e8b892, baseline=1.57.0-SNAPSHOT~c69c2cd420
dateFormat X
axisFormat %s
section baseline
no_agent (15.24 s) : 15240000, 15240000
. : milestone, 15240000,
appsec (14.751 s) : 14751000, 14751000
. : milestone, 14751000,
iast (18.854 s) : 18854000, 18854000
. : milestone, 18854000,
iast_GLOBAL (18.187 s) : 18187000, 18187000
. : milestone, 18187000,
profiling (15.174 s) : 15174000, 15174000
. : milestone, 15174000,
tracing (14.997 s) : 14997000, 14997000
. : milestone, 14997000,
section candidate
no_agent (15.067 s) : 15067000, 15067000
. : milestone, 15067000,
appsec (14.698 s) : 14698000, 14698000
. : milestone, 14698000,
iast (18.785 s) : 18785000, 18785000
. : milestone, 18785000,
iast_GLOBAL (17.893 s) : 17893000, 17893000
. : milestone, 17893000,
profiling (15.118 s) : 15118000, 15118000
. : milestone, 15118000,
tracing (15.075 s) : 15075000, 15075000
. : milestone, 15075000,
- baseline results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 15.24 s [15.24 s, 15.24 s] | - |
| appsec | 14.751 s [14.751 s, 14.751 s] | -489.0 ms (-3.2%) |
| iast | 18.854 s [18.854 s, 18.854 s] | 3.614 s (23.7%) |
| iast_GLOBAL | 18.187 s [18.187 s, 18.187 s] | 2.947 s (19.3%) |
| profiling | 15.174 s [15.174 s, 15.174 s] | -66.0 ms (-0.4%) |
| tracing | 14.997 s [14.997 s, 14.997 s] | -243.0 ms (-1.6%) |
- candidate results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 15.067 s [15.067 s, 15.067 s] | - |
| appsec | 14.698 s [14.698 s, 14.698 s] | -369.0 ms (-2.4%) |
| iast | 18.785 s [18.785 s, 18.785 s] | 3.718 s (24.7%) |
| iast_GLOBAL | 17.893 s [17.893 s, 17.893 s] | 2.826 s (18.8%) |
| profiling | 15.118 s [15.118 s, 15.118 s] | 51.0 ms (0.3%) |
| tracing | 15.075 s [15.075 s, 15.075 s] | 8.0 ms (0.1%) |
Execution time for tomcat
gantt
title tomcat - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~1eb7e8b892, baseline=1.57.0-SNAPSHOT~c69c2cd420
dateFormat X
axisFormat %s
section baseline
no_agent (1.486 ms) : 1474, 1497
. : milestone, 1486,
appsec (3.666 ms) : 3452, 3880
. : milestone, 3666,
iast (2.211 ms) : 2147, 2275
. : milestone, 2211,
iast_GLOBAL (2.267 ms) : 2202, 2332
. : milestone, 2267,
profiling (2.106 ms) : 2052, 2160
. : milestone, 2106,
tracing (2.06 ms) : 2009, 2110
. : milestone, 2060,
section candidate
no_agent (1.485 ms) : 1473, 1497
. : milestone, 1485,
appsec (3.678 ms) : 3465, 3891
. : milestone, 3678,
iast (2.224 ms) : 2160, 2288
. : milestone, 2224,
iast_GLOBAL (2.271 ms) : 2206, 2335
. : milestone, 2271,
profiling (2.084 ms) : 2030, 2137
. : milestone, 2084,
tracing (2.061 ms) : 2010, 2112
. : milestone, 2061,
- baseline results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.486 ms [1.474 ms, 1.497 ms] | - |
| appsec | 3.666 ms [3.452 ms, 3.88 ms] | 2.18 ms (146.7%) |
| iast | 2.211 ms [2.147 ms, 2.275 ms] | 725.537 µs (48.8%) |
| iast_GLOBAL | 2.267 ms [2.202 ms, 2.332 ms] | 781.298 µs (52.6%) |
| profiling | 2.106 ms [2.052 ms, 2.16 ms] | 620.518 µs (41.8%) |
| tracing | 2.06 ms [2.009 ms, 2.11 ms] | 574.089 µs (38.6%) |
- candidate results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.485 ms [1.473 ms, 1.497 ms] | - |
| appsec | 3.678 ms [3.465 ms, 3.891 ms] | 2.193 ms (147.7%) |
| iast | 2.224 ms [2.16 ms, 2.288 ms] | 738.989 µs (49.8%) |
| iast_GLOBAL | 2.271 ms [2.206 ms, 2.335 ms] | 785.524 µs (52.9%) |
| profiling | 2.084 ms [2.03 ms, 2.137 ms] | 598.625 µs (40.3%) |
| tracing | 2.061 ms [2.01 ms, 2.112 ms] | 576.048 µs (38.8%) |