Home Original page

fix NullPointerException in ClassesToRetransformFinder by jpbempel · Pull Request #10316 · DataDog/dd-trace-java

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/fix-npe-loaded-classes
git_commit_date 1767878426 1767886743
git_commit_sha 08e1657 2a279df
release_version 1.59.0-SNAPSHOT~08e165783b 1.59.0-SNAPSHOT~2a279dfc59
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1767888577 1767888577
ci_job_id 1336423572 1336423572
ci_pipeline_id 89692750 89692750
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-d2dgclf2 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-d2dgclf2 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 54 metrics, 11 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.59.0-SNAPSHOT~2a279dfc59, baseline=1.59.0-SNAPSHOT~08e165783b

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.091 s) : 0, 1091156
Total [baseline] (8.761 s) : 0, 8761281
Agent [candidate] (1.085 s) : 0, 1084984
Total [candidate] (8.769 s) : 0, 8768971
section iast
Agent [baseline] (1.231 s) : 0, 1230848
Total [baseline] (9.337 s) : 0, 9336825
Agent [candidate] (1.223 s) : 0, 1223488
Total [candidate] (9.292 s) : 0, 9291927
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.091 s -
Agent iast 1.231 s 139.692 ms (12.8%)
Total tracing 8.761 s -
Total iast 9.337 s 575.545 ms (6.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.085 s -
Agent iast 1.223 s 138.504 ms (12.8%)
Total tracing 8.769 s -
Total iast 9.292 s 522.956 ms (6.0%) 
gantt
    title insecure-bank - break down per module: candidate=1.59.0-SNAPSHOT~2a279dfc59, baseline=1.59.0-SNAPSHOT~08e165783b

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.219 ms) : 0, 1219
crashtracking [candidate] (1.184 ms) : 0, 1184
BytebuddyAgent [baseline] (655.673 ms) : 0, 655673
BytebuddyAgent [candidate] (651.9 ms) : 0, 651900
GlobalTracer [baseline] (284.134 ms) : 0, 284134
GlobalTracer [candidate] (283.211 ms) : 0, 283211
AppSec [baseline] (32.812 ms) : 0, 32812
AppSec [candidate] (32.768 ms) : 0, 32768
Debugger [baseline] (68.156 ms) : 0, 68156
Debugger [candidate] (67.06 ms) : 0, 67060
Remote Config [baseline] (621.387 µs) : 0, 621
Remote Config [candidate] (641.024 µs) : 0, 641
Telemetry [baseline] (9.0 ms) : 0, 9000
Telemetry [candidate] (8.943 ms) : 0, 8943
Flare Poller [baseline] (3.729 ms) : 0, 3729
Flare Poller [candidate] (3.747 ms) : 0, 3747
section iast
crashtracking [baseline] (1.206 ms) : 0, 1206
crashtracking [candidate] (1.191 ms) : 0, 1191
BytebuddyAgent [baseline] (796.667 ms) : 0, 796667
BytebuddyAgent [candidate] (791.72 ms) : 0, 791720
GlobalTracer [baseline] (257.36 ms) : 0, 257360
GlobalTracer [candidate] (256.018 ms) : 0, 256018
AppSec [baseline] (33.764 ms) : 0, 33764
AppSec [candidate] (34.418 ms) : 0, 34418
Debugger [baseline] (66.222 ms) : 0, 66222
Debugger [candidate] (65.093 ms) : 0, 65093
Remote Config [baseline] (593.048 µs) : 0, 593
Remote Config [candidate] (574.278 µs) : 0, 574
Telemetry [baseline] (8.596 ms) : 0, 8596
Telemetry [candidate] (8.503 ms) : 0, 8503
Flare Poller [baseline] (3.638 ms) : 0, 3638
Flare Poller [candidate] (3.548 ms) : 0, 3548
IAST [baseline] (27.231 ms) : 0, 27231
IAST [candidate] (26.904 ms) : 0, 26904
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.59.0-SNAPSHOT~2a279dfc59, baseline=1.59.0-SNAPSHOT~08e165783b

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.102 s) : 0, 1102403
Total [baseline] (10.963 s) : 0, 10963175
Agent [candidate] (1.085 s) : 0, 1085459
Total [candidate] (10.749 s) : 0, 10749179
section appsec
Agent [baseline] (1.265 s) : 0, 1265340
Total [baseline] (11.042 s) : 0, 11041733
Agent [candidate] (1.268 s) : 0, 1267535
Total [candidate] (10.976 s) : 0, 10976427
section iast
Agent [baseline] (1.233 s) : 0, 1232727
Total [baseline] (11.22 s) : 0, 11219891
Agent [candidate] (1.233 s) : 0, 1233084
Total [candidate] (11.216 s) : 0, 11215862
section profiling
Agent [baseline] (1.207 s) : 0, 1207078
Total [baseline] (11.039 s) : 0, 11038722
Agent [candidate] (1.206 s) : 0, 1205675
Total [candidate] (10.884 s) : 0, 10883925
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.102 s -
Agent appsec 1.265 s 162.937 ms (14.8%)
Agent iast 1.233 s 130.324 ms (11.8%)
Agent profiling 1.207 s 104.675 ms (9.5%)
Total tracing 10.963 s -
Total appsec 11.042 s 78.558 ms (0.7%)
Total iast 11.22 s 256.716 ms (2.3%)
Total profiling 11.039 s 75.547 ms (0.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.085 s -
Agent appsec 1.268 s 182.076 ms (16.8%)
Agent iast 1.233 s 147.625 ms (13.6%)
Agent profiling 1.206 s 120.216 ms (11.1%)
Total tracing 10.749 s -
Total appsec 10.976 s 227.248 ms (2.1%)
Total iast 11.216 s 466.683 ms (4.3%)
Total profiling 10.884 s 134.746 ms (1.3%) 
gantt
    title petclinic - break down per module: candidate=1.59.0-SNAPSHOT~2a279dfc59, baseline=1.59.0-SNAPSHOT~08e165783b

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.202 ms) : 0, 1202
crashtracking [candidate] (1.183 ms) : 0, 1183
BytebuddyAgent [baseline] (662.11 ms) : 0, 662110
BytebuddyAgent [candidate] (651.632 ms) : 0, 651632
GlobalTracer [baseline] (286.37 ms) : 0, 286370
GlobalTracer [candidate] (282.599 ms) : 0, 282599
AppSec [baseline] (33.277 ms) : 0, 33277
AppSec [candidate] (32.39 ms) : 0, 32390
Debugger [baseline] (69.747 ms) : 0, 69747
Debugger [candidate] (68.539 ms) : 0, 68539
Remote Config [baseline] (633.842 µs) : 0, 634
Remote Config [candidate] (639.587 µs) : 0, 640
Telemetry [baseline] (9.26 ms) : 0, 9260
Telemetry [candidate] (9.105 ms) : 0, 9105
Flare Poller [baseline] (3.89 ms) : 0, 3890
Flare Poller [candidate] (3.801 ms) : 0, 3801
section appsec
crashtracking [baseline] (1.186 ms) : 0, 1186
crashtracking [candidate] (1.186 ms) : 0, 1186
BytebuddyAgent [baseline] (691.412 ms) : 0, 691412
BytebuddyAgent [candidate] (692.278 ms) : 0, 692278
GlobalTracer [baseline] (258.389 ms) : 0, 258389
GlobalTracer [candidate] (259.001 ms) : 0, 259001
AppSec [baseline] (174.43 ms) : 0, 174430
AppSec [candidate] (173.464 ms) : 0, 173464
Debugger [baseline] (66.308 ms) : 0, 66308
Debugger [candidate] (67.763 ms) : 0, 67763
Remote Config [baseline] (733.899 µs) : 0, 734
Remote Config [candidate] (755.188 µs) : 0, 755
Telemetry [baseline] (9.347 ms) : 0, 9347
Telemetry [candidate] (9.332 ms) : 0, 9332
Flare Poller [baseline] (3.73 ms) : 0, 3730
Flare Poller [candidate] (3.766 ms) : 0, 3766
IAST [baseline] (24.453 ms) : 0, 24453
IAST [candidate] (24.588 ms) : 0, 24588
section iast
crashtracking [baseline] (1.191 ms) : 0, 1191
crashtracking [candidate] (1.201 ms) : 0, 1201
BytebuddyAgent [baseline] (796.864 ms) : 0, 796864
BytebuddyAgent [candidate] (798.143 ms) : 0, 798143
GlobalTracer [baseline] (257.97 ms) : 0, 257970
GlobalTracer [candidate] (257.724 ms) : 0, 257724
AppSec [baseline] (32.982 ms) : 0, 32982
AppSec [candidate] (33.667 ms) : 0, 33667
Debugger [baseline] (68.038 ms) : 0, 68038
Debugger [candidate] (66.742 ms) : 0, 66742
Remote Config [baseline] (578.005 µs) : 0, 578
Remote Config [candidate] (594.294 µs) : 0, 594
Telemetry [baseline] (8.548 ms) : 0, 8548
Telemetry [candidate] (8.531 ms) : 0, 8531
Flare Poller [baseline] (3.571 ms) : 0, 3571
Flare Poller [candidate] (3.556 ms) : 0, 3556
IAST [baseline] (27.351 ms) : 0, 27351
IAST [candidate] (27.293 ms) : 0, 27293
section profiling
crashtracking [baseline] (1.218 ms) : 0, 1218
crashtracking [candidate] (1.213 ms) : 0, 1213
BytebuddyAgent [baseline] (703.84 ms) : 0, 703840
BytebuddyAgent [candidate] (703.275 ms) : 0, 703275
GlobalTracer [baseline] (220.705 ms) : 0, 220705
GlobalTracer [candidate] (220.767 ms) : 0, 220767
AppSec [baseline] (32.165 ms) : 0, 32165
AppSec [candidate] (32.201 ms) : 0, 32201
Debugger [baseline] (68.206 ms) : 0, 68206
Debugger [candidate] (68.219 ms) : 0, 68219
Remote Config [baseline] (646.028 µs) : 0, 646
Remote Config [candidate] (636.536 µs) : 0, 637
Telemetry [baseline] (8.821 ms) : 0, 8821
Telemetry [candidate] (8.783 ms) : 0, 8783
Flare Poller [baseline] (3.666 ms) : 0, 3666
Flare Poller [candidate] (3.65 ms) : 0, 3650
ProfilingAgent [baseline] (97.912 ms) : 0, 97912
ProfilingAgent [candidate] (97.03 ms) : 0, 97030
Profiling [baseline] (98.512 ms) : 0, 98512
Profiling [candidate] (97.608 ms) : 0, 97608
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/fix-npe-loaded-classes
git_commit_date 1767878426 1767886743
git_commit_sha 08e1657 2a279df
release_version 1.59.0-SNAPSHOT~08e165783b 1.59.0-SNAPSHOT~2a279dfc59
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1767889055 1767889055
ci_job_id 1336423574 1336423574
ci_pipeline_id 89692750 89692750
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-tgsum8dv 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-tgsum8dv 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 4 performance improvements and 4 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_FULL:high_load better
[-638.482µs; -298.018µs] or [-11.954%; -5.580%]		 better
[-1.717ms; -0.708ms] or [-13.497%; -5.563%]		 unstable
[-23.880op/s; +158.317op/s] or [-3.098%; +20.541%]		 4.873ms 11.512ms 837.938op/s 5.341ms 12.725ms 770.719op/s
scenario:load:petclinic:code_origins:high_load worse
[+1.069ms; +1.847ms] or [+6.184%; +10.680%]		 worse
[+0.832ms; +1.895ms] or [+2.915%; +6.640%]		 unstable
[-42.396op/s; +10.771op/s] or [-16.097%; +4.090%]		 18.748ms 29.904ms 247.562op/s 17.290ms 28.541ms 263.375op/s
scenario:load:petclinic:iast:high_load better
[-2.910ms; -2.492ms] or [-14.736%; -12.620%]		 better
[-3.697ms; -2.607ms] or [-11.765%; -8.295%]		 unstable
[+6.641op/s; +57.922op/s] or [+2.829%; +24.674%]		 17.049ms 28.271ms 267.031op/s 19.750ms 31.422ms 234.750op/s
scenario:load:petclinic:no_agent:high_load worse
[+1.519ms; +2.592ms] or [+9.085%; +15.502%]		 worse
[+1.505ms; +4.294ms] or [+5.257%; +15.002%]		 unstable
[-56.712op/s; -1.101op/s] or [-20.910%; -0.406%]		 18.776ms 31.520ms 242.312op/s 16.720ms 28.621ms 271.219op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~2a279dfc59, baseline=1.59.0-SNAPSHOT~08e165783b
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.189 ms) : 1178, 1201
.   : milestone, 1189,
iast (3.197 ms) : 3153, 3241
.   : milestone, 3197,
iast_FULL (6.001 ms) : 5940, 6062
.   : milestone, 6001,
iast_GLOBAL (3.578 ms) : 3526, 3630
.   : milestone, 3578,
profiling (2.091 ms) : 2072, 2110
.   : milestone, 2091,
tracing (1.841 ms) : 1825, 1857
.   : milestone, 1841,
section candidate
no_agent (1.29 ms) : 1275, 1304
.   : milestone, 1290,
iast (3.13 ms) : 3089, 3170
.   : milestone, 3130,
iast_FULL (5.512 ms) : 5458, 5566
.   : milestone, 5512,
iast_GLOBAL (3.587 ms) : 3531, 3643
.   : milestone, 3587,
profiling (1.933 ms) : 1917, 1950
.   : milestone, 1933,
tracing (1.817 ms) : 1802, 1833
.   : milestone, 1817,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.189 ms [1.178 ms, 1.201 ms] -
iast 3.197 ms [3.153 ms, 3.241 ms] 2.008 ms (168.8%)
iast_FULL 6.001 ms [5.94 ms, 6.062 ms] 4.812 ms (404.6%)
iast_GLOBAL 3.578 ms [3.526 ms, 3.63 ms] 2.389 ms (200.9%)
profiling 2.091 ms [2.072 ms, 2.11 ms] 901.683 µs (75.8%)
tracing 1.841 ms [1.825 ms, 1.857 ms] 651.77 µs (54.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.29 ms [1.275 ms, 1.304 ms] -
iast 3.13 ms [3.089 ms, 3.17 ms] 1.84 ms (142.7%)
iast_FULL 5.512 ms [5.458 ms, 5.566 ms] 4.222 ms (327.4%)
iast_GLOBAL 3.587 ms [3.531 ms, 3.643 ms] 2.297 ms (178.2%)
profiling 1.933 ms [1.917 ms, 1.95 ms] 643.794 µs (49.9%)
tracing 1.817 ms [1.802 ms, 1.833 ms] 527.663 µs (40.9%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~2a279dfc59, baseline=1.59.0-SNAPSHOT~08e165783b
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.199 ms) : 17029, 17369
.   : milestone, 17199,
appsec (18.813 ms) : 18621, 19005
.   : milestone, 18813,
code_origins (17.712 ms) : 17537, 17888
.   : milestone, 17712,
iast (19.889 ms) : 19686, 20093
.   : milestone, 19889,
profiling (18.925 ms) : 18733, 19117
.   : milestone, 18925,
tracing (17.626 ms) : 17454, 17798
.   : milestone, 17626,
section candidate
no_agent (19.263 ms) : 19066, 19461
.   : milestone, 19263,
appsec (18.534 ms) : 18344, 18725
.   : milestone, 18534,
code_origins (18.857 ms) : 18669, 19045
.   : milestone, 18857,
iast (17.472 ms) : 17297, 17647
.   : milestone, 17472,
profiling (18.559 ms) : 18376, 18742
.   : milestone, 18559,
tracing (17.597 ms) : 17422, 17772
.   : milestone, 17597,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.199 ms [17.029 ms, 17.369 ms] -
appsec 18.813 ms [18.621 ms, 19.005 ms] 1.614 ms (9.4%)
code_origins 17.712 ms [17.537 ms, 17.888 ms] 513.39 µs (3.0%)
iast 19.889 ms [19.686 ms, 20.093 ms] 2.69 ms (15.6%)
profiling 18.925 ms [18.733 ms, 19.117 ms] 1.726 ms (10.0%)
tracing 17.626 ms [17.454 ms, 17.798 ms] 427.15 µs (2.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.263 ms [19.066 ms, 19.461 ms] -
appsec 18.534 ms [18.344 ms, 18.725 ms] -729.059 µs (-3.8%)
code_origins 18.857 ms [18.669 ms, 19.045 ms] -406.322 µs (-2.1%)
iast 17.472 ms [17.297 ms, 17.647 ms] -1.792 ms (-9.3%)
profiling 18.559 ms [18.376 ms, 18.742 ms] -704.782 µs (-3.7%)
tracing 17.597 ms [17.422 ms, 17.772 ms] -1.666 ms (-8.7%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/fix-npe-loaded-classes
git_commit_date 1767878426 1767886743
git_commit_sha 08e1657 2a279df
release_version 1.59.0-SNAPSHOT~08e165783b 1.59.0-SNAPSHOT~2a279dfc59
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1767888855 1767888855
ci_job_id 1336423576 1336423576
ci_pipeline_id 89692750 89692750
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-p5nbdqru 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-p5nbdqru 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~2a279dfc59, baseline=1.59.0-SNAPSHOT~08e165783b
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.539 s) : 15539000, 15539000
.   : milestone, 15539000,
appsec (15.191 s) : 15191000, 15191000
.   : milestone, 15191000,
iast (18.468 s) : 18468000, 18468000
.   : milestone, 18468000,
iast_GLOBAL (18.083 s) : 18083000, 18083000
.   : milestone, 18083000,
profiling (14.696 s) : 14696000, 14696000
.   : milestone, 14696000,
tracing (14.59 s) : 14590000, 14590000
.   : milestone, 14590000,
section candidate
no_agent (14.963 s) : 14963000, 14963000
.   : milestone, 14963000,
appsec (14.768 s) : 14768000, 14768000
.   : milestone, 14768000,
iast (18.501 s) : 18501000, 18501000
.   : milestone, 18501000,
iast_GLOBAL (17.851 s) : 17851000, 17851000
.   : milestone, 17851000,
profiling (14.749 s) : 14749000, 14749000
.   : milestone, 14749000,
tracing (14.768 s) : 14768000, 14768000
.   : milestone, 14768000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.539 s [15.539 s, 15.539 s] -
appsec 15.191 s [15.191 s, 15.191 s] -348.0 ms (-2.2%)
iast 18.468 s [18.468 s, 18.468 s] 2.929 s (18.8%)
iast_GLOBAL 18.083 s [18.083 s, 18.083 s] 2.544 s (16.4%)
profiling 14.696 s [14.696 s, 14.696 s] -843.0 ms (-5.4%)
tracing 14.59 s [14.59 s, 14.59 s] -949.0 ms (-6.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.963 s [14.963 s, 14.963 s] -
appsec 14.768 s [14.768 s, 14.768 s] -195.0 ms (-1.3%)
iast 18.501 s [18.501 s, 18.501 s] 3.538 s (23.6%)
iast_GLOBAL 17.851 s [17.851 s, 17.851 s] 2.888 s (19.3%)
profiling 14.749 s [14.749 s, 14.749 s] -214.0 ms (-1.4%)
tracing 14.768 s [14.768 s, 14.768 s] -195.0 ms (-1.3%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~2a279dfc59, baseline=1.59.0-SNAPSHOT~08e165783b
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.479 ms) : 1468, 1491
.   : milestone, 1479,
appsec (3.754 ms) : 3536, 3973
.   : milestone, 3754,
iast (2.229 ms) : 2164, 2294
.   : milestone, 2229,
iast_GLOBAL (2.262 ms) : 2197, 2327
.   : milestone, 2262,
profiling (2.112 ms) : 2057, 2166
.   : milestone, 2112,
tracing (2.052 ms) : 2002, 2103
.   : milestone, 2052,
section candidate
no_agent (1.479 ms) : 1468, 1491
.   : milestone, 1479,
appsec (3.758 ms) : 3539, 3978
.   : milestone, 3758,
iast (2.22 ms) : 2155, 2285
.   : milestone, 2220,
iast_GLOBAL (2.274 ms) : 2208, 2340
.   : milestone, 2274,
profiling (2.104 ms) : 2049, 2158
.   : milestone, 2104,
tracing (2.054 ms) : 2003, 2105
.   : milestone, 2054,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.479 ms [1.468 ms, 1.491 ms] -
appsec 3.754 ms [3.536 ms, 3.973 ms] 2.275 ms (153.8%)
iast 2.229 ms [2.164 ms, 2.294 ms] 750.118 µs (50.7%)
iast_GLOBAL 2.262 ms [2.197 ms, 2.327 ms] 783.078 µs (52.9%)
profiling 2.112 ms [2.057 ms, 2.166 ms] 632.556 µs (42.8%)
tracing 2.052 ms [2.002 ms, 2.103 ms] 573.345 µs (38.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.479 ms [1.468 ms, 1.491 ms] -
appsec 3.758 ms [3.539 ms, 3.978 ms] 2.279 ms (154.1%)
iast 2.22 ms [2.155 ms, 2.285 ms] 741.169 µs (50.1%)
iast_GLOBAL 2.274 ms [2.208 ms, 2.34 ms] 794.733 µs (53.7%)
profiling 2.104 ms [2.049 ms, 2.158 ms] 624.329 µs (42.2%)
tracing 2.054 ms [2.003 ms, 2.105 ms] 574.752 µs (38.9%)