Add build option for ARM NCHWc kernels by hariharans29 · Pull Request #26171 · microsoft/onnxruntime

added 4 commits

September 25, 2025 19:53

github-advanced-security[bot]

github-actions[bot]

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>

hariharans29

hariharans29

@hariharans29

@hariharans29

github-actions[bot]

@hariharans29 @github-actions

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>

@hariharans29

Added a comment regarding the performance of NCHWc ARM kernels and their default state.

@hariharans29 hariharans29 changed the title WIP: Add build option for ARM NCHWc kernels Add build option for ARM NCHWc kernels

Sep 29, 2025

edgchen1

fs-eire pushed a commit that referenced this pull request

Oct 24, 2025
### Description
Add a build option for new kernels introduced in
#25580

### Motivation and Context
This enables building ORT with NCHWc ARM kernels.
At the time of writing, it is turned OFF by default because its
performance relative to "regular" NCHW kernels
is not good at smaller thread counts. But its speed-up is non-negligible
with higher thread counts on supporting
ARM platforms.
Once the gap is closed for smaller thread counts, it can be turned on by
default.

---------

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>

naomiOvad pushed a commit to naomiOvad/onnxruntime that referenced this pull request

Nov 2, 2025
### Description
Add a build option for new kernels introduced in
microsoft#25580

### Motivation and Context
This enables building ORT with NCHWc ARM kernels.
At the time of writing, it is turned OFF by default because its
performance relative to "regular" NCHW kernels
is not good at smaller thread counts. But its speed-up is non-negligible
with higher thread counts on supporting
ARM platforms.
Once the gap is closed for smaller thread counts, it can be turned on by
default.

---------

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>