fix: Allow full model compilation with collection inputs (`input_signature`) by gs-olive · Pull Request #1656 · pytorch/TensorRT

@gs-olive self-assigned this

Feb 9, 2023

@gs-olive gs-olive marked this pull request as ready for review

March 14, 2023 20:08
- Allow users to specify full model compilation when using
`input_signature`, which allows for complex collection-based inputs
- Enable "psuedo-partitioning" phase for input collections as well as
output collections
- Update `OutputIsCollection` to include dictionary outputs, and add
function `InputIsCollection` to detect collection-based inputs during
graph compilation
- Remove automatic fallback for collection pack/unpack operations when
using `input_signature` argument
- Add collections tests to ensure full compilation is respected for
input and output collections
- Add documentation to `README` for usage of input signature
- Add documentation to "Getting Started" page for usage of input
signature

@gs-olive gs-olive deleted the input_signature_full_compilation branch

March 30, 2023 22:05