standardize moe permute unpermute by pesionzhao · Pull Request #73365 · PaddlePaddle/Paddle
PR Category
User Experience
PR Types
Bug fixes
Description
standardize moe_unpermute and moe_permute api interface and unit test
1 similar comment
pesionzhao
changed the title
stardardize moe permute unpermute
standardize moe permute unpermute
Comment on lines +27 to 36
| hidden_states: Tensor, | ||
| scale: Tensor | None, | ||
| expert_routemap_topk: Tensor, | ||
| expert_prob_topk: Tensor, | ||
| topk: int, | ||
| num_experts: int, | ||
| tokens_per_expert: list, | ||
| padding_multiplex: int, | ||
| padding_alignment: int, | ||
| name: str | None = None, | ||
| ): | ||
| ) -> tuple[Tensor, Tensor, Tensor, Tensor]: | ||
| if in_dynamic_or_pir_mode(): |
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
加API注释
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
两个python文件是不可以合并？
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTMeow 
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters. Learn more about bidirectional Unicode characters