Skip to content

MoE: add moe_late_tp_combine so routed experts take the tensor axis as expert parallelism - #4910

Open
systalyze-ai wants to merge 1 commit into
AI-Hypercomputer:mainfrom
systalyze-ai:upstream-pr/moe-late-tp-combine
Open

MoE: add moe_late_tp_combine so routed experts take the tensor axis as expert parallelism#4910
systalyze-ai wants to merge 1 commit into
AI-Hypercomputer:mainfrom
systalyze-ai:upstream-pr/moe-late-tp-combine

MoE: add moe_late_tp_combine so routed experts take the tensor axis a…

d9f831a
Select commit
Loading
Failed to load commit list.
Sign in for the full log view