https://hgpu.org/?p=16939
Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer