How to Loop MoE: Flatten the Experts, Untie the Attention

Sep 29, 2026 · simpleprog

Authors Shouren Wang, Chuang Ma, Mohsen Hariri, Debargha Ganguly, Wang Yang, Xiaoqing Tong, Qianying Liu, Xiaotian Han, Vipin Chaudhary

The user has submitted the current work dir /var/www/simpleprog-website/var/www/simpleprog-website