摩尔线程完成236B MoE模型万卡集群预训练

«MoE-236B model, on 25T+ tokens, completed the entire process from pre-training to long-context training from scratch on Moore Threads' domestic 10,000-card-class cluster, with the effective training time accounting for over 90%.» Moore Threads getting more serious