Sakana Fugu 技术报告：Agent 级 MoE 架构

Finally read Sakana Fugu Technical Report

Fugu is basically Mixture-of-Experts, but at the agent/API level instead of the parameter level.

Main point: instead of only making one bigger model, you can combine specialized models intelligently.

user query → orchestrator LM hidden state → routing head → chosen worker LLM → answer