月之暗面发布Kimi K3.1 Pro开源权重及详细评测
Kimi K3.1 Pro model weights are out
重磅开源!Kimi K3.1 Pro不仅放出权重,还披露了详细的MoE架构与DSA注意力机制,编程与智能体能力对标顶级闭源模型,值得部署研究。
📰 Tech Blog | 🚀 API Quickstart
📰 技术博客 | 🚀 API 快速入门
1. Model Introduction
1. 模型介绍
Kimi K3.1 Pro is an open-weight, natively multimodal agentic model, and our most capable 3T-class model to date. Post-trained from Kimi K3 with large-scale joint reinforcement learning across hundreds of downstream domains, it is the first model in the K3.1 series. With a 1-million-token context window, Kimi K3.1 Pro delivers substantial improvements in coding, 3D creation, financial research, factual accuracy, and other agentic capabilities.
Kimi K3.1 Pro 是一款开源权重的原生多模态智能体模型,也是迄今为止我们最强大的 3T 级模型。在 Kimi K3 的基础上,通过在数百个下游领域进行大规模联合强化学习进行后训练,它是 K3.1 系列中的首款模型。凭借 100 万 token 的上下文窗口,Kimi K3.1 Pro 在编程、3D 创作、金融研究、事实准确性以及其他智能体能力方面带来了显著提升。
2. Model Summary
2. 模型摘要
| Architecture | Mixture-of-Experts (MoE) |
|---|---|
| Total Parameters | 2.8T |
| Activated Parameters | 104B |
| Number of Layers | 93 |
| Number of Dense Layers | 1 |
| Attention-Layer Composition | 69 KDA + 24 Gated DSA* |
| Attention Hidden Dimension | 7168 |
| Number of Attention Heads | 96 |
| DSA Index Head Dimension | 128 |
| DSA Index Number of Heads | 32 |
| DSA Index Top-K | 2048 |
| Latent MoE Dimension | 3584 |
| MoE Hidden Dimension (per Expert) | 3072 |
| Number of Experts | 896 |
| Selected Experts per Token | 16 |
| Number of Shared Experts | 2 |
| Vocabulary Size | 160K |
| Context Length | 1048576 |
| Attention Mechanism | KDA & Gated DSA |
| Activation Function | SiTU-GLU |
| Vision Encoder | MoonViT-V2 |
| Parameters of Vision Encoder | 401M |
| Quantization | MXFP4 weights / MXFP8 activations(quantization-aware training) |
| Modality | Text, Image |
| 架构 | 混合专家(MoE) |
|---|---|
| 总参数量 | 2.8T |
| 激活参数量 | 104B |
| 层数 | 93 |
| 密集层数 | 1 |
| 注意力层组成 | 69 KDA + 24 门控 DSA* |
| 注意力隐藏维度 | 7168 |
| 注意力头数 | 96 |
| DSA 索引头维度 | 128 |
| DSA 索引头数 | 32 |
| DSA 索引 Top-K | 2048 |
| 潜在 MoE 维度 | 3584 |
| MoE 隐藏维度(每个专家) | 3072 |
| 专家总数 | 896 |
| 每 token 选择的专家数 | 16 |
| 共享专家数 | 2 |
| 词汇表大小 | 160K |
| 上下文长度 | 1048576 |
| 注意力机制 | KDA & 门控 DSA |
| 激活函数 | SiTU-GLU |
| 视觉编码器 | MoonViT-V2 |
| 视觉编码器参数量 | 401M |
| 量化 | MXFP4 权重 / MXFP8 激活值(量化感知训练) |
| 模态 | 文本、图像 |
* Compared with Kimi K3, we replace the full-attention Gated MLA layers with Gated DeepSeek Sparse Attention (Gated DSA) layers for more efficient long-context modeling.
* 与 Kimi K3 相比,我们将全注意力门控 MLA 层替换为门控深度稀疏注意力(Gated DSA)层,以实现更高效的长上下文建模。
3. Evaluation Results
3. 评估结果
Unless otherwise specified, all Kimi K3.1 Pro results use reasoning effort max, temperature = 1.0, and top-p = 0.95. A dash (—) means that the source table does not report a score. Higher scores are better except where the benchmark name explicitly states lower is better; Elo scores and other benchmark-specific metrics are not directly comparable with accuracy or pass-rate scores.
除非另有说明,所有 Kimi K3.1 Pro 的结果均使用最大推理努力(reasoning effort max),温度(temperature)= 1.0,top-p = 0.95。短横线(—)表示源表未报告分数。除基准名称明确指出越低越好外,分数越高越好;Elo 分数和其他特定基准指标与准确率或通过率分数不可直接比较。
| Benchmark | Kimi K3.1 Pro(max) | Claude Fable 5.1(max, w/ fallback) | GPT-6 Astra(max, w/ fallback) | Claude Opus 5.5(max, w/ fallback) | DeepSeek-V4.1-Flash-1017(max) | GLM-5.3(max) |
|---|---|---|---|---|---|---|
| Coding | ||||||
| Terminal-Bench 4.0 | 65.7 | 57.9 | 58.2 | 66.4 | 42.3 | 41.8 |
| Terminal-Bench-Science 0.1 | 38.1 | 40.0 | 68.1 | 63.3 | 15.7 | 8.1 |
| SWE Marathon v1.1 | 51.7 | 45.6 | 42.5 | 46.3 | 40.0 | 42.5 |
| BenchCAD w/o tools | 72.8 | 60.6 | — | 73.0 | 41.2 | — |
| BenchCAD w/ tools | 92.7 | 92.6 | 95.9 | 96.2 | 81.6 | — |
| Program Bench | 31.5 | 53.5 | 50.0 | 65.0 | 29.1 | 19.0 |
| DeepSWE v1.1 | 75.5 | 67.4 | 74.1 | 74.2 | 77.0 | 66.9 |
| PostTrain Bench v1.2 | 36.5 | 44.6 | 41.9 | 43.8 | 30.5 | 34.5 |
| Kimi Code Bench 2.0 (Internal) | 77.1 | — | — | — | 76.1 | 61.7 |
| Kimi Code Bench 3.0 Long-horizon (Internal) | 61.2 | 58.8 | 66.5 | 58.5 | 51.5 | 45.5 |
| Agentic | ||||||
| HLE-Full w/ tools | 70.0 | 65.6 | 57.2 | 67.7 | 58.8 | 62.5 |
| BrowseComp | 92.1 | — | 91.5 | 90.8 | — | — |
| BioMysteryBench | 80.6 | 81.6 | 78.9 | 81.9 | 80.0 | 79.6 |
| CharXiv (RQ) w/ python | 93.4 | 92.7 | 92.8 | 93.8 | 85.6 | — |
| MMMU-Pro w/ python | 90.0 | 88.4 | 87.8 | 89.8 | 82.5 | — |
| GDP.pdf w/ python | 85.7 | 83.8 | 85.5 | 83.9 | 73.0 | — |
| ChartoGraphy w/ python | 90.2 | 88.4 | 91.0 | 89.0 | 83.0 | — |
| BabyVision w/ python | 95.4 | 95.1 | 96.6 | 97.7 | 92.5 | — |
| ZeroBench_main w/ python (pass@5) | 63.0 | 59.0 | 58.0 | 61.0 | 51.0 | — |
| Agents' Last Exam (ALL) | 43.2 | — | 41.8 | 42.6 | 37.7 | 26.2 |
| Agents' Last Exam (CLI) | 44.2 | — | 44.2 | 40.7 | 36.0 | 29.4 |
| Automation Bench-AA | 73.3 | 59.4 | 68.5 | 69.5 | 66.6 | 62.2 |
| GDPval-AA v2.1 (Elo-score) | 1846 | 1754 | 1573 | 1866 | 1746 | 1650 |
| AA-Briefcase v1.1 (Elo-score) | 1678 | 1672 | 1569 | 1803 | 1570 | 1507 |
| APEX-Agents | 69.4 | 68.6 | 64.7 | 73.5 | 69.8 | 56.6 |
| OfficeQA Pro v2 | 64.4 | 54.5 | 54.4 | 62.2 | 40.4 | 31.1 |
| OfficeQA Pro | 67.4 | 68.6 | 66.2 | — | 62.4 | 58.6 |
| Frontier Finance | 58.6 | 60.8 | 45.0 | 56.7 | 54.5 | 57.5 |
| Harvey Legal Agent | 23.7 | 19.1 | — | — | 21.0 | — |
| HANDBOOK.md | 44.6 | 38.8 | — | 41.5 | 28.9 | 20.8 |
| OSWorld V2.1 | 79.6 | 80.7 | 75.8 | 81.8 | 69.3 | — |
| Business Operation (Internal) | 37.8 | 30.7 | 32.3 | — | 8.9 | 18.6 |
| DECK-Arena (Internal, Elo-score) | 1456 | — | 1423 | 1253 | 1231 | 1119 |
| Design Bench (Internal, Elo-score) | 957 | — | 1076 | 927 | 863 | 718 |
| Kimi Hallu Bench Hard w/ tools (Internal, lower is better) | 8.3 | 23.3 | 5.5 | 15.0 | 23.3 | 22.6 |
| Reasoning & Knowledge & Multimodal | ||||||
| GDP.pdf | 34.6 | 27.6 | 34.2 | 30.6 | 17.2 | 11.2 |
| HLE-Full | 51.1 | 57.6 | 53.6 | 59.8 | 42.6 | 43.0* |
| HLE-Diamond | 39.4 | 55.1 | 65.8 | 60.9 | 21.6 | 25.1* |
| GPQA-Diamond | 94.2 | 93.7 | 96.1 | 93.9 | 92.2 | 91.7 |
| CharXiv (RQ) | 89.0 | 88.8 | 90.0 | 92.1 | 77.0 | — |
| MMMU-Pro | 84.1 | 86.3 | 86.9 | 87.7 | 80.6 | — |
| ZeroBench_main (avg@5 / pass@5) | 29.8 / 39.0 | 23.0 / 35.0 | 43.2 / 52.0 | 35.0 / 43.0 | 11.8 / 23.0 | — |
| PerceptionBench | 68.3 | 63.0 | 77.6 | 72.1 | 47.7 | — |
| Kimi Hallu Bench w/o tools (Internal, lower is better) | 5.4 | 11.4 | 4.2 | 6.8 | 13.1 | 14.8 |
| Cyber Security | ||||||
| ExploitBench | 74.7 | 83.0 | 100 | 91.0 | — | 54.4 |
| ExploitGym | 20.7 | 30.4 | 42.4 | 34.5 | — | 15.0 |
| xdev-bench-hard (Internal) | 81.0 | — | — | — | 85.7 | 57.1 |
| 基准测试 | Kimi K3.1 Pro(max) | Claude Fable 5.1(max, w/ fallback) | GPT-6 Astra(max, w/ fallback) | Claude Opus 5.5(max, w/ fallback) | DeepSeek-V4.1-Flash-1017(max) | GLM-5.3(max) |
|---|---|---|---|---|---|---|
| 编码 | ||||||
| Terminal-Bench 4.0 | 65.7 | 57.9 | 58.2 | 66.4 | 42.3 | 41.8 |
| Terminal-Bench-Science 0.1 | 38.1 | 40.0 | 68.1 | 63.3 | 15.7 | 8.1 |
| SWE Marathon v1.1 | 51.7 | 45.6 | 42.5 | 46.3 | 40.0 | 42.5 |
| BenchCAD w/o tools | 72.8 | 60.6 | — | 73.0 | 41.2 | — |
| BenchCAD w/ tools | 92.7 | 92.6 | 95.9 | 96.2 | 81.6 | — |
| Program Bench | 31.5 | 53.5 | 50.0 | 65.0 | 29.1 | 19.0 |
| DeepSWE v1.1 | 75.5 | 67.4 | 74.1 | 74.2 | 77.0 | 66.9 |
| PostTrain Bench v1.2 | 36.5 | 44.6 | 41.9 | 43.8 | 30.5 | 34.5 |
| Kimi Code Bench 2.0 (Internal) | 77.1 | — | — | — | 76.1 | 61.7 |
| Kimi Code Bench 3.0 Long-horizon (Internal) | 61.2 | 58.8 | 66.5 | 58.5 | 51.5 | 45.5 |
| 智能体 | ||||||
| HLE-Full w/ tools | 70.0 | 65.6 | 57.2 | 67.7 | 58.8 | 62.5 |
| BrowseComp | 92.1 | — | 91.5 | 90.8 | — | — |
| BioMysteryBench | 80.6 | 81.6 | 78.9 | 81.9 | 80.0 | 79.6 |
| CharXiv (RQ) w/ python | 93.4 | 92.7 | 92.8 | 93.8 | 85.6 | — |
| MMMU-Pro w/ python | 90.0 | 88.4 | 87.8 | 89.8 | 82.5 | — |
| GDP.pdf w/ python | 85.7 | 83.8 | 85.5 | 83.9 | 73.0 | — |
| ChartoGraphy w/ python | 90.2 | 88.4 | 91.0 | 89.0 | 83.0 | — |
| BabyVision w/ python | 95.4 | 95.1 | 96.6 | 97.7 | 92.5 | — |
| ZeroBench_main w/ python (pass@5) | 63.0 | 59.0 | 58.0 | 61.0 | 51.0 | — |
| Agents' Last Exam (ALL) | 43.2 | — | 41.8 | 42.6 | 37.7 | 26.2 |
| Agents' Last Exam (CLI) | 44.2 | — | 44.2 | 40.7 | 36.0 | 29.4 |
| Automation Bench-AA | 73.3 | 59.4 | 68.5 | 69.5 | 66.6 | 62.2 |
| GDPval-AA v2.1 (Elo-score) | 1846 | 1754 | 1573 | 1866 | 1746 | 1650 |
| AA-Briefcase v1.1 (Elo-score) | 1678 | 1672 | 1569 | 1803 | 1570 | 1507 |
| APEX-Agents | 69.4 | 68.6 | 64.7 | 73.5 | 69.8 | 56.6 |
| OfficeQA Pro v2 | 64.4 | 54.5 | 54.4 | 62.2 | 40.4 | 31.1 |
| OfficeQA Pro | 67.4 | 68.6 | 66.2 | — | 62.4 | 58.6 |
| Frontier Finance | 58.6 | 60.8 | 45.0 | 56.7 | 54.5 | 57.5 |
| Harvey Legal Agent | 23.7 | 19.1 | — | — | 21.0 | — |
| HANDBOOK.md | 44.6 | 38.8 | — | 41.5 | 28.9 | 20.8 |
| OSWorld V2.1 | 79.6 | 80.7 | 75.8 | 81.8 | 69.3 | — |
| Business Operation (Internal) | 37.8 | 30.7 | 32.3 | — | 8.9 | 18.6 |
| DECK-Arena (Internal, Elo-score) | 1456 | — | 1423 | 1253 | 1231 | 1119 |
| Design Bench (Internal, Elo-score) | 957 | — | 1076 | 927 | 863 | 718 |
| Kimi Hallu Bench Hard w/ tools (Internal, lower is better) | 8.3 | 23.3 | 5.5 | 15.0 | 23.3 | 22.6 |
| 推理 & 知识 & 多模态 | ||||||
| GDP.pdf | 34.6 | 27.6 | 34.2 | 30.6 | 17.2 | 11.2 |
| HLE-Full | 51.1 | 57.6 | 53.6 | 59.8 | 42.6 | 43.0* |
| HLE-Diamond | 39.4 | 55.1 | 65.8 | 60.9 | 21.6 | 25.1* |
| GPQA-Diamond | 94.2 | 93.7 | 96.1 | 93.9 | 92.2 | 91.7 |
| CharXiv (RQ) | 89.0 | 88.8 | 90.0 | 92.1 | 77.0 | — |
| MMMU-Pro | 84.1 | 86.3 | 86.9 | 87.7 | 80.6 | — |
| ZeroBench_main (avg@5 / pass@5) | 29.8 / 39.0 | 23.0 / 35.0 | 43.2 / 52.0 | 35.0 / 43.0 | 11.8 / 23.0 | — |
| PerceptionBench | 68.3 | 63.0 | 77.6 | 72.1 | 47.7 | — |
| Kimi Hallu Bench w/o tools (Internal, lower is better) | 5.4 | 11.4 | 4.2 | 6.8 | 13.1 | 14.8 |
| 网络安全 | ||||||
| ExploitBench | 74.7 | 83.0 | 100 | 91.0 | — | 54.4 |
| ExploitGym | 20.7 | 30.4 | 42.4 | 34.5 | — | 15.0 |
| xdev-bench-hard (Internal) | 81.0 | — | — | — | 85.7 | 57.1 |
Evaluation Footnotes
评估脚注
Coding benchmarks
编码基准测试
- Terminal-Bench 4.0. Kimi K3.1 Pro is evaluated with the Claude Code harness. The DeepSeek-V4.1-Flash-1017 score is taken from its release blog. All remaining scores are the maximum values reported in model blog posts or on the official Terminal-Bench leaderboard.
- Terminal-Bench-Science 0.1. Kimi K3.1 Pro is evaluated with Claude Code. Internal evaluation of DeepSeek-V4.1-Flash-1017 yields 9.3; the table instead reports 15.7 for the older DeepSeek-V4.1-Flash from the official leaderboard. All remaining scores are from the Terminal-Bench-Science leaderboard.
- SWE-Marathon v1.1. Kimi K3.1 Pro and DeepSeek-V4.1-Flash-1017 are evaluated with Claude Code. Other scores are from the official leaderboard.
- ProgramBench. The table reports binary scores: a task receives 1 if its ProgramBench score is at least 95%, and 0 otherwise. K3.1 Pro is evaluated with Claude Code. DeepSeek and GLM scores are taken from the DeepSeek release blog; remaining scores are from Vals AI.
- DeepSWE v1.1. K3.1 Pro is evaluated with Claude Code. Other scores come from the respective technical reports for GPT-6 Astra, Claude Opus 5.5, Claude Fable 5.1, DeepSeek-V4.1-Flash-1017, and GLM-5.3.
- PostTrainBench. K3.1 Pro and DeepSeek-V4.1-Flash-1017 are evaluated internally on v1.2 with Claude Code and H20 GPUs rather than H100 GPUs. For stable evaluation, all judge models use DeepSeek-V4.1-Flash-1017 at maximum effort, which best matched the official GPT-5.6-Terra (xhigh) judge in testing. Other scores are from the official leaderboard.
- Kimi Code Bench 2.0 and Kimi Code Bench 3.0 Long-horizon. These are internal benchmarks. K3.1 Pro is evaluated with Claude Code; all other models use their maximum-effort setting. Proprietary-model testing may involve fallback behavior.
- BenchCAD. Open models are evaluated on 1,000-case subsets randomly sampled from the 17,900-case Vision2Code dataset at maximum reasoning effort. With-tools results use Claude Code; without-tools results use single-shot generation with official prompts and scoring. Claude scores are from the Opus 5.5 System Card, and GPT-6 Astra's with-tools score is from its official report. GPT-6 Astra has no reported without-tools score.
- Terminal-Bench 4.0。Kimi K3.1 Pro 使用 Claude Code 进行评估。DeepSeek-V4.1-Flash-1017 的分数来自其发布博客。其余所有分数均为模型官方博客或官方 Terminal-Bench 排行榜中报告的最高值。
- Terminal-Bench-Science 0.1。Kimi K3.1 Pro 使用 Claude Code 进行评估。DeepSeek-V4.1-Flash-1017 的内部评估结果为 9.3;表中报告的是来自官方排行榜的旧版 DeepSeek-V4.1-Flash 的分数 15.7。其余所有分数均来自 Terminal-Bench-Science 排行榜。
- SWE-Marathon v1.1。Kimi K3.1 Pro 和 DeepSeek-V4.1-Flash-1017 使用 Claude Code 进行评估。其他分数来自官方排行榜。
- ProgramBench。表中报告的是二元分数:若任务的 ProgramBench 分数至少达到 95%,则记为 1,否则为 0。K3.1 Pro 使用 Claude Code 进行评估。DeepSeek 和 GLM 的分数来自 DeepSeek 发布博客;其余分数来自 Vals AI。
- DeepSWE v1.1。K3.1 Pro 使用 Claude Code 进行评估。其他分数分别来自 GPT-6 Astra、Claude Opus 5.5、Claude Fable 5.1、DeepSeek-V4.1-Flash-1017 和 GLM-5.3 的相关技术报告。
- PostTrainBench。K3.1 Pro 和 DeepSeek-V4.1-Flash-1017 在 v1.2 版本上使用 Claude Code 和 H20 GPU(而非 H100 GPU)进行内部评估。为确保评估稳定性,所有裁判模型均以最大努力运行 DeepSeek-V4.1-Flash-1017,该设置在测试中与官方 GPT-5.6-Terra (xhigh) 裁判最为匹配。其他分数来自官方排行榜。
- Kimi Code Bench 2.0 和 Kimi Code Bench 3.0 Long-horizon。这些是内部基准测试。K3.1 Pro 使用 Claude Code 进行评估;所有其他模型均使用其最大努力设置。专有模型的测试可能涉及回退行为。
- BenchCAD。开源模型在从 17,900 例 Vision2Code 数据集中随机采样的 1,000 例子集上以最大推理能力进行评估。带工具(with-tools)结果使用 Claude Code;不带工具(without-tools)结果使用官方提示词和评分标准进行单次生成。Claude 的分数来自 Opus 5.5 系统卡片,GPT-6 Astra 的带工具分数来自其官方报告。GPT-6 Astra 未报告不带工具的分数。
Agentic benchmarks
智能体基准测试
- BioMysteryBench. Uses the official v11 release, with Kimi K3 as judge. K3.1 Pro uses Kimi Code; GLM-5.3 and DeepSeek-V4.1-Flash-1017 use Claude Code; GPT-6 Astra uses Codex. Claude scores are from official system cards.
- Agents' Last Exam. Uses the official v1.1 release, comprising 122 tasks, including 86 CLI tasks. Runs that bypass stated requirements receive zero. DeepSeek and Kimi are evaluated with Claude Code and Kimi Code, respectively; other results are from the official benchmark website.
- BioMysteryBench。使用官方 v11 版本,以 Kimi K3 作为裁判。K3.1 Pro 使用 Kimi Code;GLM-5.3 和 DeepSeek-V4.1-Flash-1017 使用 Claude Code;GPT-6 Astra 使用 Codex。Claude 的分数来自官方系统卡片。
- 智能体最终考试。采用官方 v1.1 版本,包含 122 项任务,其中包括 86 项 CLI 任务。未能满足规定要求的运行结果得零分。DeepSeek 和 Kimi 分别使用 Claude Code 和 Kimi Code 进行评估;其他结果来自官方基准测试网站。
更进一步:量化金融体系
看懂新闻只是起点——沿量化金融路径,把它变成能交付的工程能力