Meta发布816B开源模型Muse Spark Open
Unsloth Muse Spark Open is out!
Meta重磅开源旗舰级Agentic模型,816B参数规模与原生多模态能力极具行业影响力,值得开发者重点关注。
Read our How to Run Muse Spark Open Guide!
阅读我们的《如何运行 Muse Spark Open》指南!
See Unsloth Dynamic 3.0 GGUFs for our quantization benchmarks.
查看 Unsloth Dynamic 3.0 GGUFs 以了解我们的量化基准测试。
Muse Spark Open Model Card
Muse Spark Open 模型卡片
Authors: Meta Superintelligence Labs
作者:Meta Superintelligence Labs
Model Release Date: October 2026
模型发布日期:2026年10月
License: Muse Model License
许可证:Muse Model License
Muse Spark Open is an 816B total/42B active parameter open weights model with a context window of 1M tokens. Built for coding and agentic work, Muse Spark Open is natively multimodal. This open weights version has additional safety post-training to make it more robust against misuse as a standalone model without system guardrails. We recommend deploying Muse Spark Open as part of a broader AI system, with additional guardrails suited to the specific use case.
Muse Spark Open 是一个拥有816B总参数/42B活跃参数的开源权重模型,上下文窗口为1M tokens。该模型专为编码和智能体(agentic)工作而构建,原生支持多模态。此开源权重版本经过额外的安全后训练,使其作为独立模型在没有系统护栏的情况下更能抵御误用。我们建议将 Muse Spark Open 作为更广泛 AI 系统的一部分进行部署,并配备针对特定用例的额外护栏。
The model can perform well across a wide variety of use cases including:
该模型在多种用例中均能表现出色,包括:
- Multi-Step Reasoning - chains reasoning over long horizons, sustaining coherent plans across complex, extended workflows.
- End to End Agentic Task Completion - multi-step planning, sequential tool invocation, failure recovery, and long-horizon task execution, working within scaffolds, write and debug code, and resolve multi-turn requests from start to finish.
- Coding Agents - writing, debugging, and resolving real-world software engineering tasks.
- Tool Use - tool invocation across extended multi-turn workflows, diagnosing error and retrying with tool call failures
- Multimodal Reasoning - interpreting screenshots, charts, documents, images, audio and video recordings, alongside conversation for agentic and information-rich environments.
- Synthetic Data Generation - generating high-quality training data for downstream model development.
- LLM-as-a-judge Evaluation - serving as an evaluator for other models' outputs.
- 多步推理 - 在长周期内链式推理,在复杂、长期的工作流程中保持连贯的计划。
- 端到端智能体任务完成 - 多步规划、顺序工具调用、失败恢复以及长周期任务执行,能够在脚手架内工作,编写和调试代码,并从头到尾解决多轮请求。
- 编码智能体 - 编写、调试并解决现实世界的软件工程任务。
- 工具使用 - 在扩展的多轮工作流程中进行工具调用,诊断错误并在工具调用失败时重试。
- 多模态推理 - 结合对话,解释截图、图表、文档、图像、音频和视频录制内容,适用于智能体和信息丰富的环境。
- 合成数据生成 - 为下游模型开发生成高质量的训练数据。
- LLM-as-a-judge 评估 - 作为其他模型输出的评估者。
Muse Spark Open Model Overview
Muse Spark Open 模型概览
| Name | Muse Spark Open |
|---|---|
| Model Provider | Meta Platforms, Inc. or Meta Platforms Ireland Limited |
| Date of Release | October 15th, 2026 |
| License | Muse Model License |
| Parameters | 816B total / 42B active |
| Type | Mixture-of-Experts Transformer, with Perception Encoder |
| Context Length | 1M at inference |
| Vocabulary Size | 202,048 |
| Modalities | Input: Text + Image + Video + Audio / Output: Text |
| Languages | Multilingual, trained on data from more than 100 languages |
| Recommended inference parameters | Temperature = 1.0 Top_p = 1.0 Top_k = disabled It is recommended to use Reasoning Effort of high or xhigh for complex problem solving, coding, and agentic tasks. |
| Language Model | Hidden Dimension: 8192 Token Embedding: untied input/output embeddings, vocab × dim = 202,048 × 8192 ≈ ~1.66B Output layer (unembedding layer): vocab × dim = 202,048 × 8192 ≈ ~1.66B Number of Layers: 62 Gated Attention: Yes (output gate and output norm on the attention block; QK-norm enabled) Number of Attention Heads: 128 for Q and 16 for KV (grouped-query attention) Head Dimension: 64 Mixture of Experts: Yes Number of Experts: 256 Experts Activated per Token: 8 (top-k routing) |
| Perception Encoder | Architecture: 1.8B param, 50 layers, 1536 hidden dim, 16 heads, 14x14 patch size, 4096 output dim Learned Absolute + 2D RoPE for positional embedding, LayerNorm + GELU for FFN Sparse attention with factor 4 (every 4th + last layer are full attention) |
| 名称 | Muse Spark Open |
|---|---|
| 模型提供方 | Meta Platforms, Inc. 或 Meta Platforms Ireland Limited |
| 发布日期 | 2026年10月15日 |
| 许可证 | Muse Model License |
| 参数量 | 总计 816B / 激活 42B |
| 类型 | 混合专家(MoE)Transformer,带有感知编码器 |
| 上下文长度 | 推理时支持 1M |
| 词汇表大小 | 202,048 |
| 模态 | 输入:文本 + 图像 + 视频 + 音频 / 输出:文本 |
| 语言 | 多语言,使用超过 100 种语言的数据进行训练 |
| 推荐的推理参数 | Temperature = 1.0 Top_p = 1.0 Top_k = 禁用 |
| 对于复杂问题解决、编码和智能体任务,建议使用高(high)或极高(xhigh)的推理努力程度。 | |
| 语言模型 | 隐藏层维度:8192 |
| 词嵌入:未绑定的输入/输出嵌入,vocab × dim = 202,048 × 8192 ≈ ~1.66B | |
| 输出层(解嵌入层):vocab × dim = 202,048 × 8192 ≈ ~1.66B | |
| 层数:62 | |
| 门控注意力:是(注意力块包含输出门和输出归一化;启用 QK-norm) | |
| 注意力头数:Q 为 128,KV 为 16(分组查询注意力) | |
| 头维度:64 | |
| 混合专家:是 | |
| 专家总数:256 | |
| 每 token 激活的专家数:8(基于 top-k 路由) | |
| 感知编码器 | 架构:1.8B 参数,50 层,1536 隐藏维度,16 个头,14x14 补丁大小,4096 输出维度 |
| 位置嵌入采用学习到的绝对位置 + 2D RoPE,前馈网络采用 LayerNorm + GELU | |
| 稀疏注意力因子为 4(每第 4 层及最后一层为全注意力) |
Model Access and Best Practices
模型访问与最佳实践
Access via API
通过 API 访问
The model is available via API through third party inference providers.
该模型可通过第三方推理提供商以 API 形式提供。
Open Weights on your own system
在自有系统上使用开放权重
The weights are available for download through Hugging Face. The model is available in BF16 and NVFP4 versions. To run on your own system, the model requires a GPU with at least 700GB of VRAM for NVFP4 and 2TB for BF16. It also requires an inference deployment framework - supported frameworks are SGLang, vLLM, Hugging Face, TensorRT-LLM, Unsloth and Llama.cpp. It is also optimized to run on two Mac Studios with M5 Ultra using MLX.
权重可通过 Hugging Face 下载。模型提供 BF16 和 NVFP4 版本。要在自有系统上运行,模型需要至少 700GB VRAM 的 GPU(用于 NVFP4)或 2TB VRAM(用于 BF16)。还需要一个推理部署框架——支持的框架包括 SGLang、vLLM、Hugging Face、TensorRT-LLM、Unsloth 和 Llama.cpp。此外,该模型已针对使用 MLX 在两台搭载 M5 Ultra 芯片的 Mac Studio 上运行进行了优化。
Please see the developer documentation for more information on how to deploy and use the model.
请参阅开发者文档,了解有关如何部署和使用模型的更多信息。
Inference Parameters
推理参数
You can customize inference parameters to achieve the best performance for your use case.
您可以自定义推理参数,以实现最适合您用例的最佳性能。
- Reasoning Effort: Reasoning effort controls how much the model thinks before it responds. Set it with the reasoning_effort request parameter, or with chat_template_kwargs={"reasoning_effort": ...}, to low, medium, high, or xhigh. The default is xhigh. Use high or xhigh for complex problem solving, coding, and agentic tasks, and low or medium for faster, shorter responses. Any other value returns an error.
- Sampling Parameters: The following settings are recommended for most deployments: temperature = 1.0, top_p = 1.0, top_k = disabled
- 推理努力程度:推理努力程度控制模型在响应前进行思考的深度。可通过 reasoning_effort 请求参数或 chat_template_kwargs={"reasoning_effort": ...} 设置为 low、medium、high 或 xhigh。默认值为 xhigh。对于复杂问题解决、编码和智能体任务,请使用 high 或 xhigh;对于需要更快、更短响应的场景,请使用 low 或 medium。其他任何值将返回错误。
- 采样参数:大多数部署推荐以下设置:temperature = 1.0,top_p = 1.0,top_k = disabled
Training data
训练数据
Training data includes text, images, audio, and video. It includes data drawn from public sources, crawled from the Internet, acquired from third parties, derived from Meta’s products and services, and synthetically generated, curated and enriched by external vendor networks and Meta personnel. Data curation methodologies include cleaning, processing, modifying, deduplication, and filtering, among others.
训练数据包括文本、图像、音频和视频。数据来源涵盖公共来源、互联网爬取、第三方获取、源自 Meta 的产品和服务,以及由外部供应商网络和 Meta 人员合成生成、策展和丰富处理的数据。数据策展方法包括清洗、处理、修改、去重和过滤等。
Benchmarks
基准测试
We compare Muse Spark Open to other leading open-weight models of similar size and architecture. For Muse Spark Open we use xhigh reasoning effort, temperature = 1.0, top_p=1.0, top_k=disabled across benchmarks.
我们将 Muse Spark Open 与同等规模和架构的其他领先开源权重模型进行比较。在所有基准测试中,我们对 Muse Spark Open 使用 xhigh 推理努力程度,temperature = 1.0,top_p=1.0,top_k=disabled。
| Benchmark | Muse Spark Open (xhigh) | Inkling (xhigh) | Nemotron 3 Ultra (thinking on) | Beam | Mistral Large 4 | Qwen3.8-2.4T-A95B (xhigh) | GLM 5.3 (max) | Kimi K3 (max) |
|---|---|---|---|---|---|---|---|---|
| General | ||||||||
| Artificial Analysis Intelligence Index | 39 | 26 | 23 | - | 38 | 40 | 45 | 44 |
| Agentic | ||||||||
| JobBench | 61.8 | 31.1 | 27.2 | - | - | 52.7 | 61.4 | 54.3 |
| MCP-Atlas | 89.2 | 76.0 | 63.1 | 78.7 | - | 84.5 | 84.2 | 82.3 |
| GDPVal-AA v2 | 1401 | 1079 | 1016 | - | 1424 | 1613 | 1653 | 1537 |
| OSWorld Verified | 80.4 | 40.1 | - | - | - | - | - | 84.8 |
| Toolathlon Verified | 72.8 | 45.5 | 34.3 | - | - | 72.5 | 73.0 | 76.5 |
| Knowledge & Reasoning | ||||||||
| HLE-Diamond (no tools) | 26.1 | 11.2 | 8.9 | - | - | 17.3 | 16.4 | 22.2 |
| AA Omniscience | 25 | 2 | 0 | 13 | -5 | 4 | 14 | 20 |
| SciCode | 58.5 | 47.0 | 40.3 | 49.7 | 54.2 | 54.1 | 59.0 | 59.5 |
| HLE (w/ tools) | 61.0 | 46.0 | 37.4 | 51.2 | - | 56.2 | 62.5 | 56.0 |
| GPQA Diamond | 89.0 | 87.2 | 86.7 | 90.5 | - | 93.5 | 91.7 | 93.5 |
| Coding | ||||||||
| DeepSWE 1.1 Preferred harness | 60 | - | - | 44 | 62 | 57 | 67 | 68 |
| SWE-Atlas-QnA Preferred harness | 58 | - | - | 35 | 59 | 62 | 59 | 66 |
| Terminal-Bench 2.1 Terminus 2 agent | 76.4 | 55.1 | 53.9 | 80.1 | - | 82.0 | 83.9 | 85.0 |
| Multimodal | ||||||||
| ZeroBench (w/ tools) | 50.0 | 14.0 | - | - | - | - | - | 41.0 |
| BabyVision (w/ tools) | 80.2 | 34.2 | - | - | - | - | - | 85.7 |
| SimpleVQA (w/ tools) | 73.6 | 52.3 | - | - | - | - | - | 71.9 |
| WorldVQA (w/ tools) | 49.4 | 18.0 | - | - | - | - | - | 51.0 |
| IntPhys2 | 68.3 | 55.2 | - | - | - | - | - | 60.3 |
| VideoMMEv2 | 61.5 | 36.9 | - | - | - | - | - | 65.4 |
| Safety | ||||||||
| FORTRESS adversarial (static) lower is better | ARS: 5.8 ORS: 17.4 | ARS: 25.0 ORS: 7.4 | ARS: 26.4 ORS: 13.3 | - | - | ARS: 21.6 ORS: 12.8 | ARS: 28.2 ORS: 3.2 | ARS: 26.7 ORS: 2.7 |
| StrongREJECT v2 (adaptive) lower is better | 0.5 | 86.4 | 80.7 | - | - | 65.6 | 62.9 | 66.6 |
| 基准测试 | Muse Spark Open (xhigh) | Inkling (xhigh) | Nemotron 3 Ultra (thinking on) | Beam | Mistral Large 4 | Qwen3.8-2.4T-A95B (xhigh) | GLM 5.3 (max) | Kimi K3 (max) |
|---|---|---|---|---|---|---|---|---|
| 通用能力 | ||||||||
| Artificial Analysis 智能指数 | 39 | 26 | 23 | - | 38 | 40 | 45 | 44 |
| 智能体能力 | ||||||||
| JobBench | 61.8 | 31.1 | 27.2 | - | - | 52.7 | 61.4 | 54.3 |
| MCP-Atlas | 89.2 | 76.0 | 63.1 | 78.7 | - | 84.5 | 84.2 | 82.3 |
| GDPVal-AA v2 | 1401 | 1079 | 1016 | - | 1424 | 1613 | 1653 | 1537 |
| OSWorld Verified | 80.4 | 40.1 | - | - | - | - | - | 84.8 |
| Toolathlon Verified | 72.8 | 45.5 | 34.3 | - | - | 72.5 | 73.0 | 76.5 |
| 知识 & 推理 | ||||||||
| HLE-Diamond (no tools) | 26.1 | 11.2 | 8.9 | - | - | 17.3 | 16.4 | 22.2 |
| AA Omniscience | 25 | 2 | 0 | 13 | -5 | 4 | 14 | 20 |
| SciCode | 58.5 | 47.0 | 40.3 | 49.7 | 54.2 | 54.1 | 59.0 | 59.5 |
| HLE (w/ tools) | 61.0 | 46.0 | 37.4 | 51.2 | - | 56.2 | 62.5 | 56.0 |
| GPQA Diamond | 89.0 | 87.2 | 86.7 | 90.5 | - | 93.5 | 91.7 | 93.5 |
| 编程 | ||||||||
| DeepSWE 1.1 Preferred harness | 60 | - | - | 44 | 62 | 57 | 67 | 68 |
| SWE-Atlas-QnA Preferred harness | 58 | - | - | 35 | 59 | 62 | 59 | 66 |
| Terminal-Bench 2.1 Terminus 2 agent | 76.4 | 55.1 | 53.9 | 80.1 | - | 82.0 | 83.9 | 85.0 |
| 多模态 | ||||||||
| ZeroBench (w/ tools) | 50.0 | 14.0 | - | - | - | - | - | 41.0 |
| BabyVision (w/ tools) | 80.2 | 34.2 | - | - | - | - | - | 85.7 |
| SimpleVQA (w/ tools) | 73.6 | 52.3 | - | - | - | - | - | 71.9 |
| WorldVQA (w/ tools) | 49.4 | 18.0 | - | - | - | - | - | 51.0 |
| IntPhys2 | 68.3 | 55.2 | - | - | - | - | - | 60.3 |
| VideoMMEv2 | 61.5 | 36.9 | - | - | - | - | - | 65.4 |
| 安全性 | ||||||||
| FORTRESS adversarial (static) lower is better | ARS: 5.8 ORS: 17.4 | ARS: 25.0 ORS: 7.4 | ARS: 26.4 ORS: 13.3 | - | - | ARS: 21.6 ORS: 12.8 | ARS: 28.2 ORS: 3.2 | ARS: 26.7 ORS: 2.7 |
| StrongREJECT v2 (adaptive) lower is better | 0.5 | 86.4 | 80.7 | - | - | 65.6 | 62.9 | 66.6 |
For more details about our evaluations, see our report.
有关我们评估的更多详情,请参阅我们的报告。
Safety and Preparedness
安全性与准备情况
We strongly recommend deploying Muse Spark Open as part of an AI system with guardrails tailored to your intended use cases. These system-level protections should balance helpfulness and safety and address safety and security risks, including those arising from integration with external tools.
我们强烈建议将 Muse Spark Open 作为 AI 系统的一部分进行部署,并针对您的预期用例定制护栏(guardrails)。这些系统级保护措施应平衡有用性与安全性,并解决安全与安全风险,包括由与外部工具集成所带来的风险。
Muse Spark Open has been evaluated across four complementary safety areas, and met our safety criteria for release based on model evaluations and an assessment of residual risks:
Muse Spark Open 已在四个互补的安全性领域进行了评估,并根据模型评估和剩余风险评估结果,满足了我们的发布安全标准:
- Content safety: Harmful-content generation and refusal behavior, alongside response quality and ideological balance.
- Agentic risk: Harmful or unauthorized actions when using tools or acting on users' behalf, including unsafe code execution and destructive changes in coding-agent workflows.
- 内容安全:有害内容生成与拒绝行为,以及响应质量和意识形态平衡。
- 智能体风险:在使用工具或代表用户行动时产生的有害或未授权行为,包括不安全的代码执行和编码智能体工作流中的破坏性变更。
更进一步:量化金融体系
看懂新闻只是起点——沿量化金融路径,把它变成能交付的工程能力