跳到主内容
@wquguru
精选90r/LocalLLaMA(Reddit)模型发布/更新多源精选 ×8

Meta发布816B开源模型Muse Spark Open

Unsloth Muse Spark Open is out!

原文
发到 X
推荐理由

Meta重磅开源旗舰级Agentic模型,816B参数规模与原生多模态能力极具行业影响力,值得开发者重点关注。

Read our How to Run Muse Spark Open Guide!

阅读我们的《如何运行 Muse Spark Open》指南!

See Unsloth Dynamic 3.0 GGUFs for our quantization benchmarks.

查看 Unsloth Dynamic 3.0 GGUFs 以了解我们的量化基准测试。

Muse Spark Open Model Card

Muse Spark Open 模型卡片

Authors: Meta Superintelligence Labs

作者:Meta Superintelligence Labs

Model Release Date: October 2026

模型发布日期:2026年10月

License: Muse Model License

许可证:Muse Model License

Muse Spark Open is an 816B total/42B active parameter open weights model with a context window of 1M tokens. Built for coding and agentic work, Muse Spark Open is natively multimodal. This open weights version has additional safety post-training to make it more robust against misuse as a standalone model without system guardrails. We recommend deploying Muse Spark Open as part of a broader AI system, with additional guardrails suited to the specific use case.

Muse Spark Open 是一个拥有816B总参数/42B活跃参数的开源权重模型,上下文窗口为1M tokens。该模型专为编码和智能体(agentic)工作而构建,原生支持多模态。此开源权重版本经过额外的安全后训练,使其作为独立模型在没有系统护栏的情况下更能抵御误用。我们建议将 Muse Spark Open 作为更广泛 AI 系统的一部分进行部署,并配备针对特定用例的额外护栏。

The model can perform well across a wide variety of use cases including:

该模型在多种用例中均能表现出色,包括:

  • Multi-Step Reasoning - chains reasoning over long horizons, sustaining coherent plans across complex, extended workflows.
  • End to End Agentic Task Completion - multi-step planning, sequential tool invocation, failure recovery, and long-horizon task execution, working within scaffolds, write and debug code, and resolve multi-turn requests from start to finish.
  • Coding Agents - writing, debugging, and resolving real-world software engineering tasks.
  • Tool Use - tool invocation across extended multi-turn workflows, diagnosing error and retrying with tool call failures
  • Multimodal Reasoning - interpreting screenshots, charts, documents, images, audio and video recordings, alongside conversation for agentic and information-rich environments.
  • Synthetic Data Generation - generating high-quality training data for downstream model development.
  • LLM-as-a-judge Evaluation - serving as an evaluator for other models' outputs.
  • 多步推理 - 在长周期内链式推理,在复杂、长期的工作流程中保持连贯的计划。
  • 端到端智能体任务完成 - 多步规划、顺序工具调用、失败恢复以及长周期任务执行,能够在脚手架内工作,编写和调试代码,并从头到尾解决多轮请求。
  • 编码智能体 - 编写、调试并解决现实世界的软件工程任务。
  • 工具使用 - 在扩展的多轮工作流程中进行工具调用,诊断错误并在工具调用失败时重试。
  • 多模态推理 - 结合对话,解释截图、图表、文档、图像、音频和视频录制内容,适用于智能体和信息丰富的环境。
  • 合成数据生成 - 为下游模型开发生成高质量的训练数据。
  • LLM-as-a-judge 评估 - 作为其他模型输出的评估者。

Muse Spark Open Model Overview

Muse Spark Open 模型概览

NameMuse Spark Open
Model ProviderMeta Platforms, Inc. or Meta Platforms Ireland Limited
Date of ReleaseOctober 15th, 2026
LicenseMuse Model License
Parameters816B total / 42B active
TypeMixture-of-Experts Transformer, with Perception Encoder
Context Length1M at inference
Vocabulary Size202,048
ModalitiesInput: Text + Image + Video + Audio / Output: Text
LanguagesMultilingual, trained on data from more than 100 languages
Recommended inference parametersTemperature = 1.0 Top_p = 1.0 Top_k = disabled It is recommended to use Reasoning Effort of high or xhigh for complex problem solving, coding, and agentic tasks.
Language ModelHidden Dimension: 8192 Token Embedding: untied input/output embeddings, vocab × dim = 202,048 × 8192 ≈ ~1.66B Output layer (unembedding layer): vocab × dim = 202,048 × 8192 ≈ ~1.66B Number of Layers: 62 Gated Attention: Yes (output gate and output norm on the attention block; QK-norm enabled) Number of Attention Heads: 128 for Q and 16 for KV (grouped-query attention) Head Dimension: 64 Mixture of Experts: Yes Number of Experts: 256 Experts Activated per Token: 8 (top-k routing)
Perception EncoderArchitecture: 1.8B param, 50 layers, 1536 hidden dim, 16 heads, 14x14 patch size, 4096 output dim Learned Absolute + 2D RoPE for positional embedding, LayerNorm + GELU for FFN Sparse attention with factor 4 (every 4th + last layer are full attention)
名称Muse Spark Open
模型提供方Meta Platforms, Inc. 或 Meta Platforms Ireland Limited
发布日期2026年10月15日
许可证Muse Model License
参数量总计 816B / 激活 42B
类型混合专家(MoE)Transformer,带有感知编码器
上下文长度推理时支持 1M
词汇表大小202,048
模态输入:文本 + 图像 + 视频 + 音频 / 输出:文本
语言多语言,使用超过 100 种语言的数据进行训练
推荐的推理参数Temperature = 1.0 Top_p = 1.0 Top_k = 禁用
对于复杂问题解决、编码和智能体任务,建议使用高(high)或极高(xhigh)的推理努力程度。
语言模型隐藏层维度:8192
词嵌入:未绑定的输入/输出嵌入,vocab × dim = 202,048 × 8192 ≈ ~1.66B
输出层(解嵌入层):vocab × dim = 202,048 × 8192 ≈ ~1.66B
层数:62
门控注意力:是(注意力块包含输出门和输出归一化;启用 QK-norm)
注意力头数:Q 为 128,KV 为 16(分组查询注意力)
头维度:64
混合专家:是
专家总数:256
每 token 激活的专家数:8(基于 top-k 路由)
感知编码器架构:1.8B 参数,50 层,1536 隐藏维度,16 个头,14x14 补丁大小,4096 输出维度
位置嵌入采用学习到的绝对位置 + 2D RoPE,前馈网络采用 LayerNorm + GELU
稀疏注意力因子为 4(每第 4 层及最后一层为全注意力)

Model Access and Best Practices

模型访问与最佳实践

Access via API

通过 API 访问

The model is available via API through third party inference providers.

该模型可通过第三方推理提供商以 API 形式提供。

Open Weights on your own system

在自有系统上使用开放权重

The weights are available for download through Hugging Face. The model is available in BF16 and NVFP4 versions. To run on your own system, the model requires a GPU with at least 700GB of VRAM for NVFP4 and 2TB for BF16. It also requires an inference deployment framework - supported frameworks are SGLang, vLLM, Hugging Face, TensorRT-LLM, Unsloth and Llama.cpp. It is also optimized to run on two Mac Studios with M5 Ultra using MLX.

权重可通过 Hugging Face 下载。模型提供 BF16 和 NVFP4 版本。要在自有系统上运行,模型需要至少 700GB VRAM 的 GPU(用于 NVFP4)或 2TB VRAM(用于 BF16)。还需要一个推理部署框架——支持的框架包括 SGLang、vLLM、Hugging Face、TensorRT-LLM、Unsloth 和 Llama.cpp。此外,该模型已针对使用 MLX 在两台搭载 M5 Ultra 芯片的 Mac Studio 上运行进行了优化。

Please see the developer documentation for more information on how to deploy and use the model.

请参阅开发者文档,了解有关如何部署和使用模型的更多信息。

Inference Parameters

推理参数

You can customize inference parameters to achieve the best performance for your use case.

您可以自定义推理参数,以实现最适合您用例的最佳性能。

  • Reasoning Effort: Reasoning effort controls how much the model thinks before it responds. Set it with the reasoning_effort request parameter, or with chat_template_kwargs={"reasoning_effort": ...}, to low, medium, high, or xhigh. The default is xhigh. Use high or xhigh for complex problem solving, coding, and agentic tasks, and low or medium for faster, shorter responses. Any other value returns an error.
  • Sampling Parameters: The following settings are recommended for most deployments: temperature = 1.0, top_p = 1.0, top_k = disabled
  • 推理努力程度:推理努力程度控制模型在响应前进行思考的深度。可通过 reasoning_effort 请求参数或 chat_template_kwargs={"reasoning_effort": ...} 设置为 low、medium、high 或 xhigh。默认值为 xhigh。对于复杂问题解决、编码和智能体任务,请使用 high 或 xhigh;对于需要更快、更短响应的场景,请使用 low 或 medium。其他任何值将返回错误。
  • 采样参数:大多数部署推荐以下设置:temperature = 1.0,top_p = 1.0,top_k = disabled

Training data

训练数据

Training data includes text, images, audio, and video. It includes data drawn from public sources, crawled from the Internet, acquired from third parties, derived from Meta’s products and services, and synthetically generated, curated and enriched by external vendor networks and Meta personnel. Data curation methodologies include cleaning, processing, modifying, deduplication, and filtering, among others.

训练数据包括文本、图像、音频和视频。数据来源涵盖公共来源、互联网爬取、第三方获取、源自 Meta 的产品和服务,以及由外部供应商网络和 Meta 人员合成生成、策展和丰富处理的数据。数据策展方法包括清洗、处理、修改、去重和过滤等。

Benchmarks

基准测试

We compare Muse Spark Open to other leading open-weight models of similar size and architecture. For Muse Spark Open we use xhigh reasoning effort, temperature = 1.0, top_p=1.0, top_k=disabled across benchmarks.

我们将 Muse Spark Open 与同等规模和架构的其他领先开源权重模型进行比较。在所有基准测试中,我们对 Muse Spark Open 使用 xhigh 推理努力程度,temperature = 1.0,top_p=1.0,top_k=disabled。

BenchmarkMuse Spark Open (xhigh)Inkling (xhigh)Nemotron 3 Ultra (thinking on)BeamMistral Large 4Qwen3.8-2.4T-A95B (xhigh)GLM 5.3 (max)Kimi K3 (max)
General
Artificial Analysis Intelligence Index392623-38404544
Agentic
JobBench61.831.127.2--52.761.454.3
MCP-Atlas89.276.063.178.7-84.584.282.3
GDPVal-AA v2140110791016-1424161316531537
OSWorld Verified80.440.1-----84.8
Toolathlon Verified72.845.534.3--72.573.076.5
Knowledge & Reasoning
HLE-Diamond (no tools)26.111.28.9--17.316.422.2
AA Omniscience252013-541420
SciCode58.547.040.349.754.254.159.059.5
HLE (w/ tools)61.046.037.451.2-56.262.556.0
GPQA Diamond89.087.286.790.5-93.591.793.5
Coding
DeepSWE 1.1 Preferred harness60--4462576768
SWE-Atlas-QnA Preferred harness58--3559625966
Terminal-Bench 2.1 Terminus 2 agent76.455.153.980.1-82.083.985.0
Multimodal
ZeroBench (w/ tools)50.014.0-----41.0
BabyVision (w/ tools)80.234.2-----85.7
SimpleVQA (w/ tools)73.652.3-----71.9
WorldVQA (w/ tools)49.418.0-----51.0
IntPhys268.355.2-----60.3
VideoMMEv261.536.9-----65.4
Safety
FORTRESS adversarial (static) lower is betterARS: 5.8 ORS: 17.4ARS: 25.0 ORS: 7.4ARS: 26.4 ORS: 13.3--ARS: 21.6 ORS: 12.8ARS: 28.2 ORS: 3.2ARS: 26.7 ORS: 2.7
StrongREJECT v2 (adaptive) lower is better0.586.480.7--65.662.966.6
基准测试Muse Spark Open (xhigh)Inkling (xhigh)Nemotron 3 Ultra (thinking on)BeamMistral Large 4Qwen3.8-2.4T-A95B (xhigh)GLM 5.3 (max)Kimi K3 (max)
通用能力
Artificial Analysis 智能指数392623-38404544
智能体能力
JobBench61.831.127.2--52.761.454.3
MCP-Atlas89.276.063.178.7-84.584.282.3
GDPVal-AA v2140110791016-1424161316531537
OSWorld Verified80.440.1-----84.8
Toolathlon Verified72.845.534.3--72.573.076.5
知识 & 推理
HLE-Diamond (no tools)26.111.28.9--17.316.422.2
AA Omniscience252013-541420
SciCode58.547.040.349.754.254.159.059.5
HLE (w/ tools)61.046.037.451.2-56.262.556.0
GPQA Diamond89.087.286.790.5-93.591.793.5
编程
DeepSWE 1.1 Preferred harness60--4462576768
SWE-Atlas-QnA Preferred harness58--3559625966
Terminal-Bench 2.1 Terminus 2 agent76.455.153.980.1-82.083.985.0
多模态
ZeroBench (w/ tools)50.014.0-----41.0
BabyVision (w/ tools)80.234.2-----85.7
SimpleVQA (w/ tools)73.652.3-----71.9
WorldVQA (w/ tools)49.418.0-----51.0
IntPhys268.355.2-----60.3
VideoMMEv261.536.9-----65.4
安全性
FORTRESS adversarial (static) lower is betterARS: 5.8 ORS: 17.4ARS: 25.0 ORS: 7.4ARS: 26.4 ORS: 13.3--ARS: 21.6 ORS: 12.8ARS: 28.2 ORS: 3.2ARS: 26.7 ORS: 2.7
StrongREJECT v2 (adaptive) lower is better0.586.480.7--65.662.966.6

For more details about our evaluations, see our report.

有关我们评估的更多详情,请参阅我们的报告。

Safety and Preparedness

安全性与准备情况

We strongly recommend deploying Muse Spark Open as part of an AI system with guardrails tailored to your intended use cases. These system-level protections should balance helpfulness and safety and address safety and security risks, including those arising from integration with external tools.

我们强烈建议将 Muse Spark Open 作为 AI 系统的一部分进行部署,并针对您的预期用例定制护栏(guardrails)。这些系统级保护措施应平衡有用性与安全性,并解决安全与安全风险,包括由与外部工具集成所带来的风险。

Muse Spark Open has been evaluated across four complementary safety areas, and met our safety criteria for release based on model evaluations and an assessment of residual risks:

Muse Spark Open 已在四个互补的安全性领域进行了评估,并根据模型评估和剩余风险评估结果,满足了我们的发布安全标准:

  • Content safety: Harmful-content generation and refusal behavior, alongside response quality and ideological balance.
  • Agentic risk: Harmful or unauthorized actions when using tools or acting on users' behalf, including unsafe code execution and destructive changes in coding-agent workflows.
  • 内容安全:有害内容生成与拒绝行为,以及响应质量和意识形态平衡。
  • 智能体风险:在使用工具或代表用户行动时产生的有害或未授权行为,包括不安全的代码执行和编码智能体工作流中的破坏性变更。

更进一步:量化金融体系

看懂新闻只是起点——沿量化金融路径,把它变成能交付的工程能力

进入量化体系 →