Mistral发布万亿参数多模态大模型Large 4及GGUF权重
mistralai/Mistral-Large-4-1T-A52B · Hugging Face
Mistral最新旗舰级万亿参数多模态模型发布,原生支持百万上下文与复杂Agent工作流,本地部署资源需求大幅降低,值得开发者重点关注。
https://huggingface.co/ggml-org/Mistral-Large-4-1T-A52B-GGUF
https://huggingface.co/ggml-org/Mistral-Large-4-1T-A52B-NVFP4-GGUF
https://huggingface.co/unsloth/Mistral-Large-4-1T-A52B-GGUF
from Mistral:
来自 Mistral:
Mistral Large 4 - Le Chonk
Mistral Large 4 is our largest and most capable model to date: a 1 trillion-parameter natively multimodal Mixture-of-Experts model with 49 billion active parameters per token (52 billion including embeddings and output layers), trained from scratch on 3,800 NVIDIA Grace Blackwell GPUs in Mistral's own datacenters in Europe.
Mistral Large 4 是我们迄今为止最大、能力最强的模型:这是一个拥有 1 万亿参数的原生多模态混合专家(MoE)模型,每个 token 有 490 亿活跃参数(包括嵌入层和输出层共 520 亿参数),在 Mistral 位于欧洲的数据中心中,使用 3,800 块 NVIDIA Grace Blackwell GPU 从头训练而成。
Mistral Large 4 unifies instruction following, reasoning, coding, and agentic workflows in a single set of weights. While a generalist model, it shows especially good performance on workloads such as cybersecurity, finance, and law, and it surpasses frontier closed models on visual grounding. It is natively fluent in 160+ languages, including every official language of the European Union.
Mistral Large 4 将指令遵循、推理、编码和智能体工作流统一在一组权重中。作为一个通用模型,它在网络安全、金融和法律等工作负载上表现出特别优异的性能,并在视觉定位方面超越了前沿的闭源模型。它原生支持 160 多种语言,包括欧盟的所有官方语言。
Find more information on our blog. The model is also served on the Mistral API as mistral-large-4.
在我们的博客上查找更多信息。该模型也通过 Mistral API 提供服务,API 名称为 mistral-large-4。
Key Features
主要特性
Mistral Large 4 includes the following architectural choices:
Mistral Large 4 包含以下架构选择:
- ~1T total / ~52B active parameters: granular Mixture-of-Experts with 128 routed experts (4 active per token) and 1 shared expert.
- 1M context length, for long-context workloads.
- Multimodal input: accepts text and image input, with text output. Pixtral-style vision encoder trained to handle variable image sizes and aspect ratios.
- Instruct and Reasoning functionalities with function calls, reasoning effort configurable per request.
- ~1T 总参数 / ~52B 活跃参数:细粒度的混合专家结构,包含 128 个路由专家(每个 token 激活 4 个)和 1 个共享专家。
- 1M 上下文长度,适用于长上下文工作负载。
- 多模态输入:接受文本和图片输入,并输出文本。采用 Pixtral 风格的视觉编码器,经过训练以处理可变尺寸和纵横比的图像。
- 具备指令跟随和推理功能,支持函数调用,可根据请求配置推理强度。
Mistral Large 4 offers the following capabilities:
Mistral Large 4 提供以下能力:
- Reasoning Mode: three reasoning efforts — low, medium, high (default) — so the same model can answer a quick chat reply or work through a complex agentic run.
- Vision: analyzes images, charts, technical drawings, and documents, with state-of-the-art visual grounding among open weights.
- Multilingual: natively fluent in 160+ languages, including all official languages of the European Union.
- System Prompt: strong adherence and support for system prompts.
- Agentic: native function calling, JSON output, and strict JSON schema enforcement.
- Cybersecurity: state of the art among open-weight models for security work, while refusing malicious requests.
- Large Context Window: supports a 1M context window.
- 推理模式:三种推理强度——低、中、高(默认),使同一模型既能回答快速聊天回复,也能处理复杂的智能体运行任务。
- 视觉:分析图片、图表、技术图纸和文档,在开源权重模型中具有最先进的视觉定位能力。
- 多语言:原生流畅支持 160 多种语言,包括欧盟所有官方语言。
- 系统提示词:对系统提示词具有强大的遵循和支持能力。
- 智能体:原生支持函数调用、JSON 输出以及严格的 JSON Schema 强制校验。
- 网络安全:在安全工作中处于开源权重模型的领先地位,同时会拒绝恶意请求。
- 大上下文窗口:支持 1M 上下文窗口。
We release this model under the Mistral Ecosystem Open-Weight License: a modified version of the MIT license, for both commercial and non-commercial use — operating a Model-as-a-Service business requires a separate commercial license with Mistral.
我们在 Mistral 生态系统开放权重许可下发布此模型:这是 MIT 许可证的修改版本,适用于商业和非商业用途——运营 Model-as-a-Service 业务需要与 Mistral 签订单独的商用许可证。
llama.cpp suport merged: https://github.com/ggml-org/llama.cpp/pull/31376
llama.cpp 支持已合并:https://github.com/ggml-org/llama.cpp/pull/31376
更进一步:量化金融体系
看懂新闻只是起点——沿量化金融路径,把它变成能交付的工程能力