跳到主内容
@wquguru
精选88MarkTechPost(RSS)模型发布/更新多源精选 ×4

Liquid AI发布LFM3:6款开源2B级多模态模型

Liquid AI Releases LFM3: 6 Open-Weight 2B-Class Multimodal Models

原文
发到 X
推荐理由

端侧2B模型性能逼近大模型,Agent能力显著领先同量级竞品,适合关注边缘部署与轻量化Agent的工程团队参考。

Liquid AI has released LFM3, its new generation of Liquid Foundation Models. Liquid AI LFM3 is a family of 6 open-weight, 2B-class models built on one shared backbone. The family covers text, vision, audio, omni and decision tasks. Every model can be fine-tuned on a single GPU. Developers can then deploy on phones, laptops, private servers or the cloud.

Liquid AI 发布了 LFM3,其新一代 Liquid 基础模型。Liquid AI LFM3 是一个由 6 个开源权重、2B 级别模型组成的家族,它们基于同一个共享骨干网络构建。该家族涵盖文本、视觉、音频、全能(omni)和决策任务。每个模型都可以在单块 GPU 上进行微调。然后开发者可以在手机、笔记本电脑、私有服务器或云端进行部署。

TL;DR

TL;DR(太长不看版)

  • Size: LFM3-1.7B has 1.73B parameters and a 256K context window. LFM3-VL-2B has 1.92B and 128K. LFM3-Omni-2B has 2.2B.
  • Runs on: about 1 GB of memory at 4-bit, so phones and laptops. GGUF, MLX, ONNX, FP8 and NVFP4 checkpoints ship.
  • Performance: LFM3-1.7B averages 49.37 across 29 benchmarks, above Qwen3.5-9B at 47.24 (Liquid’s own eval).
  • Best: IFEval 96.66, and AutomationBench 41.29 vs 15.10 for Qwen3.5-9B.
  • Worst: Humanity’s Last Exam (no tools) 7.17, and RULER 128K 65.56 vs 87.11 for Qwen3.5-9B.
  • 规模:LFM3-1.7B 拥有 17.3 亿参数和 256K 上下文窗口。LFM3-VL-2B 拥有 19.2 亿参数和 128K 上下文。LFM3-Omni-2B 拥有 22 亿参数。
  • 运行环境:4-bit 量化下仅需约 1 GB 内存,因此适用于手机和笔记本电脑。提供 GGUF、MLX、ONNX、FP8 和 NVFP4 检查点。
  • 性能:LFM3-1.7B 在 29 个基准测试中的平均分为 49.37,高于 Qwen3.5-9B 的 47.24(Liquid 自身评估结果)。
  • 最佳表现:IFEval 得分 96.66,AutomationBench 得分 41.29,而 Qwen3.5-9B 为 15.10。
  • 最差表现:Humanity’s Last Exam(无工具)得分 7.17,RULER 128K 得分 65.56,而 Qwen3.5-9B 为 87.11。

What is Liquid AI LFM3?

什么是 Liquid AI LFM3?

LFM3 is a multimodal model family from Liquid AI that branches 6 models from 1 base. All of them start from LFM3-1.7B-Base.

LFM3 是 Liquid AI 的多模态模型家族,从一个基础模型衍生出 6 个模型。它们都始于 LFM3-1.7B-Base。

The release includes:

此次发布包括:

  • LFM3-1.7B: a text model for local agents, post-trained for harnesses like Hermes Agent, Pi and OpenClaw.
  • LFM3-VL-2B: the first LFM vision model with video input, sampled at 2 fps.
  • LFM3-Audio-2B: speech in and out across 18 languages, with tool calling.
  • LFM3-Omni-2B: vision, audio and language in one model, answering in text or speech.
  • d1-2B and d1-Omni-2B: decision models that answer many questions in 1 forward pass.
  • LFM3-1.7B:一个用于本地智能体的文本模型,针对 Hermes Agent、Pi 和 OpenClaw 等框架进行了后训练。
  • LFM3-VL-2B:首个支持视频输入的 LFM 视觉模型,采样率为 2 fps。
  • LFM3-Audio-2B:支持 18 种语言的语音输入和输出,并具备工具调用能力。
  • LFM3-Omni-2B:在一个模型中融合视觉、音频和语言功能,可以以文本或语音形式回答。
  • d1-2B 和 d1-Omni-2B:决策模型,能够在一次前向传播中回答多个问题。

How does the tri-hybrid architecture work?

三混合架构是如何工作的?

The backbone mixes 3 operators across 24 layers. There are 13 gated short convolutions, 5 sliding-window attention layers and 6 global attention layers. The SWA window is 256 tokens. Convolution kernels grew from 3 to 7.

骨干网络在 24 层中混合了 3 种算子。其中包括 13 个门控短卷积、5 个滑动窗口注意力层和 6 个全局注意力层。SWA 窗口大小为 256 个 token。卷积核大小从 3 增加到 7。

Liquid AI team found this mix with its hardware-in-the-loop architecture search. LFM2 was tuned on 1 phone and 1 laptop. LFM3 was tuned across 14 device and backend combinations. These include a Raspberry Pi 5 and the Qualcomm Hexagon NPU.

Liquid AI 团队通过硬件在环架构搜索发现了这种混合方式。LFM2 在一部手机和一台笔记本电脑上进行了调整。LFM3 在 14 种设备和后端组合上进行了调整。其中包括 Raspberry Pi 5 和 Qualcomm Hexagon NPU。

Other changes include head-wise sigmoid gates on attention, partial RoPE on global layers and sandwich norm. The base model saw 22T tokens. The last 3.5T tokens were agent-heavy mid-training, which also extended context to 256K.

其他更改包括注意力机制上的逐头 sigmoid 门控、全局层上的部分 RoPE 以及三明治归一化。基础模型经历了 22T 个 token 的训练。最后 3.5T 个 token 侧重于智能体训练的中间阶段,这也将上下文扩展到了 256K。

Post-training ran in 4 stages. SFT on 1.75T tokens came first, then mixed RL. Next, 6 specialist teachers were distilled into 1 model, followed by agentic RL.

后训练分为 4 个阶段。首先是在 1.75T 个 token 上进行 SFT(监督微调),然后是混合 RL(强化学习)。接下来,将 6 位专家教师蒸馏到一个模型中,随后进行智能体 RL。

How does LFM3-1.7B perform on benchmarks?

LFM3-1.7B 在基准测试中的表现如何?

Liquid AI reports that LFM3-1.7B beats LFM2.5-2.6B with 35% fewer parameters. The bigger story is the agent results. On WebArena-Verified it scores 38.42, against 28.94 for Qwen3.5-9B. On BFCL V4 it scores 71.39, against 62.83.

Liquid AI 报告称,LFM3-1.7B 以少 35% 的参数击败了 LFM2.5-2.6B。更大的亮点是智能体(agent)表现。在 WebArena-Verified 上得分为 38.42,而 Qwen3.5-9B 为 28.94。在 BFCL V4 上得分为 71.39,而 Qwen3.5-9B 为 62.83。

Size still wins on knowledge and agentic coding. GPQA Diamond is 63.37, versus 80.40 for Qwen3.5-9B. SWE-bench Verified is 43.40, versus 51.20. Search narrows the gap: Humanity’s Last Exam rises from 7.17 to 13.90 with tools.

在知识和智能体编码方面,参数量优势依然明显。GPQA Diamond 得分为 63.37,而 Qwen3.5-9B 为 80.40。SWE-bench Verified 得分为 43.40,而 Qwen3.5-9B 为 51.20。引入工具后差距缩小:Humanity’s Last Exam 得分从 7.17 提升至 13.90。

How do LFM3-1.7B and its rivals compare?

LFM3-1.7B 及其竞争对手相比如何?

FeatureLFM3-1.7BMiniCPM5-2BQwen3.5-4BGemma 4 E4B
Parameters1.73B2.52B4B LM (5B on Hub with vision)4.5B effective (8B with embeddings)
ArchitectureConv + SWA + global attentionStandard Llama transformerGated DeltaNet + gated attentionSliding window + global attention
Context256K131,072262,144128K
Input modalitiesTextTextText, image, videoText, image, audio
LicenseLFM Open License v1.0 ($10M revenue threshold)Apache 2.0Apache 2.0Apache 2.0
BFCL V4 (Liquid eval)71.3962.6555.1248.25
WebArena-Verified (Liquid eval)38.429.1121.9217.06
SWE-bench Verified (Liquid eval)43.4034.8041.200.50
GPQA Diamond (Liquid eval)63.3765.1575.7657.88
GPQA Diamond (vendor-reported)63.3770.276.258.6
RULER 128K (Liquid eval)65.5637.9684.6318.82
Liquid 29-benchmark average49.3739.1939.2731.74
特性LFM3-1.7BMiniCPM5-2BQwen3.5-4BGemma 4 E4B
参数1.73B2.52B4B LM(Hub 上含视觉模块为 5B)有效 4.5B(含嵌入层为 8B)
架构Conv + SWA + 全局注意力标准 Llama TransformerGated DeltaNet + 门控注意力滑动窗口 + 全局注意力
上下文长度256K131,072262,144128K
输入模态文本文本文本、图像、视频文本、图像、音频
许可证LFM Open License v1.0(营收门槛 1000 万美元)Apache 2.0Apache 2.0Apache 2.0
BFCL V4(Liquid 评估)71.3962.6555.1248.25
WebArena-Verified(Liquid 评估)38.429.1121.9217.06
SWE-bench Verified(Liquid 评估)43.4034.8041.200.50
GPQA Diamond(Liquid 评估)63.3765.1575.7657.88
GPQA Diamond(厂商报告)63.3770.276.258.6
RULER 128K(Liquid 评估)65.5637.9684.6318.82
Liquid 29项基准平均分49.3739.1939.2731.74

Sources: Liquid LFM3 model card, MiniCPM5-2B card, Qwen3.5-4B card, Gemma 4 E4B card, LFM license.

来源:Liquid LFM3 模型卡片、MiniCPM5-2B 卡片、Qwen3.5-4B 卡片、Gemma 4 E4B 卡片、LFM 许可证。

What about vision, audio, omni and decision models?

那么视觉、音频、全模态和决策模型呢?

LFM3-VL-2B averages 71.4 across 62 vision benchmarks. Gemma 4 12B scores 71.7 on the same suite. It leads that comparison on visual grounding (77.3) and GUI understanding (83.1). Video (61.2) and agentic tasks (42.5) still trail larger API models.

LFM3-VL-2B 在 62 个视觉基准测试中的平均得分为 71.4。Gemma 4 12B 在同一套基准上的得分为 71.7。它在视觉定位(77.3)和 GUI 理解(83.1)方面领先。视频(61.2)和智能体任务(42.5)的表现仍落后于更大的 API 模型。

LFM3-Audio-2B reaches 6.2 English WER and a 3.8 UTMOSv2 TTS score. LFM3-Omni-2B scores 70.1 on Daily-Omni, against 61.3 for Qwen2.5-Omni-7B.

LFM3-Audio-2B 达到 6.2 的英文 WER 和 3.8 的 UTMOSv2 TTS 分数。LFM3-Omni-2B 在 Daily-Omni 上得分为 70.1,而 Qwen2.5-Omni-7B 为 61.3。

d1-2B replaces d1-3B with a third fewer parameters. It improves Decision Bench from 83.6 to 85.2.

d1-2B 以比 d1-3B 少三分之一的参数取代了后者。它将 Decision Bench 得分从 83.6 提升至 85.2。

How can developers deploy LFM3?

开发者如何部署 LFM3?

Weights are on Hugging Face, the Liquid AI Playground and the Liquid API. The docs list GGUF, MLX and ONNX for the text and vision models. Runtimes include llama.cpp, MLX, vLLM, SGLang, Ollama and Transformers.

权重已发布在 Hugging Face、Liquid AI Playground 和 Liquid API。文档列出了文本和视觉模型的 GGUF、MLX 和 ONNX 格式。运行时支持包括 llama.cpp、MLX、vLLM、SGLang、Ollama 和 Transformers。

On-device, Liquid AI measured llama.cpp at Q4_0 with 32K context. A full 128K context needs 1.6 GB of KV cache. Qwen3.5-4B needs 4.3 GB. On 1 NVIDIA B300 with SGLang, LFM3-1.7B produces 3.6B tokens per day at 1,024 concurrent requests.

在端侧,Liquid AI 使用 llama.cpp 对 Q4_0 量化模型进行了测试,上下文长度为 32K。完整的 128K 上下文需要 1.6 GB 的 KV 缓存。Qwen3.5-4B 则需要 4.3 GB。在配备 SGLang 的单张 NVIDIA B300 上,LFM3-1.7B 每天可生成 36 亿个 token(并发请求数为 1,024)。

Liquid AI also showed specialization. A few hours of SFT and GRPO on 1 A100 lifted wind-turbine defect classification to 67%.

Liquid AI 还展示了其专业化能力。在单张 A100 上进行数小时的监督微调(SFT)和 GRPO 训练后,风力涡轮机缺陷分类准确率提升至 67%。

Key Takeaways

关键要点

  • 6 open-weight 2B-class models share 1 tri-hybrid backbone.
  • LFM3-1.7B fits in about 1 GB at 4-bit with 256K context.
  • It beats Qwen3.5-9B on BFCL V4, WebArena-Verified and AutomationBench.
  • Knowledge and agentic coding remain clear weak spots.
  • Free commercial use stops at $10M annual revenue.
  • 6 款开源 2B 级模型共享同一个三混合(tri-hybrid)骨干网络。
  • LFM3-1.7B 在 4-bit 量化下仅需约 1 GB 内存,即可支持 256K 上下文。
  • 它在 BFCL V4、WebArena-Verified 和 AutomationBench 基准测试中超越了 Qwen3.5-9B。
  • 知识推理和智能体编码仍是明显的短板。
  • 免费商用许可适用于年营收不超过 1,000 万美元的企业。

Check out the technical details, model weights and docs. Also, feel free to follow us on Twitter and don’t forget to join our 150k+ML SubReddit and Subscribe to our Newsletter. Wait! are you on telegram? now you can join us on telegram as well.

查看技术细节、模型权重和文档。也欢迎在 Twitter 上关注我们,别忘了加入拥有 15 万+成员的 ML SubReddit,并订阅我们的新闻通讯。等等!你在 Telegram 上吗?现在你也可以加入我们的 Telegram 群组。

更进一步:量化金融体系

看懂新闻只是起点——沿量化金融路径,把它变成能交付的工程能力

进入量化体系 →