跳到主内容
@wquguru
精选88Hacker News Best(web_list)模型发布/更新

Fireworks发布Ember-1:基于Kimi K3优化推理效率

Ember-1

原文
发到 X
推荐理由

针对Agent场景Token过高的痛点,给出了具体的蒸馏优化方案与实测数据,对追求推理成本的开发者极具参考价值。

Join us for our inaugural conference, Forge 2026

加入我们首届大会 Forge 2026

Blog

博客

Ember 1

Introducing Ember-1

介绍 Ember-1

PUBLISHED 9/23/2026

发布于 2026/9/23

Table of Contents

目录

  • Ember-1: half the tokens, same answers
  • How Fireworks Research built Ember-1
  • The problem: thinking models think too much
  • From an observation to a premium model
  • The Specialized Intelligence Index: Ember-1 sets a Pareto frontier for Bedside Bench
  • Evaluating Pareto across more industry benchmarks
  • Customer validation: Live A/B tests
  • Internal validation: Our own developers didn't notice
  • What's next
  • Ember-1:一半的 token,同样的答案
  • Fireworks Research 如何构建 Ember-1
  • 问题:思考模型想得太多
  • 从观察到高端模型
  • 专用智能指数:Ember-1 为 Bedside Bench 设定了帕累托前沿
  • 在更多行业基准上评估帕累托最优
  • 客户验证:实时 A/B 测试
  • 内部验证:我们自己的开发人员都没有察觉
  • 下一步计划

Table of Contents

目录

Ember-1: half the tokens, same answers

Ember-1:一半的 token,同样的答案

Ember-1 is a new specialized model from Fireworks Research that delivers Kimi K3’s quality with 40% fewer tokens. Built on Kimi K3, it learned to cut unnecessary reasoning while keeping the thinking that matters. We tested it on external benchmarks, in live customer A/B tests, and on our own coding and agent workloads, and quality held up in every setting. Available today, Ember-1 kicks off an ongoing series of specialized models by Fireworks, shaped by what developers want next. Ember is just the start of what you could build with the Fireworks Training platform.

Ember-1 是 Fireworks Research 推出的一款新型专用模型,以比 Kimi K3 少 40% 的 token 提供同等质量。该模型基于 Kimi K3 构建,学会了削减不必要的推理过程,同时保留关键的思考能力。我们在外部基准测试、实时客户 A/B 测试以及自身的编码和智能体工作负载中对其进行了测试,结果显示其在所有场景下均保持了高质量。Ember-1 今日上线,标志着 Fireworks 由开发者需求驱动的专用模型系列的开端。Ember 只是你利用 Fireworks Training 平台所能构建内容的起点。

How Fireworks Research built Ember-1

Fireworks Research 如何构建 Ember-1

We heard from users that they needed K3’s coding capabilities at a lower cost, because its long reasoning traces made automated coding expensive at scale. Turning down K3's reasoning effort didn't solve this. Lower effort settings gave up too much quality. To keep the quality and cut the tokens, the model had to learn to reason more efficiently, and that meant training it.

我们从用户处了解到,他们需要以更低成本获得 K3 的编码能力,因为其冗长的推理轨迹导致大规模自动化编码成本高昂。降低 K3 的推理强度并未解决这一问题,因为低强度设置牺牲了过多质量。为了保持质量并减少 token 消耗,模型必须学会更高效地推理,这意味着我们需要对其进行训练。

Getting there took serious research. Our team ran more than 50 training experiments and over 200 evaluations, and developed new training algorithms along the way to shorten reasoning without losing accuracy. We did it all on Fireworks Serverless Training. Because we didn’t have to provision or manage GPUs, we could launch experiments as soon as we had an idea, pay only for what we ran, and move from research to launch in a fraction of the usual time and cost.

实现这一目标需要深入的研究。我们的团队进行了超过 50 次训练实验和 200 多次评估,并在过程中开发了新的训练算法,以在不损失准确性的前提下缩短推理时间。所有这些均在 Fireworks Serverless Training 上完成。由于无需配置或管理 GPU,我们可以在产生想法后立即启动实验,仅按实际运行量付费,并将从研究到发布的周期缩短至通常时间和成本的零头。

We trained across a broad set of tasks so the token savings would carry over to many workloads. We then evaluated Ember-1 on the Specialized Intelligence Index, public benchmarks, and live production traffic to confirm it used fewer tokens with no drop in quality. Ember-1 is Fireworks’ own model and the first in a series of models from Fireworks Research.

我们在广泛的任务集上进行训练,以确保 token 节省能惠及多种工作负载。随后,我们在专用智能指数(Specialized Intelligence Index)、公开基准测试以及实时生产流量中对 Ember-1 进行了评估,确认其在不降低质量的前提下使用了更少的 token。Ember-1 是 Fireworks 自研的模型,也是 Fireworks Research 系列模型中的第一款。

The problem: thinking models think too much

问题:思考模型想得太多

Reasoning models like Kimi K3 spend the majority of their generated tokens, sometimes more than 90%, on internal reasoning rather than the answer itself. This thinking structure is expensive on a single request, but it gets much worse in multi-turn agentic workloads. Every turn replays all prior reasoning back to the model, so context grows roughly quadratically with the number of turns. Long reasoning traces from early turns get re-read (and re-billed) on every subsequent call.

像 Kimi K3 这样的推理模型,其生成的 token 中大部分(有时超过 90%)都用于内部推理,而非直接生成答案。这种思考结构在单次请求中成本高昂,而在多轮智能体工作负载中情况会变得更糟。每一轮都会将之前的所有推理过程重新输入给模型,因此上下文长度随轮数大致呈二次方增长。早期轮次产生的长推理轨迹会在后续的每次调用中被重新读取(并重新计费)。

Is all that reasoning actually necessary? Our experiments said no. The reasoning Kimi K3 emits is far longer than the task requires, and the excess can be removed without touching the answer. This was how we created Ember-1, an economical version of Kimi K3 built from specialized intelligence.

所有这些推理真的有必要吗?我们的实验表明不需要。Kimi K3 输出的推理内容远超任务所需,且在不影响答案的前提下可以移除多余部分。这正是我们打造 Ember-1 的方式——一个基于专门智能构建的、更具经济性的 Kimi K3 版本。

From an observation to a premium model

从观察到高端模型

Not all of K3's reasoning is wasted. Some of it is self-reflection: revisiting an assumption, responding to feedback, or tracing an outcome back to an earlier decision can help the model recover from mistakes. The opportunity is to preserve this ability while reducing unnecessary reasoning and escaping unproductive loops. We believe that learning from tasks and environment feedback can teach the model to reason more efficiently while maintaining its capabilities.

K3 的推理并非全部浪费。其中一部分属于自我反思:回顾假设、回应反馈或将结果追溯至早期决策,有助于模型从错误中恢复。我们的机会在于保留这种能力,同时减少不必要的推理并摆脱低效循环。我们认为,从任务和环境中获取反馈可以让模型在保持能力的同时更高效地进行推理。

For agentic tasks, this learning extends across the interaction. The model explores possible actions, incorporates new observations, and refines its reasoning as it progresses. Feedback connects decisions to their consequences, encouraging useful reflection throughout the task.

对于智能体任务,这种学习贯穿整个交互过程。模型探索可能的行动,整合新的观察结果,并在推进过程中不断优化其推理。反馈将决策与其后果联系起来,鼓励在整个任务过程中进行有益的反思。

We carried these insights into a training collection spanning mathematics, coding, instruction following, conversation, search, tool use, and software engineering, covering both standalone problems and extended interactions to enforce adaptation to observations and outcomes. Task feedback guides on-policy planning and learning, with an emphasis on preserving capability across this range of settings.

我们将这些见解融入到一个涵盖数学、编程、指令遵循、对话、搜索、工具使用和软件工程等领域的训练数据集中,既包括独立问题也包括扩展交互,以强制模型适应观察结果和最终成果。任务反馈指导在线策略规划与学习,重点在于在这一系列场景中保持模型的能力。

Results on public benchmarks and live A/B tests support this direction: across seven benchmarks and two customers’ production traffic, Kimi K3’s reasoning could be shortened by 35–50% without sacrificing accuracy. The internalized behavior also shows restrained token use on unsuccessful attempts, reducing prolonged, unproductive reasoning.

公开基准测试和实时 A/B 测试的结果支持了这一方向:在七个基准测试和两家客户的生产流量中,Kimi K3 的推理长度缩短了 35–50%,且未牺牲准确性。内化的行为还表现为在未成功的尝试中克制地使用 token,从而减少了冗长且低效的推理过程。

The Specialized Intelligence Index: Ember-1 sets a Pareto frontier for Bedside Bench

专门智能指数:Ember-1 为 Bedside Bench 设定了帕累托前沿

Earlier this week, we introduced the Specialized Intelligence Index (SII) to benchmark open, closed, and specialized models against real-world tasks created by industry experts.

本周早些时候,我们推出了专业智能指数(SII),用于以行业专家创建的真实任务为基准,对开放、封闭和专业模型进行对标评估。

We evaluated Ember-1 on Doximity’s Bedside Bench, a physician-validated benchmark spanning 500 clinical cases across 10 specialized categories.

我们在Doximity的Bedside Bench上评估了Ember-1,这是一个由医生验证的基准测试,涵盖10个专业类别中的500个临床案例。

The result? Ember-1 set a new Pareto frontier for Bedside Bench across both open and closed models including GPT-5.6 Sol, GPT-6 Astra, and Claude Opus 5 on cost/task.

结果如何?在成本/任务方面,Ember-1在包括GPT-5.6 Sol、GPT-6 Astra和Claude Opus 5在内的开放和封闭模型中,为Bedside Bench设立了新的帕累托前沿。

Figure 1: Pareto Frontier from SII on Bedside Bench

图1:Bedside Bench上SII的帕累托前沿

Figure 2: Score vs. Duration Chart on Bedside Bench SII

图2:Bedside Bench SII上的得分与耗时图表

Evaluating Pareto across more industry benchmarks

在更多行业基准测试中评估帕累托前沿

We also evaluated Ember-1 on the quality-vs-cost frontier across some other industry benchmarks. We computed per-benchmark cost using the public Kimi K3 API pricing (uncached input $3/M tokens, cached input $0.30/M, output $15/M) and plotted it against pass rate for three arms: K3 at reasoning effort low, K3 at reasoning effort high, K3 at reasoning effort max (default), and Ember-1. Across every benchmark with more than 50 test samples, Ember-1 sits on or near the Pareto frontier, matching K3-max quality at a fraction of the cost, and strictly dominating K3-low. We also analyzed GPT-6 Astra, Claude Opus-5 and GLM 5.3, and found that Ember-1 was a leader on the Pareto frontier.

我们还评估了Ember-1在其他一些行业基准测试中的质量-成本前沿。我们使用公开的Kimi K3 API定价(未缓存输入3美元/M tokens,缓存输入0.30美元/M,输出15美元/M)计算每个基准测试的成本,并将其与三个分支的通过率进行对比:推理努力程度低时的K3、高时的K3、最大(默认)时的K3,以及Ember-1。在每个拥有超过50个测试样本的基准测试中,Ember-1都位于或接近帕累托前沿,以极低的成本实现了与K3-max相当的质量,并严格优于K3-low。我们还分析了GPT-6 Astra、Claude Opus-5和GLM 5.3,发现Ember-1是帕累托前沿上的领先者。

Figure 3: Average of 5 Industry Benchmarks on Open and Closed Model Cost/Task

图3:开放与封闭模型在5个行业基准测试上的平均成本/任务

We took a double-click on the results directly comparing Ember-1 to the original K3, and found the following results:

我们对直接比较Ember-1与原K3的结果进行了深入分析,发现了以下结果:

NK3 LowK3 HighK3 maxEmber-1Ember-1 vs. K3 Max
Terminal Bench 2.18976.4%77.6%80.9%82.0%-51.9% / -23.1 USD
SWE-bench Verified50080.4%86.0%93.2%92.2%-15.5% / -68.1 USD
SWE-Interact756.7%13.3%21.3%20.0%-32.5% / -60.8 USD
DeepSWE 1.111355.8%62.8%66.4%75.2%-23.7% / -126.9 USD
τ-2 Bench Airline5064%64%64%66%-5.9% / -0.3 USD

The most cost optimized way to run K3 is no longer to make it think less, but to run Ember-1, the model that learned to think efficiently.

运行K3最具成本效益的方式不再是让它减少思考,而是运行Ember-1——这个学会了高效思考的模型。

Customer validation: Live A/B tests

客户验证:实时A/B测试

Benchmarks only tell you so much. Like what we found in the Specialized Intelligence Index results, we wanted to test the model on more real workloads, and to test the model using production traffic. The real test is often whether the model holds up on production traffic, in products users depend on.

基准测试能告诉你的信息有限。正如我们在专业智能指数结果中发现的那样,我们希望用更多的真实工作负载来测试该模型,并使用生产流量进行测试。真正的考验往往是模型在用户依赖的产品中的生产流量表现是否稳定。

We ran live A/B tests with two customers on their production coding workloads. In both cases, Ember-1 delivered impressive token savings, approximately 35% fewer tokens per task at comparable quality. Most of the downstream product metrics held or improved, including task completion, success scores, and failure rates all moving in the right direction at substantially lower token cost. Following the A/B tests, one customer is now running Ember-1 in live production, with plans to scale it up to replace the base model entirely.

我们与两家客户在生产编码工作负载上进行了实时 A/B 测试。在这两种情况下,Ember-1 都实现了令人印象深刻的令牌节省,在质量相当的情况下,每个任务的令牌使用量减少了约 35%。大多数下游产品指标保持稳定或有所改善,包括任务完成率、成功评分和失败率均朝着正确的方向变化,且令牌成本大幅降低。A/B 测试之后,一家客户现在已在生产环境中运行 Ember-1,并计划扩大规模以完全替换基础模型。

更进一步:量化金融体系

看懂新闻只是起点——沿量化金融路径,把它变成能交付的工程能力

进入量化体系 →

相似阅读

关联信息,但可能不是同一事件