跳到主内容
@wquguru
精选88Tomasz Tunguz(RSS)产品与增长

AI应用定价与护城河:Harness如何压缩推理成本并提升毛利

The Harness Margin Opportunity

原文
发到 X
推荐理由

直接揭示了AI SaaS时代的核心盈利公式:用Harness压缩推理成本以换取高毛利和增长速度。给出了具体的成本对比数据和构建护城河的方法论,创业者可直接用于产品架构设计与商业计划推演。

The better the harness, the better the business.

Harness(控制框架)越好,生意就越好。

Berkeley published a study this week showing harnesses, the systems that control AI agents, set the price of an answer. The right harness cuts the cost of the same result by 71% without a loss of accuracy.1

本周伯克利发布了一项研究,显示 Harness(控制框架)——即控制 AI Agent 的系统——决定了答案的价格。正确的 Harness 能在不损失准确性的情况下,将相同结果的生成成本降低 71%。1

The data points to the opportunity for the next generation software applications : harnesses. Yes, we can use AI to do almost anything we want at work. But no, we cannot afford to provide everyone access to state of the art models for every task.

数据指向了下一代软件应用的机会:Harness。是的,我们可以利用 AI 完成工作中几乎任何我们想做的事。但不行的是,我们无法为每项任务都让所有人访问最先进的模型。

Harnesses coalesce common workflows into repeatable patterns : deterministic code or skills. The better the harness, the greater the compression, the lower the AI cost.

Harness 将常见的工作流凝聚为可重复的模式:确定性代码或技能。Harness 越好,压缩率越高,AI 成本越低。

Imagine Theory buys a $250k a year contract for an AI associate to evaluate 5,000 companies. Two startups bid. Inferno calls a state of the art model on every step. Inferefficient runs a harness that coalesces the work into deterministic code, reserving the expensive model for the few steps that need it.

假设 Theory 公司购买了一份年薪 25 万美元的 AI 助理合同,用于评估 5000 家公司。两家初创公司竞标。Inferno 在每一步都调用最先进的模型。Inferefficient 运行一个 Harness,将工作凝聚为确定性代码,仅将昂贵的模型保留给真正需要的那几步。

Inferno burns $131k on inference. Inferefficient burns $37k. Both carry the same cost for hosting, evaluations & the humans who check the work. Identical revenue, 38% gross margin against 75%.2

Inferno 在推理上花费了 13.1 万美元。Inferefficient 花费了 3.7 万美元。两者在托管、评估以及审核工作的人类方面的成本相同。收入相同,但毛利率分别为 38% 和 75%。2

Inferno cannot copy Inferefficient. Routing to a cheap model is only safe if you know which tasks it clears, & that knowledge comes from watching ten thousand versions of the same work. The cost advantage & the moat are the same asset.

Inferno 无法复制 Inferefficient。路由到廉价模型只有在你知道它哪些任务能处理时才安全,而这种知识来自于观察同一工作的上万次版本迭代。成本优势与护城河源于同一资产。

Past 8,600 evaluations Inferno loses money on every additional one. It has to ration usage, which makes it the worse product at the moment the customer finds it most valuable. Inferefficient says yes to everything.

在第 8600 次评估之后,Inferno 每多进行一次评估就会亏损。它必须限制使用量,这导致它在客户觉得它最有价值的时候,反而成了更差的产品。而 Inferefficient 对一切都说“好”。

Gross profit buys growth. On a $250k contract that costs $150k to win, Inferno waits nineteen months to earn back the sale. Inferefficient waits ten. One of these businesses can hire twice as fast as the other.

毛利驱动增长。对于一份赢得成本为 15 万美元的 25 万美元合同,Inferno 需要等待 19 个月才能收回销售成本。Inferefficient 只需等待 10 个月。其中一家公司的招聘速度可以是另一家的两倍。

Margins will not climb to 100%. As inference gets cheaper, buyers will ask more of their agents, shifting the equilibrium over time in response to competition. The gap between the two companies is what persists.

利润率不会攀升至 100%。随着推理成本降低,买家会对他们的 Agent 提出更多要求,从而随着时间的推移,在竞争响应中改变平衡点。两家公司之间的差距才是持久存在的。

Effective harnesses are not cocktails of exotic ingredients : a deep customer understanding, a collection of relevant evals & a factory for automating hill climbing.

有效的 Harness 并非由异质成分混合而成:它需要深刻的客户理解、一系列相关的评估(evals)以及一个用于自动化爬山算法的工厂。

That’s a recipe for a valuable, defensible software company.

这是一份打造有价值且具备防御性软件公司的配方。

  • Melissa Z. Pan, Shuo Yang, Negar Arabzadeh, Wei-Lin Chiang, Ion Stoica, & Matei Zaharia, “HarnessTax: How Much Does the Harness Matter for Coding Agents?”, 2026. Twenty-one model-harness pairs, 30 tasks each from SWE-bench Lite & Terminal-Bench 2.0, three attempts per task, costed on a fixed price list dated September 1, 2026. Across all 42 within-model harness comparisons, a two-sided Fisher exact test finds one result at p < 0.05, where chance alone would produce about two, & none survives a Holm-Bonferroni correction. Two limits : the published rollouts are sorted by cost, which destroys the task pairing & rules out a paired test, & at 90 rollouts per cell the study detects only swings of roughly fifteen points. The quality gap is undemonstrated at this sample size, not proven absent. ↩︎
  • The harness swap is GPT-5.6 Sol moving from Claude Code to Pi in the same study : $1.540 to $0.441 per resolved task, the same model in both cases. That 71% reduction is measured data & is what the argument rests on. The rest is illustrative : that a company evaluation runs about seventeen benchmark-task equivalents, & that both companies carry $25k of non-inference cost of goods for hosting, evaluation infrastructure & human review. Those assumptions set the absolute margins, not the gap between them. At ten task equivalents the comparison is 59% against 81% ; at thirty it is a loss against 64%. Inferefficient stays a software business across that range & Inferno does not, which is the point. ↩︎
  • Melissa Z. Pan、Shuo Yang、Negar Arabzadeh、Wei-Lin Chiang、Ion Stoica 与 Matei Zaharia,《HarnessTax:Harness 对 Coding Agents 的影响有多大?》,2026 年。包含 21 个模型-harness 配对,每个配对在 SWE-bench Lite 和 Terminal-Bench 2.0 中各执行 30 个任务,每个任务尝试三次,费用基于 2026 年 9 月 1 日的固定价格表计算。在所有 42 次同模型 harness 比较中,双侧 Fisher 精确检验发现仅有一个结果满足 p < 0.05,而仅凭随机 chance 本应产生约两个此类结果;且没有任何结果通过 Holm-Bonferroni 校正。存在两个局限性:已发布的 rollout 数据按成本排序,这破坏了任务配对关系并排除了配对检验的可能性;且每单元格 90 次 rollout 的样本量下,研究仅能检测到大约十五个百分点的波动。在此样本量下,质量差距未被证实,但也不能证明其不存在。↩︎
  • 该研究中 harness 的替换是指 GPT-5.6 Sol 从 Claude Code 切换到 Pi:每项解决任务的成本从 1.540 美元降至 0.441 美元,两侧使用的是同一模型。这 71% 的成本降低是实测数据,也是该论点的基础。其余内容为示例说明:一家公司的评估运行约相当于十七个基准任务,且两家公司均承担 25,000 美元的除推理外的商品成本(用于托管、评估基础设施及人工审核)。这些假设设定了绝对利润空间,而非两者之间的差距。当以十个任务当量计算时,比较结果为 59% 对比 81%;当以三十个任务当量计算时,则为亏损对比 64%。在该范围内,Inferefficient 始终是一家软件企业,而 Inferno 则不是,这正是核心观点所在。↩︎

更进一步:量化金融体系

看懂新闻只是起点——沿量化金融路径,把它变成能交付的工程能力

进入量化体系 →

相似阅读

关联信息,但可能不是同一事件