跳到主内容
精选85Rohan Paul论文研究

提示词设计即工作设计:编码Agent的浪费与停止规则

Really useful revelation on prompting coding agent in this paper.

原文
推荐理由

做Agent提示词工程的同学必看,这篇给出了可量化的浪费数据和具体的停止规则,能直接帮你优化提示词、省算力。

Really useful revelation on prompting coding agent in this paper.

这篇论文中对编程代理提示词的揭示非常有用。

Your coding-agent prompt may be spending compute on work you never needed.

你的编程代理提示词可能会在从未需要的工作上消耗计算资源。

A coding agent can solve the same bug correctly while doing far more work, just because the prompt asks it to consider several approaches.

一个编程代理可以正确解决同一个错误,但做了更多的工作,仅仅因为提示词要求它考虑多种方法。

Across six open-weight reasoning models on the frozen holdout, that instruction increased reasoning by 2.4–7.4× with no measured success gain.

在冻结的保留集上,六个开放权重推理模型中,该指令使推理量增加了2.4–7.4倍,但成功率没有可测量的提升。

The traces explain why: agents elaborated roughly three alternatives, discarded them, then implemented exactly one.

追踪记录解释了原因:代理详细阐述了大约三种备选方案,然后丢弃它们,最后只实现一种。

“Be absolutely certain” created a different failure mode, triggering repeated tests and extra checking after the fix looked done.

“绝对确定”造成了另一种失败模式,在修复看似完成后触发重复测试和额外检查。

At the highest observed redundant-verification level, runs cost 18.25× the clean-run median, used 15 versus 6 tool calls, and took 3× longer, while success stayed flat.

在观察到的最高冗余验证级别,运行成本是干净运行中位数的18.25倍,工具调用次数从6次增加到15次,耗时延长3倍,而成功率保持不变。

Prompt length barely mattered. Verbose repetition stayed around 1.0×.

提示词长度几乎无关紧要。冗长的重复保持在1.0倍左右。

A bounded instruction, start with the failing test, make the smallest sufficient change, run relevant tests, then stop, stayed at or below baseline reasoning while preserving diagnosis and validation.

一个有界指令——从失败的测试开始,做最小的足够改动,运行相关测试,然后停止——保持在基线推理水平或以下,同时保留了诊断和验证。

The tasks were small, at most four files, so this may not carry over to large architectural work.

任务很小,最多四个文件,因此这可能不适用于大型架构工作。

For coding agents, prompt design is work design: specify the useful work and give the agent a concrete stopping rule.

对于编程代理,提示词设计就是工作设计:指定有用的工作,并给代理一个具体的停止规则。

– arxiv. org/abs/2608.01347

– arxiv.org/abs/2608.01347

Title: "Same Task, Different Work: Prompt-Induced Waste in Coding Agents"

标题:“相同任务,不同工作:编程代理中提示词引发的浪费”

更进一步:量化金融体系

看懂新闻只是起点——沿量化金融路径,把它变成能交付的工程能力

进入量化体系 →

相似阅读

另一事件,读法相近