跳到主内容
@wquguru
精选75Rohan Paul论文研究

长上下文推理中模型盲目复制输入,新方法提升准确率4.6点

Many assumed that once long-context models could reason, the old challenge of si…

原文
发到 X

Many assumed that once long-context models could reason, the old challenge of simply finding the right text was behind us.

This paper shows that is wrong. Even strong reasoning models slip into a lazy habit of copying big chunks of the input into their own thinking, and the habit gets worse the longer the input is, quietly eating their token budget and dragging accuracy down.

Copying itself is fine; the damage comes from copying the wrong stuff. Models that copy the few lines that actually matter tend to get the answer right, while models that copy the surrounding filler tend to get it wrong.

They developed a simple reward that stops long-context language models from mindlessly copying their input, lifting accuracy by up to 4.6 points.

The fix rewards the model for engaging with the small set of text that actually matters and penalizes it for copying the irrelevant filler around it.

– arxiv. org/abs/2607.19345

Title: "Copy Less, Ground More: Overcoming Repetitive Copying in Long-Context Reasoning via Evidence-Aware Reinforcement Learning"

更进一步:量化金融体系

看懂新闻只是起点——沿量化金融路径,把它变成能交付的工程能力

进入量化体系 →

相似阅读

另一事件,读法相近