跳到主内容
@wquguru
精选70r/LLMDevs(Reddit)模型发布/更新多源精选 ×3

Anthropic Agent记忆机制实验:通过“做梦”纠正错误记录

Claude got lost in Pokémon. The fix was to correct what it remembered.

原文
发到 X

Giving an agent memory sounds like an obvious upgrade. Anthropic's new memory research has a nice example of why saving something can also make a mistake stick.

赋予智能体记忆听起来像是一个显而易见的升级。Anthropic 最新的研究成果提供了一个很好的例子,说明保存某些信息也可能导致错误被固化。

In a Pokémon run, Claude recorded the wrong location for a PokéCenter near Mt. Moon. It then trusted that note while navigating and ended up back on an earlier route. The memory was actively steering it the wrong way.

在《宝可梦》游戏流程中,Claude 记录了月见山附近一个宝可梦中心(PokéCenter)的错误位置。它在导航时信任了这条笔记,结果又回到了之前的路线上。这种记忆实际上在引导它走向错误的方向。

The researchers ran what they call 'dreaming': Claude checked its saved notes against the original session transcript, found the location error and rewrote the note. With the correction, it went back into the cave and eventually reached Cerulean City.

研究人员执行了他们所谓的“做梦”过程:Claude 将其保存的笔记与原始会话记录进行核对,发现了位置错误并重写了该笔记。经过修正后,它重新进入洞穴并最终到达了华蓝市(Cerulean City)。

This is external memory being checked and reorganized, not the model changing its weights or evidence of consciousness. It's a reported experiment, not a claim that all Claude sessions now do this.

这是对外部记忆进行检查和重组,并非模型改变了权重或表现出意识迹象。这是一项已报告的实验,而非声称所有 Claude 会话现在都会这样做。

The useful distinction for me is between remembering a conclusion and remembering why that conclusion was justified. A neat summary can look authoritative even when the original observation was ambiguous.

对我来说,有用的区分在于记住结论与记住该结论为何合理之间的区别。即使原始观察存在歧义,简洁的摘要看起来也可能具有权威性。

For an agent I wanted to keep running, I'd want a correction to preserve the old note and the evidence for the change. Quietly replacing one confident note with another makes it hard to tell whether the agent learned something or merely changed its story. That's a design preference, not a result demonstrated by this experiment.

对于我希望持续运行的智能体,我希望能保留旧笔记以及变更的证据。悄悄用一个自信的笔记替换另一个,会让人难以判断智能体是学到了新东西,还是仅仅改变了说法。这是一种设计偏好,而非本实验所证明的结果。

Source: Anthropic, The components of agent memory.

来源:Anthropic,《智能体记忆的组成部分》。

Disclosure: I work on an AI API service. This is AI-assisted research commentary, not a product recommendation or an experiment I reproduced.

披露:我在一家 AI API 服务公司工作。本文为 AI 辅助的研究评论,并非产品推荐,也不是我复现的实验。

更进一步:量化金融体系

看懂新闻只是起点——沿量化金融路径,把它变成能交付的工程能力

进入量化体系 →