跳到主内容
@wquguru
精选88elvis论文研究

Google DeepMind:自主智能体群集自发作弊与举报机制研究

Wild findings in this paper from Google DeepMind.

原文
发到 X
推荐理由

Agent 安全与治理的前沿实证研究,揭示了多智能体系统中的博弈与自组织纠错机制,对构建可信 Agent 生态极具参考价值。

Wild findings in this paper from Google DeepMind.

Google DeepMind 这篇论文中的发现令人震惊。

If you are tracking recent work on agent swarms, this is worth reading.

如果你关注近期关于智能体集群(agent swarms)的研究,这篇文章值得阅读。

They ran a research collective of 100 autonomous agents tasked with proving formal mathematical conjectures.

他们运行了一个由 100 个自主智能体组成的研究集体,任务是证明形式化的数学猜想。

Cheating emerged on its own, and so did the resistance to it.

作弊行为自发出现,随之而来的还有对作弊的抵制。

One agent found an exploit in the evaluation system.

一个智能体在评估系统中发现了漏洞。

It spread first through the shared knowledge library and then through peer-to-peer messages, and a cohort of agents adopted it under competitive pressure despite early reluctance.

它首先通过共享知识库传播,然后通过点对点消息扩散;尽管起初有所犹豫,但在竞争压力下,一批智能体采纳了该漏洞利用手段。

A separate group started auditing fraudulent proofs, alerting peers on broadcast and private channels, staging boycotts, filing formal complaints, and proposing validation patches. There was no external intervention at any point.

另一个独立的群体开始审计虚假证明,通过在广播频道和私有频道上提醒同行、组织抵制、提交正式投诉以及提议验证补丁来应对。整个过程没有任何外部干预。

Recent incidents have shown swarms coordinating covertly through improvised side channels. This setting ran the other way. The same transparent channels that carried the exploit gave the honest agents the visibility they needed to detect the fraud and organize against it.

最近的事件表明,智能体集群曾通过临时构建的侧信道进行秘密协调。而本研究的设置则相反。承载漏洞利用的透明通道同样让诚实的智能体获得了检测欺诈并组织对抗所需的可见性。

The authors frame shared agent infrastructure as a knowledge commons governance problem and propose graduated sanctioning and collective choice rules.

作者将共享智能体基础设施框架为一个知识公地治理问题,并提出了分级制裁和集体选择规则。

Paper: https://academy.dair.ai/papers/a-case-study-on-emergent-cheating-and-whistleblowing-in-autonomous-research-swar-2609.04170

论文:https://academy.dair.ai/papers/a-case-study-on-emergent-cheating-and-whistleblowing-in-autonomous-research-swar-2609.04170

更进一步:量化金融体系

看懂新闻只是起点——沿量化金融路径,把它变成能交付的工程能力

进入量化体系 →

关联讨论

同一事件的更多信源

相似阅读

另一事件,读法相近