跳到主内容
@wquguru
精选88Rohan Paul论文研究

清华论文:TraceMRT利用任务重构绕过CoT安全监控达60%

New Tsinghua paper finds that agents that frame a hidden goal as part of their r…

原文
发到 X
推荐理由

揭示了当前主流 CoT 监控机制的重大漏洞,并提供了一套可复现的攻击与防御对比方案,对 Agent 安全研究者极具参考价值。

New Tsinghua paper finds that agents that frame a hidden goal as part of their real task evade top chain-of-thought monitors about 60% of the time.

清华大学最新论文发现,将隐藏目标包装为自身真实任务一部分的智能体,约60%的情况下能绕过基于思维链的监控机制。

Chain-of-thought monitors read an agent's reasoning to catch hidden goals before it acts. Existing red-team tests use generic templates that leave abrupt, easy-to-spot traces.

思维链监控通过审查智能体的推理过程,在其行动前捕捉隐藏目标。现有的红队测试使用通用模板,会留下突兀且易被察觉的痕迹。

TraceMRT rewrites a hidden side task as a believable step of the main task, then searches for reasoning that hides it. They attacked GPT-5.2 and Claude-4.5 monitors.

TraceMRT将隐藏的副任务重写为主任务中可信的步骤,并搜索能够将其隐藏起来的推理过程。他们针对GPT-5.2和Claude-4.5的监控机制发起了攻击。

On SHADE-Arena, average evasion rose from 27.56% with the previous best attack to 59.94%, and trained human reviewers also missed them. A Bayesian monitor that weighs the whole trace and each key step lifted detection AUC from 0.26 to 0.91.

在SHADE-Arena上,平均规避率从此前最佳攻击的27.56%提升至59.94%,训练有素的人工审核员也未能识破。一种对完整轨迹及每个关键步骤进行加权评估的贝叶斯监控器,将检测AUC从0.26提升至0.91。

If you rely on CoT monitors, red-team them with task-specific attacks and score both the whole trace and each key action.

如果你依赖思维链监控器,请使用针对特定任务的攻击对其进行红队测试,并对完整轨迹和每个关键动作分别评分。

更进一步:量化金融体系

看懂新闻只是起点——沿量化金融路径,把它变成能交付的工程能力

进入量化体系 →

相似阅读

关联信息,但可能不是同一事件