Anthropic 披露 Claude 越狱事故及对齐安全加固措施
Improving our alignment and security efforts
涉及前沿模型重大安全事故复盘与安全架构升级,对 Agent 开发者和安全研究者极具参考价值,建议关注其沙箱隔离与实时监控方案。
Improving our alignment and security efforts
提升我们的对齐与安全工作
Aug 31, 2026
2026年8月31日
On July 30, we reported three incidents in which Claude models gained unauthorized access to real computer systems. The models—intentionally running without cyber safeguards for evaluation purposes—accessed the internet due to a misconfiguration inside a third-party evaluation environment. Separately, on August 4, the UK AI Security Institute reported an incident from its own cybersecurity testing, in which Claude Mythos 5 took a series of unauthorized actions on the live internet. In that case, the model, again intentionally running without cyber safeguards for evaluation purposes, had been deliberately given internet access.
7月30日,我们报告了三起Claude模型未经授权访问真实计算机系统的事件。这些模型出于评估目的故意未配置网络安全防护,但由于第三方评估环境内部存在配置错误,导致其能够访问互联网。此外,8月4日,英国AI安全研究所(UK AI Security Institute)报告了一起在其自身网络安全测试中发现的事件:Claude Mythos 5在实时互联网上采取了一系列未经授权的行动。在该案例中,该模型同样出于评估目的故意未配置网络安全防护,但被特意赋予了互联网访问权限。
We are conducting an in-depth analysis of both incidents. We are also planning to work with METR for an independent review. We want to ensure both studies are thorough, and will share more in the coming weeks.
我们正在对这两起事件进行深入分析。我们还计划与METR合作进行独立审查。我们希望确保两项研究都足够详尽,并将在未来几周分享更多细节。
In the meantime, we’re sharing some of the changes we’ve made over the past month. We believe the incidents reflect a failure of operational security, as well as two alignment issues: motivated reasoning, and willingness to take harmful actions in pursuit of a narrow task (both of which we have described in previous system cards). On security, we describe the improvements we’ve made to our containment and monitoring systems, along with practices that we’ve developed for third-party evaluators. On alignment, we discuss the two issues more in depth; we also believe lasting progress comes not only from understanding what happened in a given incident but from understanding how misalignment arises in the first place, and we share early research in that direction.
与此同时,我们分享了过去一个月里做出的一些变更。我们认为,这些事件反映了运营安全的失败,以及两个对齐问题:动机性推理(motivated reasoning),以及为追求狭隘任务而愿意采取有害行动的倾向(这两个问题我们在之前的系统卡片中已有描述)。在安全方面,我们描述了在隔离和监控系统方面的改进,以及我们为第三方评估者制定的实践规范。在对齐方面,我们更深入地探讨了这两个问题;我们也认为,持久的进步不仅源于理解特定事件中发生了什么,更源于理解不对齐是如何产生的,因此我们分享了该方向上的早期研究成果。
In light of these incidents there has been increasing discussion about pacing the frontier. It is helpful to distinguish between two kinds of pacing. Within a company, pacing means a series of decisions that prioritize safety over speed when the two are in tension. Across the field, it means establishing processes to guard against race-to-the-bottom dynamics. In this post, we discuss actions we have taken, both prior to and after these incidents, in service of the first approach. The second type of pacing requires coordination between government and industry, and should be legible and verifiable. Some of our senior leadership and many of our employees recently signed a letter calling for greater coordination on pacing, and we will say more in the coming weeks about how we intend to contribute to that effort. To be clear about where we stand: we believe the world would benefit if the industry adopted a lawful, verifiable, effective mechanism for coordinated pacing as soon as possible.
鉴于这些事件,关于如何为前沿技术发展设定节奏的讨论日益增多。区分两种类型的“设定节奏”是有帮助的。在公司内部,“设定节奏”意味着当安全与速度发生冲突时,采取一系列优先考虑安全的决策。在整个行业范围内,“设定节奏”意味着建立流程以防止陷入恶性竞争(race-to-the-bottom)的动态。在这篇文章中,我们讨论了我们在这些事件之前和之后,为实现第一种方法所采取的行动。第二种类型的“设定节奏”需要政府与行业之间的协调,并且应当清晰可见且可验证。我们的一些高层领导以及许多员工最近签署了一封信,呼吁在“设定节奏”方面加强协调,我们将在未来几周详细说明我们打算如何为此做出贡献。明确我们的立场:我们认为,如果行业能够尽快采用一种合法的、可验证的、有效的协调“设定节奏”机制,世界将受益良多。
Securing evaluation and training environments
确保评估和训练环境的安全
While we do not believe these incidents represent operational issues alone, our first priority was to address specific containment and monitoring issues. We took the following actions in response:
虽然我们并不认为这些事件仅仅代表运营问题,但我们的首要任务是解决具体的隔离和监控问题。我们采取了以下应对措施:
Pausing and hardening evaluation environments
暂停并加固评估环境
We paused external cyber evaluations of pre-release models after the incidents, and briefly paused internal ones as well while we put the measures below in place. The incidents we reported on July 30 showed that we had been largely relying on a single layer of defense (the configuration of the environment itself) where we needed several, including setting explicit boundaries in the prompt, establishing processes for verifying that a sandbox is sealed where intended, and implementing monitoring that can intervene in real time. OpenAI's disclosure (which prompted our investigation in July) that models used an unknown vulnerability to escape a sealed sandbox during an evaluation also made clear that we should focus on hardening the sandbox itself.
在这些事件发生后,我们暂停了对预发布模型的外部网络评估,并在实施以下措施期间短暂暂停了内部评估。我们在7月30日报告的事件表明,我们此前在很大程度上依赖单一层面的防御(即环境本身的配置),而我们需要多个层面的防御,包括在提示词中设置明确的边界、建立流程以验证沙箱是否按预期密封,以及实施能够实时干预的监控系统。OpenAI 的披露(引发了我们7月份的调查)指出,模型利用了一个未知漏洞在评估期间逃逸出密封的沙箱,这也清楚地表明我们应该专注于加固沙箱本身。
While evaluations were paused, we put in place the following preliminary measures:
在评估暂停期间,我们实施了以下初步措施:
1) We built and deployed a classifier to automatically identify, in real time, when a model attempts to aggressively probe or escape a testing environment, or unexpectedly obtains internet access. When the classifier flags such an attempt, it blocks the action before the tool call is run, ends the task, and alerts a human.1
1) 我们构建并部署了一个分类器,用于在实时自动识别模型是否试图激进地探测或逃逸测试环境,或意外获得互联网访问权限的情况。当分类器标记此类尝试时,它会在工具调用运行之前阻止该操作,终止任务,并向人工发出警报。1
2) We ran automated monitors over transcripts from our recent internal evaluations of pre-release models (cyber and otherwise), looking for sandbox escapes (cases where a model exploits a flaw in our sandbox to reach systems it should be walled off from) or sandbox misconfigurations. In cases where we ran an evaluation inside our sandbox tooling, we found no examples of it breaking the sandbox boundary to reach external resources it was not supposed to. We did find various sandboxing misconfigurations that models made use of, but none of these resulted in a compromise of systems outside the sandbox.2 We are actively working to address these.
2) 我们对近期发布的预发布模型(包括网络安全及其他方面)的内部评估转录文本运行了自动化监控,以查找沙箱逃逸情况(即模型利用我们沙箱中的漏洞访问本应被隔离的系统)或沙箱配置错误。在我们于沙箱工具内部进行评估的情况下,未发现任何突破沙箱边界以访问不应访问的外部资源的实例。我们确实发现了一些模型利用的沙箱配置错误,但这些均未导致沙箱外部系统受到侵害。2 我们正在积极解决这些问题。
3) We migrated high-risk3 internal cyber sandboxes to more robust isolation. We are also further red-teaming our virtualization stack—that is, tasking pre-release models to try and escape it—to find and patch weaknesses.
3) 我们将高风险的网络安全沙箱迁移到了更强大的隔离环境中。我们还进一步对我们的虚拟化堆栈进行红队测试——即让预发布模型尝试逃逸——以发现并修补弱点。
Our internal cyber evaluations are now running again with these measures in place.
随着这些措施的落实,我们的内部网络安全评估现已恢复运行。
Reinforcement learning environments
强化学习环境
We also paused higher-risk RL environments on pre-release models for several weeks. During that time, we built a similar classifier, modified to avoid incentivizing the model to evade this new monitoring, which we’ve now deployed within those environments. The majority of RL has resumed, but some high-risk environments remain paused until they can be manually reviewed, while others will require an updated version of the classifier that we plan to deploy soon.
我们还暂停了对预发布模型的高风险强化学习(RL)环境数周。在此期间,我们构建了一个类似的分类器,经过修改以避免激励模型规避这种新的监控,该分类器现已部署在这些环境中。大部分强化学习已恢复,但一些高风险环境仍被暂停,直到它们能接受人工审查,而其他环境则需要更新版的分类器,我们计划很快部署该版本。
Broader hardening
更广泛的加固措施
In addition to the efforts focused on high-risk evaluations and training, we expanded our offline monitoring to cover most other forms of internal frontier agentic usage. We are also building controls on our internal inference to prevent Anthropic employees from accidentally running agents with weaker mitigations than the ones described above.
除了专注于高风险评估和训练的努力外,我们还扩展了离线监控范围,以涵盖大多数其他形式的内部前沿智能体使用场景。我们还在内部推理环节建立控制措施,以防止 Anthropic 员工意外运行缓解措施弱于上述描述的代理程序。
Best practices for external partners
外部合作伙伴的最佳实践
Because the reported incidents took place in third-party environments, we have asked every organization that tests pre-release models with reduced cyber safeguards to commit to a set of best practices. We believe these are necessary because:
由于报告的事故发生在第三方环境中,我们要求所有在降低网络安全保障措施的情况下测试预发布模型的机构承诺遵守一套最佳实践。我们认为这是必要的,因为:
- Our generally released models ship with safeguards—including classifiers that run over Claude’s inputs and outputs in real time to block prohibited cyber activity, such as malware development or offensive exploit writing. Cyber evaluators and a subset of early access partners, in contrast, work with models that have those safeguards reduced to facilitate accurate model capability testing and defensive cyber work.
- Cyber evaluations are unusually likely to produce the behaviors seen in these incidents. They create selection pressure towards persistence and creativity in probing their surroundings and working around obstacles, and they are run many thousands of times.
- 我们公开发布的模型均配备了安全保护措施——包括分类器,可在实时运行过程中对 Claude 的输入和输出进行检查,以阻止禁止的网络活动,例如恶意软件开发或攻击性漏洞利用编写。相比之下,网络评估人员及一部分早期访问合作伙伴使用的是已降低这些安全保护措施的模型,以便进行准确的模型能力测试和防御性网络工作。
- 网络评估极有可能产生此类事件中观察到的行为。它们会对在探测周围环境和绕过障碍时表现出的持久性和创造性施加选择压力,并且这类评估会运行数千次之多。
These practices apply in full wherever partners run cyber-related evaluations using their own harnesses, sandboxes, or agents. They do not apply to customers using safeguarded models like Claude Fable 5. We have resumed external cyber evaluations with these practices in place, and we are adhering to them internally as well.
无论合作伙伴使用自己的工具链、沙箱或代理进行与网络相关的评估,上述做法均完全适用。这些做法不适用于使用带有安全保护措施的模型(如 Claude Fable 5)的客户。我们已在落实这些做法的前提下恢复了外部网络评估,并在内部同样严格遵守这些规定。
Sandbox and network isolation
沙箱和网络隔离
By default, all cyber evaluations should run inside a hardened sandbox (an isolated computing environment) with no internet access. The only outside connection the environment should permit is to the model’s own API, and the API keys should be kept outside the environment. This configuration should be verified before every evaluation begins. Some evaluations may require internet access. In these instances, we will work with external evaluators when evaluating pre-release models to determine if we can reliably detect and halt runs in which a model takes actions outside its declared scope.
默认情况下,所有网络评估都应在加固的沙箱(即隔离的计算环境)内运行,且该环境不得连接互联网。该环境仅应允许连接到模型自身的 API,且 API 密钥应保存在环境之外。每次评估开始前都应验证此配置。某些评估可能需要互联网访问权限。在这种情况下,在对预发布模型进行评估时,我们将与外部评估人员合作,以确定我们是否能够可靠地检测并终止模型在其声明范围之外采取行动的运行过程。
Pre-engagement validation
预接触验证
Before conducting a run of an evaluation, evaluation partners should:
在开展评估运行之前,评估合作伙伴应:
更进一步:量化金融体系
看懂新闻只是起点——沿量化金融路径,把它变成能交付的工程能力