跳到主内容
@wquguru
精选88The Zvi(RSS)行业动态多源精选 ×3

Anthropic泄露AI监管草案遭批:削弱执法权,被指偏袒商业利益

Leaked Anthropic Draft AI Regulatory Bill Is Unacceptable and Troubling

原文
发到 X
推荐理由

AI行业核心玩家主动推动监管立法的罕见案例,其草案细节直接反映大厂对安全与合规的真实态度,值得从业者关注。

There is a newly leaked bill that Anthropic is purportedly shopping around is (if you assume its bugs get fixed).

据传Anthropic正在四处游说的一项新泄露法案是(如果你假设其中的漏洞得到修复的话)。

It is similar to the FRONTIER Act, with stronger preemption of state laws, stronger transparency provisions and weaker enforcement provisions.

它与FRONTIER法案类似,具有更强的州法优先效力、更透明的条款以及较弱的执行条款。

Having slept on this, I find it unacceptable that Anthropic is actively shopping exactly the type of bill I have warned we will need to fight against during the lame duck session. They are trying to use this last time with a Republican Congress to pass preemption of exactly the important state laws, and get some transparency but not much enforcement in exchange.

经过深思熟虑,我认为Anthropic积极推销正是我警告过我们在跛脚鸭会期中需要与之斗争的那种法案,这是不可接受的。他们正试图利用共和党控制国会的最后机会,通过优先适用那些重要的州法律,并以换取一些透明度但缺乏有力执行为代价。

This reads as intentional, that Anthropic is more afraid that the government might enforce rules against Anthropic, than they are worried about the ability of the government to enforce rules against everyone. Anthropic’s policy team seems to have, chosen protecting their business interests and guarding against their political risk, at the expense of safety considerations.

这看起来是故意的,即Anthropic更担心政府可能会对其执行规则,而不是担心政府有能力对所有人执行规则。Anthropic的政策团队似乎选择了保护其商业利益和防范政治风险,而牺牲了安全考量。

There was no need for the company purportedly existing to promote safety to propose a bill that is not even actively stronger than the FRONTIER Act, when the FRONTIER Act was a compromise bill proposed back in June.

当FRONTIER法案是六月提出的妥协方案时,这家自称致力于促进安全的公司根本没有必要提出一项甚至不如FRONTIER法案积极的法案。

Even if you were fine with what is being given up, what you get in return very obviously does not meet the moment. Nor is there any need for such compromises. It seems rather insane for Anthropic to be proposing it now. This seems like the bill that someone on the anti-regulatory side should be pushing. It is not obvious this makes us safer than doing nothing, even if the alternative is fully nothing at all levels.

即使你同意所放弃的内容,你得到的回报显然也不符合当前的形势。而且也没有必要做出这样的妥协。Anthropic现在提出这一点似乎相当疯狂。这看起来像是反监管一方应该推动的法案。即使替代方案是完全什么都不做,这是否让我们比什么都不做更安全也不明显。

Say it isn’t so, Anthropic, or at least that it was a mistake and is no longer so, or I am going to be rather cross.

Anthropic,请别这么说,或者至少承认这是个错误且不再如此,否则我会非常生气。

I am at a conference and cannot do an RTFB, but it feels important to get word of this out quickly, especially so Anthropic employees can look into this and ask questions.

我正在参加一场会议,无法进行RTFB(阅读法案),但感觉有必要迅速传播这一消息,特别是让Anthropic的员工能够调查此事并提出问题。

If you want the full text, here is a copy.

如果你想看全文,这里有一份副本。

Others RTFB (Read the Bill)

其他人RTFB(阅读法案)

I have not had the time to do so, but the other usual suspects quickly sprinted to RTFB (read the bill) and they did not like what they saw. You can try to call this a ‘pretty reasonable AI safety bill’ as Charlie Bullock does, but that is by the standards of people trying to protect the industry from more impactful regulation.

我没有时间这样做,但其他通常的怀疑者迅速去RTFB(阅读法案),他们对所见内容并不满意。你可以像Charlie Bullock那样称其为‘相当合理的AI安全法案’,但这只是基于那些试图保护行业免受更具影响力监管的人的标准。

POLITICO: Anthropic quietly pitches its own AI safety bill to lawmakers.

POLITICO:Anthropic悄悄向立法者推销其自身的AI安全法案。

Ketan Ramakrishnan: Anthropic’s new federal AI bill is, without any overstatement, astonishingly bad.

Ketan Ramakrishnan:Anthropic的新联邦AI法案,毫不夸张地说,糟糕透顶。

Charlie Bullock: Big news. My take: Anthropic deserves some credit for actually proposing a pretty reasonable AI safety bill; that’s more than other frontier labs have done.

Charlie Bullock:重大新闻。我的看法是:Anthropic 值得一些肯定,因为他们确实提出了一项相当合理的 AI 安全法案;这比其他前沿实验室做得要多。

But they don’t deserve *too* much credit, IMO; this bill is weaker than the Trahan-Obernolte FRONTIER Act in some key ways, and since the political momentum has shifted significantly in the direction of safety since FRONTIER was introduced back in July, I think new bills introduced today should ideally go further than FRONTIER was able to go rather than regressing.

但在我看来,他们不值得*过多*赞誉;在某些关键方面,这项法案比 Trahan-Obernolte FRONTIER 法案要弱,而且自今年七月 FRONTIER 法案提出以来,政治风向已显著转向安全方向。我认为今天提出的新法案 ideally 应该比 FRONTIER 所能达到的走得更远,而不是倒退。

To be fair to Anthropic, the main places where this bill is significantly weaker than FRONTIER are (a) rulemaking (very strong in FRONTIER, almost nonexistent in Anthropic’s bill) and (b) the emergency shutdown authority. Even if you take safety seriously, it might make some sense to dial those authorities back if you didn’t trust the executive branch to wield them responsibly, because those are the easiest provisions for a hypothetical President who hypothetically might not like a certain frontier AI company to abuse.

公平地说,Anthropic 的主要弱点在于(a)规则制定(FRONTIER 中非常强有力,而在 Anthropic 的法案中几乎不存在)和(b)紧急停机权。即使你认真对待安全问题,如果你不信任行政部门负责任地行使这些权力,那么削弱这些权限可能也有一定道理,因为这些是最容易被一个假设的、可能对某家特定前沿 AI 公司不满的总统滥用的条款。

There are some improvements over FRONTIER as well; for instance, this bill does specify that auditors are employed on a continuing basis and has better provisions regarding auditor access to information. Happy to see that from Anthropic (although I think their access provision is still a little undercooked and has Fourth Amendment problems).

也有一些优于 FRONTIER 的地方;例如,这项法案明确规定审计员是持续聘用的,并且在审计员获取信息方面有更好的规定。很高兴看到 Anthropic 有这方面的举措(尽管我认为他们的信息获取规定仍然有些欠妥,并存在第四修正案的问题)。

Overall, I think the embedded auditor bills that get introduced in the coming months are going to be significantly better and more ambitious than this, and I hope Anthropic supports those bills instead of opposing anything that treats catastrophic risks like the serious national security issue they are. Still, it’s encouraging to see a frontier lab come this far.

总体而言,我认为未来几个月推出的嵌入式审计员法案将会比这项法案好得多,也更有雄心壮志。我希望 Anthropic 能支持这些法案,而不是反对任何将灾难性风险视为严重国家安全问题的举措。尽管如此,看到一家前沿实验室走到这一步还是令人鼓舞的。

Charlie Bullock: I think the drafting is okay. I’ve seen better but I’ve definitely seen worse. Claude is a pretty good legislative drafter. There are a few clear mistakes but that’s par for the course in a leaked discussion draft.

Charlie Bullock:我认为起草工作还可以。我见过更好的,但也绝对见过更差的。Claude 是一位相当不错的立法起草者。虽然有一些明显的错误,但这在泄露的讨论草案中是常态。

Nathan Calvin: Charlie’s analysis is right but he is nicer than I am – I found myself viscerally angry at multiple points reading this bill. There are some good and sensible parts, but overall this legislation is not remotely close to meeting the moment and I overall think passing it would make us less protected against catastrophic risks than we are under existing law.

Nathan Calvin:Charlie 的分析是正确的,但他比我温和——我在阅读这份法案时多次感到本能的愤怒。其中有一些好且明智的部分,但总体而言,这项立法远远未能应对当下的挑战,我认为通过它会使我们比现有法律下更少受到灾难性风险的威胁。

Two parts that stand out as particularly infuriating when taken together:

有两部分结合在一起特别令人恼火:

1. Some of the preemption provisions are remarkably far reaching and consequential, and in addition to preempting legislation like SB 53 would also remove general powers that state courts have to enjoin defendants and protect the public. Most outrageously, it has a provision that looks like its intended to stops states from enforcing laws or judicial decrees that “suspend the development, deployment, or internal use of an AI model” to protect their citizens from imminent catastrophic harms. Such powers to block and suspend model deployments would then only reside with the federal government.

1. 某些优先适用条款的影响深远且后果严重,除了像 SB 53 这样的立法被优先适用外,还会剥夺州法院禁止被告和保护公众的一般权力。最为令人愤慨的是,其中包含一项看似旨在阻止各州执行或司法裁决中“暂停人工智能模型的开发、部署或内部使用”以保护其公民免受迫在眉睫的灾难性伤害的规定。此类阻止和暂停模型部署的权力将仅由联邦政府掌握。

2. The federal governments powers to restrict the development, deployment, or internal use of a frontier model has to meet an absurdly high bar.

2. 联邦政府限制前沿模型开发、部署或内部使用的权力必须满足极其苛刻的条件。

First, there needs to be an imminent risk of a catastrophic harm (meaning killing more than 50 people or causing more than a billion dollars in damage). But thats not enough! The agency head needs to make a detailed determination with no deference given to show why no alternative would prevent the imminent catastrophe. Next the court is also explicitly told to consider the harms to the developer and other harms from restricting the model, but no considerations in the other direction.

首先,必须存在造成灾难性伤害的紧迫风险(即导致超过 50 人死亡或造成超过十亿美元的损失)。但这还不够!机构负责人需要进行详细认定,且不得给予任何尊重,以证明为何没有其他替代方案可以防止迫在眉睫的灾难。接下来,法院也被明确要求考虑限制该模型对开发者造成的损害以及其他损害,但不考虑相反方向的任何因素。

This is absurd! For all of its warning about the potential for AI to cause a catastrophe that kills literally everyone on the planet, Anthropic’s proposed federal law likely makes it harder than under existing law for a court to get an order blocking or restricting the development of frontier models? WTF??

这太荒谬了!Anthropic 在其警告中强调人工智能可能导致杀死地球上每个人的灾难,但其提出的联邦法律很可能使得法院比在现行法律下更难下达命令来阻止或限制前沿模型的开发?真是搞不懂??

There are also a bunch of others things that I would like to see improved – the substantive details of the auditing section and the potential for rule-making on substantive safety standards both come to mind – but I think these stand out as particularly indefensible.

还有一些其他方面我希望看到改进——审计部分的具体细节以及制定实质性安全标准的规则制定潜力都浮现在我脑海中——但我认为上述几点尤为难以辩护。

Charlie Bullock: Nathan’s righteous anger has inspired me to make one more mildly disapproving observation: it’s kind of wild that the Anthropic bill has no government licensing for the independent auditors.

Charlie Bullock:Nathan 义愤填膺的情绪激励我再做一个略带不满的观察:Anthropic 法案竟然没有对独立审计师进行政府许可,这简直令人难以置信。

Licensing is, IMO, the bare minimum thing that you need to even be able to pretend that your auditing regime isn’t just going to devolve into a race to the bottom. Without it, auditors will inevitably compete with each other to offer their customers, the labs, the least bothersome audits available at the lowest possible price point. Obviously Anthropic trusts itself to do a great job of picking great auditors, but do they trust OpenAI to do the same? What about SpaceXSI?

在我看来,许可制度是你至少能够假装你的审计机制不会沦为逐底竞争所必需的最基本要求。如果没有它,审计师不可避免地会相互竞争,以最低的可能价格向他们的客户(即实验室)提供最少打扰的审计服务。显然,Anthropic 相信自己能很好地挑选出优秀的审计师,但他们相信 OpenAI 也能做到吗?SpaceXSI 呢?

Why Would Anthropic Do This?

Anthropic 为什么要这么做?

The new Anthropic bill is weaker than their June framework, and offers both forward-looking and backward-looking preemption in exchange, despite months of movement to enable us to do more. What are we even doing?

Anthropic 的新法案比其六月框架更弱,尽管经过数月的推动以使我们能够做更多工作,但它却以提供前瞻性(forward-looking)和回溯性(backward-looking)的优先权作为交换。我们到底在做什么?

Nate Soares: Anthropic’s proposed law would make it even harder than it already is for a court to block or restrict the development of an AI that threatens all humanity.

Nate Soares:Anthropic 提出的法律将使法院更难阻止或限制威胁全人类的人工智能的发展。

更进一步:量化金融体系

看懂新闻只是起点——沿量化金融路径,把它变成能交付的工程能力

进入量化体系 →