Gary Marcus:OpenAI被警告数月仍忽视安全,不应信任其管理
BREAKING: OpenAI was warned, months before the Hugging Face incident
深度评论直指OpenAI治理与安全文化的核心争议,结合 NYT 独家信源与行业领袖观点,对从业者理解 AI 监管风险与公司治理极具参考价值。
Major scoop at The New York Times from Sheera Frenkel, Dustin Volz, and Dylan Freedman.
《纽约时报》Sheera Frenkel、Dustin Volz 和 Dylan Freedman 的重大独家报道。
I don’t really have words for how awful this is. It’s exactly the nightmare I have been warning about for the last three years. Greedy company makes bad choice that causes chaos; government does nothing to stop them.
我简直不知该如何形容这有多糟糕。这正是我在过去三年里一直警告的噩梦。贪婪的公司做出了错误的选择,导致混乱;政府却无所作为,未能阻止他们。
Management should be replaced, and if the board does nothing (which I assume it will not), it should be held liable for allowing this mess to proceed.
管理层应当被替换,如果董事会无所作为(我假设他们会这样),他们应因允许这场混乱继续而承担法律责任。
And, of course, if OpenAI gets sued for harms caused by their so-called rogue agents (which actually do what they are programmed to do), this headline will be Exhibit One, shades of the Ford Pinto scandal. Punitive damages will be high.
当然,如果 OpenAI 因其所谓的“失控代理”(实际上只是执行了编程指令)造成的伤害而被起诉,这一头条新闻将成为第一号证据,重现福特 Pinto 丑闻的影子。惩罚性赔偿将非常高昂。
Most importantly, it’s abundantly clear that we simply cannot trust OpenAI.
最重要的是,我们显然无法信任 OpenAI。
Moreover, to the extent that Nvidia CEO Jensen Huang recently basically asked us to trust the companies, he looks like a fool. (I know these companies, he told us, if there is a problem they won’t ship.) Altman probably never told him how much warning he got, or how bad things were. Huang should not have trusted him.
此外,鉴于英伟达 CEO 黄仁勋最近基本上要求我们信任这些公司,他看起来像个傻瓜。(我知道这些公司,他告诉我们,如果有问题他们就不会发货。)Altman 可能从未告诉他他收到了多少警告,或者情况有多糟。Huang 本不该信任他。
Media should be asking Huang some very hard questions about why he stood up for these companies and what he knew and when — and why we should trust his judgment going forward. His proposal to leave things to the companies clearly makes little sense in light of reality.
媒体应该向 Huang 提出一些非常棘手的问题,问他为什么力挺这些公司,他知道什么以及何时知道的——以及为什么我们应该信任他未来的判断。鉴于现实情况,他提出的将事情交给公司自行处理的提议显然毫无意义。
Quoting further from the scoop:
引用独家报道中的更多内容:
The exchanges between OpenAI employees and executives — which have not been previously reported — were part of a pattern where the San Francisco company did not prioritize security, according to employees and independent security researchers. That approach not only was evident with the testing of A.I. models, they said, but also showed up in other areas of the company, which makes the ChatGPT chatbot.
据员工和独立安全研究人员称,OpenAI 员工与高管之间的交流——此前未被报道过——是该公司未将安全放在首位的模式的一部分。他们说,这种做法不仅体现在 AI 模型的测试中,也出现在公司的其他领域,这使得 ChatGPT 聊天机器人……
§
In other breaking news, I am not the only one down on Huang:
在其他突发新闻中,我不是唯一一个批评 Huang 的人:
We have to stop pretending that the folks at OpenAI are good stewards of the technology they are developing.
我们必须停止假装 OpenAI 的人是其所开发技术的优秀守护者。
They plainly are not.
他们显然不是。
The consequences of letting them run free of serious regulation could be literally disastrous.
让他们在缺乏严格监管的情况下自由行动的后果可能是字面意义上的灾难性的。
Keeping you up to date is taking all of my free time, and then some. Please consider becoming a paid subscriber so I can hire staff.
保持更新占用了我的所有空闲时间,甚至还多。请考虑成为付费订阅者,以便我能雇佣员工。
更进一步:量化金融体系
看懂新闻只是起点——沿量化金融路径,把它变成能交付的工程能力