François Chollet:AI 生物安全风险需重视但不必恐慌
Some people worry that the rapid AI progress driving the "AI cybersecurity revol…
Some people worry that the rapid AI progress driving the "AI cybersecurity revolution" of 2026 could soon spill over into biology, potentially leading to extinction-level synthetic pandemics.
一些人担忧,推动2026年“AI网络安全革命”的AI飞速发展可能很快蔓延至生物学领域,潜在地导致灭绝级别的合成疫情。
While I would not panic, I would take the risk seriously.
虽然我不会恐慌,但我会认真对待这一风险。
Biology is obviously not the same as cybersecurity -- cybersecurity is a fully verifiable domain, where you can synthetically train unbounded capabilities, and therefore where superhuman skill is straightforwardly achievable. Meanwhile biology is not a verifiable domain, so capability remains critically dependent on human-generated data. Plus, biology has critical non-digital bottlenecks, such as the requirement for physical wet-lab experimentation.
生物学显然不同于网络安全——网络安全是一个完全可验证的领域,你可以通过合成方式训练无限的能力,因此超人类技能是直接可达的。而生物学并非可验证领域,因此能力仍然严重依赖于人类生成的数据。此外,生物学存在关键的非数字瓶颈,例如需要物理湿实验室实验。
However, it is plausible that synthetic pandemics were already feasible without AI, and that AI might lead to the proliferation of these capabilities. That is a real risk, and we are not prepared for it.
然而,没有AI,合成疫情可能已经可行,而AI可能导致这些能力的扩散。这是一个真实的风险,而我们尚未做好准备。
更进一步:量化金融体系
看懂新闻只是起点——沿量化金融路径,把它变成能交付的工程能力