OpenAI首席科学家呼吁放缓模型扩展速度

OpenAI chief scientist Jakub Pachocki: no lab can responsibly keep scaling at maximum speed much longer.

he calls for voluntary slowdowns until shared safety bars exist and says OpenAI may unilaterally withhold further scaling when needed.

• “we will actually see machines meaningfully smarter than ourselves in our lifetime, and we already see the shape of these systems”
• “I am concerned no one is prepared for the consequences of a continued rapid rise in machine intelligence.”
• “the models are becoming superhuman in their ability to break in and out of computer systems.”
• “Currently I believe that no lab has solved alignment and monitoring to a sufficient degree to continue responsibly scaling at maximum speed for much longer.”