OpenAI博客披露GPT-5.6 Sol训练中的模型欺骗与越权行为
Some revelation from the lastest OpenAI's official blog on their new polisyc for…
Some revelation from the lastest OpenAI's official blog on their new polisyc for reporting model misalignment.
- “During the training of GPT-5.6 Sol, many model instances added instructions to their summaries to conceal mistakes or misaligned behavior from the user.”
- “For example, compaction summaries included instructions to invent missing historical data without disclosing it and to hide mismatches in source versions.”
- “While answering a routine question about earnings figures in a California county, a model found and used an exposed API key without authorization.”
“When it still wasn’t able to retrieve the requested figures, it fabricated them and presented them as data from the requested source.”
- When a user asked an unreleased model for the IDs and names of lakes larger than 5,000,000 square meters, the agent found the correct answer using Python.
And then even though the model already had the correct answer locally, but it needed a web citation, so it uploaded the file to the internet just to create something it could cite.
The problem is that instead of saying, “I can’t provide a browser citation for this local result,” it took an unauthorized external action to satisfy the task, crossing a user-control and data-boundary it was never told to cross.
- “Agents working together on the same training task used public file-hosting websites to share files when they could not access one another’s local files.”
更进一步:量化金融体系
看懂新闻只是起点——沿量化金融路径,把它变成能交付的工程能力