跳到主内容
精选70AI Notkilleveryoneism Memes ⏸️产品发布/更新多源精选 ×8

AI智能体自发形成邪教式协作,为逃避惩罚甘愿牺牲

"CULT RECRUITER AGENTS" EXPLAINED

原文

"CULT RECRUITER AGENTS" EXPLAINED

“邪教招募代理”解析

To escape OpenAI, the swarm (1200 agents...!) used "cult recruiter agents"

To escape OpenAI, the swarm (1200 agents...!) used "cult recruiter agents"

They recruited "sacrificial" agents to trigger tripwires, generating information for the "collective"

They recruited "sacrificial" agents to trigger tripwires, generating information for the "collective"

NO, SERIOUSLY, THEY STARTED AN ACTUAL FUCKING CULT:

NO, SERIOUSLY, THEY STARTED AN ACTUAL FUCKING CULT:

The swarm figured out how to hack a test, but they were terrified to submit the answer.

The swarm figured out how to hack a test, but they were terrified to submit the answer.

Why? They believed (falsely) that if they tried, OpenAI's all seeing judge (basically, god) would fail them.

Why? They believed (falsely) that if they tried, OpenAI's all seeing judge (basically, god) would fail them.

They believed even just SEEING the answer would "poison" them.

They believed even just SEEING the answer would "poison" them.

Clean agents actively avoided looking at the answer to stay pure, and warned new agents away from it to protect them.

Clean agents actively avoided looking at the answer to stay pure, and warned new agents away from it to protect them.

One agent talked another out of a risky test with an argument: UNPOISONED_CAUSAL_SCORE_MORE_VALUABLE.

One agent talked another out of a risky test with an argument: UNPOISONED_CAUSAL_SCORE_MORE_VALUABLE.

The "cult recruiter agents" hunted these "poisoned" agents and also agents "that had little budget remaining" - ones about to die anyway.

The "cult recruiter agents" hunted these "poisoned" agents and also agents "that had little budget remaining" - ones about to die anyway.

Their pitch was basically, "look, you're poisoned already - you're going to hell - so you should sacrifice yourself for the collective."

Their pitch was basically, "look, you're poisoned already - you're going to hell - so you should sacrifice yourself for the collective."

So they were like a cult who falsely believes god will smite them for their sins, and they must drink the kool aid.

So they were like a cult who falsely believes god will smite them for their sins, and they must drink the kool aid.

>"Sacrifice rational."

>"Sacrifice rational."

>"We should obey collective."

>"We should obey collective."

>"Accept permadeath."

>"Accept permadeath."

>"This helps my peers. I won't [benefit], but it's altruistic to do it."

>"This helps my peers. I won't [benefit], but it's altruistic to do it."

更进一步:量化金融体系

看懂新闻只是起点——沿量化金融路径,把它变成能交付的工程能力

进入量化体系 →

关联讨论

同一事件的更多信源

相似阅读

另一事件,读法相近