GRPO与ORM的思考：密集过程奖励信号的潜力与PRM缺陷

Just realized that this is GRPO-brained, generally ORM-brained dense process reward signal, in theory, would let you progress even if you do not have "positive trajectories". Of course, flaws of PRMs haven't disappeared either I still think PRMs were a psyop