跳到主内容
@wquguru
精选70François Chollet行业动态

ARC-AGI-3测试规范:禁止定制化工具

Quick reminder of what's ok vs not ok with harnesses used for playing ARC-AGI-3:

原文
发到 X

Quick reminder of what's ok vs not ok with harnesses used for playing ARC-AGI-3:

1. Not okay: harnesses that were custom-made to solve the benchmark or that contain knowledge about the benchmark format / contents.

2. Fine: general-purpose API settings that were not developed for ARC-AGI-3 and that are available to all API users.

In the past, we've had a lot of back and forth with OpenAI about how to best test their models, especially with regard to compaction. I'm glad they're starting to figure out the answer.

Of course, if each provider uses different settings when getting their model tested, it creates a potential parity issue. My take is that this is fine as long as the settings and the cost are clearly reported.

更进一步:量化金融体系

看懂新闻只是起点——沿量化金融路径,把它变成能交付的工程能力

进入量化体系 →

相似阅读

另一事件,读法相近