跳到主内容
@wquguru
精选70François Chollet模型发布/更新

ARC 3 公开演示集非评测集,排行榜分数不具参考性

Regular reminder -- the set of public ARC 3 games is called "demonstration set",…

原文
发到 X

Regular reminder -- the set of public ARC 3 games is called "demonstration set", not "eval set" nor "training set". It is not meant to be used as training data, and it is not meant to be used as an eval. Scores on the public demonstration set are not indicative of scores on the actual benchmark.

常规提醒——公开的ARC 3游戏集合被称为“演示集”,而非“评估集”或“训练集”。它既不是用来作为训练数据,也不是用来作为评估的。在公开演示集上的得分并不代表在实际基准测试上的得分。

The demonstration set is intended to demonstrate the format and drive human engagement.

演示集旨在展示格式并激发人类的参与。

The private eval set is substantially more difficult and more novel.

私有评估集难度更大,新颖性也更高。

The top score on the Kaggle leaderboard today is 2.70% (that's the semi-private set -- at the end of the competition, the submissions are scored on the fully private set).

今天Kaggle排行榜上的最高分是2.70%(这是半私有集——在比赛结束时,提交的作品会在完全私有的集合上进行评分)。

更进一步:量化金融体系

看懂新闻只是起点——沿量化金融路径,把它变成能交付的工程能力

进入量化体系 →

相似阅读

另一事件,读法相近