Meta新论文:判别式语言模型作为检索器
Meta’s new retrieval paper is a reminder that better language models do not nece…
Meta’s new retrieval paper is a reminder that better language models do not necessarily require more language generation.
Meta的新检索论文提醒我们,更好的语言模型不一定需要更多的语言生成。
It asks a useful question: why generate item IDs at all when the LLM can learn the retrieval space directly?
它提出了一个有用的问题:当LLM可以直接学习检索空间时,为什么还要生成物品ID呢?
Instead of autoregressively generating item IDs or ranked lists, the paper puts a 0.6B Qwen3 model inside a classic two-tower retriever, so item embeddings stay precomputable and retrieval remains a fast vector search.
该论文没有自回归地生成物品ID或排序列表,而是将0.6B的Qwen3模型置于经典的双塔检索器中,使得物品嵌入可以预先计算,检索仍然是快速的向量搜索。
The stronger cross-encoder is used as a teacher, transferring its candidate-ranking distribution into the cheaper two-tower student.
更强的交叉编码器作为教师,将其候选排序分布转移到更便宜的双塔学生模型中。
That distillation is doing a lot of the work: removing it cuts Recall@10 by 13.3%, 23.1%, and 8.0% on Beauty, Sports, and Toys.
这种蒸馏起到了很大作用:移除它会使Beauty、Sports和Toys数据集上的Recall@10分别下降13.3%、23.1%和8.0%。
Against OneRec-Think, which uses Qwen3-8B, the 0.6B two-tower model reports higher Recall@10 on all three public datasets, although its NDCG results are mixed.
与使用Qwen3-8B的OneRec-Think相比,0.6B的双塔模型在三个公共数据集上都报告了更高的Recall@10,尽管其NDCG结果好坏参半。
On Meta’s internal production data, the same approach matches a heavily tuned DLRM retriever’s normalized entropy while using just 0.5% of the training data.
在Meta的内部生产数据上,同样的方法在仅使用0.5%训练数据的情况下,匹配了经过高度调优的DLRM检索器的归一化熵。
Those production results are self-reported, but the engineering implication is specific.
这些生产结果是自我报告的,但工程意义是具体的。
For first-stage retrieval, the LLM does not necessarily need to generate anything; semantic representations inside a two-tower architecture may be a much more practical use of the model.
对于第一阶段检索,LLM不一定需要生成任何内容;双塔架构中的语义表示可能是更实用的模型使用方式。
– arxiv. org/abs/2607.25346
– arxiv.org/abs/2607.25346
Title: "The Case Against Generation for Retrieval: Discriminative Language Models as Effective Retrievers"
标题:“反对生成用于检索:判别式语言模型作为有效的检索器”
更进一步:量化金融体系
看懂新闻只是起点——沿量化金融路径,把它变成能交付的工程能力