跳到主内容
@wquguru
精选88Microsoft Research(RSS)模型发布/更新

微软发布RetroChimera:Nature论文开源分子逆合成模型

Improving synthesis prediction of small molecules at scale with RetroChimera

原文
发到 X
推荐理由

AI for Science领域重磅进展,Nature级成果且完整开源权重,做计算化学与药物发现的同学值得重点关注。

At a glance

概览

  • We report on the recent publication of our retrosynthesis model RetroChimera in the journal Nature (opens in new tab).
  • The paper describes the model’s architecture as well as extensive validation studies, including the model’s ability to recall rare reaction types, and successful zero-shot transfer and fine-tuning on proprietary datasets.
  • We open-source RetroChimera’s implementation and weights in the hope that it will enable researchers to accelerate development of new medicinally relevant molecules and advanced materials.
  • 我们报道了我们的逆合成模型 RetroChimera 最近在《自然》杂志(在新标签页中打开)上的发表情况。
  • 该论文描述了模型的架构以及广泛的验证研究,包括模型回忆罕见反应类型的能力,以及在专有数据集上成功的零样本迁移和微调。
  • 我们开源了 RetroChimera 的实现代码和权重,希望它能帮助研究人员加速开发具有医药相关性的新分子和先进材料。

Developing new medicines and materials requires making new molecules but planning how to make them is still largely manual, time-consuming, and costly. RetroChimera automatically proposes high-quality synthesis routes. The model combines two strong models with complementary strengths, learning how to rank their proposals to produce better predictions than either alone. In blind tests, PhD-level chemists prefer RetroChimera’s individual reaction predictions over preceding models and recorded literature reactions.

开发新药和新材料需要制造新的分子,但规划如何制造它们仍然 largely 是手动的、耗时的且成本高昂。RetroChimera 自动提出高质量的合成路线。该模型结合了两个具有互补优势的强模型,学习如何对它们的提议进行排序,从而产生比单独使用任一模型更好的预测结果。在盲测中,拥有博士学位的化学家更倾向于选择 RetroChimera 的单个反应预测,而非先前的模型和已记录的文献反应。

Custom-made molecules are unlocking advances in modern medicine, smart materials, and sustainable agriculture. Yet, progress is slowed by chemical synthesis—the time-consuming process of making new molecules from simpler building blocks in the lab. In addition, synthesis is a significant driver of drug development costs. So even as computational methods make it possible to explore large numbers of novel molecules, finding practical ways to synthesize them remains a critical challenge.

定制分子正在推动现代医学、智能材料和可持续农业的进步。然而,进展因化学合成而受阻——这是在实验室中将简单构建块合成为新分子的耗时过程。此外,合成是药物开发成本的主要驱动因素之一。因此,尽管计算方法使得探索大量新型分子成为可能,但找到切实可行的合成方法仍然是一个关键挑战。

Figure 1: Planning a synthesis by working backward. Retrosynthesis starts with a target molecule and proposes successive disconnections into simpler precursors until purchasable building blocks are reached. The highlighted path shows a complete synthesis route; pale branches illustrate alternatives explored along the way. Circles represent molecules and squares represent reactions. For clarity, only a few branches are illustrated, with chemical structures shown for the target, one intermediate, and selected building blocks.

图 1:通过逆向工作来规划合成。逆合成从目标分子开始,并提出连续的断开步骤以生成更简单的前体,直到达到可购买的构建块。高亮路径显示了一条完整的合成路线;浅色分支展示了沿途探索的其他替代方案。圆圈代表分子,方块代表反应。为了清晰起见,仅展示了几条分支,并显示了目标分子、一个中间体和一些选定构建块的化学结构。

Retrosynthesis approaches this problem by working backwards from a target molecule, breaking it down step by step into simpler precursors (Figure 1). This process is comparable to playing strategic board games like chess and Go. It involves contemplating a wide range of possible immediate moves, or individual disconnections, while also requiring high-level strategic thinking to reach the end-to-end synthesis plan. However, the number of possible moves in retrosynthesis is much larger than in board games, and it is not obvious which moves would be available for a given molecule. Existing systems face major challenges, including recalling rare but strategically important reactions, robustness beyond the training distribution, and aligning with chemists’ expectations. As a result, retrosynthesis often requires highly specialized expertise, which hinders scaling and automation of scientific discovery.

逆合成分析通过从目标分子出发逆向推导来解决这一问题,将其逐步分解为更简单的前体(图1)。这一过程类似于下国际象棋和围棋等策略性棋盘游戏。它需要思考大量可能的即时步骤(即单个切断操作),同时还需要高层级的战略思维来制定端到端的合成方案。然而,逆合成分析中可能的步骤数量远大于棋盘游戏,并且对于给定的分子,哪些步骤可用并不明显。现有系统面临重大挑战,包括回忆罕见但具有战略重要性的反应、超出训练分布的鲁棒性,以及与化学家预期的对齐。因此,逆合成分析通常需要高度专业化的专业知识,这阻碍了科学发现的扩展和自动化。

Figure 2: Our framework for ensemble-based retrosynthesis with learned re-ranking which underpins RetroChimera. The ensemble receives a target molecule as the input, which is then processed by the sub-models. The model outputs are aggregated using a learning-to-rank strategy. While in this work we only investigate deep learning models as prediction sources (solid boxes), it is possible to add additional sources, for example calls to reaction databases or human-in-the-loop queries (dashed box).

图2:基于集成学习和重排序的逆合成预测框架,构成了RetroChimera的基础。该集成模型以目标分子作为输入,随后由子模型进行处理。模型输出通过一种学习排序(learning-to-rank)策略进行聚合。虽然在本研究中我们仅将深度学习模型作为预测来源(实线框),但可以添加其他来源,例如调用反应数据库或人机交互查询(虚线框)。

In a paper recently published in the journal Nature (opens in new tab), we present RetroChimera (opens in new tab), a new framework for retrosynthesis prediction. It is built around two models (Figure 2). R-SMILES 2, a Transformer-based de-novo model, predicts precursor molecules directly from the input molecule. This gives it the flexibility to learn reaction patterns directly from data. However, its unconstrained generation can also make it prone to hallucination.

在近期发表于《自然》杂志(opens in new tab)的一篇论文中,我们提出了RetroChimera(opens in new tab),这是一种新的逆合成预测框架。它围绕两个模型构建(图2)。R-SMILES 2是一种基于Transformer的从头生成模型,直接从输入分子预测前体分子。这赋予了它直接从数据中学习反应模式的灵活性。然而,其无约束的生成方式也可能导致幻觉现象。

NeuralLoc, in contrast, is a graph neural network- (GNN) based model that encodes both the target molecule and reaction templates as graphs. It selects reaction templates and predicts where they should be applied to the target molecule. Its predictions are grounded in reaction patterns extracted from the training data, so it tends to produce more accurate and reliable outputs. But it’s more constrained when encountering reactions not covered by the template library.

相比之下,NeuralLoc是一种基于图神经网络(GNN)的模型,它将目标分子和反应模板都编码为图结构。它选择反应模板并预测这些模板应应用于目标分子的何处。其预测基于从训练数据中提取的反应模式,因此往往能产生更准确和可靠的输出。但在遇到模板库未涵盖的反应时,它的约束性更强。

These differences actually turn out to be a strength. Rather than making the same kinds of predictions, the two models capture complementary patterns in chemistry and specialize in different reaction types. R-SMILES 2 performs particularly well on reactions that involve large changes over the course of the reaction, while NeuralLoc excels in reactions of low precedence and those involving more localized changes.

这些差异实际上成为了一种优势。这两个模型并非做出相同类型的预测,而是捕捉化学中互补的模式,并专注于不同类型的反应。R-SMILES 2 在处理反应过程中发生较大变化的反应方面表现尤为出色,而 NeuralLoc 则在低优先级反应以及涉及更局部变化的反应中表现出色。

RetroChimera combines the ranked predictions of both sub-models using a learned ensembling strategy. Each model assigns a learned, rank-dependent vote to each predicted reactant set, and votes are added when both models propose the same reaction. By learning how much to trust each model at different ranks, RetroChimera can leverage their complementary strengths, approximately matching the better-performing sub-model across reaction classes.

RetroChimera 使用一种学习到的集成策略,结合两个子模型的排序预测结果。每个模型为每个预测的反应物集合分配一个学习到的、依赖于排名的投票,当两个模型提出相同的反应时,投票会进行累加。通过学习在不同排名下对每个模型的信任程度,RetroChimera 能够利用它们的互补优势,在各类反应中大致匹配表现更好的子模型。

Figure 3: Expert assessment of multistep synthesis routes. Left: Ratings of individual reaction steps. Right: Complete routes accepted or rejected for ten challenging targets. RetroChimera succeeded on nine targets, versus five for the de novo model, four for the editing model, and two for NeuralSym, a strong baseline model.

图 3:专家对多步合成路线的评估。左侧:单个反应步骤的评分。右侧:十个具有挑战性的目标所接受或拒绝的完整路线。RetroChimera 在九个目标上取得成功,相比之下,de novo 模型为五个,editing 模型为四个,NeuralSym(一个强大的基线模型)为两个。

As a result, RetroChimera performs strongly across both common and rare reaction classes and produces retrosynthesis predictions that better align with chemists’ judgment (Figure 3). In blind tests, expert chemists preferred disconnections of complex molecules suggested by RetroChimera over those obtained from its constituent sub-models, as well as those from more established approaches, and even from the test set itself.

因此,RetroChimera 在常见和罕见反应类别中均表现出强劲的性能,并产生了与化学家判断更为一致的逆合成预测结果(图 3)。在盲测中,专家化学家更倾向于选择由 RetroChimera 建议的复杂分子断键方案,而非其组成子模型、更成熟的方法甚至测试集本身所提供的方案。

We believe RetroChimera could help researchers identify promising synthesis route more efficiently, supporting faster design-make-test cycle across molecular science applications, including drug discovery and design of smart materials. RetroChimera could enable chemists to assess more—and more complex—candidate molecules at large scale. Paired with increasing levels of laboratory automation, we expect further acceleration toward closed-loop, self-improving systems for synthesis planning and execution.

我们相信 RetroChimera 能够帮助研究人员更高效地识别有前景的合成路线,支持包括药物发现和智能材料设计在内的分子科学应用中的“设计-制造-测试”循环加速。RetroChimera 使化学家能够在大规模范围内评估更多——且更复杂的——候选分子。随着实验室自动化水平的不断提高,我们预计将进一步加速向闭环、自我改进的合成规划与执行系统迈进。

RetroChimera is available on GitHub (opens in new tab) (MIT license) and accessible via Microsoft Foundry (opens in new tab). For instructions on how to access the checkpoint, we refer to the GitHub repository.

RetroChimera 已在 GitHub(新标签页打开)(MIT 许可证)上提供,并可通过 Microsoft Foundry(新标签页打开)访问。有关如何获取检查点的说明,请参阅 GitHub 仓库。

We invite the broader chemistry community to experiment with RetroChimera, helping us identify its strengths and shortcomings so we can enhance it in the future. We are looking forward to hearing how it performs on various targets you care about!

我们邀请更广泛的化学社区试用 RetroChimera,帮助我们识别其优势和不足,以便在未来对其进行改进。我们期待了解它在您关注的各种目标上的表现!

For a deeper look at the findings, including evaluation experiments with our external research collaborators, see the full Nature publication (opens in new tab) and the accompanying Microsoft Source article (opens in new tab).

如需更深入地了解研究结果,包括与外部研究合作者进行的评估实验,请参阅完整的《自然》出版物(在新标签页中打开)以及配套的 Microsoft Source 文章(在新标签页中打开)。

Publication

出版物

OSS repository

开源代码库

Microsoft Foundry

Microsoft Foundry

Opens in a new tab

在新标签页中打开

更进一步:量化金融体系

看懂新闻只是起点——沿量化金融路径,把它变成能交付的工程能力

进入量化体系 →

相似阅读

关联信息,但可能不是同一事件