跳到主内容
@wquguru
精选88MIT News 人工智能(RSS)行业动态

MIT林肯实验室发布最新AI加速器技术演进报告

Supercomputing researchers document evolution of AI hardware

原文
发到 X
推荐理由

算力选型是AI工程的核心痛点,这份来自MIT官方实验室的年度深度盘点提供了详实的竞品参数与架构分析,做基础设施规划的同学值得收藏参考。

As artificial intelligence transforms industries and national security, understanding the latest hardware capabilities is important for maintainind technological advantage.

随着人工智能正在改变各行各业和国家安全,了解最新的硬件能力对于保持技术优势至关重要。

AI accelerators — specialized systems designed to speed up capabilities such as neural networks, deep learning, and machine learning — have been a major area of development for nearly a decade. Since 2018, team from the Lincoln Laboratory Supercomputing Center (LLSC) has been conducting the Lincoln AI Computing Survey (LAICS, pronounced "lace"). Six papers later, LAICS continues to summarize current commercial AI accelerators and compare their peak performance and peak power.

AI加速器——专为加速神经网络、深度学习和机器学习等能力而设计的专用系统——近十年来一直是发展的重点领域。自2018年以来,林肯实验室超级计算中心(LLSC)的团队一直在开展林肯AI计算调查(LAICS,发音为“lace”)。在发表六篇论文后,LAICS继续总结当前的商用AI加速器,并比较它们的峰值性能和峰值功耗。

"About eight years ago, we saw a sharp rise in the number of research AI accelerators described in research papers and commercial accelerators being announced, and we started to get questions about them from government sponsors of the laboratory's work. That was motivation enough to start the survey," says Albert Reuther, a staff member at the LLSC, which operates and optimizes the high-performance computing systems used by thousands of laboratory research staff.

LLSC的一名员工Albert Reuther表示:“大约八年前,我们看到研究论文中描述的AI加速器数量急剧增加,同时也有许多商用加速器宣布问世,我们开始收到来自该实验室工作政府资助方的相关问题。这足以成为启动这项调查的动力。”LLSC负责运营和优化数千名实验室研究人员使用的高性能计算系统。

Although AI accelerators are frequently used for processes such as machine learning, they also can enable other parallel applications, such as modeling the functions of molecules and speeding up simulations of fluid dynamics — processes that are very computationally expensive.

尽管AI加速器经常用于机器学习等过程,但它们也能支持其他并行应用,例如模拟分子功能以及加速流体动力学模拟——这些过程都非常耗费计算资源。

AI accelerator technology can come in a number of forms: central processing units (CPUs), graphics processing units (GPUs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), and dataflow accelerators. Each type of accelerator has slightly different capabilities. CPUs can be used for general-purpose computing, while ASICs can perform only very specific tasks. Dataflow accelerators, FPGAs, and GPUs are more flexible and can be configured for a variety of workloads. Efficiency and performance vary across the different types of accelerators depending on how they are designed. The goal of LAICS is to survey the technologies currently on the market and compare them to find the best accelerators for certain needs.

AI加速器技术可以以多种形式出现:中央处理器(CPU)、图形处理器(GPU)、专用集成电路(ASIC)、现场可编程门阵列(FPGA)和数据流加速器。每种类型的加速器都具有略有不同的能力。CPU可用于通用计算,而ASIC只能执行非常特定的任务。数据流加速器、FPGA和GPU则更加灵活,可以配置以适应各种工作负载。不同类别的加速器在效率和性能上各不相同,具体取决于其设计方式。LAICS的目标是调查目前市场上的技术并进行比较,从而为特定需求找到最佳的加速器。

Led by Reuther, the LAICS team includes LLSC members Michael Jones, Peter Michaleas, Jeremy Kepner, and Vijay Gadepally. The team also collaborates with researchers across Lincoln Laboratory, including in the Advanced Technology Division and Intelligence, Surveillance, and Reconnaissance and Tactical Systems Division, to learn how accelerators support research and development for their missions.

在鲁瑟的带领下,LAICS团队包括LLSC成员迈克尔·琼斯、彼得·米查利斯、杰里米·凯普纳和维贾伊·加德帕利。该团队还与林肯实验室的研究人员合作,包括先进技术研究部和情报、监视与侦察及战术系统研究部,以了解加速器如何支持其任务的研究与开发。

The first paper in their series studied 57 accelerators, while the latest one looked at more than 120 accelerators. The main metrics the team uses to compare accelerators are the peak performance and power; then they sort accelerators by whether they're on a chip, card, or system. All the data in the papers are drawn from public sources, which can be challenging because some companies prefer to keep their performance and power data private. To keep up to date on the latest in the field, Reuther runs daily news and citation searches that report new technical press articles, company announcements, and industry presentations.

他们系列论文中的第一篇研究了57种加速器,而最新的一篇考察了超过120种加速器。团队用于比较加速器的主要指标是峰值性能和功耗;然后他们根据加速器是集成在芯片上、卡上还是系统中进行分类。论文中的所有数据均来自公开来源,这颇具挑战性,因为一些公司倾向于保密其性能和功耗数据。为了跟上该领域的最新动态,鲁瑟每天进行新闻和引用搜索,报道新的技术新闻文章、公司公告和行业演示。

"It continues to surprise me how each year another five to 10 startups get funded and announced, and then release new AI accelerators," Reuther says. "One might think that the landscape is saturated enough, but then another batch of innovative accelerators is introduced."

鲁瑟说:“每年都有另外五到十家初创公司获得融资并宣布成立,随后发布新的AI加速器,这仍然让我感到惊讶。”“人们可能会认为市场已经足够饱和,但随后又有一批创新的加速器被推出。”

In addition to summarizing the performance versus peak power of the current accelerators, each paper explores a new aspect of the field. For example, the paper published in 2022 investigated sources of performance increases, finding that they stem from smaller, denser transistor designs and the use of lower numerical precision (i.e., calculating fewer significant digits). The latest paper examined different architectural choices available, analyzing how the addition of certain components, such as more cores per processor or parallel performance, would change the system.

除了总结当前加速器的性能与峰值功耗外,每篇论文还探讨了该领域的一个新方面。例如,2022年发表的论文调查了性能提升的来源,发现它们源于更小、更密集的晶体管设计以及使用较低的数值精度(即计算的有效位数更少)。最新的论文考察了可用的不同架构选择,分析了增加某些组件(如每个处理器的核心数更多或并行性能)将如何改变系统。

Reuther plans to continue the survey for the foreseeable future, stating that, in just the past few months, six new startups have announced their first AI accelerators.

鲁瑟计划在未来一段时间内继续这项调查,他表示,仅在过去的几个月里,就有六家新初创公司宣布了他们的首款AI加速器。

"AI and the hardware it runs on are such hot topics, and it is important for Lincoln Laboratory to be an unbiased technical advisor for choosing and pursuing the right technologies," Reuther says. "Our AI accelerator surveys have helped many sponsors and government colleagues gain a better understanding of the AI accelerator landscape and make better research and acquisition decisions about them. This survey has also been very valuable to determine which GPUs we should consider for upcoming LLSC system purchases so it not only benefits our sponsors and mission programs, but also benefits all LLSC users."

"AI及其运行的硬件是当前的热门话题,林肯实验室作为选择并推进合适技术的中立技术顾问至关重要," Reuther表示。"我们的AI加速器调查帮助许多赞助方和政府同事更好地了解AI加速器格局,从而做出更优的研究和采购决策。此次调查对于确定我们应在LLSC系统采购中考虑哪些GPU也极具价值,因此它不仅惠及我们的赞助方和项目计划,也造福所有LLSC用户。"

The full set of papers and the accompanying datasets can be found here.

完整的论文集及配套的 datasets 可在此处找到。

更进一步:量化金融体系

看懂新闻只是起点——沿量化金融路径,把它变成能交付的工程能力

进入量化体系 →

相似阅读

关联信息,但可能不是同一事件