CoreWeave上线Vera Rubin算力与Forge平台
From Training to Production, NVIDIA and CoreWeave Close the Loop on Agentic AI
Vera Rubin与Vera CPU是NVIDIA最新一代硬件落地,Cognition的实测数据提供了关键的推理性能基准,对关注算力选型与Agent基础设施的团队极具参考价值。
Building on nearly a decade of co-engineering, CoreWeave has built NVIDIA compute, networking and software into a cloud purpose-built for AI that’s still returning on investment across multiple generations of deployment. Now, CoreWeave is bringing the next generation of NVIDIA infrastructure to production.
在近十年的联合工程基础上,CoreWeave 将 NVIDIA 的计算、网络和软件整合到一个专为 AI 打造的云平台中,该平台在多代部署中持续实现投资回报。如今,CoreWeave 正将下一代 NVIDIA 基础设施投入生产环境。
At CoreWeave Fully Connected, running this week in San Francisco, CoreWeave announced availability of NVIDIA Vera Rubin NVL72 systems with Spectrum-X 102.4T Ethernet networking. Cognition, the applied AI lab behind the Devin AI software engineer, is the first customer running production workloads on Vera Rubin.
在本周于旧金山举行的 CoreWeave Fully Connected 大会上,CoreWeave 宣布提供配备 Spectrum-X 102.4T 以太网网络的 NVIDIA Vera Rubin NVL72 系统。Devin AI 软件工程师背后的应用 AI 实验室 Cognition 成为首个在 Vera Rubin 上运行生产工作负载的客户。
CoreWeave will also offer NVIDIA Vera, the first CPU built for AI agents. In addition, CoreWeave launched CoreWeave Forge, a connected environment for training, evaluating and improving models and agents on NVIDIA accelerated computing.
CoreWeave 还将提供 NVIDIA Vera,这是首款专为 AI 智能体设计的 CPU。此外,CoreWeave 推出了 CoreWeave Forge,这是一个连接式环境,用于在 NVIDIA 加速计算平台上训练、评估和改进模型和智能体。
“NVIDIA accelerated computing delivers value across generations,” said Ian Buck, vice president of hyperscale and high-performance computing at NVIDIA. “CoreWeave’s NVIDIA V100 GPUs are still running customer workloads nearly a decade after Volta launched, even as CoreWeave brings Vera Rubin NVL72 into production. That’s the strength of the NVIDIA platform: infrastructure that keeps earning for years, and the flexibility to put the right GPU on the right workload.”
“NVIDIA 加速计算在各代产品中持续创造价值,”NVIDIA 超大规模和高性能计算副总裁 Ian Buck 表示。“CoreWeave 的 NVIDIA V100 GPU 在 Volta 架构发布近十年后仍在运行客户工作负载,与此同时 CoreWeave 已将 Vera Rubin NVL72 投入生产。这正是 NVIDIA 平台的优势所在:基础设施能够多年持续产生价值,并具备灵活性,可将合适的 GPU 匹配到合适的工作负载。”
Cognition Runs on Vera Rubin NVL72 With 4.8x Higher Token Throughput
Cognition 在 Vera Rubin NVL72 上运行,Token 吞吐量提升 4.8 倍
Cognition runs training, reinforcement learning and production inference for Devin on CoreWeave. The company scaled to thousands of GPUs on CoreWeave in nine months, powering Cognition inference workloads.
Cognition 在 CoreWeave 上运行 Devin 的训练、强化学习和生产推理任务。该公司在九个月内将 CoreWeave 上的 GPU 规模扩展至数千张,为 Cognition 推理工作负载提供支持。
Earlier this month, CoreWeave received its first Vera Rubin NVL72 production racks. Shortly after, Cognition benchmarked Vera Rubin’s inference performance against a GB200 NVL72 baseline using a real-world software engineering workload. To generate this workload, it sampled a subset of tasks from FrontierCode and deployed AI agents to solve them.
本月早些时候,CoreWeave 收到了首批 Vera Rubin NVL72 生产机架。随后不久,Cognition 使用真实的软件工程工作负载对 Vera Rubin 的推理性能与 GB200 NVL72 基线进行了基准测试。为生成该工作负载,它从 FrontierCode 中采样了一部分任务子集,并部署 AI 智能体来求解这些任务。
In its early tests, Cognition saw Vera Rubin NVL72 deliver up to a 4.8x increase in total token throughput for SWE-2 inference workloads over GB200 NVL72. For Devin, those gains mean faster real-time code generation and more responsive multistep reasoning.
在早期测试中,Cognition 发现 Vera Rubin NVL72 在 SWE-2 推理工作负载下的总 Token 吞吐量较 GB200 NVL72 最高提升了 4.8 倍。对于 Devin 而言,这些性能提升意味着更快的实时代码生成能力和更敏捷的多步推理能力。
“Agentic coding is a complex workload: long contexts, high concurrency and token volumes where cost per token decides what we can ship,” said Silas Alberti, founding team at Cognition. “Having all of it on one platform, with NVIDIA and CoreWeave engineers who work the hard problems alongside ours, matters more to us than any single spec.”
“智能体编码是一项复杂的工作负载:长上下文、高并发以及大量的 token,而每个 token 的成本决定了我们能交付什么。”Cognition 创始团队成员 Silas Alberti 表示。“将所有内容整合在一个平台上,并由 NVIDIA 和 CoreWeave 的工程师与我们并肩攻克难题,这比任何单一规格都对我们更重要。”
CoreWeave Announces NVIDIA Vera Rubin Availability on CoreWeave Cloud
CoreWeave 宣布在 CoreWeave Cloud 上提供 NVIDIA Vera Rubin
CoreWeave announced availability of NVIDIA Vera Rubin NVL72 on CoreWeave Cloud, making it one of the first cloud providers to deliver the platform in customers’ hands.
CoreWeave 宣布在 CoreWeave Cloud 上提供 NVIDIA Vera Rubin NVL72,使其成为首批将该平台交付给客户手中的云提供商之一。
Early-access customers can put the performance of NVIDIA’s full-stack AI factory platform to work quickly on CoreWeave Cloud. In days, CoreWeave stood up a production Vera Rubin cluster for Cognition, achieved as a result of the codesign and collaboration between NVIDIA and CoreWeave up and down the stack, from infrastructure to tokens served.
早期访问客户可以迅速在 CoreWeave Cloud 上利用 NVIDIA 全栈 AI 工厂平台的性能。仅用几天时间,CoreWeave 就为 Cognition 搭建了一个生产级的 Vera Rubin 集群,这是 NVIDIA 和 CoreWeave 从基础设施到服务 token 的全栈协同设计与合作的结果。
Capacity can be operated through CoreWeave Kubernetes Service, SUNK, CoreWeave Mission Control, CoreWeave Sandboxes and CoreWeave Inference.
容量可通过 CoreWeave Kubernetes Service (SUNK)、CoreWeave Mission Control、CoreWeave Sandboxes 和 CoreWeave Inference 进行操作。
NVIDIA Vera CPU to Come to CoreWeave Cloud, Tests Show More Than 3x Faster Agentic Sandbox Startups
NVIDIA Vera CPU 即将登陆 CoreWeave Cloud,测试显示智能体沙箱启动速度提升超过 3 倍
Agentic AI puts pressure on infrastructure from two directions: serving agents demands low-latency compute at scale, while improving them through post-training requires thousands of isolated environments running at once.
智能体 AI 从两个方向对基础设施施加压力:服务智能体需要大规模的低延迟计算,而通过后训练对其进行优化则需要同时运行数千个隔离环境。
NVIDIA Vera CPU is purpose-built for agentic workloads. For agentic AI, a key performance measure is how many isolated agent environments can run at once and how consistent and performant each one stays as that number grows.
NVIDIA Vera CPU 专为智能体工作负载而设计。对于智能体 AI,关键的性能指标是能够同时运行多少个隔离的智能体环境,以及随着数量增加,每个环境的稳定性和性能表现如何。
CoreWeave’s deployment of Vera puts 128 CPUs and 11,264 cores in a single rack, enough for more than 11,000 concurrent environments at one core each. With CoreWeave Sandboxes, these environments are hardware-isolated and run alongside the training jobs they support, with Spectrum-X Ethernet switches and BlueField-4 DPUs ensuring secure, high-performance, secure agent communication at low latency.
CoreWeave 部署的 Vera 在一个机架中集成了 128 颗 CPU 和 11,264 个核心,足以支持每个核心一个环境的超过 11,000 个并发环境。借助 CoreWeave Sandboxes,这些环境实现了硬件隔离,并与它们所支持的训练任务并行运行,Spectrum-X 以太网交换机和 BlueField-4 DPU 确保了低延迟下安全、高性能的智能体通信。
In testing, CoreWeave achieved more than 3x faster agent sandbox startup times on NVIDIA Vera CPUs, accelerating and scaling its sandboxes, an execution layer for reinforcement learning (RL), agent tool use and model evaluation that let AI teams run code in isolated environments on CoreWeave. On Terminal-Bench, CoreWeave saw a 1.7x performance gain on Vera CPU across all passing tasks.
在测试中,CoreWeave 在 NVIDIA Vera CPU 上实现了超过 3 倍的智能体沙箱启动速度提升,加速并扩展了其沙箱功能——这是一个用于强化学习(RL)、智能体工具使用和模型评估的执行层,允许 AI 团队在 CoreWeave 的隔离环境中运行代码。在 Terminal-Bench 测试中,CoreWeave 在所有通过的任务中观察到 Vera CPU 带来了 1.7 倍的性能提升。
CoreWeave Forge: Closing the AI Loop From Production Back to Training
CoreWeave Forge:从生产回溯至训练,闭环 AI 流程
Models and agents improve by running a loop: production behavior informs the next training run, and each evaluation sharpens the next version. This loop has historically been split across tools from different vendors, with signal lost at every handoff.
模型和智能体通过运行循环进行改进:生产行为为下一次训练提供依据,每次评估都使下一个版本更加完善。历史上,这一循环被分割在不同供应商的工具中,每次交接都会导致信号丢失。
CoreWeave Forge unifies Weights & Biases, post-training expertise from OpenPipe and the open source marimo notebook project in one connected environment built for continuous model and agent improvement. It stays open across models, frameworks and clouds.
CoreWeave Forge 将 Weights & Biases、OpenPipe 的后训练专业知识以及开源 marimo 笔记本项目整合在一个专为持续模型和智能体改进而构建的连接环境中。它在模型、框架和云之间保持开放。
New and expanded capabilities available include:
新增和扩展的功能包括:
- CoreWeave ARIA — now generally available — helps users learn, research, code and iterate across the AI loop, analyzing runs, proposing experiments, recommending code changes and storing them in GitHub, and bringing back actionable evidence that analyzes experiment data, surfaces what drove a change and proposes the next experiments to run.
- CoreWeave Agent Lens — a new service — turns production agent observability into continuous improvement and understandable insights. It improves failure detection by 20% and fixes issues at half of the cost, which turns tens of millions of production agent traces into insights that drive fixes.
- CoreWeave Sandboxes — now generally available — let users run agents, tool calls, RL and evaluations in isolated CPU or GPU execution environments, on serverless infrastructure or on the infrastructure they already train on, providing a fresh, isolated environment for every agent tool call, RL run or evaluation.
- Post-training improves model quality and cuts latency and costs harnessing users’ own production signals, with no training cluster required. Serverless supervised fine-tuning and serverless RL let users experiment with their own training recipes. Serverless RL trains 1.4x faster at 40% lower cost than a self-managed setup.
- CoreWeave ARIA — 现已全面可用 — 帮助用户在 AI 循环中学习、研究、编码和迭代,分析运行结果、提出实验建议、推荐代码更改并将其存储在 GitHub 中,同时带回可操作的证据,这些证据会分析实验数据,揭示导致变化的因素,并提出下一步要运行的实验。
- CoreWeave Agent Lens — 一项新服务 — 将生产环境中的智能体可观测性转化为持续改进和易于理解的洞察。它将故障检测率提高了 20%,并将修复成本降低了一半,从而将数千万条生产环境智能体追踪数据转化为驱动修复的洞察。
- CoreWeave Sandboxes — 现已全面可用 — 允许用户在隔离的 CPU 或 GPU 执行环境中运行智能体、工具调用、强化学习(RL)和评估,可以在无服务器基础设施上运行,也可以在用户已有的训练基础设施上运行,为每次智能体工具调用、RL 运行或评估提供全新且隔离的环境。
- 后训练利用用户自身生产信号来提升模型质量并降低延迟和成本,无需训练集群。无服务器监督微调(SFT)和无服务器 RL 让用户能够尝试自己的训练配方。与自管理设置相比,无服务器 RL 的训练速度提高 1.4 倍,成本降低 40%。
NVIDIA Dynamo, an open source inference framework for AI factories, powers CoreWeave’s managed inference service as well as RL Rollouts, now in private preview. RL Rollouts loads new checkpoints into a live deployment while it’s running, so reinforcement learning continues without redeploys, and post-training gets the same inference efficiency as production.
NVIDIA Dynamo 是一个面向 AI 工厂的开源推理框架,它为 CoreWeave 的管理式推理服务以及目前处于私密预览阶段的 RL Rollouts 提供支持。RL Rollouts 能够在运行时将新的检查点加载到实时部署中,从而使强化学习在不重新部署的情况下继续进行,并且后训练能够获得与生产环境相同的推理效率。
Canva, Capital One and MasterClass are among the first companies building on Forge.
Canva、Capital One 和 MasterClass 是首批基于 Forge 构建的公司之一。
NVIDIA Nemotron open models give teams on Forge a direct path to customizing and deploying reasoning and multimodal models for agentic workflows.
NVIDIA Nemotron 开源模型为 Forge 上的团队提供了定制和部署用于智能体工作流的推理和多模态模型的直接路径。
Proven Impact From Startups to Global Enterprises
从初创企业到全球企业的已验证影响力
AI labs, AI-natives and global enterprises are using the co-engineered NVIDIA and CoreWeave platform to move from prototype to production faster.
AI实验室、AI原生企业和全球企业正在使用NVIDIA与CoreWeave联合打造的平台,从原型开发快速迈向生产部署。
In healthcare, Ennoble Care, a home-based care provider serving about 50,000 high-need Medicare patients across 15 states, selected CoreWeave to run clinical AI inference. It will use reserved NVIDIA RTX PRO 6000 GPU capacity on CoreWeave Kubernetes Service to scale AI agents for clinical documentation, decision support and back-office automation.
在医疗领域,为覆盖15个州约5万名高需求Medicare患者提供居家护理服务的Ennoble Care选择了CoreWeave来运行临床AI推理任务。它将利用CoreWeave Kubernetes Service上预留的NVIDIA RTX PRO 6000 GPU算力,扩展用于临床文档生成、决策支持和后台自动化的AI智能体。
CoreWeave has delivered record MLPerf results in every round of training and inference. It’s the only cloud provider who holds the Platinum ranking in SemiAnalysis ClusterMAX 1.0, 2.0 and 3.0, and serves nine of the 10 leading AI labs.
CoreWeave在每一轮训练和推理的MLPerf基准测试中均创下纪录。它是唯一在SemiAnalysis ClusterMAX 1.0、2.0和3.0中均获得铂金排名的云服务商,并为全球十大领先AI实验室中的九家提供服务。
更进一步:量化金融体系
看懂新闻只是起点——沿量化金融路径,把它变成能交付的工程能力