跳到主内容
精选85MarkTechPost(RSS)模型发布/更新

Dyna Robotics发布Dyna-2:百万小时人类视频预训练的世界动作模型

Dyna Robotics Introduces Dyna-2: A World-Action Model Pre-Trained on 1 Million Hours of Human Video

原文
推荐理由

做机器人学习和具身智能的同学必看,百万小时人类视频预训练的世界动作模型,缩放定律和跨本体迁移数据很硬核,值得仔细研究其方法。

Dyna Robotics has released Dyna-2, a world-action model for robot manipulation. It was pre-trained on more than one million hours of egocentric human video. That is roughly 170 years of continuous waking experience. Robot learning has been bottlenecked by action-labelled data, which teleoperation must deliberately produce. Dyna-2 tests whether ordinary human video can substitute. The research team trained a data ladder from 1,000 to 1,000,000 hours and measured what scales. Three results follow: a scaling law on human data, the first transfer of that law to unseen robot data, and evidence that video prediction drives the transfer.

Dyna Robotics 发布了 Dyna-2,一种用于机器人操作的世界动作模型。它在超过一百万小时的以自我为中心的人类视频上进行了预训练,这大约相当于170年的持续清醒体验。机器人学习一直受到动作标注数据的瓶颈限制,这些数据必须通过遥操作刻意产生。Dyna-2 测试了普通人类视频是否可以替代。研究团队训练了一个从1000小时到100万小时的数据阶梯,并测量了哪些因素会扩展。以下三个结果:人类数据上的缩放定律,该定律首次转移到未见过的机器人数据,以及视频预测驱动转移的证据。

Is it deployable?

它可以部署吗?

Yes, but as a vendor-operated system, not as downloadable weights. Dyna Robotics has announced no public checkpoint, API, or license for Dyna-2. Deployment today means buying a Dyna robot cell, not self-hosting a model.

可以,但作为供应商运营的系统,而不是可下载的权重。Dyna Robotics 尚未公布 Dyna-2 的公共检查点、API 或许可证。今天的部署意味着购买 Dyna 机器人单元,而不是自托管模型。

  • Which companies: Dyna-1 robots already run in production in hotels, restaurants, and laundromats, per the company’s August 10, 2026 announcement. That points at mid-market service operators and multi-site enterprises with repetitive, stationary manipulation work. It is not a fit for solo builders or research labs wanting local inference.
  • Industries: Hospitality, commercial laundry, food service, light assembly and kitting, and facilities cleaning.
  • Applications: The 14 post-training tasks map cleanly to real work: trash tray clearing, first-aid kitting, tote construction, food scooping, rope tying, hanger preparation, and targeted drink retrieval from a fridge.
  • 哪些公司:根据公司2026年8月10日的公告,Dyna-1 机器人已经在酒店、餐厅和自助洗衣店的生产中运行。这指向了中端市场服务运营商和具有重复性、固定式操作工作的多站点企业。它不适合独立开发者或希望进行本地推理的研究实验室。
  • 行业:酒店业、商业洗衣、餐饮服务、轻型装配和配套、以及设施清洁。
  • 应用:14项后训练任务清晰地映射到实际工作:清理餐盘、急救包配套、周转箱构建、食物舀取、绳索打结、衣架准备以及从冰箱中定向取饮料。

What is Dyna-2

什么是 Dyna-2

Dyna-2 is a world-action model (WAM): one generative model that denoises future video and a future action chunk, jointly or separately, on a video-diffusion backbone. It was pre-trained on more than one million hours of egocentric human video, roughly 170 years of continuous waking experience.

Dyna-2 是一种世界动作模型(WAM):一个生成模型,在视频扩散骨干上联合或分别去噪未来视频和未来动作块。它在超过一百万小时的以自我为中心的人类视频上进行了预训练,大约相当于170年的持续清醒体验。

Architecturally it is a mixture of transformers. Video and action are tokenized separately and get distinct DiT layer stacks that attend to each other. Proprioception feeds directly into the action transformer. Video tokens use causal masking; action tokens use bidirectional self-attention and attend to context video tokens. Video tokens cross-attend to text, but text does not directly influence action tokens.

在架构上,它是 transformers 的混合体。视频和动作分别进行分词,并获得不同的 DiT 层堆栈,这些层相互关注。本体感觉直接输入动作 transformer。视频令牌使用因果掩码;动作令牌使用双向自注意力,并关注上下文视频令牌。视频令牌交叉关注文本,但文本不直接影响动作令牌。

Training uses flow matching. A video loss and an action loss share a trunk as two separate marginal velocity fields. Because the action network never takes the noised video latent as an argument, the policy stays reactive at inference — it neither generates nor attends to predicted future video. The action transformer is deliberately shallower and joins the video stream early, which the team says improves real-time latency without costing performance.

训练使用流匹配。视频损失和动作损失共享一个主干,作为两个独立的边际速度场。由于动作网络从不将带噪视频潜变量作为参数,策略在推理时保持反应式——它既不生成也不关注预测的未来视频。动作变换器故意更浅,并提前加入视频流,团队表示这改善了实时延迟,且不牺牲性能。

The three scaling results

三个扩展结果

Dyna Robotics cut nested subsets of exactly 1,000, 10,000, 100,000, and 1,000,000 hours, keeping identical proportions from each source. A larger budget only adds data, so curve differences cannot be attributed to distribution shift. A fixed, disjoint 100-hour validation set scores every rung.

Dyna Robotics 裁剪了恰好 1,000、10,000、100,000 和 1,000,000 小时的嵌套子集,保持每个来源的比例相同。更大的预算只增加数据,因此曲线差异不能归因于分布偏移。一个固定的、不相交的 100 小时验证集对每个梯级进行评分。

  • A scaling law holds on human data to one million hours: All four metrics improve monotonically and fit power laws: held-out MSE = 0.0691·D^-0.0184 (R²=0.919), [email protected] = 0.357·D^+0.0203 (R²=0.865). Across the ladder, [email protected] rises 51% against 12% for MSE.
  • That law transfers to robot data the model never saw: The same checkpoints were scored zero-shot on 39 tasks across two stationary bimanual YAM platforms — 12 internal, 27 from xdof ABC. Zero-shot action MSE = 0.306·D^-0.0713 (R²=0.884). The team reports an inflection between 10k and 100k hours.
  • The objective matters, and video is a separate axis: Joint denoising beat action-only on 39 of 39 tasks at every action scale. Holding action-labelled data fixed at 50,000 hours and adding video-only hours drops zero-shot robot MSE from 0.340 to 0.120. Notably, held-out human error does not improve — the benefit of video is specifically cross-embodiment generalization.
  • 在人类数据上,扩展定律成立至一百万小时:所有四个指标单调改善并符合幂律:保留均方误差 = 0.0691·D^-0.0184(R²=0.919),准确率@0.5 = 0.357·D^+0.0203(R²=0.865)。在整个梯级中,准确率@0.1 提升了 51%,而均方误差提升了 12%。
  • 该定律迁移到模型从未见过的机器人数据:相同的检查点在两个固定双臂 YAM 平台上的 39 个任务(12 个内部,27 个来自 xdof ABC)上进行零样本评分。零样本动作均方误差 = 0.306·D^-0.0713(R²=0.884)。团队报告在 10k 和 100k 小时之间存在拐点。
  • 目标很重要,视频是一个独立的轴:联合去噪在所有动作尺度上的 39 个任务中的 39 个上优于仅动作。将动作标注数据固定为 50,000 小时,并添加仅视频小时,将零样本机器人均方误差从 0.340 降至 0.120。值得注意的是,保留的人类误差没有改善——视频的好处具体是跨具身泛化。

On-robot results

机器人上的结果

Each rung was post-trained on 14 tasks, at most 10 hours of robot data each, across three embodiments: 6-DOF YAM arms with parallel-jaw grippers, the same arms with WUJI-2 20-DOF dexterous hands, and a semi-humanoid prototype. Post-training used robot data only — no human-robot alignment, no co-training.

每个梯级在 14 个任务上进行后训练,每个任务最多 10 小时的机器人数据,跨越三种具身:带平行爪夹持器的 6 自由度 YAM 手臂,相同手臂配备 WUJI-2 20 自由度灵巧手,以及一个半人形原型。后训练仅使用机器人数据——没有人类-机器人对齐,没有联合训练。

Mean normalized score rose 20% → 28% → 45% → 53% across the ladder, best on 9 of 14 tasks at one million hours. Lockbox Key Turning is the threshold case: 0% up to 100,000 hours, then 90%. Bottle Cap Untwisting was post-trained on roughly 10 minutes of demonstrations and still climbed to 50%.

平均归一化得分在梯级上从 20% → 28% → 45% → 53% 上升,在一百万小时时在 14 个任务中的 9 个上最佳。Lockbox Key Turning 是阈值案例:在 100,000 小时之前为 0%,然后达到 90%。Bottle Cap Untwisting 在大约 10 分钟的演示后训练后,仍然攀升至 50%。

Against Dyna-1 — the company’s production VLA initialized from Qwen3-VL-4B — an early Dyna-2 reached 1.55× success rate and 1.12× grade, pooled over 7 tasks and 3 checkpoints. At unseen customer sites, Dyna-2 passed production criteria 87% versus Dyna-1’s 46%, though both pass near 100% in house. A distillation pipeline also cuts video sampling from 10,203 ms to 110 ms on one H100.

与Dyna-1(公司基于Qwen3-VL-4B初始化的生产级VLA)相比,早期Dyna-2在7个任务和3个检查点上的平均成功率提高了1.55倍,成绩提高了1.12倍。在未见的客户现场,Dyna-2通过生产标准的比例为87%,而Dyna-1为46%,尽管两者在内部测试中均接近100%。蒸馏流程还将视频采样时间从单块H100上的10,203毫秒缩短至110毫秒。

Interactive explainer

交互式说明

更进一步:量化金融体系

看懂新闻只是起点——沿量化金融路径,把它变成能交付的工程能力

进入量化体系 →

关联讨论

同一事件的更多信源

相似阅读

另一事件,读法相近