跳到主内容
@wquguru
精选88NVIDIA 博客(RSS)模型发布/更新

Skild AI发布S1机器人基础模型,单视频演示实现零重训

Skild AI Taps NVIDIA Physical AI to Teach Robots New Tasks From a Single Video

原文
发到 X
推荐理由

机器人领域重磅进展,S1模型实现了从视频到执行的零重训泛化,大幅降低工业部署门槛,值得关注具身智能落地的从业者阅读。

Manufacturing floors, warehouses and production lines rarely stay fixed — tasks change, layouts shift and new products arrive, and most robots can’t keep up without significant reprogramming.

制造车间、仓库和生产线很少一成不变——任务会变化,布局会调整,新产品不断涌入,而大多数机器人在没有大量重新编程的情况下无法跟上节奏。

Skild AI’s new S1 robot foundation model helps address this, designed to learn previously unseen, long-horizon tasks from a single video demonstration. The model, launched last week, uses video as input to understand and execute the task without updating its weights or undergoing task-specific post-training — a technique called in-context learning.

Skild AI 的新 S1 机器人基础模型有助于解决这一问题,该模型旨在从单个视频演示中学习以前未见过的长周期任务。该模型于上周发布,使用视频作为输入来理解和执行任务,无需更新其权重或进行特定任务的后续训练——这种技术称为上下文学习(in-context learning)。

Skild built S1 and conducted the research on NVIDIA AI infrastructure, part of a broader collaboration spanning synthetic data generation, model training, simulation and real-world physical AI deployment. The companies are working together to move adaptable robot intelligence from the lab into factories and other dynamic operating environments.

Skild 在 NVIDIA AI 基础设施上构建了 S1 并开展了相关研究,这是双方更广泛合作的一部分,涵盖合成数据生成、模型训练、仿真以及现实世界物理 AI 部署。两家公司正共同努力,将可适应的机器人智能从实验室推向工厂和其他动态运营环境。

“Learning by experience, and not preprogramming, is the step change that has happened in robotics,” said Deepak Pathak, cofounder and CEO of Skild AI. “NVIDIA Isaac Lab and NVIDIA Cosmos technologies help Skild create the scalable, diverse experience its robots need to learn across many scenarios and embodiments.”

“通过经验学习而非预先编程,是机器人领域发生的变革性一步,”Skild AI 联合创始人兼首席执行官 Deepak Pathak 表示。“NVIDIA Isaac Lab 和 NVIDIA Cosmos 技术帮助 Skild 创建了可扩展且多样化的经验,使其机器人能够在多种场景和形态中学习。”

The launch comes as the company reached a $100 million annual revenue run rate 10 months after its first commercial deployment. In that time, Skild has built more than 60 deployment partnerships with work spanning manufacturing, logistics, inspection, security, food preparation and other applications.

此次发布之际,该公司在其首次商业部署后 10 个月达到了每年 1 亿美元的年化收入运行率。在此期间,Skild 建立了 60 多个部署合作伙伴关系,工作范围涵盖制造、物流、检查、安保、食品准备及其他应用。

Learning New Work From One Video

从一段视频中学习新工作

Most industrial robots are built for fixed jobs, so each new product, process or layout requires more data, retraining and validation.

大多数工业机器人是为固定工作而设计的,因此每种新产品、工艺或布局都需要更多的数据、重新训练和验证。

S1 takes a different approach: An operator records a video of the desired task and provides it to the model as a prompt. It interprets the demonstrated intent, objects and sequence, then maps them into actions for the robot in front of it — with no retraining — and often for a task not covered by its pretraining dataset.

S1 采取了不同的方法:操作员录制所需任务的视频,并将其作为提示提供给模型。模型解读所演示的意图、物体和序列,然后将其映射为面前机器人的动作——无需重新训练——并且通常适用于其预训练数据集未涵盖的任务。

S1 can perform unfamiliar tasks lasting up to 10 minutes, including plant potting, pancake making, pour-over coffee brewing and kit assembly. These tasks can span dozens of manipulation steps and require the robot to compose skills in sequences it hasn’t previously performed.

S1 可以执行长达 10 分钟的不熟悉任务,包括盆栽植物、制作煎饼、手冲咖啡冲泡和套件组装。这些任务可能涉及数十个操作步骤,并要求机器人组合出它此前未曾执行过的技能序列。

https://blogs.nvidia.com/wp-content/uploads/2026/09/robotics-promo-skildai-corp-blog-1600x900-one.mp4

https://blogs.nvidia.com/wp-content/uploads/2026/09/robotics-promo-skildai-corp-blog-1600x900-one.mp4

In one plant-potting test, the Skild AI team moved from recording the demonstration to autonomous execution on hardware in just 11 minutes. The model can also adjust when objects move, recover from errors and combine skills in sequences that weren’t explicitly programmed.

在一项盆栽测试中,Skild AI 团队从录制演示到在硬件上实现自主执行,仅用了 11 分钟。该模型还能在物体移动时进行调整、从错误中恢复,并组合成未明确编程的顺序技能。

In Skild’s tests on new, multistep tasks, its S1 robot succeeded about 66% of the time at each step, compared with 9% for a similar AI system — a more than sevenfold improvement. Skild also estimates that showing the robot one short video example can be as useful as giving it roughly 380 hands-on training examples. A person collecting those examples manually could take 50-100 hours.

在 Skild 针对新多步骤任务的测试中,其 S1 机器人每一步的成功率约为 66%,而类似 AI 系统的成功率仅为 9%——提升了七倍以上。Skild 还估计,向机器人展示一个简短的视频示例,其效用相当于提供大约 380 个动手训练示例。人工收集这些示例可能需要 50-100 小时。

From Research to Factory Work

从研究到工厂工作

S1 breaks the cycle of needing to constantly retrain robots for new factors by letting operators demonstrate new tasks directly without requiring a new dataset or training run for every change. Where customer agreements permit, experience from Skild’s commercial deployments can inform the broader model and help accelerate future deployments.

S1 打破了需要为新的因素不断重新训练机器人的循环,它允许操作员直接演示新任务,无需为每次变更提供新的数据集或训练运行。在客户协议允许的情况下,Skild 商业部署的经验可以为更广泛的模型提供参考,并帮助加速未来的部署。

That work is already in action on the factory floor. Skild, NVIDIA and Foxconn are deploying the Skild Brain on dual-arm manipulators for high-precision assembly of NVIDIA Blackwell systems. In one demonstrated workflow, a robot installs a busbar and limit block, fastens 16 screws and adapts to disturbances across a multistep task. The work requires precise motion, contact-aware control, sequence tracking and recovery when the scene differs from the plan.

这项工作已经在工厂车间付诸实践。Skild、NVIDIA 和富士康正在双臂机械臂上部署 Skild Brain,用于 NVIDIA Blackwell 系统的高精度组装。在一次演示的工作流程中,机器人安装母排和限位块,拧紧 16 颗螺丝,并在多步骤任务中适应干扰。这项工作需要精确的运动、接触感知控制、序列跟踪以及在场景与计划不符时的恢复能力。

https://blogs.nvidia.com/wp-content/uploads/2026/09/skildai-video-2.mp4

https://blogs.nvidia.com/wp-content/uploads/2026/09/skildai-video-2.mp4

NVIDIA Technology Across the Development Cycle

NVIDIA 技术贯穿整个开发周期

NVIDIA accelerated computing gives Skild the scale to train its shared robot brain using simulation, human video, teleoperation and, where permitted, deployment data. NVIDIA Cosmos open world foundation models help diversify training data and turn video into structured descriptions, while Cosmos Curator helps annotate, filter and organize data at scale.

NVIDIA 加速计算使 Skild 能够利用仿真、人类视频、遥操作以及(在允许的情况下)部署数据来训练其共享的机器人大脑。NVIDIA Cosmos 开放世界基础模型有助于多样化训练数据并将视频转化为结构化描述,而 Cosmos Curator 则帮助大规模地标注、过滤和组织数据。

Skild is extensively using NVIDIA’s open simulation frameworks to train and validate its robot brain before real-world deployment. NVIDIA Omniverse libraries and the NVIDIA Isaac Sim framework provide physically based virtual environments for generating data, testing edge cases and validating behaviors.

Skild 广泛使用 NVIDIA 的开源仿真框架,在实际部署之前训练和验证其机器人大脑。NVIDIA Omniverse 库和 NVIDIA Isaac Sim 框架提供了基于物理的虚拟环境,用于生成数据、测试边缘情况并验证行为。

Skild further strengthens the skills of its brain through reinforcement learning in Isaac Lab, an open modular robot learning framework. Powered by the Newton physics engine, Isaac Lab helps Skild’s engineers accurately model various physical parameters, such as forces, contact, collision and pressure, and reduce the simulation-to-reality gap.

Skild 进一步通过 Isaac Lab(一个开源模块化机器人学习框架)中的强化学习来增强其大脑的技能。Isaac Lab 由 Newton 物理引擎驱动,帮助 Skild 的工程师准确模拟各种物理参数,如力、接触、碰撞和压力,并缩小仿真与现实的差距。

Skild and NVIDIA are also jointly developing new GPU-accelerated simulation solvers that quickly and accurately model how robots physically touch, grip and manipulate solid objects. They’ll soon be made available to all developers as part of Newton.

Skild 和 NVIDIA 还在共同开发新的 GPU 加速仿真求解器,能够快速且准确地模拟机器人如何物理性地触摸、抓取和操作固体物体。它们将很快作为 Newton 的一部分向所有开发者开放。

As models move toward production, NVIDIA Nsight tools help engineers find performance bottlenecks during training, and the NVIDIA TensorRT software development kit optimizes inference so robots can respond quickly in the physical world. Together, these technologies connect the data, simulation, training and deployment stages instead of treating them as separate systems.

随着模型走向生产环境,NVIDIA Nsight 工具帮助工程师在训练过程中发现性能瓶颈,而 NVIDIA TensorRT 软件开发工具包则优化推理过程,使机器人能够在物理世界中快速响应。这些技术共同连接了数据、仿真、训练和部署阶段,而不是将它们视为独立的系统。

Read Skild AI’s S1 research and explore the NVIDIA Isaac robotics platform.

阅读 Skild AI 的 S1 研究,并探索 NVIDIA Isaac 机器人平台。

更进一步:量化金融体系

看懂新闻只是起点——沿量化金融路径,把它变成能交付的工程能力

进入量化体系 →

相似阅读

关联信息,但可能不是同一事件