Gemini Robotics 2 控制人形机器人全身

Really cool: Google DeepMind says Gemini Robotics 2 can control a humanoid’s entire body, from walking and crouching to manipulating objects with five-fingered hands.

The system combines three models: Gemini Robotics 2 converts vision and instructions into movement. -ER 2 plans tasks lasting several minutes, tracks hundreds of decisions and coordinates multiple robots. -On-Device 2 runs locally and can adapt to a completely new two-arm robot with fewer than 200 examples collected over a few hours.

The same Robotics 2 checkpoint controlled different versions of Apptronik’s Apollo humanoid and a Franka Duo robot.

However, performance remains uneven: Success rates ranged from 45.7% to 76.3% on whole-body tasks. Five-finger manipulation ranged from 32% for using a dustpan to 92% for unscrewing a bulb.