Real-time human shadowing
A policy trained in simulation lets the robot follow human body and hand motion in real time using pose estimates from an external RGB camera. [1][2]
Price & availability
Prototype
Current dataset status: Prototype.
Product overview
HumanPlus is a research humanoid system from Stanford University, presented in the paper 'HumanPlus: Humanoid Shadowing and Imitation from Humans' and at CoRL 2024. The authors are Zipeng Fu, Qingqing Zhao, Qi Wu, Gordon Wetzstein and Chelsea Finn. Its 180 cm, 33-DoF hardware is built on a Unitree H1 and fitted with Inspire Robots RH56DFX hands and custom wrists; it is not a commercial product.
The system has two parts. A shadowing policy, trained in simulation with reinforcement learning on existing human motion data, lets the robot follow a person's body and hand motion in real time using pose estimates from an external RGB camera. Teleoperated shadowing then collects whole-body data, which is used to train skill policies from the robot's two head-mounted RGB cameras by behavior cloning.
The paper reports autonomous tasks with 60 to 100 percent success after up to 40 demonstrations, including putting on a shoe, unloading warehouse racks and folding a sweatshirt. The authors released the HST and HIT code publicly, with hardware software based on unitree_ros2.
Capabilities
A policy trained in simulation lets the robot follow human body and hand motion in real time using pose estimates from an external RGB camera. [1][2]
Teleoperated shadowing gathers whole-body data, which is then used to train egocentric-vision skill policies by behavior cloning. [2]
The paper reports 60 to 100 percent success on autonomous tasks learned from up to 40 demonstrations. [2]
The HST and HIT implementations are on GitHub, and the hardware codebase is based on unitree_ros2. [3]
Hardware profile
Quick answers
No general order page is verified. Stanford HumanPlus is currently classified as prototype. [1]
The listed payload is 7.5 kg; The paper says the arms can hold items up to 7.5 kg; it does not specify whether this is per arm or combined. [2]
Stanford HumanPlus has 33 listed degrees of freedom; Two 6-DoF hands, two 1-DoF wrists, and a 19-DoF body. [1][2]
Stanford HumanPlus is made by Stanford University, based in United States. [1]
Side by side
Choose up to four robots for a sourced specification and price comparison.
Evaluation footprint
No benchmark embodiments or results reference this robot yet.
Related
Evidence