Transferring Human Motion to Humanoid Robots

Transferring Human Motion to Humanoid Robots

Research Project
Project Goals

Transferring motion from a human demonstrator to a humanoid robot is an important step toward developing robots that are easily programmable and that can replicate or learn from observed human motion. The so called motion retargeting problem has been well studied and several off-line solutions exist based on optimization approaches that rely on pre-recorded human motion data collected from a marker-based motion capture system.  From the perspective of human robot interaction, there is a growing interest in online motion transfer, particularly without using markers.  Such requirements have placed stringent demands on retargeting algorithms and limited the potential use of off-line and pre-recorded methods.  To address these limitations, we have developed an online task space control theoretic retargeting formulation to generate robot joint motions that adhere to the robot's balance constraints,  joint limit constraints, joint velocity constraints, and self-collision constraints. The inputs to the proposed method include low dimensional normalized human motion descriptors, detected and tracked using a  vision based key-point detection and tracking algorithm.  The proposed vision algorithm does not rely on markers placed on anatomical landmarks, nor does it require special instrumentation or calibration. The implementation requires a depth image sequence, which is collected from a single time of flight imaging device such as a Kinect sensor.  The feasibility of the proposed approach is shown by means of online experimental results on the Honda humanoid robot - ASIMO.​​

Research Area


Proc. of Digital Human Modeling Symposium, Tokyo, Japan 2014
C. John, B. Dariush
International Journal of Humanoid Robotics, Vol 10, No 3 2013
P. Wensing, G. Bin Hammam, B. Dariush, D. Orin
Journal of Computer Vision and Image Understanding, Vol. 114, Issue 12, pp. 1362-1375 2010
Y. Zhu, B. Dariush, K. Fujimura
IEEE/RAS Intelligent Robots and Systems Conference (IROS), Taipei, Taiwan 2010
B. Dariush, G. Bin-Hammam, D. Orin
International Conference on Robotics and Automation (ICRA). Anchorage, AK. 2010
G. Bin-Hammam, D. Orin, B. Dariush
International Journal of Humanoid Robotics. Vol. 6, No.2, pp. 265-289. 2009
B. Dariush, M. Gienger, A. Arumbakkam, Y. Zhu, B. Jian, K. Fujimura, C. Goerick.
2008 IEEE International Conference on Robotics and Automation, Pasadena, CA 2008
B. Dariush, M. Gienger, B. Jian, C. Goerick, K. Fujimura