ABSTRACT Human motion tracking is receiving increasing attention from researchers of different fields of study nowadays. The interest is motivated by a wide range of applications, such as wireless healthcare, surveillance, and human-computer interaction. A complete model of human consists of both the movements and the shape of the human body skeleton. There are so many ways to track human motion, from marker sensing, marker less, optical, etc. Kinect sensor developed by Microsoft had done human tracking in 3d perspective and widely used in both in commercial and experiments purpose. However this Kinect method tracking by estimating depth image yield good result for simple gestures. In this study a novel approach is proposed to track complicated movement such as yoga movement with three Kinects in order to overcome kinect’s limitation.