Posture Reconstruction Using Kinect with a Probabilistic Model

Zhou, Liuyang, Liu, Zhiguang, Leung, Howard and Shum, Hubert P. H. (2014) Posture Reconstruction Using Kinect with a Probabilistic Model. In: Proceedings of the 20th ACM Symposium on Virtual Reality Software and Technology, 11th - 13th November 2014, Edinburgh, UK.

Full text not available from this repository.

Abstract

Recent work has shown that depth image based 3D posture estimation hardware such as Kinect has made interactive applications more popular. However, it is still challenging to accurately recognize postures from a single depth camera due to the inherently noisy data derived from depth images and self-occluding action performed by the user. While previous research has shown that data-driven methods can be used to reconstruct the correct postures, they usually require a large posture database, which greatly limit the usability for systems with constrained hardware such as game console. To solve this problem, we present a new probabilistic framework to enhance the accuracy of the postures live captured by Kinect. We adopt the Gaussian Process model as a prior to leverage position data obtained from Kinect and marker-based motion capture system. We also incorporate a temporal consistency term into the optimization framework to constrain the velocity variations between successive frames. To ensure that the reconstructed posture resembles the observed input data from Kinect when its tracking result is good, we embed joint reliability into the optimization framework. Experimental results demonstrate that our system can generate high quality postures even under severe self-occlusion situations, which is beneficial for real-time posture based applications such as motion-based gaming and sport training.

Item Type:	Conference or Workshop Item (Speech)
Additional Information:	DOI:10.1145/2671015.2671021
Uncontrolled Keywords:	Posture Reconstruction, Gaussian Process, Kinect
Subjects:	G400 Computer Science
Department:	Faculties > Engineering and Environment > Computer and Information Sciences
Depositing User:	Hubert Shum
Date Deposited:	11 Nov 2015 16:41
Last Modified:	10 Oct 2019 23:15
URI:	http://nrl.northumbria.ac.uk/id/eprint/24450

Downloads