Boosted key-frame selection and correlated pyramidal motion-feature representation for human action recognition

Liu, Li, Shao, Ling and Rockett, Peter (2013) Boosted key-frame selection and correlated pyramidal motion-feature representation for human action recognition. Pattern Recognition, 46 (7). pp. 1810-1818. ISSN 0031-3203

Full text not available from this repository. (Request a copy)

Abstract

In this paper we propose a novel method for human action recognition based on boosted key-frame selection and correlated pyramidal motion feature representations. Instead of using an unsupervised method to detect interest points, a Pyramidal Motion Feature (PMF), which combines optical flow with a biologically inspired feature, is extracted from each frame of a video sequence. The AdaBoost learning algorithm is then applied to select the most discriminative frames from a large feature pool. In this way, we obtain the top-ranked boosted frames of each video sequence as the key frames which carry the most representative motion information. Furthermore, we utilise the correlogram which focuses not only on probabilistic distributions within one frame but also on the temporal relationships of the action sequence. In the classification phase, a Support-Vector Machine (SVM) is adopted as the final classifier for human action recognition. To demonstrate generalizability, our method has been systematically tested on a variety of datasets and shown to be more effective and accurate for action recognition compared to the previous work. We obtain overall accuracies of: 95.5%, 93.7%, and 36.5% with our proposed method on the KTH, the multiview IXMAS and the challenging HMDB51 datasets, respectively.

Item Type:	Article
Uncontrolled Keywords:	Action recognition; Pyramidal motion features; Boosted key-frame selection; Correlograms
Subjects:	G400 Computer Science
Department:	Faculties > Engineering and Environment > Computer and Information Sciences
Related URLs:	Publisher
Depositing User:	Paul Burns
Date Deposited:	10 Jun 2015 14:35
Last Modified:	12 Oct 2019 22:30
URI:	http://nrl.northumbria.ac.uk/id/eprint/22837

Downloads