Combining appearance and structural features for human action recognition

Zhao, Dongjie, Shao, Ling, Zhen, Xiantong and Liu, Yan (2013) Combining appearance and structural features for human action recognition. Neurocomputing, 113. pp. 88-96. ISSN 0925-2312

Full text not available from this repository. (Request a copy)

Abstract

In this paper, we propose to integrate structural information with appearance features for human action recognition. In local representations based on detected spatio-temporal interest points (STIPs), the layout of STIPs carries important cues of motion structures in video sequences, and is assumed to contain complementary information to appearance features. We aim to incorporate structures into the description of STIPs by combing with appearance features for action representation.

Based on the previous work of the 3D shape context, we present an optimised version of 3D shape context to encode the layout information of STIPs. By combining the proposed optimised 3D shape context with appearance descriptors, e.g., HOG3D and 3D gradients, we provide a more informative and discriminative description of STIPs for action classification. To validate the proposed descriptor, we have conducted extensive experiments on the KTH and the UCF YouTube datasets. The results prove that the optimised 3D shape context offers complementary information to appearance features, showing its effectiveness for action representation; moreover, the proposed descriptor yields comparable results with the state-of-the-art methods.

Item Type:	Article
Uncontrolled Keywords:	Human action recognition; Spatio-temporal interest points; Bag of words; 3D shape context; Feature combination; Structural features
Subjects:	G400 Computer Science
Department:	Faculties > Engineering and Environment > Computer and Information Sciences
Related URLs:	Publisher
Depositing User:	Paul Burns
Date Deposited:	10 Jun 2015 14:25
Last Modified:	12 Oct 2019 22:30
URI:	http://nrl.northumbria.ac.uk/id/eprint/22835

Downloads