Spatio-Temporal Laplacian Pyramid Coding for Action Recognition

Shao, Ling, Zhen, Xiantong, Tao, Dacheng and Li, Xuelong (2014) Spatio-Temporal Laplacian Pyramid Coding for Action Recognition. IEEE Transactions on Cybernetics, 44 (6). pp. 817-827. ISSN 2168-2267

Full text not available from this repository. (Request a copy)

Abstract

We present a novel descriptor, called spatiotemporal Laplacian pyramid coding (STLPC), for holistic representation of human actions. In contrast to sparse representations based on detected local interest points, STLPC regards a video sequence as a whole with spatio-temporal features directly extracted from it, which prevents the loss of information in sparse representations. Through decomposing each sequence into a set of band-pass-filtered components, the proposed pyramid model localizes features residing at different scales, and therefore is able to effectively encode the motion information of actions. To make features further invariant and resistant to distortions as well as noise, a bank of 3-D Gabor filters is applied to each level of the Laplacian pyramid, followed by max pooling within filter bands and over spatio-temporal neighborhoods. Since the convolving and pooling are performed spatio-temporally, the coding model can capture structural and motion information simultaneously and provide an informative representation of actions. The proposed method achieves superb recognition rates on the KTH, the multiview IXMAS, the challenging UCF Sports, and the newly released HMDB51 datasets. It outperforms state of the art methods showing its great potential on action recognition.

Item Type:	Article
Uncontrolled Keywords:	Action recognition, computer vision, max pooling, spatio-temporal Laplacian pyramid
Subjects:	G400 Computer Science
Department:	Faculties > Engineering and Environment > Computer and Information Sciences
Related URLs:	Publisher
Depositing User:	Paul Burns
Date Deposited:	10 Jun 2015 13:20
Last Modified:	12 Oct 2019 22:30
URI:	http://nrl.northumbria.ac.uk/id/eprint/22825

Downloads