Action Recognition From Arbitrary Views Using Transferable Dictionary Learning

Zhang, Jingtian, Shum, Hubert P. H., Han, Jungong and Shao, Ling (2018) Action Recognition From Arbitrary Views Using Transferable Dictionary Learning. IEEE Transactions on Image Processing, 27 (10). pp. 4709-4723. ISSN 1057-7149

[img]
Preview
Text
08359373.pdf - Published Version
Available under License Creative Commons Attribution.

Download (8MB) | Preview
Official URL: https://doi.org/10.1109/TIP.2018.2836323

Abstract

Human action recognition is crucial to many practical applications, ranging from human-computer interaction to video surveillance. Most approaches either recognize the human action from a fixed view or require the knowledge of view angle, which is usually not available in practical applications. In this paper, we propose a novel end-to-end framework to jointly learn a view-invariance transfer dictionary and a view-invariant classifier. The result of the process is a dictionary that can project real-world 2D video into a view-invariant sparse representation, as well as a classifier to recognize actions with an arbitrary view. The main feature of our algorithm is the use of synthetic data to extract view-invariance between 3D and 2D videos during the pre-training phase. This guarantees the availability of training data, and removes the hassle of obtaining real-world videos in specific viewing angles. Additionally, for better describing the actions in 3D videos, we introduce a new feature set called the 3D dense trajectories to effectively encode extracted trajectory information on 3D videos. Experimental results on the IXMAS, N-UCLA, i3DPost and UWA3DII datasets show improvements over existing algorithms.

Item Type: Article
Uncontrolled Keywords: Action recognition, 3D dense trajectories, view-invariance, transfer dictionary learning
Subjects: G400 Computer Science
Department: Faculties > Engineering and Environment > Computer and Information Sciences
Depositing User: Becky Skoyles
Date Deposited: 15 Jun 2018 11:35
Last Modified: 11 Oct 2019 08:20
URI: http://nrl.northumbria.ac.uk/id/eprint/34568

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year

View more statistics


Policies: NRL Policies | NRL University Deposit Policy | NRL Deposit Licence