Saliency-Informed Spatio-Temporal Vector of Locally Aggregated Descriptors and Fisher Vector for Visual Action Recognition

Zuo, Zheming, Organisciak, Daniel, Shum, Hubert and Yang, Longzhi (2018) Saliency-Informed Spatio-Temporal Vector of Locally Aggregated Descriptors and Fisher Vector for Visual Action Recognition. In: BMVC 2018 - British Machine Vision Conference, 3rd - 6th September 2018, Newcastle upon Tyne, UK.

[img]
Preview
Text (Full text)
Zuo et al - Saliency-Informed Spatio-Temporal Vector of Locally Aggregated Descriptors and Fisher Vector for Visual Action Recognition.pdf - Published Version

Download (2MB) | Preview
Official URL: http://bmvc2018.org/programme/BMVC2018.zip

Abstract

Feature encoding has been extensively studied for the task of visual action recognition (VAR). The recently proposed super vector-based encoding methods, such as the Vector of Locally Aggregated Descriptors (VLAD) and the Fisher Vector (FV), have significantly improved the recognition performance. Despite of the success, they still struggle with the superfluous information that presents during the training stage, which makes the methods computationally expensive when applied to a large number of extracted features. In order to address such challenge, this paper proposes a Saliency-Informed Spatio-Temporal VLAD (SST-VLAD) approach which selects the extracted features corresponding to small amount of videos in the data set by considering both the spatial and temporal video-wise saliency scores; and the same extension principle has also been applied to the FV approach. The experimental results indicate that the proposed feature encoding scheme consistently outperforms the existing ones with significantly lower computational cost.

Item Type: Conference or Workshop Item (Paper)
Subjects: G400 Computer Science
Department: Faculties > Engineering and Environment > Computer and Information Sciences
Depositing User: Paul Burns
Date Deposited: 17 Sep 2018 15:04
Last Modified: 11 Oct 2019 17:19
URI: http://nrl.northumbria.ac.uk/id/eprint/35744

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year

View more statistics