Dilated causal convolution with multi-head self attention for sensor human activity recognition

Hamad, Rebeen, Kimura, Masashi, Yang, Longzhi, Woo, Wai Lok and Wei, Bo (2021) Dilated causal convolution with multi-head self attention for sensor human activity recognition. Neural Computing and Applications. ISSN 0941-0643 (In Press)

Text (Advance online version)
Hamad2021_Article_DilatedCausalConvolutionWithMu.pdf - Published Version
Available under License Creative Commons Attribution 4.0.

Download (1MB) | Preview
Official URL: https://doi.org/10.1007/s00521-021-06007-5


Systems of sensor human activity recognition are becoming increasingly popular in diverse fields such as healthcare and security. Yet, developing such systems poses inherent challenges due to the variations and complexity of human behaviors during the performance of physical activities. Recurrent neural networks, particularly long short-term memory have achieved promising results on numerous sequential learning problems, including sensor human activity recognition. However, parallelization is inhibited in recurrent networks due to sequential operation and computation that lead to slow training, occupying more memory and hard convergence. One-dimensional convolutional neural network processes input temporal sequential batches independently that lead to effectively executed operations in parallel. Despite that, a one-dimensional Convolutional Neural Network is not sensitive to the order of the time steps which is crucial for accurate and robust systems of sensor human activity recognition. To address this problem, we propose a network architecture based on dilated causal convolution and multi-head self-attention mechanisms that entirely dispense recurrent architectures to make efficient computation and maintain the ordering of the time steps. The proposed method is evaluated for human activities using smart home binary sensors data and wearable sensor data. Results of conducted extensive experiments on eight public and benchmark HAR data sets show that the proposed network outperforms the state-of-the-art models based on recurrent settings and temporal models.

Item Type: Article
Uncontrolled Keywords: Activity recognition, Smart home, Self-attention, Dilated causal convolution
Subjects: G400 Computer Science
G500 Information Systems
Department: Faculties > Engineering and Environment > Computer and Information Sciences
Depositing User: Elena Carlaw
Date Deposited: 13 Apr 2021 12:11
Last Modified: 31 Jul 2021 16:20
URI: http://nrl.northumbria.ac.uk/id/eprint/45904

Actions (login required)

View Item View Item


Downloads per month over past year

View more statistics