ConvNet-based performers attention and supervised contrastive learning for activity recognition

Hamad, Rebeen, Yang, Longzhi, Woo, Wai Lok and Wei, Bo (2023) ConvNet-based performers attention and supervised contrastive learning for activity recognition. Applied Intelligence, 53 (8). pp. 8809-8825. ISSN 0924-669X

s10489-022-03937-y.pdf - Published Version
Available under License Creative Commons Attribution 4.0.

Download (1MB) | Preview
Official URL:


Human activity recognition based on generated sensor data plays a major role in a large number of applications such as healthcare monitoring and surveillance system. Yet, accurately recognizing human activities is still challenging and active research due to people’s tendency to perform daily activities in a different and multitasking way. Existing approaches based on the recurrent setting for human activity recognition have some issues, such as the inability to process data parallelly, the requirement for more memory and high computational cost albeit they achieved reasonable results. Convolutional Neural Network processes data parallelly, but, it breaks the ordering of input data, which is significant to build an effective model for human activity recognition. To overcome these challenges, this study proposes causal convolution based on performers-attention and supervised contrastive learning to entirely forego recurrent architectures, efficiently maintain the ordering of human daily activities and focus more on important timesteps of the sensors’ data. Supervised contrastive learning is integrated to learn a discriminative representation of human activities and enhance predictive performance. The proposed network is extensively evaluated for human activities using multiple datasets including wearable sensor data and smart home environments data. The experiments on three wearable sensor datasets and five smart home public datasets of human activities reveal that our proposed network achieves better results and reduces the training time compared with the existing state-of-the-art methods and basic temporal models.

Item Type: Article
Uncontrolled Keywords: Activity recognition, Contrastive learning, Class imbalanced problem, Temporal evaluation, Attention mechanism, Sensor data
Subjects: G400 Computer Science
Department: Faculties > Engineering and Environment > Computer and Information Sciences
Depositing User: John Coen
Date Deposited: 07 Jul 2022 09:56
Last Modified: 28 Jun 2023 11:45

Actions (login required)

View Item View Item


Downloads per month over past year

View more statistics