Deep learning-based networks for automated recognition and classification of awkward working postures in construction using wearable insole sensor data

Antwi-Afari, Maxwell Fordjour, Qarout, Yazan, Herzallah, Randa, Anwer, Shahnawaz, Umer, Waleed, Zhang, Yongcheng and Manu, Patrick (2022) Deep learning-based networks for automated recognition and classification of awkward working postures in construction using wearable insole sensor data. Automation in Construction, 136. p. 104181. ISSN 0926-5805

[img]
Preview
Text
Accepted Manuscript.pdf - Accepted Version
Available under License Creative Commons Attribution Non-commercial No Derivatives 4.0.

Download (1MB) | Preview
Official URL: https://doi.org/10.1016/j.autcon.2022.104181

Abstract

Among the numerous work-related risk factors, construction workers are often exposed to awkward working postures that may lead them to develop work-related musculoskeletal disorders (WMSDs). To mitigate WMSDs among construction workers, awkward working posture recognition is the first step in proactive WMSD prevention. Several researchers have proposed wearable sensor-based systems and machine learning classifiers for awkward posture recognition. However, these wearable sensor-based systems (e.g., surface electromyography) are either intrusive or require attaching multiple sensors on workers' bodies, which may lead to workers' discomfort and systemic instability, thus, limiting their application on construction sites. In addition, machine learning classifiers are limited to human-specific shallow features which influence model performance. To address these limitations, this study proposes a novel approach by using wearable insole pressure system and recurrent neural network (RNN) models, which automate feature extraction and are widely used for sequential data classification. Therefore, the research objective is to automatically recognize and classify different types of awkward working postures in construction by using deep learning-based networks and wearable insole sensor data. The classification performance of three RNN-based deep learning models, namely: (1) long-short term memory (LSTM), (2) bidirectional LSTM (Bi-LSTM), and (3) gated recurrent units (GRU), was evaluated using plantar pressure data captured by a wearable insole system from workers on construction sites. The experimental results show that GRU model outperforms the other RNN-based deep learning models with a high accuracy of 99.01% and F1-score between 93.19% and 99.39%. These results demonstrate that GRU models can be employed to learn sequential plantar pressure patterns captured by a wearable insole system to recognize and classify different types of awkward working postures. The findings of this study contribute to wearable sensor-based posture-related recognition and classification, thus, enhancing construction workers' health and safety.

Item Type: Article
Additional Information: Funding Information: The authors acknowledged two funding supports from (1) Aston Institute for Urban Technology and the Environment (ASTUTE) , Seedcorn Grants Proposal 2020/21 entitled “Wearable Insole Sensor Data and a Deep Learning Network-Based Recognition for Musculoskeletal Disorders Prevention in Construction” and (2) Aston Research and Knowledge Exchange Pump Priming Fund 2021/22, Grant Proposal entitled "Digital Twin-Enabled Wearable Sensing Technologies for Improved Workers' Activity Recognition and Work-Related Risk Assessment". Special thanks to all our participants involved in this study.
Uncontrolled Keywords: Awkward working postures, Deep learning networks, Wearable insole pressure system, Work-related musculoskeletal disorders, Work-related risk recognition
Subjects: B800 Medical Technology
B900 Others in Subjects allied to Medicine
G400 Computer Science
Department: Faculties > Engineering and Environment > Mechanical and Construction Engineering
Depositing User: John Coen
Date Deposited: 23 Mar 2022 11:17
Last Modified: 01 Mar 2023 08:00
URI: https://nrl.northumbria.ac.uk/id/eprint/48736

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year

View more statistics