Validity of facial features’ geometric measurements for real-time assessment of mental fatigue in construction equipment operators

Mehmood, Imran, Li, Heng, Umer, Waleed, Arsalan, Aamir, Saad Shakeel, M. and Anwer, Shahnawaz (2022) Validity of facial features’ geometric measurements for real-time assessment of mental fatigue in construction equipment operators. Advanced Engineering Informatics, 54. p. 101777. ISSN 1474-0346

[img] Text
MS ADVEI-D-22-00632 [R2].pdf - Accepted Version
Restricted to Repository staff only until 15 October 2023.
Available under License Creative Commons Attribution Non-commercial No Derivatives 4.0.

Download (1MB) | Request a copy
Official URL: https://doi.org/10.1016/j.aei.2022.101777

Abstract

Operating construction equipment for extended periods of time may lead to mental fatigue and, as a result, an increased risk of human error-related accidents and jeopardized health problems for the operators. Therefore, to limit the risk of accidents and protect operators' wellbeing, their mental fatigue must be monitored reliably and in real time. Recently, many invasive technologies have been employed to alleviate this problem, but they entail the wearing of physical sensors, which may instigate irritation and discomfort. This study proposes a non-invasive mental fatigue monitoring method using geometric measurements of their facial features that does not require the operators to wear sensors on their body. The study further validates the proposed method by comparing it with wearable electroencephalography (EEG) technology to establish its ecological validity for construction equipment operators. To serve the purpose, a one-hour excavator operation by sixteen construction equipment operators was conducted on a construction site. Ground truth, brain activity using wearable EEG, and geometric measurements of facial features were extracted and analyzed at the baseline and every 20 min for one hour. A considerable temporal variation was found in the reported metrics (eye aspect ratio, eye distance, mouth aspect ratio, face area, and head motion) and were significantly correlated with ground truth and EEG metric. Furthermore, the brain visualization pattern obtained from EEG was also associated with the variations in the facial features. The findings of the study reveal that construction equipment operators’ mental fatigue can be monitored non-invasively using geometrical measurements of facial features.

Item Type: Article
Additional Information: Funding information: The authors acknowledged the following two funding grants: 1. General Research Fund (GRF) Grant ( 15201621 ) titled “ Monitoring and managing fatigue of construction plant and equipment operators exposed to prolonged sitting”; and 2. General Research Fund (GRF) Grant ( 15210720 ) titled “The development and validation of a noninvasive tool to monitor mental and physical stress in construction workers”.
Uncontrolled Keywords: mental fatigue, construction equipment operators, construction safety, facial features, electroencephalography
Subjects: C800 Psychology
K900 Others in Architecture, Building and Planning
Department: Faculties > Engineering and Environment > Mechanical and Construction Engineering
Depositing User: John Coen
Date Deposited: 22 Dec 2022 10:37
Last Modified: 22 Dec 2022 10:45
URI: https://nrl.northumbria.ac.uk/id/eprint/50990

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year

View more statistics