Abnormal Infant Movements Classification With Deep Learning on Pose-Based Features

Ho, Edmond, McCay, Kevin, Shum, Hubert, Fehringer, Gerhard, Marcroft, Claire and Embleton, Nicholas (2020) Abnormal Infant Movements Classification With Deep Learning on Pose-Based Features. IEEE Access, 8. pp. 51582-51592. ISSN 2169-3536

09034058.pdf - Published Version
Available under License Creative Commons Attribution 4.0.

Download (8MB) | Preview
Official URL: https://doi.org/10.1109/ACCESS.2020.2980269


The pursuit of early diagnosis of cerebral palsy has been an active research area with some very promising results using tools such as the General Movements Assessment (GMA). In our previous work, we explored the feasibility of extracting pose-based features from video sequences to automatically classify infant body movement into two categories, normal and abnormal. The classification was based upon the GMA, which was carried out on the video data by an independent expert reviewer. In this paper we extend our previous work by extracting the normalised pose-based feature sets, Histograms of Joint Orientation 2D (HOJO2D) and Histograms of Joint Displacement 2D (HOJD2D), for use in new deep learning architectures. We explore the viability of using these pose-based feature sets for automated classification within a deep learning framework by carrying out extensive experiments on five new deep learning architectures. Experimental results show that the proposed fully connected neural network FCNet performed robustly across different feature sets. Furthermore, the proposed convolutional neural network architectures demonstrated excellent performance in handling features in higher dimensionality. We make the code, extracted features and associated GMA labels publicly available.

Item Type: Article
Additional Information: Funding information: This work was supported in part by the Royal Society under Grant IES\R1\191147 and Grant IES\R2\181024, and in part by the NIHR Fellowship under Grant ICA-CDRF-2018-04-ST2-020.
Uncontrolled Keywords: Deep learning, feature extraction, classification, infants, pose-based features
Subjects: G400 Computer Science
G500 Information Systems
Department: Faculties > Engineering and Environment > Computer and Information Sciences
Depositing User: Elena Carlaw
Date Deposited: 10 Mar 2020 14:44
Last Modified: 05 Aug 2021 08:10
URI: http://nrl.northumbria.ac.uk/id/eprint/42436

Actions (login required)

View Item View Item


Downloads per month over past year

View more statistics