A Pose-based Feature Fusion and Classification Framework for the Early Prediction of Cerebral Palsy in Infants

McCay, Kevin, Hu, Pengpeng, Shum, Hubert P. H., Woo, Wai Lok, Marcroft, Claire, Embleton, Nicholas D., Munteanu, Adrian and Ho, Edmond (2022) A Pose-based Feature Fusion and Classification Framework for the Early Prediction of Cerebral Palsy in Infants. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 30. pp. 8-19. ISSN 1534-4320

A_Pose-Based_Feature_Fusion_and_Classification_Framework_for_the_Early_Prediction_of_Cerebral_Palsy_in_Infants.pdf - Published Version
Available under License Creative Commons Attribution 4.0.

Download (1MB) | Preview
_Final_TNSRE_2021_Fusion.pdf - Accepted Version

Download (648kB) | Preview
Official URL: https://doi.org/10.1109/TNSRE.2021.3138185


The early diagnosis of cerebral palsy is an area which has recently seen significant multi-disciplinary research. Diagnostic tools such as the General Movements Assessment (GMA), have produced some very promising results. However, the prospect of automating these processes may improve accessibility of the assessment and also enhance the understanding of movement development of infants. Previous works have established the viability of using pose-based features extracted from RGB video sequences to undertake classification of infant body movements based upon the GMA. In this paper, we propose a series of new and improved features, and a feature fusion pipeline for this classification task. We also introduce the RVI-38 dataset, a series of videos captured as part of routine clinical care. By utilising this challenging dataset we establish the robustness of several motion features for classification, subsequently informing the design of our proposed feature fusion framework based upon the GMA. We evaluate our proposed framework's classification performance using both the RVI-38 dataset and the publicly available MINI-RGBD dataset. We also implement several other methods from the literature for direct comparison using these two independent datasets.Our experimental results and feature analysis show that our proposed pose-based method performs well across both datasets. The proposed features afford us the opportunity to include finer detail than previous methods, and further model GMA specific body movements. These new features also allow us to take advantage of additional body-part specific information as a means of improving the overall classification performance, whilst retaining GMA relevant, interpretable, and shareable features.

Item Type: Article
Additional Information: Funding information: This work was supported in part by the Royal Society (Ref: IES\R2\181024 and IES\R1\191147). The authors would like to thank the extended team at the RVI, and in particular, Patricia Dulson for her work annotating and transferring the video data for analysis.
Uncontrolled Keywords: Cerebral Palsy, Early Diagnosis, Explainable AI, General Movements Assessment, Machine Learning, Motion Analysis, Skeletal Pose Estimation
Subjects: B800 Medical Technology
Department: Faculties > Engineering and Environment > Computer and Information Sciences
Depositing User: John Coen
Date Deposited: 23 Dec 2021 12:23
Last Modified: 31 Jan 2022 15:00
URI: http://nrl.northumbria.ac.uk/id/eprint/48045

Actions (login required)

View Item View Item


Downloads per month over past year

View more statistics