Identification of Abnormal Movements in Infants: A Deep Neural Network for Body Part-based Prediction of Cerebral Palsy

Sakkos, Dimitrios, McCay, Kevin D., Marcroft, Claire, Embleton, Nicholas D., Chattopadhyay, Samiran and Ho, Edmond S. L. (2021) Identification of Abnormal Movements in Infants: A Deep Neural Network for Body Part-based Prediction of Cerebral Palsy. IEEE Access. ISSN 2169-3536 (In Press)

09467286.pdf - Accepted Version
Available under License Creative Commons Attribution 4.0.

Download (17MB) | Preview
Official URL:


The early diagnosis of cerebral palsy is an area which has recently seen significant multi-disciplinary research. Diagnostic tools such as the General Movements Assessment (GMA), have produced some very promising results, however these manual methods can be laborious. The prospect of automating these processes is seen as key in advancing this field of study. In our previous works, we examined the viability of using pose-based features extracted from RGB video sequences to undertake classification of infant body movements based upon the GMA. In this paper, we propose a new deep learning framework for this classification task. We also propose a visualization framework which identifies body-parts with the greatest contribution towards a classification decision. The inclusion of a visualization framework is an important step towards automation as it helps make the decisions made by the machine learning framework interpretable. We directly compare the proposed framework’s classification with several other methods from the literature using two independent datasets. Our experimental results show that the proposed method performs more consistently and more robustly than our previous pose-based techniques as well as other features from related works in this setting. We also find that our visualization framework helps provide greater interpretability, enhancing the likelihood of the adoption of these technologies within the medical domain.

Item Type: Article
Additional Information: Funding information: This work was supported in part by the Royal Society under Grant Ref: IES \R1\191147.
Uncontrolled Keywords: Cerebral Palsy, Deep Learning, Early Diagnosis, Explainable AI, General Movements Assessment, Interpretable AI, Machine Learning, Medical Visualization, Motion Analysis, Skeletal Pose
Subjects: B800 Medical Technology
G400 Computer Science
G600 Software Engineering
Department: Faculties > Engineering and Environment > Computer and Information Sciences
Faculties > Health and Life Sciences > Social Work, Education and Community Wellbeing
Depositing User: John Coen
Date Deposited: 01 Jul 2021 07:51
Last Modified: 02 Jul 2021 09:43

Actions (login required)

View Item View Item


Downloads per month over past year

View more statistics