Interactive sonification to assist children with autism during motor therapeutic interventions

Cibrian, Franceli L., Ley-Flores, Judith, Newbold, Joseph, Singh, Aneesha, Bianchi-Berthouze, Nadia and Tentori, Monica (2021) Interactive sonification to assist children with autism during motor therapeutic interventions. Personal and Ubiquitous Computing, 25 (2). pp. 391-410. ISSN 1617-4909

Manuscrip (Accepted).pdf - Accepted Version

Download (967kB) | Preview
Official URL:


Interactive sonification is an effective tool used to guide individuals when practicing movements. Little research has shown the use of interactive sonification in supporting motor therapeutic interventions for children with autism who exhibit motor impairments. The goal of this research is to study if children with autism understand the use of interactive sonification during motor therapeutic interventions, its potential impact of interactive sonification in the development of motor skills in children with autism, and the feasibility of using it in specialized schools for children with autism. We conducted two deployment studies in Mexico using Go-with-the-Flow, a framework to sonify movements previously developed for chronic pain rehabilitation. In the first study, six children with autism were asked to perform the forward reach and lateral upper-limb exercises while listening to three different sound structures (i.e., one discrete and two continuous sounds). Results showed that children with autism exhibit awareness about the sonification of their movements and engage with the sonification. We then adapted the sonifications based on the results of the first study, for motor therapy of children with autism. In the next study, nine children with autism were asked to perform upper-limb lateral, cross-lateral, and push movements while listening to five different sound structures (i.e., three discrete and two continues) designed to sonify the movements. Results showed that discrete sound structures engage the children in the performance of upper-limb movements and increase their ability to perform the movements correctly. We finally propose design considerations that could guide the design of projects related to interactive sonification.

Item Type: Article
Additional Information: Funding information: This work was partially funded by the Microsoft Faculty Fellowship grant and the EU-FP7 Marie Curie IRSES UBIHEALTH: Exchange of Excellence in Ubiquitous Computing Technologies to Address Healthcare Challenges.
Uncontrolled Keywords: interactive sonification, Autism, motor therapeutic intervention, children
Subjects: B900 Others in Subjects allied to Medicine
Department: Faculties > Engineering and Environment > Computer and Information Sciences
Depositing User: John Coen
Date Deposited: 03 Dec 2020 13:33
Last Modified: 27 Nov 2021 03:30

Actions (login required)

View Item View Item


Downloads per month over past year

View more statistics