Ways of Guided Listening: Embodied approaches to the design of interactive sonifications

Ballweg, Holger Matthias (2019) Ways of Guided Listening: Embodied approaches to the design of interactive sonifications. Doctoral thesis, Northumbria University.

Text (Doctoral thesis)
Ballweg.Holger_phd.pdf - Submitted Version

Download (5MB) | Preview


This thesis presents three use cases for interactive feedback. In each case users interact with a system and receive feedback: the primary source of feedback is visual, while a second source of feedback is offered as sonification.
The first use case comprised an interactive sonification system for use by pathologists in the triage stage of cancer diagnostics. Image features derived from computational homology are mapped to a soundscape with integrated auditory glance indicating potential regions of interests. The resulting prototype did not meet the requirements of a domain expert.
In the second case this thesis presents an interactive sonification plug-in developed for a software package for interactive visualisation of macromolecular complexes. A framework for building different sonification methods in Python and an OSC-controlled sound producing software was established along with sonification methods and a general sonification plugin. It received generally positive feedback, but the mapping was deemed not very transparent.
From these cases and ideas in sonification design literature, the Subject-Position-Based Sonification Design Framework (SPBDF) was developed. It explores an alternative conception of design: that working from a frame of reference encompassing a non-expert audience will lead towards sonifications that are more easily understood. A method for the analysis of sonifications according to its criteria is outlined and put into practice to evaluate a range of sonifications.
This framework was evaluated in the third use case, a system for sonified feedback for an exercise device designed for back pain rehabilitation. Two different sonifications, one using SPBDF as basis of their design, were evaluated, indicating that interactive sonification can provide valuable feedback and improve task performance (decrease the mean speed) when the soundscape employed invokes an appropriate emotional response in the user.

Item Type: Thesis (Doctoral)
Uncontrolled Keywords: auditory display, sound design, protein dynamics, subject position
Subjects: G400 Computer Science
G900 Others in Mathematical and Computing Sciences
Department: Faculties > Engineering and Environment > Computer and Information Sciences
University Services > Graduate School > Doctor of Philosophy
Depositing User: Ay Okpokam
Date Deposited: 15 Jan 2020 16:34
Last Modified: 31 Jul 2021 20:06
URI: http://nrl.northumbria.ac.uk/id/eprint/41916

Actions (login required)

View Item View Item


Downloads per month over past year

View more statistics