Lemma 4: Haptic Input + Auditory Display = Musical Instrument?

Vickers, Paul (2006) Lemma 4: Haptic Input + Auditory Display = Musical Instrument? In: Haptic and Audio Interaction Design: First International Workshop, HAID 2006, Glasgow, UK, August 31 - September 1, 2006. Proceedings. Lecture Notes in Computer Science, 4129/2 . Springer, London, pp. 56-67. ISBN 978-3-540-37596-8

Full text not available from this repository. (Request a copy)

Abstract

In this paper we look at some of the design issues that affect the success of multimodal displays that combine acoustic and haptic modalities. First, issues affecting successful sonification design are explored and suggestions are made about how the language of electroacoustic music can assist. Next, haptic interaction is introduced in the light of this discussion, particularly focusing on the roles of gesture and mimesis. Finally, some observations are made regarding some of the issues that arise when the haptic and acoustic modalities are combined in the interface. This paper looks at examples of where auditory and haptic interaction have been successfully combined beyond the strict confines of the human-computer application interface (musical instruments in particular) and discusses lessons that may be drawn from these domains and applied to the world of multimodal human-computer interaction. The argument is made that combined haptic-auditory interaction schemes can be thought of as musical instruments and some of the possible ramifications of this are raised.

Item Type:	Book Section
Subjects:	G400 Computer Science
Department:	Faculties > Engineering and Environment > Computer and Information Sciences
Depositing User:	Paul Vickers
Date Deposited:	27 Mar 2013 17:11
Last Modified:	12 Oct 2019 22:29
URI:	http://nrl.northumbria.ac.uk/id/eprint/11301

Downloads