Opto-Phono-Kinesia (OPK): Designing Motion-Based Interaction for Expert Performers

Gibson, Steve (2018) Opto-Phono-Kinesia (OPK): Designing Motion-Based Interaction for Expert Performers. In: Twelfth International Conference on Tangible, Embedded and Embodied Interactions, 18-21 March 2018, Stockholm.

OPK_SGibson_ExtendedAbstractsFormat.pdf - Published Version

Download (2MB) | Preview
Official URL: http://doi.org/10.1145/3173225.317295


Opto-Phono-Kinesia (OPK) is an audio-visual performance piece in which all media elements are controlled by the body movements of a single performer. The title is a play on a possible synesthetic state involving connections between vision, sound and body motion. Theoretically, for a person who experiences this state, a specific colour could trigger both a sound and a body action. This synesthetic intersection is simulated in OPK by simultaneity of body movement, and audio-visual result.

Using the Gesture and Media System 3.0 motion-tracking system, the performer can dynamically manipulate an immersive environment using two small infrared trackers. The project employs a multipart interface design based on a formal model of increasing complexity in visual-sound-body mapping, and is therefore best performed by an expert performer with strong spatial memory and advanced musical ability. OPK utilizes the “body as experience, instrument and interface” [1] for control of a large-scale environment.

Item Type: Conference or Workshop Item (Paper)
Uncontrolled Keywords: Immersive environments; motion-tracking; live audiovisuals; synesthesia; ephemeral interfaces; multimodal experiences; interaction design; media art
Subjects: W200 Design studies
W900 Others in Creative Arts and Design
Department: Faculties > Arts, Design and Social Sciences > Design
Depositing User: Becky Skoyles
Date Deposited: 16 Jan 2018 14:51
Last Modified: 18 Mar 2018 03:30
URI: http://nrl.northumbria.ac.uk/id/eprint/33125

Actions (login required)

View Item View Item


Downloads per month over past year

View more statistics

Policies: NRL Policies | NRL University Deposit Policy | NRL Deposit Licence