Beyond Multimedia Adaptation: Quality of Experience-Aware Multi-Sensorial Media Delivery

Yuan, Zhenhui, Ghinea, Gheorghita and Muntean, Gabriel-Miro (2015) Beyond Multimedia Adaptation: Quality of Experience-Aware Multi-Sensorial Media Delivery. IEEE Transactions on Multimedia, 17 (1). pp. 104-117. ISSN 1520-9210

06957558.pdf - Published Version
Available under License Creative Commons Attribution.

Download (2MB) | Preview
Official URL:


Multiple sensorial media (mulsemedia) combines multiple media elements which engage three or more of human senses, and as most other media content, requires support for delivery over the existing networks. This paper proposes an adaptive mulsemedia framework (ADAMS) for delivering scalable video and sensorial data to users. Unlike existing two-dimensional joint source-channel adaptation solutions for video streaming, the ADAMS framework includes three joint adaptation dimensions: video source, sensorial source, and network optimization. Using an MPEG-7 description scheme, ADAMS recommends the integration of multiple sensorial effects (i.e., haptic, olfaction, air motion, etc.) as metadata into multimedia streams. ADAMS design includes both coarse- and fine-grained adaptation modules on the server side: mulsemedia flow adaptation and packet priority scheduling. Feedback from subjective quality evaluation and network conditions is used to develop the two modules. Subjective evaluation investigated users' enjoyment levels when exposed to mulsemedia and multimedia sequences, respectively and to study users' preference levels of some sensorial effects in the context of mulsemedia sequences with video components at different quality levels. Results of the subjective study inform guidelines for an adaptive strategy that selects the optimal combination for video segments and sensorial data for a given bandwidth constraint and user requirement. User perceptual tests show how ADAMS outperforms existing multimedia delivery solutions in terms of both user perceived quality and user enjoyment during adaptive streaming of various mulsemedia content. In doing so, it highlights the case for tailored, adaptive mulsemedia delivery over traditional multimedia adaptive transport mechanisms.

Item Type: Article
Uncontrolled Keywords: Mulsemedia, quality of experience, subjective testing.
Subjects: G400 Computer Science
G500 Information Systems
Department: Faculties > Engineering and Environment > Computer and Information Sciences
Depositing User: Elena Carlaw
Date Deposited: 09 Nov 2020 12:58
Last Modified: 31 Jul 2021 13:30

Actions (login required)

View Item View Item


Downloads per month over past year

View more statistics