Audio-Visual Resource Allocation for Bimodal Virtual Environments.

Doukakis, E., Debattista, K., Harvey, C., Bashford-Rogers, T. and Chalmers, A., 2017. Audio-Visual Resource Allocation for Bimodal Virtual Environments. Computer Graphics Forum. (In Press)

Full text available as:

[img] PDF
AVRABVE_pp.pdf - Accepted Version
Restricted to Repository staff only until 14 July 2018.
Available under License Creative Commons Attribution Non-commercial No Derivatives.

21MB

Abstract

Fidelity is of key importance if virtual environments are to be used as authentic representations of real environments. However, simulating the multitude of senses that comprise the human sensory system is computationally challenging. With limited computational resources it is essential to distribute these carefully in order to simulate the most ideal perceptual experience. This paper investigates this balance of resources across multiple scenarios where combined audio-visual stimulation is delivered to the user. A subjective experiment was undertaken where participants (N=35) allocated five fixed resource budgets across graphics and acoustic stimuli. In the experiment, increasing the quality of one of the stimuli decreased the quality of the other. Findings demonstrate that participants allocate more resources to graphics, however as the computational budget is increased, an approximately balanced distribution of resources is preferred between graphics and acoustics. Based on the results, an audiovisual quality prediction model is proposed and successfully validated against previously untested budgets and an untested scenario.

Item Type:Article
ISSN:0167-7055
Additional Information:Engineering and Physical Sciences Research Council. Grant Number: EP/K014056/1
Uncontrolled Keywords:Multi-Modal ; Cross-Modal ; Bi-Modal ; Sound ; Graphics
Group:Faculty of Science & Technology
ID Code:29532
Deposited By: Unnamed user with email symplectic@symplectic
Deposited On:26 Jul 2017 08:46
Last Modified:26 Jul 2017 08:46

Downloads

Downloads per month over past year

More statistics for this item...
Repository Staff Only -