Skip to main content

Spatialised Audio in a Custom-Built OpenGL-based Ear Training Virtual Environment.

Pedersen, K., Hulusic, V., Amelidis, P. and Slattery, T., 2020. Spatialised Audio in a Custom-Built OpenGL-based Ear Training Virtual Environment. IEEE Computer Graphics and Applications, 40 (5), 67-81.

Full text available as:

[img]
Preview
PDF
CGASI-2019-12-0147.R2_Hulusic_v2.pdf - Accepted Version
Available under License Creative Commons Attribution Non-commercial.

8MB
[img] PDF
CGASI-2019-12-0147.R2_Hulusic.pdf - Accepted Version
Restricted to Repository staff only
Available under License Creative Commons Attribution Non-commercial.

8MB

DOI: 10.1109/MCG.2020.3013439

Abstract

Interval recognition is an important part of ear training - the key aspect of music education. Once trained, the musician can identify pitches, melodies, chords and rhythms by listening to music segments. In a conventional setting, the tutor would teach a trainee the intervals using a musical instrument, typically a piano. However, this is expensive, time consuming and non-engaging for either party. With the emergence of new technologies, including Virtual Reality (VR) and areas such as edutainment, this and similar trainings can be transformed into a more engaging, more accessible, customisable (virtual) environments, with addition of new cues and bespoke progression settings. In this work, we designed and implemented a VR ear training system for interval recognition. The usability, user experience and the effect of multimodal integration through addition of a perceptual cue - spatial audio, was investigated in two experiments with 46 participants. The results show that the system is highly acceptable and provides a very good experience for users. Furthermore, we show that the added spatial auditory cues provided in the VR application give users significantly more information for judging the musical intervals, something that is not possible in a non-VR environment.

Item Type:Article
ISSN:0272-1716
Additional Information:© 2020 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Uncontrolled Keywords:virtual reality; ear training; spatial audio; OpenG; Training; Ear; Three-dimensional displays; Rhythm; Visualization; Software
Group:Faculty of Science & Technology
ID Code:34409
Deposited By: Unnamed user with email symplectic@symplectic
Deposited On:06 Aug 2020 14:47
Last Modified:02 Sep 2020 08:12

Downloads

Downloads per month over past year

More statistics for this item...
Repository Staff Only -