Skip to main content

Multimodality with Eye tracking and Haptics: A New Horizon for Serious Games?

Deng, S., Kirkby, J. A., Chang, J. and Zhang, J. J., 2014. Multimodality with Eye tracking and Haptics: A New Horizon for Serious Games? International Journal of Serious Games, 1 (4), 17 - 34.

Full text available as:

24-228-1-PB (1) (1).pdf - Published Version
Available under License Creative Commons Attribution Non-commercial No Derivatives.


Official URL:

DOI: 10.17083/ijsg.v1i4.24


The goal of this review is to illustrate the emerging use of multimodal virtual reality that can benefit learning-based games. The review begins with an introduction to multimodal virtual reality in serious games and we provide a brief discussion of why cognitive processes involved in learning and training are enhanced under immersive virtual environments. We initially outline studies that have used eye tracking and haptic feedback independently in serious games, and then review some innovative applications that have already combined eye tracking and haptic devices in order to provide applicable multimodal frameworks for learning-based games. Finally, some general conclusions are identified and clarified in order to advance current understanding in multimodal serious game production as well as exploring possible areas for new applications.

Item Type:Article
Uncontrolled Keywords:Eye tracking ; Haptic ; Multimodal ; Serious games ; Virtual reality
Group:Faculty of Media & Communication
ID Code:23452
Deposited By: Symplectic RT2
Deposited On:25 Apr 2016 13:15
Last Modified:14 Mar 2022 13:55


Downloads per month over past year

More statistics for this item...
Repository Staff Only -