Skip to main content

Exploitation of multiplayer interaction and development of virtual puppetry storytelling using gesture control and stereoscopic devices.

Liang, H., Chang, J., Deng, S., Chen, C., Tong, R. and Zhang, J. J., 2017. Exploitation of multiplayer interaction and development of virtual puppetry storytelling using gesture control and stereoscopic devices. Computer Animation and Virtual Worlds, 28 (5), e1727.

Full text available as:

[img]
Preview
PDF
CAVW_v2.pdf - Accepted Version
Available under License Creative Commons Attribution Non-commercial No Derivatives.

988kB

DOI: 10.1002/cav.1727

Abstract

With the rapid development of human-computer interaction technologies, the new media generation demands novel learning experiences with natural interaction and immersive experience. Considering that digital storytelling is a powerful pedagogical tool for young children, in this paper, we design an immersive storytelling environment that allows multiple players to use naturally interactive hand gestures to manipulate virtual puppetry for assisting narration. A set of multimodal interaction techniques is presented for a hybrid user interface that integrates existing 3D visualization and interaction devices including head-mounted displays and depth motion sensor. In this system, the young players could intuitively use hand gestures to manipulate virtual puppets to perform a story and interact with props in a virtual stereoscopic environment. We have conducted a user experiment with four young children for pedagogical evaluation, as well as system acceptability and interactivity evaluation by postgraduate students. The results show that our framework has great potential to stimulate learning abilities of young children through collaboration tasks. The stereoscopic head-mounted display outperformed the traditional monoscopic display in a comparison between the two.

Item Type:Article
ISSN:1546-4261
Group:Faculty of Media & Communication
ID Code:24601
Deposited By: Symplectic RT2
Deposited On:26 Aug 2016 13:53
Last Modified:14 Mar 2022 13:58

Downloads

Downloads per month over past year

More statistics for this item...
Repository Staff Only -