Hand gesture-based interactive puppetry system to assist storytelling for children.

Liang, H., Chang, J., Kazmi, I. K., Zhang, J. J. and Jiao, P., 2016. Hand gesture-based interactive puppetry system to assist storytelling for children. Visual Computer, 1 - 15. (In Press)

Full text available as:

visual computer__NCCA_BU_v3_SD.pdf - Accepted Version
Available under License Creative Commons Attribution Non-commercial No Derivatives.

art_10.1007_s00371-016-1272-6.pdf - Published Version
Available under License Creative Commons Attribution.


DOI: 10.1007/s00371-016-1272-6


© 2016 The Author(s)Digital techniques have been used to assist narrative and storytelling, especially in many pedagogical practices. With the rapid development of HCI techniques, saturated with digital media in their daily lives, young children, demands more interactive learning methods and meaningful immersive learning experiences. In this paper, we propose a novel hand gesture-based puppetry storytelling system which provides a more intuitive and natural human computer interaction method for young children to develop narrative ability in virtual story world. Depth motion sensing and hand gestures control technology is utilized in the implementation of user-friendly interaction. Young players could intuitively use hand gestures to manipulate virtual puppet to perform story and interact with different items in virtual environment to assist narration. Based on the result of the evaluation, this novel digital storytelling system shows positive pedagogical functions on children’s narrating ability as well as the competencies of cognitive and motor coordination. The usability of the system is preliminary examined in our test, and the results which showed that young children can benefit from playing with Puppet Narrator.

Item Type:Article
Group:Faculty of Media & Communication
ID Code:24185
Deposited By: Unnamed user with email symplectic@symplectic
Deposited On:27 Jun 2016 14:57
Last Modified:03 Aug 2016 15:27


Downloads per month over past year

More statistics for this item...
Repository Staff Only -