Personal storytelling: Using Natural Language Generation for children with complex communication needs, in the wild...

Tintarev, N., Reiter, E., Black, R., Waller, A. and Reddington, J., 2016. Personal storytelling: Using Natural Language Generation for children with complex communication needs, in the wild... International Journal of Human Computer Studies, 92-93, 1 - 16.

Full text available as:

[img] PDF
TintarevHWST2016.pdf - Accepted Version
Restricted to Repository staff only until 16 April 2018.
Available under License Creative Commons Attribution Non-commercial No Derivatives.

2MB

DOI: 10.1016/j.ijhcs.2016.04.005

Abstract

This paper describes a Natural Language Generation system (NLG), How was School Today? that automatically creates a personal narrative from sensor data and other media (photos and audio). It can be used by children with complex communication needs in schools to support interactive narrative about personal experiences. The robustness of story generation to missing data was identified as a key area for improvement in a feasibility study of the system at a first special needs school. This paper therefore suggests three possible methods for generating stories from unstructured data: clustering by voice recording, by location, or by time. Clustering based on voice recordings resulted in stories that were perceived as most easy to read, and to make most sense, by parents in a quantitative evaluation. This method was implemented in the live system, which was developed and evaluated iteratively at a second special needs school with children with different usage profiles. Open challenges and possibilities for NLG in augmented and alternative communication are also discussed.

Item Type:Article
ISSN:1071-5819
Uncontrolled Keywords:Assistive technology; Augmented and alternative communication; Natural Language Generation; Communication aids; User-centered design
Subjects:UNSPECIFIED
Group:Faculty of Science and Technology
ID Code:24305
Deposited By: Unnamed user with email symplectic@symplectic
Deposited On:05 Jul 2016 13:28
Last Modified:05 Jul 2016 13:28

Downloads

Downloads per month over past year

More statistics for this item...
Repository Staff Only -