Skip to main content

Personal storytelling: Using Natural Language Generation for children with complex communication needs, in the wild...

Tintarev, N., Reiter, E., Black, R., Waller, A. and Reddington, J., 2016. Personal storytelling: Using Natural Language Generation for children with complex communication needs, in the wild... International Journal of Human Computer Studies, 92-93, 1 - 16.

Full text available as:

[img]
Preview
PDF
TintarevHWST2016.pdf - Accepted Version
Available under License Creative Commons Attribution Non-commercial No Derivatives.

2MB

DOI: 10.1016/j.ijhcs.2016.04.005

Abstract

This paper describes a Natural Language Generation system (NLG), How was School Today? that automatically creates a personal narrative from sensor data and other media (photos and audio). It can be used by children with complex communication needs in schools to support interactive narrative about personal experiences. The robustness of story generation to missing data was identified as a key area for improvement in a feasibility study of the system at a first special needs school. This paper therefore suggests three possible methods for generating stories from unstructured data: clustering by voice recording, by location, or by time. Clustering based on voice recordings resulted in stories that were perceived as most easy to read, and to make most sense, by parents in a quantitative evaluation. This method was implemented in the live system, which was developed and evaluated iteratively at a second special needs school with children with different usage profiles. Open challenges and possibilities for NLG in augmented and alternative communication are also discussed.

Item Type:Article
ISSN:1071-5819
Uncontrolled Keywords:Assistive technology; Augmented and alternative communication; Natural Language Generation; Communication aids; User-centered design
Group:Faculty of Science & Technology
ID Code:24305
Deposited By: Symplectic RT2
Deposited On:05 Jul 2016 13:28
Last Modified:14 Mar 2022 13:57

Downloads

Downloads per month over past year

More statistics for this item...
Repository Staff Only -