The Thematic Modelling of Subtext.

Hargood, C., Millard, D.E. and Weal, M.J., 2018. The Thematic Modelling of Subtext. Multimedia Tools and Applications. (In Press)

Full text available as:

[img] PDF
IJMTA-hargood.pdf - Accepted Version
Restricted to Repository staff only
Available under License Creative Commons Attribution Non-commercial No Derivatives.

1MB
[img]
Preview
PDF (OPEN ACCESS ARTICLE)
10.1007%2Fs11042-018-5972-y.pdf - Published Version
Available under License Creative Commons Attribution.

3MB

DOI: 10.1007/s11042-018-5972-y

Abstract

Narratives form a key component of multimedia knowledge representation on the Web. However, many existing multimedia narrative systems either ignore the narrative qualities of any media, or focus on the literal depicted content ignoring any subtext. Ignoring narrative subtext can lead to erroneous search results, or automatically remixed content that lacks cohesion. We suggest that subtext can be computationally modeled in terms of Tomashevsky's hierarchy of themes and motifs. These elements can then be used in a semiotic term expansion algorithm, incorporating knowledge of subtext into search and subsequent narrative generation. We present two experimental applications of this technique. In the first, we use our thematic model in the automatic construction of photo montages from Flickr, comparing it to more traditional term expansion based on co-occurrence, and showing that this improves the perceived relevance of images within the montage. In the second, we use the thematic model in order to automatically identify Flickr images to illustrate short stories, where it dampened the perception of unwanted themes (an effect we describe as reducing thematic noise). Our work is among the fi rst in this space, and shows that thematic subtext can be tackled computationally.

Item Type:Article
ISSN:0942-4962
Uncontrolled Keywords:Narrative; Term expansion; Thematics; Narrative cohesion; Semiotics; Multimedia mining
Group:Faculty of Science & Technology
ID Code:30549
Deposited By: Unnamed user with email symplectic@symplectic
Deposited On:10 Apr 2018 10:05
Last Modified:01 May 2018 13:42

Downloads

Downloads per month over past year

More statistics for this item...
Repository Staff Only -