Kostoulas, T., Chanel, G., Muszynski, M., Lombardo, P. and Pun, T., 2017. Films, Affective Computing and Aesthetic Experience: Identifying Emotional and Aesthetic Highlights from Multimodal Signals in a Social Setting. Frontiers in ICT, 4, 1-11.
Full text available as:
|
PDF
Films, Affective Computing and Aesthetic Experience Identifying Emotional and Aesthetic Highlights from Multimodal Signals in a Social Setting.pdf - Published Version Available under License Creative Commons Attribution. 695kB | |
Copyright to original material in this document is with the original owner(s). Access to this content through BURO is granted on condition that you use it only for research, scholarly or other non-commercial purposes. If you wish to use it for any other purposes, you must contact BU via BURO@bournemouth.ac.uk. Any third party copyright material in this document remains the property of its respective owner(s). BU grants no licence for further use of that third party material. |
Abstract
Over the last years, affective computing has been strengthening its ties with the humanities, exploring and building understanding of people’s responses to specific artistic multimedia stimuli. “Aesthetic experience” is acknowledged to be the subjective part of some artistic exposure, namely, the inner affective state of a person exposed to some artistic object. In this work, we describe ongoing research activities for studying the aesthetic experience of people when exposed to movie artistic stimuli. To do so, this work is focused on the definition of emotional and aesthetic highlights in movies and studies the people responses to them using physiological and behavioral signals, in a social setting. In order to examine the suitability of multimodal signals for detecting highlights, we initially evaluate a supervised highlight detection system. Further, in order to provide an insight on the reactions of people, in a social setting, during emotional and aesthetic highlights, we study two unsupervised systems. Those systems are able to (a) measure the distance among the captured signals of multiple people using the dynamic time warping algorithm and (b) create a reaction profile for a group of people that would be indicative of whether that group reacts or not at a given time. The results indicate that the proposed systems are suitable for detecting highlights in movies and capturing some form of social interactions across different movie genres. Moreover, similar social interactions during exposure to emotional and some types of aesthetic highlights, such as those corresponding to technical or lightening choices of the director, can be observed. The utilization of electrodermal activity measurements yields in better performances than those achieved when using acceleration measurements, whereas fusion of the modalities does not appear to be beneficial for the majority of the cases.
Item Type: | Article |
---|---|
ISSN: | 2297-198X |
Uncontrolled Keywords: | aesthetic experience; synchronization; physiological and behavioral signals; affective computing; social setting; highlights detection |
Group: | Faculty of Science & Technology |
ID Code: | 29429 |
Deposited By: | Symplectic RT2 |
Deposited On: | 04 Jul 2017 10:34 |
Last Modified: | 14 Mar 2022 14:05 |
Downloads
Downloads per month over past year
Repository Staff Only - |