Films, Affective Computing and Aesthetic Experience: Identifying Emotional and Aesthetic Highlights from Multimodal Signals in a Social Setting.

Kostoulas, T., Chanel, G., Muszynski, M., Lombardo, P. and Pun, T., 2017. Films, Affective Computing and Aesthetic Experience: Identifying Emotional and Aesthetic Highlights from Multimodal Signals in a Social Setting. Frontiers in ICT, 4, pp. 1-11.

Full text available as:

[img]
Preview
PDF
Films, Affective Computing and Aesthetic Experience Identifying Emotional and Aesthetic Highlights from Multimodal Signals in a Social Setting.pdf - Published Version
Available under License Creative Commons Attribution.

695kB

DOI: 10.3389/fict.2017.00011

Abstract

Over the last years, affective computing has been strengthening its ties with the humanities, exploring and building understanding of people’s responses to specific artistic multimedia stimuli. “Aesthetic experience” is acknowledged to be the subjective part of some artistic exposure, namely, the inner affective state of a person exposed to some artistic object. In this work, we describe ongoing research activities for studying the aesthetic experience of people when exposed to movie artistic stimuli. To do so, this work is focused on the definition of emotional and aesthetic highlights in movies and studies the people responses to them using physiological and behavioral signals, in a social setting. In order to examine the suitability of multimodal signals for detecting highlights, we initially evaluate a supervised highlight detection system. Further, in order to provide an insight on the reactions of people, in a social setting, during emotional and aesthetic highlights, we study two unsupervised systems. Those systems are able to (a) measure the distance among the captured signals of multiple people using the dynamic time warping algorithm and (b) create a reaction profile for a group of people that would be indicative of whether that group reacts or not at a given time. The results indicate that the proposed systems are suitable for detecting highlights in movies and capturing some form of social interactions across different movie genres. Moreover, similar social interactions during exposure to emotional and some types of aesthetic highlights, such as those corresponding to technical or lightening choices of the director, can be observed. The utilization of electrodermal activity measurements yields in better performances than those achieved when using acceleration measurements, whereas fusion of the modalities does not appear to be beneficial for the majority of the cases.

Item Type:Article
ISSN:2297-198X
Uncontrolled Keywords:aesthetic experience; synchronization; physiological and behavioral signals; affective computing; social setting; highlights detection
Group:Faculty of Science & Technology
ID Code:29429
Deposited By: Unnamed user with email symplectic@symplectic
Deposited On:04 Jul 2017 10:34
Last Modified:04 Jul 2017 10:34

Downloads

Downloads per month over past year

More statistics for this item...
Repository Staff Only -