Intelligent Joystick Sensing the User's Emotion and Providing Biofeedback.

Abstract

Development of an intelligent joystick is proposed which senses the user’s bio-signals and recognises the user’s emotion. It provides biofeedback to the user as well as the user’s emotional state information to the computer allowing human-computer interaction over sensitive environment. While the user is interacting with a computer via a joystick the bio-signals can be collected through the user’s fingers touching it. The collected bio-signals information is mapped on a two-dimensional space to find out the quality and intensity of emotion continuously and in a real-time manner. The intelligent joystick has application within several fields such as healthcare, sport and game industries. In such cases, the user can be influenced, or suffer from medical problems while under stress during interaction with the machines. The intelligent joystick will provide feedback to the user and alert alarm about unhealthy conditions through the embedded actuators and allow the machine to adapt with the users’ emotional state.