Exploring unconscious user responses to affective computing in interactive prototypes: a consumer neuroscience study

Behavior & Information Technology

Affective Computing (AC) has gained increasing attention for its potential to enrich HumanComputer Interaction by enabling technologies to recognise and respond to human emotions. However, there is limited research on how users unconsciously react to AC-based interactive prototypes at a physiological level during interaction. This study examines user cognitive and affective responses to two interactive AC-based Prototypes using consumer neuroscience techniques – Electroencephalogram (EEG), Galvanic Skin Response (GSR), and Eye-tracking – to capture unconscious physiological responses. Two laboratory experiments were conducted with a total sample of 34 participants, each experiment employing a different interactive AC-based prototype. The objective is to explore how users engage in cognitive and affective responses, as well as visual behaviour, through unconscious physiological responses generated during interactions with AC-based Prototypes. Results indicate that AC-based Prototypes exhibit greater engagement, cognitive load, and emotional impact on users compared to conventional technology. This study contributes to the field by providing evidence on how AC Prototypes influence user responses at an unconscious level, offering insights into how these technologies can enhance human-computer interactions. These findings indicate that AC technology enables more personalized and emotionally adaptive interactions between humans and machines by responding to users’ affective states.