Driver’s Emotions Detection with Automotive Systems in Connected and Autonomous Vehicles (CAVs)

Meza-García, B

Rodríguez-Ibáñez, N.

Abstract: The aim of this work is to evaluate selected systems in order to assess the emotional state of drivers based on facial analysis and vital signs acquired from camera, galvanic skin response (GSR) and photo plethysmography (PPG). Facial analysis and biomedical variables like galvanic skin response, which is related to sympatho-vagal nervous system balance, provides direct information of the driver physiological state, instead of indirect indicia of the participant’s behavior. Facial and GSR data used in this study were recorded by doing tests with subjects in different scenarios in order to evaluate selected commercial systems and their limitations in controlled and real driving conditions.

Results demonstrate that the emotional state of the driver can be assessed by facial analysis in combination with GSR relative data.

This publication uses Facial Expression Analysis and GSR which is fully integrated into iMotions Lab

Learn more