• Instagram
  • LinkedIn
  • X
  • YouTube

Research & Science

Publications

Facial Expression Analytics and Self-Report Measures in Technology-Integrated Nursing Simulation

Nirvair Singh Khosa

Olivia Kendall

Carrie Miller

Joseph Poole

Adam Davidson

Faraz Dadgostari

Manjinder Kour

Stacy Stellflug

Bernadette McCrory

Abstract:

Medical errors rank among the leading causes of death, with medication administration errors contributing substantially to preventable harm. Simulation-based training, especially when integrated with cutting edge technologies such as electronic medical records (EMR) and barcode medication administration (BCMA), holds promise for enhancing nursing competency, patient safety, outcomes and reducing error rates. This study evaluated clinician and non-clinician responses to a high-fidelity simulation incorporating EMR and BCMA, using surveys and facial expression analytics. Thirty participants (17 clinicians, 13 non-clinicians) completed a structured six-phase simulation scenario and subsequent survey measuring engagement, perceived realism, and workload. Facial recordings were segmented into six task phases and analyzed via iMotions for ten emotional/behavioral metrics. Survey results indicated that clinicians reported significantly higher engagement and realism, while workload did not differ. Facial expression analysis revealed that clinicians exhibited greater blink rate, confusion, joy, and sentimentality during task-intensive phases like chart review, vitals, and medication administration. Clinicians showed higher engagement and realism, while workload was similar across groups. Facial analysis revealed greater blink rate, confusion, joy, and sentimentality for clinicians during chart review, vitals, and medication administration, confirming cognitive-affective engagement in technology-integrated simulation.

This publication uses Facial Expression Analysis which is fully integrated into iMotions Lab

Learn more

Learn more about the technologies used

Other publications you might be interested in