Publications

Using machine learning applied to multimodal physiological data allows the classification of cognitive workload (low, moderate, or high load) during task performance. However, current techniques, such as multisensor data fusion (e.g. electroencephalogram, heart rate, eye movements, and other physiologicalsignals), suffer from excessive dimensionality, intersubject variability, imbalanced feature vectors, and poor data alignment between sensors. This […]

Background Migraine with aura (MwA) is a common neurological disorder often accompanied by visual and cognitive difficulties, including impaired attention and reading. Although previous studies have examined oculomotor function in migraine using specific and highly controlled paradigms, findings have been mixed, and eye movements during more natural tasks like reading remain understudied. The aim of […]

This paper presents a case study usability evaluation of a graphical user interface (GUI) used in the Virtual Terrain Image Generation System (VTIGS) developed by AMST Systemtechnik GmbH. The GUI is used by instructors to configure night vision training scenarios for pilots using Night Vision Goggles (NVG). However, many instructors are non-aviation professionals. This study […]

Gaze attention estimation is the task that aims to understand where each person is looking in each scene. In this study, we introduce a new annotated dataset that is derived from medical simulation training videos, capturing diverse and authentic clinical scenarios from a practical medical environment and annotated by the ground truth data from eye-tracking […]

Background:. Usability plays an important role in user experience and directly influences users’ satisfaction and overall perception of the IT solution. A combination of subjective and objective evaluation methods can increase the overall usability assessment. Methods: This paper presents a comparative analysis of eye-tracking and survey data that provided a comparison of the graphical user […]

Robot-Assisted Language Learning (RALL) has emerged as an innovative method to support children’s language development. However, limited research has examined how its effectiveness is compared to other digital and human-led storytelling approaches, particularly among young learners. This study involved 81 children (M age = 5.58), who were randomly assigned to one of three storyteller conditions: a researcher-developed social […]

Introduction: Understanding how emotional experiences shape consumer behavior in digital environments is a central issue in decision-making neuroscience. While social media feeds are saturated with sponsored content, little is known about how such content modulates affective rhythms and influences engagement. Methods: Grounded in decision neuroscience frameworks and affective processing models, this study develops a three-layer analytical model […]

As technology continues to shape how students read and write, digital literacy practices have become increasingly multimodal and complex—posing new challenges for researchers seeking to understand these processes in authentic educational settings. This paper presents three qualitative studies that use multimodal analyses and visual modeling to examine digital reading and writing across age groups, learning […]

Purpose Voice assistants (VAs) have reshaped customer service by offering new interaction channels. This study explores how user-expressed emotions during interactions with multimodal and voice-only devices across different contexts affect satisfaction. Capturing user emotions via voice tone and speech content analysis, we show that both device type and usage context are crucial in shaping user […]

Neurodivergent students, including those with Autism Spectrum Disorder (ASD) and Attention Deficit/Hyperactivity Disorder (ADHD), frequently encounter challenges in several areas of foreign language (FL) learning, including vocabulary acquisition. This exploratory study aimed to investigate real-time English as a Foreign Language (EFL) word recognition using eye tracking within the Visual World Paradigm (VWP). Specifically, it examined […]