Abstract: Objective To report on the use of an eye-tracking retrospective think-aloud for usability evaluation and to describe its application in assessing the usability of a mobile health app. Materials and Methods We used an eye-tracking retrospective think-aloud to evaluate the usability of a HIV prevention mobile app among 20 young men (15-18 years) in […]

Abstract: In this study, we compare haptic feedback and nonhaptic feedback conditions in which virtual characters bump into the participant who is immersed in a virtual environment. A questionnaire was developed to determine the influence of haptic feedback on a number of concepts (presence, embodiment, positive and negative affect, interaction realism with virtual character, and […]

Abstract: How does haptic feedback during a human-virtual human interaction affect emotional arousal in virtual reality? In this between-subjects study, we compare haptic feedback and no haptic feedback conditions in which a virtual human “bumps” into the participant in order to determine the influence of haptic feedback on emotional arousal, sense of presence, and embodiment […]

Abstract: This study aims to examine how taboo content affects language learner psychology and language learning gains in a multi-modal learning environment by using facial expression analysis. 40 Muslim language learners were initially asked about their opinions on pork and watched a subtitled cooking video including pork visuals and their facial expressions were recorded. Before […]

Abstract: Facial mimicry has long been considered a main mechanism underlying emotional contagion (i.e. the transfer of emotions between people). A closer look at the empirical evidence, however, reveals that although these two phenomena often co-occur, the changes in emotional expressions may not necessarily be causally linked to the changes in subjective emotional experience. Here, […]

Abstract BackgroundEmotions play a critical role in our daily decisions. However, it remains unclear how and what sort of emotional expressions are associated with therapeutic decisions in multiple sclerosis (MS) care. Our goal was to evaluate the relationship between emotions and affective states (as captured by muscle facial activity and emotional expressions) and TI amongst […]

Abstract: Human language is often multimodal, which comprehends a mixture of natural language, facial gestures, and acoustic behaviors. However, two major challenges in modeling such multimodal human language time-series data exist: 1) inherent data non-alignment due to variable sampling rates for the sequences from each modality; and 2) long-range dependencies between elements across modalities. In […]

Abstract: Human language is a rich multimodal signal consisting of spoken words, facial expressions, body gestures, and vocal intonations. Learning representations for these spoken utterances is a complex research problem due to the presence of multiple heterogeneous sources of information. Recent advances in multimodal learning have followed the general trend of building more complex models […]

Abstract: Nowadays, the widespread access to Internet has made the shift from traditional classroom learning to virtual e-learning more accessible than ever. Online education has developed a whole industry both in the private and the public sector. E-learning is either a substitute for tradition learning, usually chosen independently by students, or a complementary for it, […]

Abstract: A good user experience can only be achieved by knowing and understanding users’ wishes, needs and cognitive abilities. The aim of this study is to find out how the user of the online appointment booking interacts with the interface as well as the visualizations. The focus is on the question of whether the new […]