Abstract: This study aims to examine how taboo content affects language learner psychology and language learning gains in a multi-modal learning environment by using facial expression analysis. 40 Muslim language learners were initially asked about their opinions on pork and watched a subtitled cooking video including pork visuals and their facial expressions were recorded. Before […]

Abstract: Facial mimicry has long been considered a main mechanism underlying emotional contagion (i.e. the transfer of emotions between people). A closer look at the empirical evidence, however, reveals that although these two phenomena often co-occur, the changes in emotional expressions may not necessarily be causally linked to the changes in subjective emotional experience. Here, […]

Abstract BackgroundEmotions play a critical role in our daily decisions. However, it remains unclear how and what sort of emotional expressions are associated with therapeutic decisions in multiple sclerosis (MS) care. Our goal was to evaluate the relationship between emotions and affective states (as captured by muscle facial activity and emotional expressions) and TI amongst […]

Abstract: Human language is often multimodal, which comprehends a mixture of natural language, facial gestures, and acoustic behaviors. However, two major challenges in modeling such multimodal human language time-series data exist: 1) inherent data non-alignment due to variable sampling rates for the sequences from each modality; and 2) long-range dependencies between elements across modalities. In […]

Abstract: Human language is a rich multimodal signal consisting of spoken words, facial expressions, body gestures, and vocal intonations. Learning representations for these spoken utterances is a complex research problem due to the presence of multiple heterogeneous sources of information. Recent advances in multimodal learning have followed the general trend of building more complex models […]

Abstract: Nowadays, the widespread access to Internet has made the shift from traditional classroom learning to virtual e-learning more accessible than ever. Online education has developed a whole industry both in the private and the public sector. E-learning is either a substitute for tradition learning, usually chosen independently by students, or a complementary for it, […]

Abstract: A good user experience can only be achieved by knowing and understanding users’ wishes, needs and cognitive abilities. The aim of this study is to find out how the user of the online appointment booking interacts with the interface as well as the visualizations. The focus is on the question of whether the new […]

Abstract: Facial expression was proven to show a person’s emotions, including 6 basic human emotions, namely happy, sad, surprise, disgusted, angry, and fear. Currently, the recognition of basic emotions is applied using the automatic facial expression analysis software. In fact, not all emotions are performed with the same expressions. This study aims to analyze whether […]

Abstract: The goal of this study was to investigate 65 students’ evidence scores of emotions while they engaged in cognitive and metacognitive self-regulated learning processes as they learned about the circulatory system with MetaTutor, a hypermedia-based intelligent tutoring system. We coded for the accuracy of detecting students’ cognitive and metacognitive processes, and examined how the […]

Abstract: Workers’ performance in indoor offices can be greatly affected by the thermal condition of the environment. However, this effect can be difficult to quantify, especially when the thermal stress is a moderate increase or decrease in temperature and the work productivity cannot be directly measured. Subjects’ high motivation to perform well under experimental conditions […]