Publications made possible with iMotions

Abstract: The purpose of this paper is to generate a framework for investigating direct face-to-face interactions during corporate results presentations from senior executives. This is important because face-to-face communications represent opportunities for impression management owing to cognitive biases and constraints arising from the interplay of non-verbal and verbal cues. Our Behavioural Impression Management Framework combines […]

Abstract: Conflicting online reviews challenge the consumer’s decision-making processes. Furthermore, increase in visual content, both positive and negative, adds complexity. This study analyses conflicting online reviews based on text and photos using automatic processing patterns and conscious perceptions. The study is built on the stimulus-organism-response model revisited by Jacoby (2002), and captures nonlinear eye-tracking data […]

Abstract: Block-wise missingness in multimodal data poses a challenging barrier for the analysis over it, which is quite common in practical scenarios such as the multimedia intelligent tutoring systems (ITSs). In this work, we collected data from 194 undergraduates via a biology ITS which involves three modalities: student-system logfiles, facial expressions, and eye tracking. However, […]

Abstract: The purpose of this study was to illustrate that people’s affective valuation of exercise can be identified in their faces. The study was conducted with a software for automatic facial expression analysis and it involved testing the hypothesis that positive or negative affective valuation occurs spontaneously when people are reminded of exercise. We created […]

Abstract: The goal of this study was to examine college students’ (n = 61) contextualized emotions during in-game actions while playing CRYSTAL ISLAND, a game-based learning environment where students are tasked with solving the mystery of what illness impacted all island inhabitants. We examined emotions during in-game actions: during book reading, after scanning food items for the […]

Abstract: A safe transition between autonomous and manual control requires sustained visual attention of the driver for the perception and assessment of hazards in dynamic driving environments. Thus, drivers must retain a certain level of situation awareness to safely takeover. Understanding the visual attention allocation of drivers can pave the way to inferring their dynamic […]

Abstract: The impact of built environment on the human restorativeness has long been argued; however, the interrelations between neuroscience and the built environment, and the degree to which the built environment contributes to increased human restorativeness has not been completely understood yet. Understanding the interrelations between neuroscience and the built environment is critical as 90% […]

Abstract: Game-based learning environments are designed to foster high levels of student engagement and motivation during learning of complex topics. Game-based learning environments allow students freedom to navigate a space to interact with game elements that foster learning, i.e., agency. Agency has been studied in learning, and it has been demonstrated that increased student agency […]

Abstract: Human emotions unfold over time, and more affective computing research has to prioritize capturing this crucial component of real-world affect. Modeling dynamic emotional stimuli requires solving the twin challenges of time-series modeling and of collecting high-quality time-series datasets. We begin by assessing the state-of-the-art in time-series emotion recognition, and we review contemporary time-series approaches […]

Abstract: Literature indicates that both academic tasks (Deater-Deckard et al. 2013; Skinner et al. Educational and Psychological Measurement, 69(3): 493–525, 2009) and video gaming (Irwin The Journal of Psychology, 133, 157–164, 1999; Laffan et al. Computers in Human Behavior, 65, 544–549, 2016; Whitton Simulation & Gaming, 42(5), 596–609, 2011) have qualities that engage and captivate […]

Abstract: In the investigative field, the use of interviews as a method of gathering legally admissible information is in serious decline. Due to a greater understanding of human stress response and biometric measurements, previously objective tools such as the polygraph have been removed from the investigators toolkit. Newer methods of biometric monitoring can potentially help […]

Abstract: The complex world around us is inherently multimodal and sequential (continuous). Information is scattered across different modalities and requires multiple continuous sensors to be captured. As machine learning leaps towards better generalization to real world, multimodal sequential learning becomes a fundamental research area. Arguably, modeling arbitrarily distributed spatio-temporal dynamics within and across modalities is […]