Individuals vary in how they move their faces in everyday social interactions. In a first large-scale study, we measured variation in dynamic facial behaviour during social interaction and examined dyadic outcomes and impression formation. In Study 1, we recorded semi-structured video calls with 52 participants interacting with a confederate across various everyday contexts. Video clips […]

Advancements in biosensor technologies are sought after to enable innovation in the field of neuropsychology and emotional research. Galvanic skin response, facial expressions analysis, as well as respiration have been used in the past to measure implicit emotional reactions. While some of these focus on either the valence or intensity of emotions, respiration shows promise […]

This study introduces a novel multimodal corpus for expressive task-based spoken language and dialogue, focused on language use under frustration and surprise, elicited from three tasks motivated by prior research and collected in an IRB-approved experiment. The resource is unique both because these are understudied affect states for emotion modeling in language, and also because […]

Consumers’ swiping behavior largely determines their exposure to social media advertisements. According to embodied cognition and enactment theory, advertisers might leverage atypical swiping to increase attention and thus brand recall. To identify typical smartphone swiping, the authors develop a taxonomy of the motor actions consumers exhibit when browsing social media in real life. A mobile […]

Recent evidence shows that physiological cues, such as pupil dilation (PD), heart rate (HR), skin conductivity (SC), and electroencephalography (EEG), can indicate cognitive load (CL) in users while performing tasks. This paper aims to investigate physiological (multimodal) measurement of CL in a Sternberg memory task as the difficulty level increases in both maintenance and probe […]

The human-nature connection is one of the main aspects determining supportive and comfortable office environments. In this context, the application of eye-tracking-equipped Virtual Reality (VR) devices to support an evaluation on the effect of greenery elements indoors on individuals’ efficiency and engagement is limited. A new approach to investigate visual attention, distraction, cognitive load and […]

The digital realm has witnessed the rise of various search modalities, among which the Image-Based Conversational Search System stands out. This research delves into the design, implementation, and evaluation of this specific system, juxtaposing it against its text-based and mixed counterparts. A diverse participant cohort ensures a broad evaluation spectrum. Advanced tools facilitate emotion analysis, […]

An often-proposed enhancement for mobile maps to aid assisted navigation is the presentation of landmark information, yet understanding of the manner in which they should be displayed is limited. In this study, we investigated whether the visualization of landmarks as 3D map symbols with either an abstract or realistic style influenced the subsequent processing of […]

Background: The critical importance of positive emotions for classroom functioning is well established and teachers’ and learners’ trait-based joy during class has been shown to covary. This has been interpreted as evidence of emotional contagion across teachers and learners. However, no research to date seems to have explored in-situ processes of emotional contagion, thus the […]

Most tourism campaigns rely heavily on emotional appeals. Therefore, it is crucial to understand which video sequences elicit certain emotions to determine whether they are consistent with the targeted marketing objectives. In this study, we employ facial expression analysis to trace the emotional responses of participants watching a tourism destination commercial. Since previous studies did […]