We found 207 articles matching your filters.
-
The Role of Energetic Music in a Video Game: Analyzing its Effect on Immersion, Perception and Performance
Energetic music has the potential to enhance immersion but can also negatively impact task performance. This study measured the effects of music on a video game suited for energetic music using both subjective (questionnaires) and objective (facial and physiological analysis) measures. Participants played under two conditions: with and without music. While the music condition led […] -
Prenatal affective cognitive training to reduce the risk of postpartum depression (PACT): study protocol for a randomized controlled trial
Background Postpartum depression (PPD) affects 30–50% of women with a history of previous depression or bipolar disorder and 8% of women with no history of depression. Negative cognitive biases in the perception of infant cues and difficulties with emotion regulation are replicated risk factors. Current interventions focus on detecting and treating rather than preventing PPD. The aim of this […] -
Using Psychophysiological Data to Facilitate Reflective Conversations with Children about their Player Experiences
Given the ubiquity of videogame play by children, concerns about the impacts of videogames, and increasing evidence of the benefits associated with digital play, it is important to evaluate the player experience (pX) of children. Moreover, it is essential to include children’s voices in research about technologies designed for their use. However, eliciting rich, first-hand […] -
Predicting consumer ad preferences: Leveraging a machine learning approach for EDA and FEA neurophysiological metrics
This research unveils to predict consumer ad preferences by detecting seven basic emotions, attention and engagement triggered by advertising through the analysis of two specific physiological monitoring tools, electrodermal activity (EDA), and Facial Expression Analysis (FEA), applied to video advertising, offering a twofold contribution of significant value. First, to identify the most relevant physiological features […] -
Cannabis Users’ and Non-Users’ Differential Responses to Two Anti-Cannabis Campaigns
Even though multiple states have approved legal recreational use of cannabis, the expansion of recreational cannabis legalization has led to public health concerns in the United States. Young adults (18–25 years old) have the highest percentage of cannabis use disorder compared to all other age groups. The purpose of this study is to compare cognitive […] -
AI-enhanced analysis of naturalistic social interactions characterizes interaffective impairments in schizophrenia
Social deficits in schizophrenia have been attributed to an impaired attunement to mutual interaction, or “interaffectivity”. While impairments in emotion recognition and facial expressivity in schizophrenia have been consistently reported, findings on mimicry and social synchrony are inconsistent, and previous studies have often lacked ecological validity. To investigate interaffective behavior in dyadic interactions in a […] -
Towards Automated Competency Estimation for Math Education– An Eye Tracking and Emotion Analysis Study
Personalization relies on user models– representations of the user’s competencies, preferences, and skills to adapt the system behavior to optimize interaction. But the anticipated gain in productivity is offset by the effort involved in collecting and maintaining said user model. This is particularly pronounced in systems like ALeA (Adaptive Learning Assistant, https://courses.voll-ki.fau.de/), where the learner […] -
The Face of Deception: How Your Mimicry Tells the True Story
Presentation Abstract:Objective: There are contested claims that communication receivers mimic communication senders less when senders are deceptive compared to truthful. Our studies evaluate a novel computer-based measure of facial mimicry to determine its potential to inform the debate. By examining the facial reactions of individuals receiving deceptive and truthful messages, we test whether this innovative […] -
Unveiling the power of video sentiment analysis for predicting advertising effectiveness: exploratory research on femvertising
This research challenges the conventional method of textual sentiment analysis in evaluating advertising effectiveness. We examined two distinct video ads for a cosmetics brand, employing video sentiment analysis to gauge their emotional impact on 35 female participants. This assessment was conducted using a self-reported questionnaire and a biometric platform integrating facial detection analysis (using Affdex […] -
Association of intensity and dominance of CEOs’ smiles with corporate performance
This study investigated whether the facial expressions of chief executive officers (CEOs) are associated with corporate performance. A photograph of the CEO or president of each company that appeared on the Fortune Global 500 list for 2018 was taken from the company’s official website. The smile intensity and action unit activation in each face were […] -
Persona-Based and Scenario-Based Design of Virtual and Physical Companion Robots with Varied Kawaii (Cute) Attributes
In recent years, concerns about anxiety and other mental health issues in university students have been widely reported. Some college campuses have seen increased student requests to bring emotional support animals to campus, although these animals are hard to care for in shared living spaces that are common in college settings. This paper reports on […] -
Dyadic Interactions and Interpersonal Perception: An Exploration of Behavioral Cues for Technology-Assisted Mediation
Mediators aim to shape group dynamics in various ways, such as improving trust and cohesion, balancing participation, and promoting constructive conflict resolution. Technological systems used to mediate human-human interactions must be able to continuously assess the state of the interaction and generate appropriate actions. In this paper, behavioral cues that indicate interpersonal perception in dyadic […] -
Unveiling impact dynamics: Discriminatory brand advertisements, stress response, and the call for ethical marketing practices
This research explores the impact of discriminatory brand advertisements on groups experiencing discrimination, employing the transactional theory of stress and coping. The findings reveal that discriminatory-offensive advertisements induce stress, quantified via galvanic skin response, predominantly in highly discriminated groups. This stress subsequently catalyzes motivational approach tendencies over time, as evidenced by electroencephalogram measurements. The study […] -
The Psychophysiological Interrelationship between Working Conditions and Stress of Harvester and Forwarder Drivers – a Study Protocol
(1) Background: The proportion of fully mechanized harvesting systems in Austria is constantly increasing especially because of the technological development of the machines, which allows them to drive on increasingly steep terrain. This leads to additional challenges and potential hazards for the operators, which may also cause higher stress levels. The purpose of this study […] -
Unlocking Human-Robot Dynamics: Introducing SenseCobot, a Novel Multimodal Dataset on Industry 4.0
In the era of Industry 4.0, the importance of human-robot collaboration (HRC) in the advancement of modern manufacturing and automation is paramount. Understanding the intricate physiological responses of the operator when they interact with a cobot is essential, especially during programming tasks. To this aim, wearable sensors have become vital for real-time monitoring of worker […] -
The positive effect of blue luminescent pathways on urban park visitor’s affective states: A virtual reality online study measuring facial expressions and self-reports
The colour blue often elicits feelings of calmness and contentment, for which evidence has largely been provided in daytime settings. It is unclear whether pathways illuminated in blue, for example, in urban recreational park areas at night confers the same positive impact on night time park visitors. To tackle this open empirical question, we investigated […] -
INVESTIGATING THE ROLE OF COGNITIVE FLEXIBILITY IN SHAPING TEACHER ENGAGEMENT IN A SIMULATED VIRTUAL CLASSROOM
The teaching process involves complex, multifaceted relationships. For this reason, teachers’ engagement in teaching can be shaped by factors such as the teacher’s goals, the conditions of the teaching environment, and the teacher’s cognitive characteristics. Determining the impact of these cognitive, subjective, and environmental conditions on teacher engagement, which reflects teachers’ performance, can provide useful […] -
Face Value: Remote facial expression analysis adds predictive power to perceived effectiveness for selecting anti-tobacco PSAs
Perceived effectiveness (PE) is a validated tool for predicting the potential impact of anti-tobacco public service announcements (PSAs). We set out to evaluate the added predictive value of facial expression analysis when combined with PE in a remote (online) survey. Each of 302 tobacco users watched 3 PSAs and allowed transmission of webcam videos from […] -
This article is… Consumer reactions to unfinished teasers for digital content
To preview digital content and arouse consumers’ interest, online providers often use short teasers designed in an unfinished form, such that the teaser begins a new sentence but does not finish it. These teasers aim to create curiosity and trigger consumption of the advertised content. However, we reveal that consumers’ reactions to unfinished teasers are […] -
Beyond negativity? A laboratory study on emotional responses to populist strategies on social media
This exploratory laboratory study analyzes emotional responses to two types of populist strategies on social media platforms. We focus on emotional responses to content expressing ordinariness (on Instagram) and victimhood (on TikTok), where the content creator is a right-wing populist leader who is unfavorably perceived by the respondents in the study. Thus, the study critically […] -
Being facially expressive is socially advantageous
Individuals vary in how they move their faces in everyday social interactions. In a first large-scale study, we measured variation in dynamic facial behaviour during social interaction and examined dyadic outcomes and impression formation. In Study 1, we recorded semi-structured video calls with 52 participants interacting with a confederate across various everyday contexts. Video clips […] -
FUSE- FrUstration and Surprise Expressions: ASubtle Emotional Multimodal Language Corpus
This study introduces a novel multimodal corpus for expressive task-based spoken language and dialogue, focused on language use under frustration and surprise, elicited from three tasks motivated by prior research and collected in an IRB-approved experiment. The resource is unique both because these are understudied affect states for emotion modeling in language, and also because […] -
Joy is reciprocally transmitted between teachers and students: Evidence on facial mimicry in the classroom
Background: The critical importance of positive emotions for classroom functioning is well established and teachers’ and learners’ trait-based joy during class has been shown to covary. This has been interpreted as evidence of emotional contagion across teachers and learners. However, no research to date seems to have explored in-situ processes of emotional contagion, thus the […] -
Inclusive Design Insights from a Preliminary Image-Based Conversational Search Systems Evaluation
The digital realm has witnessed the rise of various search modalities, among which the Image-Based Conversational Search System stands out. This research delves into the design, implementation, and evaluation of this specific system, juxtaposing it against its text-based and mixed counterparts. A diverse participant cohort ensures a broad evaluation spectrum. Advanced tools facilitate emotion analysis, […] -
Tracing emotional responses to nature-based tourism commercials and tagging individual sequences
Most tourism campaigns rely heavily on emotional appeals. Therefore, it is crucial to understand which video sequences elicit certain emotions to determine whether they are consistent with the targeted marketing objectives. In this study, we employ facial expression analysis to trace the emotional responses of participants watching a tourism destination commercial. Since previous studies did […] -
Does electricity consumption make happy? The emotional dimensions of time-scaled electricity consumption graphs for household appliances
Due to the current situation regarding climate change, smart home energy management systems help to provide an overview of a household’s electricity consumption at appliance level by means of time-scaled visualizations. Such electricity consumption graphs need to be visually appealing to unleash potentials for a positive contribution to energy transition. Triggered emotions in particular play a […] -
Emerging biometric methodologies for human behaviour measurement in applied sensory and consumer science
This chapter covers some of the most popular emerging technologies used for measuring human behaviour in applied sensory and consumer science. Here, we focus on eye-tracking (ET) technology, electrodermal activity (EDA) or skin conductance, facial expression analysis (FEA) and electroencephalography (EEG), all of which can be employed to explore the underlying and at times unconscious […] -
Granting a Better Verdict of the Mini-Mental State Examination (MMSE) With New Technologies
There are millions of people in the world who have been diagnosed with dementia and this condition not only directly affects the patient, but also their family members and caregivers; That is why it is sought to have a verdict in which it can be reliably seen if a person suffers from dementia. The way […] -
Systematic Evaluation of Driver’s Behavior: A Multimodal Biometric Study
Abstract Complex traffic areas and high cognitive workload while driving are leading contributors to traffic crashes. Even though cognitive workload and stress have been previously assessed through various neurophysiological responses, they are rarely characterized simultaneously, limiting the triangulation of behavioral metrics (like drivers’ visual attention and facial coding) with physiological measures to investigate their interplay. […] -
Using facial emotion recognition to research emotional phases in an inquiry-based science activity
Background Observational and declarative approaches applied by human observers have dominated the study of emotions, engagement, and attention. However, these approaches are susceptible to biases such as social desirability. Additionally, declarative approach cannot measure these parameters in real-time. Purpose This study aims to apply Facial Emotion Recognition (FER) technology in an inquiry-based activity to address […] -
Children and overtourism: a cognitive neuroscience experiment to reflect on exposure and behavioural consequences
As tourism research has paid limited attention to children, this study investigates children’s reactions to tourism development, focusing on their unique viewpoints on the World Heritage Site of Dubrovnik, Croatia. It employed cognitive neuroscience methods with 397 participants, revealing that, despite their preference for sustainable tourism scenarios, children exhibit a notable fixation on images emblematic […] -
Effect of changing threat conditions on police and military commanders’ preferences for urgent and offensive actions: An analysis of decision making at the operational level of war
A simulation was conducted to examine the decision making of 102 high-ranking police and military commanders (male/female = 88/12, mean years of employment = 22.15) engaged in a simulated hybrid attack on Norway. Four 2 × 3 repeated-measures ANOVA tests were performed, with two groups (police, military) and three phases (peace, war, and post-conflict) as independent variables. The decision tasks of […] -
A Quantitative Way for Measuring the Building User Design Feedback and Evaluation
Computers are not smart enough yet to design and thus alleviate the need for a designer, although they can offer various possibilities of assistant to the designer. Various learning techniques provided in machine learning and artificial intelligence, such as dynamic programming and reinforcement learning, are making computers smarter at so many of the tasks humans […] -
Effect of cognitive load in autonomous vehicles on driver performance during transfer of control
Present study on cognitive workload in driving focuses on reduction of workload for better driving performance. In this paper, we talk about the cognitive load in drivers of autonomous cars and their performance under multiple cognitive loads. Our previous studies have indicated that low to no workload is likely to induce drowsiness in drivers of […] -
Using Eye Tracking to Reveal Responses to the Built Environment and Its Constituents
Eye-tracking technology has numerous applications in both commercial and research contexts. The recent introduction of affordable wearable sensors has significantly broadened the scope of potential uses, spanning fields such as computer gaming, education, entertainment, health, neuromarketing, and psychology, among others. Another development is the use of downloadable software, which permits participants to record their responses […] -
Understanding Learning Engagement with User-Centered Human-Computer Interaction in a Multimodal Online Learning Environment
Multimodal online learning environment improves learning experience through different modalities such as visual, auditory, and kinesthetic interactions. Multimodal learning analytics (MMLA) with multiple biosensors provides a way to overcome the challenge of analyzing the multiple interaction types simultaneously. Galvanic skin response/electrodermal activity (GSR/EDA), eye tracking and facial expression were used to measure the learning interaction […] -
Examining the Impact of Stress and Fear of COVID-19 on Transit Travel
The COVID-19 pandemic altered daily life by forcing governments to issue measures for the prevention of the spread of the disease such as stay-at-home orders, requiring face coverings, and maintaining physical distancing, among others. This caused a significant disruption in every aspect of people’s lives. This disruption was prominent in the transportation sector where travel […] -
Predicting video virality and viewer engagement: a biometric data and machine learning approach
Predicting video virality is the holy grail of marketing today. Previous video virality prediction research has relied upon two processes that may lead to incomplete data or incomplete analyses: non-subconscious data collection and self-reporting. This exploratory study evaluates the potential of using a physiological manifestation of emotions captured through facial expressions and skin conductance to […] -
Prenatal affective cognitive training: A proof-of-concept study
Negatively biased cognitive response to infant stimuli during pregnancy is associated with increased postpartum depression (PPD) risk. This proof-of-concept study aimed to investigate the feasibility and effects of a two-week affective cognitive training intervention on cognitive responses to emotional infant stimuli for pregnant participants at risk of PPD. Forty-three participants were included: 23 at high risk and 22 at […] -
Design and assessment of an experimental model for evaluating the effectiveness of audiovisual products on the circular economy aimed at promoting environmental awareness
Communication is crucial to encourage citizens to adopt sustainable habits, but the effectiveness of awareness-raising actions in the last decade has been limited. Therefore, it is essential to invest efforts to understand and improve the effectiveness of environmental awareness actions. This research aims to design an experimental model to evaluate the effectiveness of audiovisual products on ecological […] -
DUX: a dataset of user interactions and user emotions
User experience evaluation is becoming increasingly important, and so is emotion recognition. Recognizing users’ emotions based on their interactions alone would not be intrusive to users and can be implemented in many applications. This is still an area of active research and requires data containing both the user interactions and the corresponding emotions. Currently, there […] -
Objective Measurement of Social Gaze and Smile Behaviors in Children with Suspected Autism Spectrum Disorder During Administration of the Autism Diagnostic Observation Schedule, 2nd Edition
Best practice for the assessment of autism spectrum disorder (ASD) symptom severity relies on clinician ratings of the Autism Diagnostic Observation Schedule, 2nd Edition (ADOS-2), but the association of these ratings with objective measures of children’s social gaze and smiling is unknown. Sixty-six preschool-age children (49 boys, M = 39.97 months, SD = 10.58) with suspected ASD (61 confirmed ASD) were administered […] -
A Multimodal Emotion Perspective on Social Media Influencer Marketing: The Effectiveness of Influencer Emotions, Network Size, and Branding on Consumer Brand Engagement Using Facial Expression and Linguistic Analysis
Social media influencers rely on emotional connection to maintain and grow their followings and have value for brands. To date, however, no research has quantitatively examined the impact of emotion in the facial expressions and caption text that influencers use in their video posts on consumer engagement through likes, comments, and views of posts. Grounded […] -
Multimodal biometric data collection of interpersonal communication
Communication between individuals involves multiple factors: attending to the other person’s thoughts, interpreting their non-verbal behavior, and (un)intentionally mirroring their expression- and attention patterns. Moreover, we may be evaluating the authenticity of their expressions and behavior throughout the conversation. Experimental investigation of these factors in natural settings can be cumbersome and technically challenging. Here, we […] -
Facial Expressions as an Index of Listening Difficulty and Emotional Response
Knowledge about listening difficulty experienced during a task can be used to better understand speech perception processes, to guide amplification outcomes, and can be used by individuals to decide whether to participate in communication. Another factor affecting these decisions is individuals’ emotional response which has not been measured objectively previously. In this study, we describe […] -
Assessing the Impact of Sustainability News Clips on Fast-Fashion Brands Purchase Intention
Sustainability has become a growing concern in the fashion industry over the last few decades. The fashion industry is regarded as one of the most polluting industries. This chapter attempts to provide an analysis of the consumer’s perception towards their fast-fashion choices in Australia. The specific objectives are to find the impact of environment/sustainability news […] -
Driver’s Emotions Detection with Automotive Systems in Connected and Autonomous Vehicles (CAVs)
Abstract: The aim of this work is to evaluate selected systems in order to assess the emotional state of drivers based on facial analysis and vital signs acquired from camera, galvanic skin response (GSR) and photo plethysmography (PPG). Facial analysis and biomedical variables like galvanic skin response, which is related to sympatho-vagal nervous system balance, […] -
The Study of Facial Muscle Movements for Non-Invasive Thermal Discomfort Detection via Bio-Sensing Technology. Part I: Development of the Experimental Design and Description of the Collected Data
In the time of climate change, as heat waves become a more regular occurrence, indoor thermal comfort is an important factor in day to day life. Due to such circumstances, many researchers have focused their studies on finding an effective solution that will not only enable thermal comfort, but also increase satisfaction within the indoor […] -
Visual Tailoring and Skin Cancer Prevention: Comparing Personalized, Stock, and Non-Ultraviolet Images
Past research has demonstrated that ultraviolet (UV) photos – which reveal skin damage as dark patches – can increase preventive behaviors. Emerging camera technology facilitates personalized UV photos for interventions, yet little is known about how personalized photos compare to other visuals and what cognitive or affective mechanism explains their persuasive impact. To engage this […] -
Associations between emotions and psychophysiological states and confirmation bias in question formulation in ongoing simulated investigative interviews of child sexual abuse
Introduction: In forensic settings interviewers are advised to ask as many open-ended questions as possible. However, even experts may have difficulty following this advice potentially negatively impacting an investigation. Here, we sought to investigate how emotions and psychophysiological parameters are associated with question formulation in real time in an ongoing (simulated) child sexual abuse (CSA) interview. […] -
Start Making Sense: Identifying Behavioural Indicators When Things Go Wrong During Interaction with Artificial Agents
The findings from this study will allow artificial agents to be trained to understand characteristic human behaviour exhibited during communication, and how to respond to specific non-verbal cues and biometric feedback with appropriately human-like behaviour -
Facial Expressions and Self-Reported Emotions When Viewing Nature Images
Many studies have demonstrated that exposure to simulated natural scenes has positive effects on emotions and reduces stress. In the present study, we investigated emotional facial expressions while viewing images of various types of natural environments. Both automated facial expression analysis by iMotions’ AFFDEX 8.1 software (iMotions, Copenhagen, Denmark) and self-reported emotions were analyzed. Attractive […] -
Atypical Facial Expressivity in Young Children with Problematic Peer Relationships
Peer problems are frequently associated with difficulties in recognizing and appraising the emotions of others. It has been argued that facial responsiveness to others’ emotions—or motor empathy—is a precursor of emotion processing and affective empathy. Although mimicry impairments have been observed in studies of young people with conduct problems, to our knowledge no study has […] -
The effects of expressions of fear induced by background music on reading comprehension
Research has suggested that background music can have a positive or negative effect that can influence the affective state of individuals. Although research has demonstrated that fear negatively influences our cognitive performance, there is a research gap in understanding the combined effects of different background music tempo and fear in influencing reading comprehension performance. Data […] -
Differentiating Use of Facial Expression between Individuals with and without Traumatic Brain Injury Using Affectiva Software: A Pilot Study
This study investigated the feasibility of using an automated facial coding engine, Affectiva (integrated in iMotions, version 8.2), for evaluating facial expression after traumatic brain injury (TBI). An observational cross-sectional study was conducted based on facial expression data from videos of participants with TBI and control participants. The aims were to compare TBI and control […] -
The influence of negative emotions on brand trust and intention to share cause-related posts: A neuroscientific study
Negative user-generated content provides cues that warn other consumers to avoid using a particular product or service. This study explores whether brand feedback can counteract consumer backlash to a given company’s cause-related marketing, with a particular focus on how visual attention can moderate negative emotions. Hypotheses based on the Appraisal-Tendency Framework and commitment-trust theory were […] -
Children’s physiological and behavioural response evoked by the observation, olfaction, manipulation, and consumption of food textures. Part 1: liquid products
Children are thought to prefer homogeneous and simple textures that are easy to manipulate in the mouth. Although scientific research has been done on children’s acceptance for food textures, there is a lack of knowledge regarding the emotional response elicited by textures in this group of population. Physiological and behavioural methods could be an appropriate […] -
Clients’ Facial Expressions of Self-Compassion, Self-Criticism, and Self-Protection in Emotion-Focused Therapy Videos
Clients’ facial expressions allow psychotherapists to gather more information about clients’ emotional processing. This study aims to examine and investigate the facial Action Units (AUs) of self-compassion, self-criticism, and self-protection within real Emotion-Focused Therapy (EFT) sessions. For this purpose, we used the facial analysis software iMotions. Twelve video sessions were selected for the analysis based […] -
Bridging social marketing and technology in the disability field: an empirical study on the role of cybernetic avatar and social inclusion
Purpose This study aims to determine the perception and attitude of consumers toward the presence of cybernetic avatars (CAs) as part of a social inclusion initiative. Design/methodology/approach A mixed method was used to conduct the study using facial recognition expressions and surveys. Three studies were conducted. Study 1 examines consumers’ attitudes and perceptions of a […] -
Towards Context-Aware Facial Emotion Reaction Database for Dyadic Interaction Settings
Emotion recognition is a significant issue in many sectors that use human emotion reactions as communication for marketing, technological equipment, or human–robot interaction. The realistic facial behavior of social robots and artificial agents is still a challenge, limiting their emotional credibility in dyadic face-to-face situations with humans. One obstacle is the lack of appropriate training […] -
Evaluation of a motorised patient transfer device based on perceived workload, technology acceptance, and emotional states
The high prevalence of musculoskeletal disorders (MSDs) among healthcare workers is partly attributed to the low adoption of patient transfer assistive devices. This study aimed to evaluate the nurses’ perceived workload, technology acceptance, and emotional states during the use of the sliding board (SB) and mechanical intervention in the form of a Motorised Patient Transfer […] -
The face in everyday social interaction: social outcomes and personality correlates of facial behaviour
Facial behaviour is a central component of social interaction, yet is primarily studied in the absence of a social partner with a heavy focus on static, universal prototypes. Examination of individual variation in facial behaviour embedded within social interaction is essential to understand social function. We conducted a three-part multi-method study to examine how variation […] -
Affective Dynamics and Cognition during Game-based Learning
Inability to regulate affective states can impact one’s capacity to engage in higher-order thinking like scientific reasoning with game-based learning environments. Many efforts have been made to build affect-aware systems to mitigate the potentially detrimental effects of negative affect. Yet, gaps in research exist since accurately capturing and modeling affect as a state that changes […] -
Leveraging the Science to Understand Factors Influencing the Use of AI-Powered Avatar in Healthcare Services
Interests in artificial intelligence (AI) adoption have increased in many organizations. Medical providers are seeking collaborations with technology companies to provide a reliable mental healthcare service for patients. While the interest in adopting an AI-powered healthcare solution is high, it is still unclear on patients’ attitude towards adopting AI for their mental health care. Three […] -
Understanding Drivers’ Physiological Responses in Different Road Conditions
Although the driver’s emotion has been studied in the different driving environments (such as city and highway), understanding what eye metrics and facial expressions correspond to specific emotion and behavior based on subjective and biosensor data to study emotion in depth is not well researched in previous studies. Using an eye-integrated human-in-the-loop (HTIL) simulation experiment, […] -
Exploring Preservice Teachers’ Emotional Experiences in an Immersive Virtual Teaching Simulation through Facial Expression Recognition
This study investigated preservice teachers’ emotional experiences while interacting within a virtual scenario-based teacher-training system called Simulation for Teaching Enhancement of Authentic Classroom behavior Emulator (SimTEACHER). We created three types of interactions (no interaction, unexpected interaction, and expected interaction) within SimTEACHER and examined the influences of the interaction design on preservice teachers’ emotional responses in […] -
Investigating the relationship between facial mimicry and empathy
Facial expressions play a key role in interpersonal communication when it comes to negotiating our emotions and intentions, as well as interpreting those of others. Research has shown that we can connect to other people better when we exhibit signs of empathy and facial mimicry. However, the relationship between empathy and facial mimicry is still […] -
Understanding Drivers’ Physiological Responses in Different Road Conditions
Although the driver’s emotion has been studied in the different driving environments (such as city and highway), understanding what eye metrics and facial expressions correspond to specific emotion and behavior based on subjective and biosensor data to study emotion in depth is not well researched in previous studies. Using an eye-integrated human-in-the-loop (HTIL) simulation experiment, […] -
How are Drivers’ Stress Levels and Emotions Associated with the Driving Context? A Naturalistic Study
Understanding and mitigating drivers’ negative emotions, stress levels, and anxiety is of high importance for decreasing accident rates, enhancing road safety, and providing a healthy lifestyle to the community of drivers. While detecting drivers’ stress and negative emotions can significantly help with this goal, understanding what might be associated with increases in drivers’ negative emotions […] -
Capturing food-elicited emotions: Facial decoding of children’s implicit and explicit responses to tasted samples
Sensory and consumer research increasingly aims to gain direct input from children to study their eating behaviour. However, answering self-administered questionnaires can be challenging for children. In this sense, the prediction of basic emotions via facial decoding, generating quantitative observational data, could offer an alternative to questionnaires. The present study aimed to measure children’s implicit […] -
Emotional Empathy and Facial Mimicry of Avatar Faces
We explore the extent to which empathetic reactions are elicited when subjects view 3D motion-capture driven avatar faces compared to viewing human faces. Through a remote study, we captured subjects’ facial reactions when viewing avatar and humans faces, and elicited self reported feedback regarding empathy. Avatar faces varied by gender and realism. Results show no […] -
Statistical emotion control: Comparing intensity and duration of emotional reactions based on facial expressions
The aim is to develop an intelligent automatic facial expression recognition and emotion analysis (AFEREA) algorithm that, first, characterizes the time-based raw signals of biosensors in quantitative indicators of the emotional state of the individuals participating in an experiment and, second, compares the emotional reactions across them in terms of intensity and duration. The proposed […] -
Cognitive and emotional engagement while learning with VR: The perspective of multimodal methodology
This study uses a multimodal data analysis approach to provide a more continuous and objective insight into how students’ engagement unfolds and impacts learning achievements. In this study, 61 nursing students’ learning processes with a virtual reality (VR)-based simulation were captured by psycho-physiological data streams of facial expression, eye-tracking, and electrodermal activity (EDA) sensors, as well […] -
Caught in the Act: Detecting Respondent Deceit and Disinterest in On-Line Surveys. A Case Study Using Facial Expression Analysis
Much social marketing research is done on-line recruiting participants through Amazon Mechanical Turk, vetted panel vendors, social media, or community sources. When compensation is offered, care must be taken to distinguish genuine respondents from those with ulterior motives. We present a case study based on unanticipated empirical observations made while evaluating perceived effectiveness (PE) ratings […] -
Automotive Emotions: The Effect of Gender
The emotional responses to interactions with automobiles can provide insights into what works well and what works less well for people. The measurement of human emotions has thus become increasingly popular in recent times. A question which can however arise is whether statistically significant differences can occur due mainly to gender. The present investigation analysed […] -
Preliminary results of a parametric analysis of emotions in a learning process in science
In the last decades, several studies have highlighted the importance of emotions in the teaching and learning process. The classroom is considered as an emotional place, where the learning is influenced by cognitive and emotional-motivational mechanisms. Classically, emotions have been classified in seven basics categories. Furthermore, in educational settings, it is possible to evaluate other […] -
Cognitive and affective responses to marijuana prevention and educational messaging
Perceptions of risk of using marijuana have decreased significantly in the US over the last decade, while marijuana use has increased. In order to educate people on the risks associated with marijuana use, large-scale health messaging campaigns have been deployed to educate the public about the risks associated with marijuana use, particularly in states where […] -
Creation and validation of the Picture-Set of Young Children’s Affective Facial Expressions (PSYCAFE)
The immediate detection and correct processing of affective facial expressions are one of the most important competences in social interaction and thus a main subject in emotion and affect research. Generally, studies in these research domains, use pictures of adults who display affective facial expressions as experimental stimuli. However, for studies investigating developmental psychology and […] -
Memory for diverse faces in a racially attentive context
Two experiments assessed how racial ambiguity and racial salience moderates the cross-race effect (CRE). In experiment 1, White and Black participants studied and identified the race of Asian, Black, Latino, and White faces that varied in ethnic typicality (high or low ET). For White participants, the CRE was larger when comparing high-ET White faces to […] -
Machine data as the source of learning engagement in hands-on learning online
Instructional technology provides the capacity to address the needs of students with diverse cognitive skills and socialization needs. Learning experience is viewed as an important factor in learner engagement/motivation, and a contributor to learning in online instruction (Sims, 2003; Swartzwelder & Murphy, 2019; Chan, Wan & Ko, 2019). Moore’s three types of learning interaction (Moore, […] -
Analysis of Emotion and Recall in COVID-19 Advertisements: A Neuroscientific Study
In this research, neuroscience techniques are applied to the field of marketing in the analysis of advertisements that include the COVID-19 pandemic in their stories. A study of emotion and memory in these audiovisual productions is carried out as two fundamental factors for the knowledge of consumer habits and decision making. By means of facial […] -
Identifying and Describing Subtypes of Spontaneous Empathic Facial Expression Production in Autistic Adults
It is unclear whether atypical patterns of facial expression production metrics in autism reflect the dynamic and nuanced nature of facial expressions or a true diagnostic difference. Further, the heterogeneity observed across autism symptomatology suggests a need for more adaptive and personalized social skills programs. For example, it would be useful to have a better […] -
Measuring the Impact of Museum Architecture, Spaces and Exhibits on Virtual Visitors Using Facial Expression Analysis Software
Since the launch of online video portals in 2005, museums have encouraged visitors to upload and share their visits online. Although much has been written about visitors’ experiences in museums, very little exists on the impact virtual visits have on viewers. In this qualitative pilot study, a total of 2035 emotional reactions were recorded and analyzed after visiting […] -
Sponsor message processing in live broadcasts—A pilot study on the role of game outcome uncertainty and emotions
Live sport broadcasts can evoke emotions in consumers and allow companies to reach their audience in environments that allow for automatic processing of brand messages. However, only few studies have applied psychophysiological methodologies to assess how the live nature of a competition and viewers’ emotions affect the processing of sponsor messages, and prior research has […] -
Viewing Natural vs. Urban Images and Emotional Facial Expressions: An Exploratory Study
There is a large body of evidence that exposure to simulated natural scenes has positive effects on emotions and reduces stress. Some studies have used self-reported assessments, and others have used physiological measures or combined self-reports with physiological measures; however, analysis of facial emotional expression has rarely been assessed. In the present study, participant facial […] -
Emotions in Reading and Learning from Texts: Progress and Open Problems
Reading texts can prompt intense emotions, and these emotions profoundly influence learning from texts. I first discuss the findings from the eight studies reported in this special issue. The studies represent pivotal advances in research on reading. Focusing on learning from science texts, they show that different emotions and different types of text influence reading […] -
The Influence of Admiration on Intentions to Visit and Recommend a Destination: The Moderating Role of Negative Basic Emotions
This paper analyzes the moderating role of negative emotions triggered during the COVID-19 crisis on intentions to visit and willingness to recommend a destination in order to extend theoretical knowledge on emotions in the tourism field and to offer practical recommendations for tourism marketing managers. It is argued that the negative basic emotions automatically triggered […] -
Exploiting Micro Facial Expressions for More Inclusive User Interfaces
Current image/video acquisition and analysis techniques allow for not only the identification and classification of objects in a scene but also more sophisticated processing. For example, there are video cameras today able to capture micro facial expressions, namely, facial expressions that occur in a fraction of a second. Such micro expressions can provide useful information […] -
Methodological Considerations for Understanding Students’ Problem Solving Processes and Affective Trajectories During Game-Based Learning: A Data Fusion Approach
This paper describes methodological considerations for fusing data sources in understanding both affective and problem solving states of students as they engage in computational thinking (CT) game-based learning. We provide both a theoretical and empirical rationale for using data including facial recognition and students’ logfile data to gain a more robust explanation of why students […] -
Sport and Cultural Events: Willingness to Pay, Facial Expressions and Skin Response
The topic of this particular study is to combine facial expressions, skin response and willingness to pay (WTP) using an iMotions Platform. This software solution combines biosensors in human behaviour research. A useful method to estimate WTP is contingent valuation method (CV) (Mitchell and Carson 1989). The method has been widely used in cultural economics […] -
Detection of Psychopathic Traits in Emotional Faces
When meeting someone at zero acquaintance, we make assumptions about each other that encompass emotional states, personality traits, and even cognitive abilities. Evidence suggests individuals can accurately detect psychopathic personality traits in strangers based on short video clips or photographs of faces. We present an in-depth examination of this ability. In two studies, we investigated […] -
Political leadership, a quasi-experimental study of Peruvian voters’ emotional reaction and visual attention to political humor
Political humor is a wise communicative strategy for politicians to use. However, previous research has not linked politicians’ use of political humor with voter’s emotional reactions and visual attention. Two experiments were conducted using facial expression analysis and eye-tracking technology to record the emotional reaction and visual attention of participants while watching one of the […] -
Communication Skills Training Intervention Based on Automated Recognition of Nonverbal Signals
There have been promising studies that show a potential of providing social signal feedback to improve communication skills. However, these studies have primarily focused on unimodal methods of feedback. In addition to this, studies do not assess whether skills are maintained after a given time. With a sample size of 22 this paper investigates whether […] -
A User Study on User Attention for an Interactive Content-based Image Search System
User attention is one of the fundamental indications of users’ interests in search. For content-based image search systems, it is important to understand what users pay attention to, and thus engage users more in the search process. It remains a big challenge to design a user-centered interactive interface that serves well for both user interaction […] -
Engaging Learners in Synchronous Online Training Using Facial Expression Analysis Technology
The rapid growth of digitalization and the rise in the number of remote work environments have amplified the importance of remote training using online learning platforms. The effectiveness of online training relies on factors such as training content, methods, trainer skills, and technology platforms. In addition to these internal, and generally, controllable factors, various uncontrollable […] -
Processing of infant emotion in mothers with mood disorders and implications for infant development
Background Atypical neurocognitive responses to emotional stimuli are core features of unipolar depression (UD) and bipolar disorder (BD). For mothers with these mood disorders, this may influence interactions with their infants and consequently infant development. The study aimed to investigate psychophysiological and cognitive responses to infant emotional stimuli, and their relation to mother–infant interaction and […] -
Forecasting Advertisement Effectiveness: Neuroscience and Data Envelopment Analysis
This research used a novel method in which biometric data and data envelopment analysis (DEA) (a statistical tool generally used for multi-criteria decision making) were used to assess advertising effectiveness. Facial detection and eye-tracking analyses were used to measure participants’ reactions to 14 real estate advertisements. Each of the 14 advertisements had been suggested to […] -
A new approach towards evaluating the performance of maritime officers by the utilization of mobile eye tracking system and facial electromyography
The following paper presents the use of simulators in maritime training development, with an emphasis on ship bridge operations during the training and assessment phase using Mobile Eye Tracking System (METS) and Facial EMG (fEMG). In the maritime field research on human factors, the goal is to implement metrics of eye motions and facial muscle […] -
Investigation of eye tracking, electrodermal activity and facial expressions as biometric signatures of food reward and intake in normal weight adults
Pervasive exposure to a vast and varied food repertoire has contributed to the obesity epidemic. Within this issue, there is a need for a better understanding of the psychophysiological responses to food cues that precede food choice and food intake to establish how these responses contribute to the link between food availability and increasing obesity […] -
EXPRESS YOURSELF: FACIAL EXPRESSION OF HAPPINESS, ANGER, FEAR, AND SADNESS IN FUNDING PITCHES
We build upon theory from evolutionary psychology and emotional expression, including basic emotion theory and the dual threshold model of anger in organizations, to extend knowledge about the influence of facial expressions of emotion in entrepreneurial fundraising. First, we conduct a qualitative analysis to understand the objects of entrepreneurs’ facial expressions of four basic emotions […] -
Self-Reported Emotions and Facial Expressions on Consumer Acceptability: A Study Using Energy Drinks
Emotional responses elicited by foods are of great interest for new product developers and marketing professionals, as consumer acceptance proved to be linked to the emotions generated by the product in the consumers. An emotional measurement is generally considered an appropriate tool to differentiate between the products of similar nutritional value, flavour, liking and packaging. […] -
The Influence of Price on Purchase Intentions: Comparative Study between Cognitive, Sensory, and Neurophysiological Experiments
Price is considered one of the most important attributes in consumer’s choice. On the other hand, consumer’s knowledge about price tends to be imprecise. This study aims at providing new insights analyzing consumers’ perception of retail store brand (focused on Skin Care Products) comparing with two other skin care products, a premium, and a popular […] -
The Cognitive Dimension and the Affective Dimension in the Patient’s Experience
This article deals with the experience of the specific client of health services, that is, the patient. Satisfaction questionnaires are usually applied to assess patient experience. However, this tool provides only a cognitive evaluation; it does not afford an affective dimension of the experience. The objective of the present study is to verify the relationship […] -
Neurocognitive processing of infants
Emerging evidence indicates that mothers and non-mothers show different neurocognitive responses to infant stimuli. This study investigated mothers’ psychophysiological, cognitive and neuronal responses to emotional infant stimuli. A total of 35 mothers with four months old infants and 18 control women without young children underwent computerized tests assessing neurocognitive processing of infant stimuli. Their eye-gazes […] -
The Emotional Effectiveness of Advertisement
Based on cognitive–emotional neuroscience, the effectiveness of advertisement is measured in terms of individuals’ unconscious emotional responses. Using AFFDEX to record and analyze facial expressions, a combination of indicators that track both basic emotions and individual involvement is used to quantitatively determine if a spot causes high levels of ad liking in terms of attention, […] -
Measuring Arousal and Emotion in Healthcare Employees Using Novel Devices
A positive working environment is fundamental for reducing employee turnover, and increasing engagement and productivity. Technologies such as wearable sensors and video analysis of facial expressions can be used to objectively measure the emotional responses of employees in real-time in the workplace. The study aims were to perform a preliminary investigation into the validities of […] -
Facial features and head movements obtained with a webcam correlate with performance deterioration during prolonged wakefulness
We have performed a direct comparison between facial features obtained from a webcam and vigilance-task performance during prolonged wakefulness. Prolonged wakefulness deteriorates working performance due to changes in cognition, emotion, and by delayed response. Facial features can be potentially collected everywhere using webcams located in the workplace. If this type of device can obtain relevant […] -
Muscle Movements for Non-Invasive Thermal Discomfort Detection via Bio-Sensing Technology
In the time of climate change, as heat waves become a more regular occurrence, indoor thermal comfort is an important factor in day to day life. Due to such circumstances, many researchers have focused their studies on finding an effective solution that will not only enable thermal comfort, but also increase satisfaction within the indoor […] -
Exploring the Relationship between Speech and Skin Conductance for Real-Time Arousal Monitoring
Monitoring human emotions through wearable systems has become an important area of research. Electrodermal activity (EDA) has proven to be a good indicator of emotional arousal, and numerous works have focused on using EDA data to predict emotional states. However, to successfully integrate EDA data into real-time wearable emotion recognition systems, several challenges of practical […] -
Detecting Differences Between Concealed and Unconcealed Emotions Using iMotions EMOTIENT
Biometric analysis is everywhere – even in our cell phone security through facial and fingerprint recognition. It has recently become widely useful in forensic settings as well, being used for facial, fingerprint/palmprint, iris, and voice identification1. Using the iMotions Facial Expression Analysis software, I looked at detection differences between concealed and unconcealed emotions when presented […] -
Human and machine validation of 14 databases of dynamic facial expressions
With a shift in interest toward dynamic expressions, numerous corpora of dynamic facial stimuli have been developed over the past two decades. The present research aimed to test existing sets of dynamic facial expressions (published between 2000 and 2015) in a cross-corpus validation effort. For this, 14 dynamic databases were selected that featured facial expressions […] -
The effectiveness of online cause-related marketing message framing on hotel brand evaluation
This study aims to examine the interaction effect between advertising message framing (promotion-framed vs. prevention-framed) strategy and brand reputation (high vs. low) on consumers’ brand evaluation (brand attitude, word-of-mouth, purchase intention) in the context of CRM in the hotel industry. Employing a multiple quantitative methods approach with two experimental studies, data were collected through a […] -
Performance Estimation using Deep Learning Based Facial Expression Analysis
Scientists now widely accept that it is important for nuclear accident analysis to consider human error in addition to the failure of safety device. Investigating human factors in nuclear accidents is a continuing concern within the field of nuclear safety and human engineering. To reduce human error and to improve human performance, there have been […] -
Facing Driver Frustration: Towards Real-Time In-Vehicle Frustration Estimation Based on Video Streams of the Face
Drivers frequently experience frustration when facing traffic jams, red lights or badly designed in-vehicle interfaces. Frustration can lead to aggressive behaviors and negative influences on user experience. Affect-aware vehicles that recognize the driver’s degree of frustration and, based on this, offer assistance to reduce the frustration or mitigate its negative effects promise remedy. As a […] -
IMotions’ Automatic Facial Recognition and Text-Based Content Analysis of Basic Emotions and Empathy in the Application of the Interactive Neurocommunicative Technique LNCBT (Line and Numbered Concordant Basic Text)
This research paper focuses on the effectiveness of the Line Numbered Concordant Basic Text (LNCBT) of Narcotics Anonymous as an interactive neurocommunicative and gamificated technique to generate empathic emotions through its process and application. The LNCBT is studied as an effective educational, neurocommunicational and behavioral change technique for recovery from addictions. Firstly, it was analyzed […] -
Modeling the Relationships Between Basic and Achievement Emotions in Computer-Based Learning Environments
Commercial facial affect detection software is typically trained on large databases and achieves high accuracy in detecting basic emotions, but their use in educational settings is unclear. The goal of this research is to determine how basic emotions relate to the achievement emotion states that are more relevant in academic settings. Such relations, if accurate […] -
A post-paradigmatic approach to analysing emotions in social life
Scholars studying emotions in social life typically work mono-logically, within a paradigmatic camp, drawing on distinct theories of emotion. In isolation, each offers a singular conceptualisation of emotions in social life. Working multi-logically, in contrast, offers richer, comparative insight into the layered meanings of emotion relevant to a social context. Rather than treating them as […] -
Storytelling, the scale of persuasion and retention: A neuromarketing approach
Persuasive storytelling is an essential tool for propagandists, publicists, and corporations. In this research, storytelling styles have been examined for their effectiveness in terms of attitude change and retention. Two groups of respondents were asked to read two short, fictional texts about a chosen corporation’s positive action toward the environment. One story was written using […] -
A Comparison of the Affectiva iMotions Facial Expression Analysis Software With EMG for Identifying Facial Expressions of Emotion
Human faces express emotions, informing others about their affective states. In order to measure expressions of emotion, facial Electromyography (EMG) has widely been used, requiring electrodes and technical equipment. More recently, emotion recognition software has been developed that detects emotions from video recordings of human faces. However, its validity and comparability to EMG measures is […] -
Impairments in face discrimination and emotion recognition are related to aging and cognitive dysfunctions in Parkinson’s disease with dementia
Patients with Parkinson’s disease (PD) suffer from motor and non-motor symptoms; 40% would develop dementia (PD-D). Impaired face and emotion processing in PD has been reported; however, the deficits of face processing in PD-D remain unclear. We investigated three essential aspects of face processing capacity in PD-D, and the associations between cognitive, neuropsychiatric assessments and […] -
Eye gaze and facial displays of emotion during emotional film clips in remitted patients with bipolar disorder
Aberrant emotional reactivity is a putative endophenotype for bipolar disorder (BD), but the findings of behavioral studies are often negative due to suboptimal sensitivity of the employed paradigms. This study aimed to investigate whether visual gaze patterns and facial displays of emotion during emotional film clips can reveal subtle behavioral abnormalities in remitted BD patients. Thirty-eight […] -
Affect and exertion during incremental physical exercise: Examining changes using automated facial action analysis and experiential self-report
Abstract: Recent research indicates that affective responses during exercise are an important determinant of future exercise and physical activity. Thus far these responses have been measured with standardized self-report scales, but this study used biometric software for automated facial action analysis to analyze the changes that occur during physical exercise. A sample of 132 young, […] -
Influences of sensory attribute intensity, emotional responses, and non-sensory factors on purchase intent toward mixed-vegetable juice products under informed tasting condition
Abstract: Product-related sensory and non-sensory cues have been studied in the past to understand purchase behavior among consumers. However, there has been little research related to integrating emotional responses with such cues to achieve better prediction of consumer purchase behavior. This study aimed to determine the impacts of sensory attribute intensities (SAI), non-sensory factors (NSF), […] -
Explicit and Implicit Measures in Video Quality Assessment
Abstract: This work investigates the relation between subjective Video Quality Assessment (VQA) metrics and psychophysiological measures of human interaction assessment such as gaze tracking, electroencephalography and facial expression recognition. Subjective quality assessment is based on deliberate judgement attributions of perceived quality and processes that human perceivers are not consciously aware of. Traditional VQA methods ask […] -
I Can See It in Your Face. Affective Valuation of Exercise in More or Less Physically Active Individuals
Abstract: The purpose of this study was to illustrate that people’s affective valuation of exercise can be identified in their faces. The study was conducted with a software for automatic facial expression analysis and it involved testing the hypothesis that positive or negative affective valuation occurs spontaneously when people are reminded of exercise. We created […] -
Modeling emotion in complex stories: the Stanford Emotional Narratives Dataset
Abstract: Human emotions unfold over time, and more affective computing research has to prioritize capturing this crucial component of real-world affect. Modeling dynamic emotional stimuli requires solving the twin challenges of time-series modeling and of collecting high-quality time-series datasets. We begin by assessing the state-of-the-art in time-series emotion recognition, and we review contemporary time-series approaches […] -
The Effectiveness of Online Cause-Related Marketing Message Framing on Hotel Brand Evaluation
Abstract: The purpose of this study is to examine the interaction effect between online Cause-Related Marketing (CRM) advertisements and brand reputation on consumers’ brand evaluation in the hotel industry. Two experimental studies were conducted: (1) a survey-based experiment that demonstrates the moderating role of brand reputation, and (2) a laboratory experiment using psychophysiological measurements of emotional […] -
Factorized Multimodal Transformer For Multimodal Sequential Learning
Abstract: The complex world around us is inherently multimodal and sequential (continuous). Information is scattered across different modalities and requires multiple continuous sensors to be captured. As machine learning leaps towards better generalization to real world, multimodal sequential learning becomes a fundamental research area. Arguably, modeling arbitrarily distributed spatio-temporal dynamics within and across modalities is […] -
Rhetorical strategies and emotions in political marketing management
Abstract: Purpose The purpose of this paper is to analyze how political marketing management in terms of communication practices influence the voters’ emotional responses as they observe and listen to the discourse of a political leader. Design/methodology/approach An experiment was conducted, in which participants watched the last debate of the campaign leading up the Peruvian […] -
Service with a smiley face: Emojional contagion in digitally mediated relationships
Abstract: The lack of typical nonverbal cues in digitally mediated marketing communication (e.g., text messages, social media etc.) creates special challenges for marketers desiring to manage customer relationships. To overcome these limitations, marketers have turned to emojis to convey subtle meaning regarding the message sender (often a service provider) and to elicit positive emotion in […] -
Effect of Feedback on Users’ Immediate Emotions: Analysis of Facial Expressions during a Simulated Target Detection Task
Abstract: Safety-critical systems (e.g., UAV systems) often incorporate warning modules that alert users regarding imminent hazards (e.g., system failures). However, these warning systems are often not perfect, and trigger false alarms, which can lead to negative emotions and affect subsequent system usage. Although various feedback mechanisms have been studied in the past to counter the […] -
The Importance of Trust for Interface Quality and Acceptance
Abstract: As digital interfaces become common for their development and to offer a sustainable bridge between devices and users, trust in the interface is essential. In this paper we undertake a multi-method research to show from experiment results various dimensions of trust. The results confirm that trust is indeed necessary by so if raising and […] -
Emotion recognition from posed and spontaneous dynamic expressions: Human observers vs. machine analysis
Abstract: The majority of research on the judgment of emotion from facial expressions has focused on deliberately posed displays, often sampled from single stimulus sets. Herein, we investigate emotion recognition from posed and spontaneous expressions, comparing classification performance between humans and machine in a cross-corpora investigation. For this, dynamic facial stimuli portraying the six basic […] -
Emotional responses to climate change map framing using facial emotion recognition technology
Abstract: The different ways that maps are framed by the media can lead to different emotional responses to the same information. Framing shapes the way in which information is presented, and frames are used by authors and designers to focus the reader’s attention in order to lead them to a particular interpretation of the information […] -
Investigation of the dependency of the drivers’ emotional experience on different road types and driving conditions
Abstract: The growing sophistication of technologies and sociological advances are major causes for the dramatic change the automotive sector is currently undergoing. To address changes from a human-centered design perspective an improved understanding of the occupants’ emotional experience and behavior is required. Facial-Expression Analysis (FEA) is an emerging tool in support of such an approach, […] -
A comparison of the effectiveness of two types of deceit detection training methods in older adults
Abstract: Background In general, people are poor at detecting deception. Older adults are even worse than young adults at detecting deceit, which might make them uniquely vulnerable to certain types of financial fraud. One reason for poor deceit detection abilities is that lay theories of cues to deception are not valid. This study compared the […] -
The Effect of Taboo Content on Incidental Vocabulary Acquisition in a Foreign Language: A Facial Expression Analysis Study
Abstract: This study aims to examine how taboo content affects language learner psychology and language learning gains in a multi-modal learning environment by using facial expression analysis. 40 Muslim language learners were initially asked about their opinions on pork and watched a subtitled cooking video including pork visuals and their facial expressions were recorded. Before […] -
Emotional expressions associated with therapeutic inertia in multiple sclerosis care
Abstract BackgroundEmotions play a critical role in our daily decisions. However, it remains unclear how and what sort of emotional expressions are associated with therapeutic decisions in multiple sclerosis (MS) care. Our goal was to evaluate the relationship between emotions and affective states (as captured by muscle facial activity and emotional expressions) and TI amongst […] -
Basic Emotion Recogniton using Automatic Facial Expression Analysis Software
Abstract: Facial expression was proven to show a person’s emotions, including 6 basic human emotions, namely happy, sad, surprise, disgusted, angry, and fear. Currently, the recognition of basic emotions is applied using the automatic facial expression analysis software. In fact, not all emotions are performed with the same expressions. This study aims to analyze whether […] -
How are students’ emotions related to the accuracy of cognitive and metacognitive processes during learning with an intelligent tutoring system?
Abstract: The goal of this study was to investigate 65 students’ evidence scores of emotions while they engaged in cognitive and metacognitive self-regulated learning processes as they learned about the circulatory system with MetaTutor, a hypermedia-based intelligent tutoring system. We coded for the accuracy of detecting students’ cognitive and metacognitive processes, and examined how the […] -
Improving Driver Emotions with Affective Strategies
Abstract: Drivers in negative emotional states, such as anger or sadness, are prone to perform bad at driving, decreasing overall road safety for all road users. Recent advances in affective computing, however, allow for the detection of such states and give us tools to tackle the connected problems within automotive user interfaces. We see potential […] -
An Approach to Analyze User’s Emotion in HCI Experiments Using Psychophysiological Measures
Abstract: Emotional experiences have aroused HCI researchers’ interest once these types of experience involve many parts of our body, such as muscles, body postures, and psychophysiological measures. Hedonic experiences give us pleasure and good emotions, and this paper focuses on it. Some psychophysiological measures have already been correlated with both valence and arousal, the main […] -
Using computer-vision and machine learning to automate facial coding of positive and negative affect intensity
Abstract: Facial expressions are fundamental to interpersonal communication, including social interaction, and allow people of different ages, cultures, and languages to quickly and reliably convey emotional information. Historically, facial expression research has followed from discrete emotion theories, which posit a limited number of distinct affective states that are represented with specific patterns of facial action. […] -
Using both emotional responses and sensory attribute intensities to predict consumer liking and preference toward vegetable juice products
Abstract: Our previous research found that a combination of sensory attribute intensity and emotional responses helps in achieving better understanding of consumer acceptance and preference for basic taste solutions. By applying this finding to beverage samples, this study aimed to develop an optimum model of predicting either overall liking or preference of vegetable juice products […] -
The Forensic biometric analysis of changes in facial response provoked by emotional arousal during initial and subsequent exposure to stimuli
Abstract: The purpose of this research is to determine if recall of the same stimuli produces similar emotional reactions as the initial response. Humans experience involuntary and voluntary responses when encountered with a stimulus. Facial expressions are the natural way to deduce and interpret the emotional state of that person. Specialized software called iMotions biometric […] -
Investigating multimodal affect sensing in an Affective Tutoring System using unobtrusive sensors
Abstract: Affect inextricably plays a critical role in the learning process. In this study, we investigate the multimodal fusion of facial, keystrokes, mouse clicks, head posture and contextual features for the detection of student’s frustration in an Affective Tutoring System. The results (AUC=0.64) demonstrated empirically that a multimodal approach offers higher accuracy and better robustness […] -
How Are Students’ Emotions Associated with the Accuracy of Their Note Taking and Summarizing During Learning with ITSs?
Abstract: The goal of this study was to examine 38 undergraduate and graduate students’ note taking and summarizing, and the relationship between emotions, the accuracy of those notes and summaries, and proportional learning gain, during learning with MetaTutor, an ITS that fosters self-regulated learning while learning complex science topics. Results revealed that students expressed both […] -
Sensing and Learning Human Annotators Engaged in Narrative Sensemaking
Abstract: While labor issues and quality assurance in crowdwork are increasingly studied, how annotators make sense of texts and how they are personally impacted by doing so are not. We study these questions via a narrative-sorting annotation task, where carefully selected (by sequentiality, topic, emotional content, and length) collections of tweets serve as examples of […] -
Subtle behavioural responses during negative emotion reactivity and down-regulation in bipolar disorder: A facial expression and eye-tracking study
Abstract: Abnormal processing of emotional information and regulation are core trait-related features of bipolar disorder (BD) but evidence from behavioural studies is conflicting. This study aimed to investigate trait-related abnormalities in emotional reactivity and regulation in BD using novel sensitive behavioural measures including facial expressions and eye movements. Fifteen patients with BD in full or […] -
Comparing the Affectiva iMotions Facial Expression Analysis Software with EMG
Abstract: People’s faces display emotions, informing others about their affective states. In order to measure facial displays of emotion, Electromyography (EMG) has widely been used, requiring electrodes and technical equipment. More recently, emotion recognition software has been developed that detects emotions from videos. However, its validity and comparability to EMG is unclear. The aim of […] -
Branded Gamification in Technical Education
Abstract: Brand identification has the potential of shaping individuals’ attitudes, performance and commitment within learning and work contexts. We explore these effects, by incorporating elements of branded identification within gamified environments. We report a study with 44 employees, in which task performance and emotional outcomes are assessed in a real-world assembly scenario – namely, while […] -
The impact of seasonal colour change in planting on patients with psychotic disorders using biosensors
Abstract: The beneficial effect of nature on patients with mental disorders is of particular importance. There has been an increase in mental illnesses in recent years, but research on the design of healing gardens for mental and behavioural disorders remains limited. This paper is part of a wider study that aims to investigate the effect […] -
Automatic Recognition of Posed Facial Expression of Emotion in Individuals with Autism Spectrum Disorder
Abstract: Facial expression is impaired in autism spectrum disorder (ASD), but rarely systematically studied. We focus on the ability of individuals with ASD to produce facial expressions of emotions in response to a verbal prompt. We used the Janssen Autism Knowledge Engine (JAKE®), including automated facial expression analysis software (FACET) to measure facial expressions in individuals […] -
Sadder but wiser: Emotional reactions and wisdom in a simulated suicide intervention
Abstract: Scholars within the Berlin paradigm have analysed participants’ responses to a hypothetical vignette about a friend’s suicide ideation. However, no study has yet focused on participants’ emotional reactions to this scenario, an important aspect of wisdom performance. We conducted a Thin‐Slice Wisdom study where participants were asked to give advice to a hypothetical friend contemplating […] -
Copycat of dynamic facial expressions: Superior volitional motor control for expressions of disgust
Abstract: In social situations facial expressions are often strategically employed. Despite the many research on motor control of limb movements, little is known about the control over facial expressions. Using a response-priming task, we investigated motor control over three facial expressions, smiles, disgust and emotionally neutral jaw drops. Prime stimuli consisted of videos of a facial […] -
Personality traits affect the influences of intensity perception and emotional responses on hedonic rating and preference rank toward basic taste solutions
Abstract: This study aimed at determining, based on independent predictors of taste intensity and emotional response, whether individual personality traits could affect prediction models of overall liking and preference rank toward basic taste solutions. Sixty-seven participants rated taste intensities (TI) of four basic-taste solutions at both low and high concentrations, and of plain water. Emotional responses […] -
User Centred Design of Social Signals Feedback for Communication Skills Training
Abstract: Affective technologies enable the automatic recognition of human emotional expressions and nonverbal signals which play an important part in effective communication. This paper describes the use of user-centred design techniques to establish display designs suitable for feeding back recognised emotional and social signals to trainees during communication skills training. The channels of communication investigated […] -
Multimodal Language Analysis with Recurrent Multistage Fusion
Abstract: Computational modeling of human multimodal language is an emerging research area in natural language processing spanning the language, visual and acoustic modalities. Comprehending multimodal language requires modeling not only the interactions within each modality (intra-modal interactions) but more importantly the interactions between modalities (cross-modal interactions). In this paper, we propose the Recurrent Multistage Fusion Network […] -
Seat Comfort Evaluation Using Face Recognition Technology
Abstract: One of the difficulties inherent to comfort assessment is to translate comfort perception into quantifiable variables in order to measure it and use this result to improve seat comfort. This study describes the opportunities of using facial expressions recognition technology to compare comfort perception of two aircraft seats installed in a representative environment. Facial […] -
Automated Pain Detection in Facial Videos of Children using Human-Assisted Transfer Learning
Abstract: Accurately determining pain levels in children is difficult, even for trained professionals and parents. Facial activity provides sensitive and specific information about pain, and computer vision algorithms have been developed to automatically detect Facial Action Units (AUs) defined by the Facial Action Coding System (FACS). Our prior work utilized information from computer vision, i.e. […] -
A Case-Study in Neuromarketing: Analysis of the Influence of Music on Advertising Effectivenes through Eye-Tracking, Facial Emotion and GSR
Abstract: Music plays an important role in advertising. It exerts strong influence on the cognitive processes of attention and on the emotional processes of evaluation and, subsequently, in the attributes of the product. The goal of this work was to investigate these mechanisms using eye-tracking, facial expression and galvanic skin response (GSR). Nineteen university women […] -
Multimodal Language Analysis in the Wild: CMU-MOSEI Dataset and Interpretable Dynamic Fusion Graph
Abstract: Analyzing human multimodal language is an emerging area of research in NLP. Intrinsically human communication is multimodal (heterogeneous), temporal and asynchronous; it consists of the language (words), visual (expressions), and acoustic (paralinguistic) modalities all in the form of asynchronous coordinated sequences. From a resource perspective, there is a genuine need for large scale datasets that […] -
A Preliminary Investigation towards the Development of an Emotion-Aware Partner Agent for Training Control
Abstract: Simulator-based training platforms have become increasingly popular on the grounds of their potential to facilitate skill acquisition within safe and controlled environments. However, current technology is limited in its ability to adapt to individual trainees. Tailoring is in fact typically based on recorded simulation inputs and outputs, or relies on costly and time-consuming trainer-driven […] -
Automotive Emotions: An Investigation of Their Natures, Frequencies of Occurrence and Causes
Abstract: Technological and sociological developments in the automotive sector are shifting the focus of design towards developing a better understanding of driver needs, desires and emotions. Human-centred design methods are being more frequently applied to automotive research, including the use of systems to detect human emotions in real-time. One method for a non-contact measurement of […] -
Emotion in a 360-Degree vs. Traditional Format Through EDA, EEG and Facial Expressions
Abstract: Digital video advertising is growing exponentially. It is expected that digital video ad spending of the US will see double-digit growth annually through 2020 (eMarketer, 2016). Moreover, advertisers are spending on average more than $10 million annually on Digital Video, representing an 85% increase from 2 years (iab, 2016). This huge increase is mediated by […] -
How Are Students’ Emotions Associated with the Accuracy of Their Note Taking and Summarizing During Learning with ITSs?
Abstract: The goal of this study was to examine 38 undergraduate and graduate students’ note taking and summarizing, and the relationship between emotions, the accuracy of those notes and summaries, and proportional learning gain, during learning with MetaTutor, an ITS that fosters self-regulated learning while learning complex science topics. Results revealed that students expressed both […] -
Game Scenes Evaluation and Player’s Dominant Emotion Prediction
Abstract: In this paper, we present a solution for computer assisted emotional analysis of game session. The proposed approach combines eye movements and facial expressions to annotate the perceived game objects with the expressed dominate emotions. Moreover, our system EMOGRAPH (Emotional Graph) gives easy access to information about user experience and predicts player’s emotions. The […] -
Impact of Learner-Centered Affective Dynamics on Metacognitive Judgements and Performance in Advanced Learning Technologies
Affect and metacognition play a central role in learning. We examine the relationships between students’ affective state dynamics, metacognitive judgments, and performance during learning with MetaTutorIVH, an advanced learning technology for human biology education. Student emotions were tracked using facial expression recognition embedded within MetaTutorIVH and transitions between emotions theorized to be important to learning […] -
Discrimination between smiling faces: Human observers vs. automated face analysis
Abstract: This study investigated (a) how prototypical happy faces (with happy eyes and a smile) can be discriminated from blended expressions with a smile but non-happy eyes, depending on type and intensity of the eye expression; and (b) how smile discrimination differs for human perceivers versus automated face analysis, depending on affective valence and morphological facial […] -
How Does Food Taste in Anorexia and Bulimia Nervosa? A Protocol for a Quasi-Experimental, Cross-Sectional Design to Investigate Taste Aversion or Increased Hedonic Valence of Food in Eating Disorders
Background: Despite on-going efforts to better understand dysregulated eating, the olfactory-gustatory deficits and food preferences in eating disorders (ED), and the mechanisms underlying the perception of and responses to food properties in anorexia nervosa (AN) and bulimia nervosa (BN) remain largely unknown; both during the course of the illness and compared to healthy populations. It is, […] -
Toward A Companion Robot Fostering Perseverance in Math: A Pilot Study
Abstract: Challenging math problems without immediate solutions often invite students to ride an “emotional roller-coaster” through episodes of confusion, frustration, surprise and joy. Those problem solving experiences provide rich opportunities to cultivate mathematical perseverance, the mentality to forge ahead in face of ambiguity or difficulty. An ideal teacher closely monitors the problem solving process and […] -
Emotion recognition for semi-autonomous vehicles framework
Abstract: The human being in his blessed curiosity has always wondered how to make machines feel, and, at the same time how a machine can detect emotions. Perhaps some of the tasks that cannot be replaced by machines are the ability of human beings to feel emotions. In the last year, this hypothesis is increasingly […] -
How Does Prior Knowledge Influence Eye Fixations and Sequences of Cognitive and Metacognitive SRL Processes during Learning with an Intelligent Tutoring System?
Abstract: The goal of this study was to use eye-tracking and log-file data to investigate the impact of prior knowledge on college students’ (N = 194, with a subset of n = 30 for eye tracking and sequence mining analyses) fixations on (i.e., looking at) self-regulated learning-related areas of interest (i.e., specific locations on the interface) and on the sequences of […] -
Psychopathic Men: Deficits in General Mental Ability, Not Emotion Perception
Abstract: Psychopathy is characteristically associated with deficits in emotion perception; however, findings surrounding this deficit are actually quite mixed. This is most likely due to limitations of study methodology, including the use of tasks with unknown or poor psychometric properties, underpowered samples, and a lack of control for third variables. We present a study that […] -
Visual Attention Mechanisms in Happiness vs. Trustworthiness Processing of Facial Expressions
Abstract: A happy facial expression makes a person look (more) trustworthy. Do perceptions of happiness and trustworthiness rely on the same face regions and visual attention processes? In an eye-tracking study, eye movements and fixations were recorded while participants judged the un/happiness or the un/trustworthiness of dynamic facial expressions in which the eyes and/or the […] -
The Face of Contagion: Consumer Response to Service Failure Depiction in Online Reviews
Purpose: Online consumer reviews (OCRs) have emerged as a particularly important type of user-generated information about a brand because of their widespread adoption and influence on consumer decision-making. Much of the existing OCR research focuses on quantifiable OCR features such as star ratings and volume. More research that examines the influence of review elements, aside from […] -
A Framework to Bridge Teachers, Student’s Affective State, and Improve Academic Performance
Abstract: Some of the biggest problems tackling Higher Education Institutions (HEI) are student’s drop-out and academic disengagement. Physical or psychological disabilities, social-economic or academic marginalization, and emotional and affective problems, are some of the factors that can lead to it. This problematic is worsened by the shortage of educational resources that can bridge the communication gap […] -
Emotional Journey for an Emotion Provoking Cycling Exergame
Abstract: In this work we present a novel concept for affective entertainment, which we call Emotional Journey. It provides a dynamic and adaptive story path based on a player’s emotional responses and yields improved accurate recognition of the player’s emotions. We conducted a case study with 25 players to evaluate our concept using our cycling […] -
Enhancing Exercise Experience with Individual Multi-Emotion Provoking Game Elements
Abstract: In this work we present a new affective game design method that includes multi-emotion provoking and continuous game elements. Evaluated with our physical cycling exergaming system it extends our previously designed single emotion game scene approach. In addition we introduce new entertaining content that includes game elements to provoke both physical and mental stress as […] -
Identifying correlation between facial expression and heart rate and skin conductance with iMotions biometric platform
Abstract: Emotional reactions are stimulated when humans are presented with a stimulus, triggering a series of voluntary and involuntary responses. Human emotions can be measured from facial expressions and physiological processes. The iMotions biometric platform can detect and analyze the responses of different individuals, which are personalized. The iMotions software allows for the quantification of seven […] -
JAKE® Multimodal Data Capture System: Insights from an Observational Study of Autism Spectrum Disorder
Objective: To test usability and optimize the Janssen Autism Knowledge Engine (JAKE®) system’s components, biosensors, and procedures used for objective measurement of core and associated symptoms of autism spectrum disorder (ASD) in clinical trials. Methods: A prospective, observational study of 29 children and adolescents with ASD using the JAKE system was conducted at three sites in the […] -
Objective, computerized video-based rating of blepharospasm severity
Objective: To compare clinical rating scales of blepharospasm severity with involuntary eye closures measured automatically from patient videos with contemporary facial expression software. Methods: We evaluated video recordings of a standardized clinical examination from 50 patients with blepharospasm in the Dystonia Coalition’s Natural History and Biorepository study. Eye closures were measured on a frame-by-frame basis […] -
FaceSync: Open source framework for recording facial expressions with head-mounted cameras
Abstract: Advances in computer vision and machine learning algorithms have enabled researchers to extract facial expression data from face video recordings with greater ease and speed than standard manual coding methods, which has led to a dramatic increase in the pace of facial expression research. However, there are many limitations in recording facial expressions in laboratory […] -
Music Recommendation System for Human Attention Modulation by Facial Recognition on a Driving Task: A Proof of Concept
Abstract: The role of music on driving process had been discussed in the context of driver assistance as an element of security and comfort. Throughout this document, we present the development of an audio recommender system for the use by drivers, based on facial expression analysis. This recommendation system has the objective of increasing the […] -
Toward Affect-Sensitive Virtual Human Tutors: The Influence of Facial Expressions on Learning and Emotion
Abstract: Affective support can play a central role in adaptive learning environments. Although virtual human tutors hold significant promise for providing affective support, a key open question is how a tutor’s facial expressions can influence learners’ performance. In this paper, we report on a study to examine the influence of a human tutor agent’s facial […] -
Thin-Slice Measurement of Wisdom
Abstract: Objective Measurement of Wisdom within a short period of time is vital for both the public interest (e.g., understanding a presidential election) and research (e.g., testing factors that facilitate wisdom development). A measurement of emotion associated with wisdom would be especially informative; therefore, a novel Thin-Slice measurement of wisdom was developed based on the […] -
The Effects of Autonomy on Emotions and Learning in Game-Based Learning Environments
Abstract: The current study examined the impact of agency on college students’ emotions and learning during gameplay with CRYSTAL ISLAND, a game-based learning environment designed to foster microbiology learning. 96 undergraduate students (59% female) from a large North American university participated in the study. Participants were randomly assigned to one of three experimental conditions (i.e., […] -
Enhancing Student Models in Game-based Learning with Facial Expression Recognition
Abstract: Recent years have seen a growing recognition of the role that affect plays in learning. Because game-based learning environments elicit a wide range of student affective states, affect-enhanced student modeling for game-based learning holds considerable promise. This paper introduces an affect-enhanced student modeling framework that leverages facial expression tracking for game-based learning. The affect-enhanced […] -
Inhabitable space control for the creation of healthy interactive spaces through emotional domotics
Abstract: In recent years, Mexico’s level of different physiological and mental negative states, such as stress have increased. This has among its consequences, low work production and social problems including the alarming numbers that nearly 43% of adults report high levels of stress. The increase of stress incidence in people aged 15–29 years, and the lack […] -
Towards More Robust Automatic Facial Expression Recognition in Smart Environments
Abstract: In this paper, we provide insights towards achieving more robust automatic facial expression recognition in smart environments based on our benchmark with three labeled facial expression databases. These databases are selected to test for desktop, 3D and smart environment application scenarios. This work is meant to provide a neutral comparison and guidelines for developers […] -
Facial Expressions to Evaluate Advertising: A Laboratory versus Living Room Study
Abstract: In recent years researchers have shown growing interest in the impact of emotions in television commercials and in advertising in general (Park and Thorson, 1990). Emotions also influence the attitude towards the brand and to the ad (Batney and Ray, 1986; Edell and Burke, 1987; Derbaix, 1995), increase the attention of the advertisement (Olney, […] -
Context shapes social judgments of positive emotion suppression and expression
Abstract: It is generally considered socially undesirable to suppress the expression of positive emotion. However, previous research has not considered the role that social context plays in governing appropriate emotion regulation. We investigated a context in which it may be more appropriate to suppress than express positive emotion, hypothesizing that positive emotion expressions would be […] -
What makes a smiling face look happy? Visual saliency, distinctiveness, and affect
Abstract: We investigated the relative contribution of (a) perceptual (eyes and mouth visual saliency), (b) conceptual or categorical (eye expression distinctiveness), and (c) affective (rated valence and arousal) factors, and (d) specific morphological facial features (Action Units; AUs), to the recognition of facial happiness. The face stimuli conveyed truly happy expressions with a smiling mouth […] -
Alexithymia, but Not Autism Spectrum Disorder, May Be Related to the Production of Emotional Facial Expressions
Abstract: Background: A prominent diagnostic criterion of autism spectrum disorder (ASD) relates to the abnormal or diminished use of facial expressions. Yet little is known about the mechanisms that contribute to this feature of ASD. Methods: We showed children with and without ASD emotionally charged video clips in order to parse out individual differences in spontaneous production […] -
Emotional Domotics: Inhabitable Space Variable Control for the Emotions Modulation
Abstract: Throughout this document the details and progress of the research in emotional domotics, whose ultimate goal is the development of a controlled algorithm for living spaces based on the emotional state of the user, will be illustrated and detailed. The first section details the motivations and objectives of the project. The second section gives […] -
Automatic expression recognition and expertise prediction in Bharatnatyam
Abstract: Bharatnatyam is an ancient Indian Classical Dance form consisting of complex postures and expressions. One of the main challenges in this dance form is to perform expression recognition and use the resulting data to predict the expertise of a test dancer. In this paper, expression recognition is carried out for the 6 basic expressions […] -
Deep Multimodal Fusion for Persuasiveness Prediction
Abstract: Persuasiveness is a high-level personality trait that quantifies the influence a speaker has on the beliefs, attitudes, intentions , motivations, and behavior of the audience. With social multimedia becoming an important channel in propagating ideas and opinions, analyzing persuasiveness is very important. In this work, we use the publicly available Persuasive Opinion Multimedia (POM) […] -
Automatic assessment of communication skill in interface-based employment interviews using audio-visual cues
Abstract: Being an effective communicator plays a major role in employment interviews. In this paper, we provide a computational framework to automatically predict the communication skill of a person in an interface-based interview setting. The advantage of interface-based interview setting compared to that of a face-to-face setting is, the participants get assessed without any human […] -
Evaluations That Matter: Customer Preferences Using Industry-Based Evaluations and Eye-Gaze Data
Abstract: This study is the first stage of a research program aimed at understanding differences in how people process 2D and 3D automotive stimuli, using psychophysiological tools such as galvanic skin response (GSR), eye tracking, electroencephalography (EEG), and facial expressions coding, along with respondent ratings. The current study uses just one measure, eye tracking, and […] -
Correlation between subjective driver state measures and psychophysiological and vehicular data in simulated driving
Abstract: Advanced driver assistance systems require better knowledge of the driver’s state. This would allow for adapting driving support functions, e.g. adaptive automation. To detect the emotional and cognitive state of the driver, it is necessary to know which signals contain accurate information about the state. In this paper the results of a driving simulator […] -
Advanced Driver Monitoring for Assistance System (ADMAS) based on emotions
Abstract: This work presents advances in research of emotions recognition by using facial expressions to be used in active security system focused in driver monitoring systems to provide efficient assistance through Advanced Driver Assistance Systems to drivers when poor driving performance is detected; researchers have called to this approach Advanced Driver Monitoring for Assistance Systems […] -
Application of Hedonic Dynamics Using Multiple-Sip Temporal-Liking and Facial Expression for Evaluation of a New Beverage
Abstract: Drinking and eating are not a matter of a single sip or bite. Dynamic data gathered from multiple sip or bite, seem to be more reliable than simple sip/bite evaluation. However, methodologies and analyses based on multiple sips/bites have received little attention until recently. The present study tested an innovative approach to measure the […] -
The Forensic Biometric Analysis of Emotions from Facial Expressions and Physiological Processes from the Heart and Skin
Abstract: Decision-making, perception, memory and social interactions are greatly driven by emotion. Emotions can be measured from facial expressions through the facial muscles. A group of four students were exposed to emotionally loaded stimuli (videos and images) in its full complexity to assess the valence of the emotional expression, the associated arousal, skin respiration and […] -
Physiology-based recognition of Facial micro-expressions using EEG and identification of the relevant sensors by emotion
Abstract: In this paper, we present a novel work about predicting the facial expressions from physiological signals of the brain. The main contributions of this paper are twofold. a) Investigation of the predictability of facial micro-expressions from EEG. b) Identification of the relevant features to the prediction. To reach our objectives, an experiment was conducted […] -
Differential emotion attribution to neutral faces of own and other races
Abstract: Past research has demonstrated differential recognition of emotion on faces of different races. This paper reports the first study to explore differential emotion attribution to neutral faces of different races. Chinese and Caucasian adults viewed a series of Chinese and Caucasian neutral faces and judged their outward facial expression: neutral, positive, or negative. The […] -
Multimodal Validation of Facial Expression Detection Software for Real-time Monitoring of Affect in Patients with Suicidal Intent
Abstract: Facial expression is an independent and objective marker of affect. Basic emotions (fear, sadness, joy, anger, disgust and surprise) have been shown to be universal across human cultures. Techniques such as the Facial Action Coding System can capture emotion with good reliability. Such techniques visually process the changes in different assemblies of facial muscles that produce […] -
Home Alone: Social Robots for Digital Ethnography of Toddler Behavior
Abstract: An unprecedented number of children in the US start public school with major deficits in basic academic skills. Scientific evidence shows that children who have early failure experiences in school are those who are most likely to become inattentive, disruptive, or withdrawn later on. Empirical research using longitudinal randomized control studies is now showing […]
Research Report 2024
In-depth look at the scientific landscape as powered by iMotions software, showcasing groundbreaking research and the impact of our tools in various scientific and industrial fields.
iMotions Science Resources
Looking for white papers, validation reports or research show casing iMotions Multimodal capabilities?
Share Your Research
850+ universities worldwide with an iMotions human behavior lab
73 of the top 100 highest ranked universities
710+ published research papers using iMotions
iMotions is used for some of the most interesting human behavior research studies carried out by top researchers around the world. Contact us to have your publication featured here.
The authors of these publications have used iMotions as a software tool within their research.
“Software should be cited on the same basis as any other research product such as a paper or a book; that is, authors should cite the appropriate set of software products just as they cite the appropriate set of papers” (Katz et al., 2020).
We therefore encourage you to cite the use of iMotions where appropriate.
How to cite iMotions
APA
iMotions (10), iMotions A/S, Copenhagen, Denmark, (2024).
Note: adjust the version and year where relevant.
Learn How to Conduct Human Behavior Research with iMotions
Publications
Read publications made possible with iMotions
Blog
Get inspired and learn more from our expert content writers
Newsletter
A monthly close up of latest product and research news