-
Seq2Seq2Sentiment: Multimodal Sequence to Sequence Models for Sentiment Analysis
Abstract: Multimodal machine learning is a core research area spanning the language, visual and acoustic modalities. The central challenge in multimodal learning involves learning representations that can process and relate information from multiple modalities. In this paper, we propose two methods for unsupervised learning of joint multimodal representations using sequence to sequence (Seq2Seq) methods: a […]
-
Emotion in a 360-Degree vs. Traditional Format Through EDA, EEG and Facial Expressions
Abstract: Digital video advertising is growing exponentially. It is expected that digital video ad spending of the US will see double-digit growth annually through 2020 (eMarketer, 2016). Moreover, advertisers are spending on average more than $10 million annually on Digital Video, representing an 85% increase from 2 years (iab, 2016). This huge increase is mediated by […]
-
The Effects of Designers Contextual Experience on the Ideation Process and Design Outcomes
Abstract: Personal context-specific experience can affect how a designer evaluates a design problem and proposes solutions. However, this effect was seldom discovered in a quantitative manner in problem-solving design tasks. This paper uses empirical evidence and quantitative methods to show the effects of novice designers’ contextual experience on design tasks, particularly as it relates to […]
-
Integrating metacognitive judgments and eye movements using sequential pattern mining to understand processes underlying multimedia learning
Abstract: Metacomprehension is key to successful learning of complex topics when using multimedia materials. The goal of this study was to determine if eye-movement dyads could be: (1) identified by sequence mining techniques, and (2) aligned with self-reported metacognitive judgments during learning with multimedia materials that contain conceptual discrepancies designed to interfere with participants’ metacomprehension. Thirty-two […]
-
Assessment of human driver safety at Dilemma Zones with automated vehicles through a virtual reality environment
Abstract: Ensuring the safety of mixed traffic environments, in which human drivers interact with autonomous vehicles, is an impending challenge. A virtual traffic environment provides a risk-free opportunity to let human drivers interact with autonomous vehicles, indicating how variability in traffic environments and human responses compromises safety. Analyzing the section of road preceding an intersection […]
-
Game Scenes Evaluation and Player’s Dominant Emotion Prediction
Abstract: In this paper, we present a solution for computer assisted emotional analysis of game session. The proposed approach combines eye movements and facial expressions to annotate the perceived game objects with the expressed dominate emotions. Moreover, our system EMOGRAPH (Emotional Graph) gives easy access to information about user experience and predicts player’s emotions. The […]
-
How Do Different Levels of AU4 Impact Metacognitive Monitoring During Learning with Intelligent Tutoring Systems?
Abstract: We investigated how college students’ (n = 40) different levels of action unit 4 (AU4: brow lowerer), metacognitive monitoring process use and pre-test score were associated with metacognitive monitoring accuracy during learning with a hypermedia-based ITS. Results revealed that participants with high pre-test scores had the highest accuracy scores with low levels of AU4 and use […]
-
How Are Students’ Emotions Associated with the Accuracy of Their Note Taking and Summarizing During Learning with ITSs?
Abstract: The goal of this study was to examine 38 undergraduate and graduate students’ note taking and summarizing, and the relationship between emotions, the accuracy of those notes and summaries, and proportional learning gain, during learning with MetaTutor, an ITS that fosters self-regulated learning while learning complex science topics. Results revealed that students expressed both […]
-
Leverage Score Ordering
Abstract: In this paper we present Leverage Score Ordering, a novel technique for determining the ordering of data in the training of deep neural networks. Our technique is based on the distributed computation of leverage scores using random projections. These computed leverage scores provide a flexible and efficient method to determine the optimal ordering of training […]
-
Impact of Learner-Centered Affective Dynamics on Metacognitive Judgements and Performance in Advanced Learning Technologies
Abstract: Affect and metacognition play a central role in learning. We examine the relationships between students’ affective state dynamics, metacognitive judgments, and performance during learning with MetaTutorIVH, an advanced learning technology for human biology education. Student emotions were tracked using facial expression recognition embedded within MetaTutorIVH and transitions between emotions theorized to be important to […]

iMotions is used for some of the most interesting human behavior research studies carried out by top researchers around the world. Contact us to have your publication featured here.
The authors of these publications have used iMotions as a software tool within their research.
10 Most Popular Blogs
- How Eye Tracking Technology Is Changing The World [5 Examples]
- Suffolk University’s Sawyer Business School Launches Innovative X-Lab
- System 1 and System 2: Facts and Fictions
- Four Inspiring Ways Biosensors are Used to Improve Healthcare Performance
- How We Read – What Eye Tracking Can Tell Us
- Top 5 Publications of 2022
- The Top 5 Neuromarketing Research Studies
- Neuroscience Podcasts
- How biosensors increase insights into maternal responses to infants
- Our Top 50 Human Behavior Experts to Follow in 2017
Learn How to Conduct Human Behavior Research with iMotions
Publications
Read publications made possible with iMotions
Blog
Get inspired and learn more from our expert content writers
Newsletter
A monthly close up of latest product and research news