Publications

Abstract: Creating a good crowdfunding campaign is difficult. By understanding why people contribute to crowdfunding campaigns we can make campaigns better and raise more money. Crowdfunding websites allow entrepreneurs to make a pitch, which is watched by potential funders. This article describes a pilot of an experiment that measures how people react to both successful […]

Abstract: Affective technologies enable the automatic recognition of human emotional expressions and nonverbal signals which play an important part in effective communication. This paper describes the use of user-centred design techniques to establish display designs suitable for feeding back recognised emotional and social signals to trainees during communication skills training. The channels of communication investigated […]

Abstract: Analyzing human multimodal language is an emerging area of research in NLP. Intrinsically human communication is multimodal (heterogeneous), temporal and asynchronous; it consists of the language (words), visual (expressions), and acoustic (paralinguistic) modalities all in the form of asynchronous coordinated sequences. From a resource perspective, there is a genuine need for large scale datasets that […]

Abstract: Accurately determining pain levels in children is difficult, even for trained professionals and parents. Facial activity provides sensitive and specific information about pain, and computer vision algorithms have been developed to automatically detect Facial Action Units (AUs) defined by the Facial Action Coding System (FACS). Our prior work utilized information from computer vision, i.e. […]

Abstract: Metacomprehension is key to successful learning of complex topics when using multimedia materials. The goal of this study was to determine if eye-movement dyads could be: (1) identified by sequence mining techniques, and (2) aligned with self-reported metacognitive judgments during learning with multimedia materials that contain conceptual discrepancies designed to interfere with participants’ metacomprehension. Thirty-two […]

Abstract: Personal context-specific experience can affect how a designer evaluates a design problem and proposes solutions. However, this effect was seldom discovered in a quantitative manner in problem-solving design tasks. This paper uses empirical evidence and quantitative methods to show the effects of novice designers’ contextual experience on design tasks, particularly as it relates to […]

Background: Sympathetic arousal response due to rewarding emotion may not be considered threat to the well-being but such arousal response evoked by fear or punishment can be stressful. When such changes are recorded in lab as biological signals, induced with appropriate stimulus, the observed response may serve as a good indicator of homeostatic alteration. In […]

Affect and metacognition play a central role in learning. We examine the relationships between students’ affective state dynamics, metacognitive judgments, and performance during learning with MetaTutorIVH, an advanced learning technology for human biology education. Student emotions were tracked using facial expression recognition embedded within MetaTutorIVH and transitions between emotions theorized to be important to learning […]

Abstract: This study compares the use of a laptop versus a touch-screen PC to perform web-based information search tasks. Thirty-six participants took part in a lab-based experiment. They were asked to use either a laptop or a touch-screen PC to seek information on the web and retrieve relevant pieces of information while their sessions were […]

Abstract: Consumers often use a product’s visual design as a mental shortcut to judge its unobservable attributes. Mental associations between visual design and unobservable attributes aid consumers in their judgments, and hypothetically reduce consumers’ mental load. This paper describes a study that shows the possibility of quickly creating an association in subjects’ minds between a […]