Abstract: Accurately determining pain levels in children is difficult, even for trained professionals and parents. Facial activity provides sensitive and specific information about pain, and computer vision algorithms have been developed to automatically detect Facial Action Units (AUs) defined by the Facial Action Coding System (FACS). Our prior work utilized information from computer vision, i.e. […]

Abstract: Analyzing human multimodal language is an emerging area of research in NLP. Intrinsically human communication is multimodal (heterogeneous), temporal and asynchronous; it consists of the language (words), visual (expressions), and acoustic (paralinguistic) modalities all in the form of asynchronous coordinated sequences. From a resource perspective, there is a genuine need for large scale datasets that […]

Abstract: This research aims to explore the impact of cooperative or competitive gaming modes on players’ emotion and behaviors. We conducted a with-in subject study with 30 participants. Participants were asked to play a fighting game with a male research confederate in two different gameplay modes. We examined (1) self-reported preference, (2) changes in the gamers’ […]

Abstract: This study compares the use of a laptop versus a touch-screen PC to perform web-based information search tasks. Thirty-six participants took part in a lab-based experiment. They were asked to use either a laptop or a touch-screen PC to seek information on the web and retrieve relevant pieces of information while their sessions were […]

Abstract: Navigation in a hierarchical menu on the current smart TVs (STVs) contributes to a poor user experience for older adults. Difficulty with navigation is caused by the design of an interface and users’ mental models. To explore different design possibilities, two types of menu layouts (i.e., mega menus and tiled menus) with tags were […]

Abstract: Technological and sociological developments in the automotive sector are shifting the focus of design towards developing a better understanding of driver needs, desires and emotions. Human-centred design methods are being more frequently applied to automotive research, including the use of systems to detect human emotions in real-time. One method for a non-contact measurement of […]

Abstract: Simulator-based training platforms have become increasingly popular on the grounds of their potential to facilitate skill acquisition within safe and controlled environments. However, current technology is limited in its ability to adapt to individual trainees. Tailoring is in fact typically based on recorded simulation inputs and outputs, or relies on costly and time-consuming trainer-driven […]

Abstract: Multimodal machine learning is a core research area spanning the language, visual and acoustic modalities. The central challenge in multimodal learning involves learning representations that can process and relate information from multiple modalities. In this paper, we propose two methods for unsupervised learning of joint multimodal representations using sequence to sequence (Seq2Seq) methods: a […]

Abstract: Digital video advertising is growing exponentially. It is expected that digital video ad spending of the US will see double-digit growth annually through 2020 (eMarketer, 2016). Moreover, advertisers are spending on average more than $10 million annually on Digital Video, representing an 85% increase from 2 years (iab, 2016). This huge increase is mediated by […]

Abstract: Personal context-specific experience can affect how a designer evaluates a design problem and proposes solutions. However, this effect was seldom discovered in a quantitative manner in problem-solving design tasks. This paper uses empirical evidence and quantitative methods to show the effects of novice designers’ contextual experience on design tasks, particularly as it relates to […]