English
Related papers

Related papers: Inferring User Facial Affect in Work-like Settings

200 papers

Facial expression-based human emotion recognition is a critical research area in psychology and medicine. State-of-the-art classification performance is only reached by end-to-end trained neural networks. Nevertheless, such black-box models…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Tim Büchner , Niklas Penzel , Orlando Guntinas-Lichius , Joachim Denzler

Affective computing research traditionally focused on labeling a person's emotion as one of a discrete number of classes e.g. happy or sad. In recent times, more attention has been given to continuous affect prediction across dimensions in…

Human-Computer Interaction · Computer Science 2018-03-06 Jonny O'Dwyer , Ronan Flynn , Niall Murray

Understanding the mental state of other people is an important skill for intelligent agents and robots to operate within social environments. However, the mental processes involved in `mind-reading' are complex. One explanation of such…

Computer Vision and Pattern Recognition · Computer Science 2019-11-05 Jonathan Vitale , Mary-Anne Williams , Benjamin Johnston , Giuseppe Boccignone

Accurate emotion recognition is pivotal for nuanced and engaging human-computer interactions, yet remains difficult to achieve, especially in dynamic, conversation-like settings. In this study, we showcase how integrating eye-tracking data,…

Human-Computer Interaction · Computer Science 2025-11-03 Meisam Jamshidi Seikavandi , Jostein Fimland , Maria Barrett , Paolo Burelli

People come to social media to satisfy a variety of needs, such as being informed, entertained and inspired, or connected to their friends and community. Hence, to design a ranking function that gives useful and personalized post…

Social and Information Networks · Computer Science 2022-06-27 Jane Dwivedi-Yu , Yi-Chia Wang , Lijing Qin , Cristian Canton-Ferrer , Alon Y. Halevy

Group mood plays a crucial role in shaping workspace experiences, influencing group dynamics, team performance, and creativity. The perceived group mood depends on many, often subconscious, aspects such as individual emotional states or…

Human-Computer Interaction · Computer Science 2025-08-18 Tzu-Hui Wu , Sebastian Cmentowski , Yunyin Lou , Jun Hu , Regina Bernhaupt

Understanding complex user behaviour under various conditions, scenarios and journeys can be fundamental to the improvement of the user-experience for a given system. Predictive models of user reactions, responses -- and in particular,…

Human-Computer Interaction · Computer Science 2016-08-11 Mohamed Mostafa , Tom Crick , Ana C. Calderon , Giles Oatley

Life events can dramatically affect our psychological state and work performance. Stress, for example, has been linked to professional dissatisfaction, increased anxiety, and workplace burnout. We explore the impact of positive and negative…

Human-Computer Interaction · Computer Science 2023-04-19 Keith Burghardt , Nazgol Tavabi , Emilio Ferrara , Shrikanth Narayanan , Kristina Lerman

Affect and cognitive load influence many user behaviors. In this paper, we propose Motion as Emotion, a novel method that utilizes fine differences in hand motion to recognise affect and cognitive load in virtual reality (VR). We conducted…

Human-Computer Interaction · Computer Science 2024-09-20 Phoebe Chua , Prasanth Sasikumar , Yadeesha Weerasinghe , Suranga Nanayakkara

In human-in-the-loop machine learning, the user provides information beyond that in the training data. Many algorithms and user interfaces have been designed to optimize and facilitate this human--machine interaction; however, fewer studies…

Human-Computer Interaction · Computer Science 2018-03-12 Pedram Daee , Tomi Peltola , Aki Vehtari , Samuel Kaski

This paper presents a novel approach for synthesizing facial affect, which is based on our annotating 600,000 frames of the 4DFAB database in terms of valence and arousal. The input of this approach is a pair of these emotional state…

Graphics · Computer Science 2018-11-21 Dimitrios Kollias , Shiyang Cheng , Maja Pantic , Stefanos Zafeiriou

Ideas about how to increase the unconscious participation in interaction between 'a human' and 'a computer' are developed in this paper. Evidence of impact of the unconscious functioning is presented. The unconscious is characterised as…

Human-Computer Interaction · Computer Science 2009-11-02 Richard V. Diamond

Consumers often react expressively to products such as food samples, perfume, jewelry, sunglasses, and clothing accessories. This research discusses a multimodal affect recognition system developed to classify whether a consumer likes or…

Human-Computer Interaction · Computer Science 2017-05-09 Amol S Patwardhan , Gerald M Knapp

Affective states have a critical role in driving performance and safety. They can degrade driver situation awareness and negatively impact cognitive processes, severely diminishing road safety. Therefore, detecting and assessing drivers'…

Machine Learning · Computer Science 2019-07-24 Daniel Lopez-Martinez , Neska El-Haouij , Rosalind Picard

Artificial intelligence tools are increasingly embedded in everyday work, yet employees' uptake varies widely even within the same organization. Drawing on sociotechnical and work design perspectives, this research examines whether…

Computers and Society · Computer Science 2026-02-27 Aaron Reich , Diana Wolfe , Matt Price , Alice Choe , Fergus Kidd , Hannah Wagner

Multimodal affective computing analyzes user-generated social media content to predict emotional states. However, a critical gap remains in understanding how visual content shapes cognitive interpretations and elicits specific affective…

Artificial Intelligence · Computer Science 2026-04-28 Nastaran Dab , Raziyeh Zall , Mohammadreza Kangavari

Flow-like experiences at work are important for productivity and worker well-being. However, it is difficult to objectively detect when workers are experiencing flow in their work. In this paper, we investigate how to predict a worker's…

Human-Computer Interaction · Computer Science 2020-06-19 Matthew Lee

Facial expressions play a fundamental role in human communication. Indeed, they typically reveal the real emotional status of people beyond the spoken language. Moreover, the comprehension of human affect based on visual patterns is a key…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Fabio Valerio Massoli , Donato Cafarelli , Giuseppe Amato , Fabrizio Falchi

Due to the increasing nature of flexible work and the recent requirements from COVID-19 restrictions, workplaces are becoming more hybrid (i.e. allowing workers to work between traditional office spaces and elsewhere including from home).…

Computers and Society · Computer Science 2020-08-03 Mohammad Saiedur Rahaman , Shaw Kudo , Tim Rawling , Yongli Ren , Flora D. Salim

People often share news and information with their social connections, but why do some advertisements get shared more than others? A large-scale test examines whether facial responses predict sharing. Facial expressions play a key role in…

Computer Vision and Pattern Recognition · Computer Science 2019-12-24 Daniel McDuff , Jonah Berger