English
Related papers

Related papers: Affective Computing for Large-Scale Heterogeneous …

200 papers

With the rapid development of Internet and multimedia services in the past decade, a huge amount of user-generated and service provider-generated multimedia data become available. These data are heterogeneous and multi-modal in nature,…

Multimedia · Computer Science 2020-01-07 Wenwu Zhu , Xin Wang , Hongzhi Li

Affective Computing is a rapidly growing field spurred by advancements in artificial intelligence, but often, held back by the inability to translate psychological theories of emotion into tractable computational models. To address this, we…

Artificial Intelligence · Computer Science 2020-08-03 Desmond C. Ong , Harold Soh , Jamil Zaki , Noah D. Goodman

Artificial intelligence and machine learning systems have demonstrated huge improvements and human-level parity in a range of activities, including speech recognition, face recognition and speaker verification. However, these diverse tasks…

Human-Computer Interaction · Computer Science 2019-09-04 Vidhyasaharan Sethu , Emily Mower Provost , Julien Epps , Carlos Busso , Nicholas Cummins , Shrikanth Narayanan

Recent advances in neurosciences and psychology have provided evidence that affective phenomena pervade intelligence at many levels, being inseparable from the cognitionaction loop. Perception, attention, memory, learning, decisionmaking,…

Artificial Intelligence · Computer Science 2008-09-30 Luis Paulo Reis , Daria Barteneva , Nuno Lau

Multimedia documents such as text, images, sounds or videos elicit emotional responses of different polarity and intensity in exposed human subjects. These stimuli are stored in affective multimedia databases. The problem of emotion…

Human-Computer Interaction · Computer Science 2017-07-03 Marko Horvat , Davor Kukolja , Dragutin Ivanec

Affect (emotion) recognition has gained significant attention from researchers in the past decade. Emotion-aware computer systems and devices have many applications ranging from interactive robots, intelligent online tutor to emotion based…

Human-Computer Interaction · Computer Science 2016-07-12 Amol Patwardhan , Gerald Knapp

In our multicultural world, affect-aware AI systems that support humans need the ability to perceive affect across variations in emotion expression patterns across cultures. These systems must perform well in cultural contexts without…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Leena Mathur , Ralph Adolphs , Maja J Matarić

In the field of affective computing, where research continually advances at a rapid pace, the demand for user-friendly tools has become increasingly apparent. In this paper, we present the AffectToolbox, a novel software system that aims to…

Human-Computer Interaction · Computer Science 2024-02-26 Silvan Mertes , Dominik Schiller , Michael Dietz , Elisabeth André , Florian Lingenfelser

Emotion recognition in conversations is challenging due to the multi-modal nature of the emotion expression. We propose a hierarchical cross-attention model (HCAM) approach to multi-modal emotion recognition using a combination of recurrent…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-10 Soumya Dutta , Sriram Ganapathy

Humans are emotional creatures. Multiple modalities are often involved when we express emotions, whether we do so explicitly (e.g., facial expression, speech) or implicitly (e.g., text, image). Enabling machines to have emotional…

Signal Processing · Electrical Eng. & Systems 2021-11-10 Sicheng Zhao , Guoli Jia , Jufeng Yang , Guiguang Ding , Kurt Keutzer

Advertisements (ads) often contain strong affective content to capture viewer attention and convey an effective message to the audience. However, most computational affect recognition (AR) approaches examine ads via the text modality, and…

Human-Computer Interaction · Computer Science 2019-06-04 Abhinav Shukla , Shruti Shriya Gullapuram , Harish Katti , Mohan Kankanhalli , Stefan Winkler , Ramanathan Subramanian

Machine learning is frequently used in affective computing, but presents challenges due the opacity of state-of-the-art machine learning methods. Because of the impact affective machine learning systems may have on an individual's life, it…

Machine Learning · Computer Science 2025-10-07 David S. Johnson , Olya Hakobyan , Hanna Drimalla

Image emotion classification (IEC) is a longstanding research field that has received increasing attention with the rapid progress of deep learning. Although recent advances have leveraged the knowledge encoded in pre-trained visual models,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Zibo Zhou , Zhengjun Zhai , Huimin Chen , Wei Dai , Hansen Yang

Emotion recognition is a fundamental component of next-generation human-computer interaction (HCI), enabling machines to perceive, understand, and respond to users' affective states. However, existing systems often rely on single-modality…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Ziwen Zhong , Zhitao Shu , Yue Zhao

Real-world application requires affect perception models to be sensitive to individual differences in expression. As each user is different and expresses differently, these models need to personalise towards each individual to adequately…

Computer Vision and Pattern Recognition · Computer Science 2020-11-13 Nikhil Churamani

In the domain of human-computer interaction, accurately recognizing and interpreting human emotions is crucial yet challenging due to the complexity and subtlety of emotional expressions. This study explores the potential for detecting a…

Multimedia · Computer Science 2025-05-13 Jiehui Jia , Huan Zhang , Jinhua Liang

Emotion recognition has received considerable attention from the Computer Vision community in the last 20 years. However, most of the research focused on analyzing the six basic emotions (e.g. joy, anger, surprise), with a limited work…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Mina Bishay , Jay Turcot , Graham Page , Mohammad Mavadati

Affective computing has made significant strides in emotion recognition and generation, yet current approaches mainly focus on short-term pattern recognition and lack a comprehensive framework to guide affective agents toward long-term…

Human-Computer Interaction · Computer Science 2025-02-26 Bin Yin , Chong-Yi Liu , Liya Fu , Jinkun Zhang

Multimodal affective computing analyzes user-generated social media content to predict emotional states. However, a critical gap remains in understanding how visual content shapes cognitive interpretations and elicits specific affective…

Artificial Intelligence · Computer Science 2026-04-28 Nastaran Dab , Raziyeh Zall , Mohammadreza Kangavari

Understanding emotional signals in older adults is crucial for designing virtual assistants that support their well-being. However, existing affective computing models often face significant limitations: (1) limited availability of datasets…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Josep Lopez Camunas , Cristina Bustos , Yanjun Zhu , Raquel Ros , Agata Lapedriza