English
Related papers

Related papers: A Unified and Interpretable Emotion Representation…

200 papers

Recent large language models (LLMs) have made great progress in the field of text-to-speech (TTS), but they still face major challenges in synthesizing fine-grained emotional speech in an interpretable manner. Traditional methods rely on…

Machine Learning · Computer Science 2025-09-26 Jiaxuan Liu , Yang Xiang , Han Zhao , Xiangang Li , Yingying Gao , Shilei Zhang , Zhenhua Ling

With the advent of deep learning, expression recognition has made significant advancements. However, due to the limited availability of annotated compound expression datasets and the subtle variations of compound expressions, Compound…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Chen Liu , Feng Qiu , Wei Zhang , Lincheng Li , Dadong Wang , Xin Yu

This paper introduces a novel method for generating artistic images that express particular affective states. Leveraging state-of-the-art deep learning methods for visual generation (through generative adversarial networks), semantic models…

Computer Vision and Pattern Recognition · Computer Science 2021-10-01 Theodoros Galanos , Antonios Liapis , Georgios N. Yannakakis

Robust cross-subject emotion recognition from multimodal physiological signals remains a challenging problem, primarily due to modality heterogeneity and inter-subject distribution shift. To tackle these challenges, we propose a novel…

Multimedia · Computer Science 2026-01-30 Jiahao Tang , Youjun Li , Yangxuan Zheng , Xiangting Fan , Siyuan Lu , Nuo Zhang , Zi-Gang Huang

Negative emotions are linked to the onset of neurodegenerative diseases and dementia, yet they are often difficult to detect through observation. Physiological signals from wearable devices offer a promising noninvasive method for…

Human-Computer Interaction · Computer Science 2025-10-28 Muhammad Irfan , Anum Nawaz , Ayse Kosal Bulbul , Riku Klen , Abdulhamit Subasi , Tomi Westerlund , Wei Chen

A fundamental challenge in affective cognitive science is to develop models that accurately capture the relationship between external emotional stimuli and human internal experiences. While ANNs have demonstrated remarkable accuracy in…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Haotian Deng , Chi Zhang , Chen Wei , Quanying Liu

Multimodal emotion understanding requires effective integration of text, audio, and visual modalities for both discrete emotion recognition and continuous sentiment analysis. We present EGMF, a unified framework combining expert-guided…

Computation and Language · Computer Science 2026-01-13 Jiaqi Qiao , Xiujuan Xu , Xinran Li , Yu Liu

Large Language Models primarily operate through text-based inputs and outputs, yet human emotion is communicated through both verbal and non-verbal cues, including facial expressions. While Vision-Language Models analyze facial expressions…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Vaibhav Mehra , Guy Laban , Hatice Gunes

Estimating dimensional emotions, such as activation, valence and dominance, from acoustic speech signals has been widely explored over the past few years. While accurate estimation of activation and dominance from speech seem to be…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-08 Vikramjit Mitra , Hsiang-Yun Sherry Chien , Vasudha Kowtha , Joseph Yitan Cheng , Erdrin Azemi

There is a growing need for sparse representational formats of human affective states that can be utilized in scenarios with limited computational memory resources. We explore whether representing neural data, in response to emotional…

Continuous affect prediction in the wild is a very interesting problem and is challenging as continuous prediction involves heavy computation. This paper presents the methodologies and techniques used in our contribution to predict…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-02 Sowmya Rasipuram , Junaid Hamid Bhat , Anutosh Maitra

Facial valence/arousal, expression and action unit are related tasks in facial affective analysis. However, the tasks only have limited performance in the wild due to the various collected conditions. The 4th competition on affective…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Yanan Chang , Yi Wu , Xiangyu Miao , Jiahe Wang , Shangfei Wang

Recently, emotional talking face generation has received considerable attention. However, existing methods only adopt one-hot coding, image, or audio as emotion conditions, thus lacking flexible control in practical applications and failing…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Chao Xu , Junwei Zhu , Jiangning Zhang , Yue Han , Wenqing Chu , Ying Tai , Chengjie Wang , Zhifeng Xie , Yong Liu

Understanding emotions in natural language is inherently a multi-dimensional reasoning problem, where multiple affective signals interact through context, interpersonal relations, and situational cues. However, most existing emotion…

Computation and Language · Computer Science 2026-04-02 Hemanth Kotaprolu , Kishan Maharaj , Raey Zhao , Abhijit Mishra , Pushpak Bhattacharyya

Dynamic facial expression recognition (FER) databases provide important data support for affective computing and applications. However, most FER databases are annotated with several basic mutually exclusive emotional categories and contain…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Yuanyuan Liu , Wei Dai , Chuanxu Feng , Wenbin Wang , Guanghao Yin , Jiabei Zeng , Shiguang Shan

Emotion recognition in real-world environments is hindered by partial occlusions, missing modalities, and severe class imbalance. To address these issues, particularly for the Affective Behavior Analysis in-the-wild (ABAW) Expression…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Jun Yu , Naixiang Zheng , Guoyuan Wang , Yunxiang Zhang , Lingsi Zhu , Jiaen Liang , Wei Huang , Shengping Liu

Emotions are best way of communicating information; and sometimes it carry more information than words. Recently, there has been a huge interest in automatic recognition of human emotion because of its wide spread application in security,…

Computer Vision and Pattern Recognition · Computer Science 2013-12-05 Nikunj Bajaj , Aurobinda Routray , S L Happy

Explainable AI (XAI) research has traditionally focused on rational users, aiming to improve understanding and reduce cognitive biases. However, emotional factors play a critical role in how explanations are perceived and processed. Prior…

Human-Computer Interaction · Computer Science 2025-05-22 Christian Schütze , Birte Richter , Britta Wrede

We present an approach utilizing Topological Data Analysis to study the structure of face poses used in affective computing, i.e., the process of recognizing human emotion. The approach uses a conditional comparison of different emotions,…

Human-Computer Interaction · Computer Science 2021-08-04 Hamza Elhamdadi , Shaun Canavan , Paul Rosen

Emotion recognition is a complex task due to the inherent subjectivity in both the perception and production of emotions. The subjectivity of emotions poses significant challenges in developing accurate and robust computational models. This…

Machine Learning · Computer Science 2023-09-08 Mimansa Jaiswal