English
Related papers

Related papers: Towards an "In-the-Wild" Emotion Dataset Using a G…

200 papers

This paper pushes the envelope on decomposing camouflaged regions in an image into meaningful components, namely, camouflaged instances. To promote the new task of camouflaged instance segmentation of in-the-wild images, we introduce a…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Trung-Nghia Le , Yubo Cao , Tan-Cong Nguyen , Minh-Quan Le , Khanh-Duy Nguyen , Thanh-Toan Do , Minh-Triet Tran , Tam V. Nguyen

The aim of this research is development of rule based decision model for emotion recognition. This research also proposes using the rules for augmenting inter-corporal recognition accuracy in multimodal systems that use supervised learning…

Human-Computer Interaction · Computer Science 2016-07-12 Amol Patwardhan , Gerald Knapp

Big data contain rich information for machine learning algorithms to utilize when learning important features during classification tasks. Human beings express their emotion using certain words, speech (tone, pitch, speed) or facial…

Machine Learning · Computer Science 2024-07-02 Mazen Elabd , Sardar Jaf

Effective human-AI interaction relies on AI's ability to accurately perceive and interpret human emotions. Current benchmarks for vision and vision-language models are severely limited, offering a narrow emotional spectrum that overlooks…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Christoph Schuhmann , Robert Kaczmarczyk , Gollam Rabby , Felix Friedrich , Maurice Kraus , Krishna Kalyan , Kourosh Nadi , Huu Nguyen , Kristian Kersting , Sören Auer

The flow-based generative model is a deep learning generative model, which obtains the ability to generate data by explicitly learning the data distribution. Theoretically its ability to restore data is stronger than other generative…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Gao Xu , Yuanpeng Long , Siwei Liu , Lijia Yang , Shimei Xu , Xiaoming Yao , Kunxian Shu

This paper introduces a multi-label visual emotion analysis benchmark dataset for comprehensively evaluating the ability of multimodal large language models (MLLMs) to predict the emotions evoked by images. Recent user studies report an…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Tianwei Chen , Takuya Furusawa , Yuki Hirakawa , Ryotaro Shimizu , Mo Fan , Takashi Wada

Multimodal emotion recognition is an important research topic in artificial intelligence, whose main goal is to integrate multimodal clues to identify human emotional states. Current works generally assume accurate labels for benchmark…

Emotion recognition and understanding is a vital component in human-machine interaction. Dimensional models of affect such as those using valence and arousal have advantages over traditional categorical ones due to the complexity of…

Computer Vision and Pattern Recognition · Computer Science 2021-09-01 Vassilios Vonikakis , Dexter Neo , Stefan Winkler

Effective feature representations play a critical role in enhancing the performance of text generation models that rely on deep neural networks. However, current approaches suffer from several drawbacks, such as the inability to capture the…

Computation and Language · Computer Science 2024-02-27 Omama Hamad , Ali Hamdi , Khaled Shaban

Affective Behavior Analysis aims to develop emotionally intelligent technology that can recognize and respond to human emotions. To advance this field, the 7th Affective Behavior Analysis in-the-wild (ABAW) competition holds the Multi-Task…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Chen Liu , Wei Zhang , Feng Qiu , Lincheng Li , Xin Yu

We introduce ImageGem, a dataset for studying generative models that understand fine-grained individual preferences. We posit that a key challenge hindering the development of such a generative model is the lack of in-the-wild and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Yuanhe Guo , Linxi Xie , Zhuoran Chen , Kangrui Yu , Ryan Po , Guandao Yang , Gordon Wetztein , Hongyi Wen

Affective computing faces a major challenge: the lack of high-quality, diverse depth facial datasets for recognizing subtle emotional expressions. We propose a framework for synthetic depth face generation using an optimized GAN with…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Seyed Muhammad Hossein Mousavi , S. Younes Mirinezhad

Existing 3D facial emotion modeling have been constrained by limited emotion classes and insufficient datasets. This paper introduces "Emo3D", an extensive "Text-Image-Expression dataset" spanning a wide spectrum of human emotions, each…

Computer Vision and Pattern Recognition · Computer Science 2024-10-04 Mahshid Dehghani , Amirahmad Shafiee , Ali Shafiei , Neda Fallah , Farahmand Alizadeh , Mohammad Mehdi Gholinejad , Hamid Behroozi , Jafar Habibi , Ehsaneddin Asgari

Emotion recognition has become an important field of research in the human-computer interactions domain. The latest advancements in the field show that combining visual with audio information lead to better results if compared to the case…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Nicolae-Catalin Ristea , Liviu Cristian Dutu , Anamaria Radoi

Facial expression recognition (FER) is a crucial part of human-computer interaction. Existing FER methods achieve high accuracy and generalization based on different open-source deep models and training approaches. However, the performance…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Gianmarco Ipinze Tutuianu , Yang Liu , Ari Alamäki , Janne Kauttonen

Emotional understanding and generation are often treated as separate tasks, yet they are inherently complementary and can mutually enhance each other. In this paper, we propose the UniEmo, a unified framework that seamlessly integrates…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Yijie Zhu , Lingsen Zhang , Zitong Yu , Rui Shao , Tao Tan , Liqiang Nie

As we exceed upon the procedures for modelling the different aspects of behaviour, expression recognition has become a key field of research in Human Computer Interactions. Expression recognition in the wild is a very interesting problem…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-03 Sowmya Rasipuram , Junaid Hamid Bhat , Anutosh Maitra

Social chatbots have gained immense popularity, and their appeal lies not just in their capacity to respond to the diverse requests from users, but also in the ability to develop an emotional connection with users. To further develop and…

Computation and Language · Computer Science 2022-06-01 Avinash Madasu , Mauajama Firdaus , Asif Eqbal

The furnishing of multi-modal large language models (MLLMs) has led to the emergence of numerous benchmark studies, particularly those evaluating their perception and understanding capabilities. Among these, understanding image-evoked…

Multimedia · Computer Science 2025-09-18 Lancheng Gao , Ziheng Jia , Yunhao Zeng , Wei Sun , Yiming Zhang , Wei Zhou , Guangtao Zhai , Xiongkuo Min

To enhance the performance of affective models and reduce the cost of acquiring physiological signals for real-world applications, we adopt multimodal deep learning approach to construct affective models from multiple physiological signals.…

Human-Computer Interaction · Computer Science 2016-02-29 Wei Liu , Wei-Long Zheng , Bao-Liang Lu