English
Related papers

Related papers: CHEER-Ekman: Fine-grained Embodied Emotion Classif…

200 papers

In our everyday lives and social interactions we often try to perceive the emotional states of people. There has been a lot of research in providing machines with a similar capacity of recognizing emotions. From a computer vision…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Ronak Kosti , Jose M. Alvarez , Adria Recasens , Agata Lapedriza

Understanding the multi-dimensional attributes and intensity nuances of image-evoked emotions is pivotal for advancing machine empathy and empowering diverse human-computer interaction applications. However, existing models are still…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Lancheng Gao , Ziheng Jia , Zixuan Xing , Wei Sun , Huiyu Duan , Guangtao Zhai , Xiongkuo Min

Humans are emotional creatures. Multiple modalities are often involved when we express emotions, whether we do so explicitly (e.g., facial expression, speech) or implicitly (e.g., text, image). Enabling machines to have emotional…

Signal Processing · Electrical Eng. & Systems 2021-11-10 Sicheng Zhao , Guoli Jia , Jufeng Yang , Guiguang Ding , Kurt Keutzer

Emotion Recognition in Conversations (ERC) is a key step towards successful human-machine interaction. While the field has seen tremendous advancement in the last few years, new applications and implementation scenarios present novel…

Computation and Language · Computer Science 2024-10-22 Patrícia Pereira , Helena Moniz , Joao Paulo Carvalho

Emotion recognition in conversations (ERC) focuses on identifying emotion shifts within interactions, representing a significant step toward advancing machine intelligence. However, ERC data remains scarce, and existing datasets face…

Artificial Intelligence · Computer Science 2025-08-08 Burak Can Kaplan , Hugo Cesar De Castro Carneiro , Stefan Wermter

The furnishing of multi-modal large language models (MLLMs) has led to the emergence of numerous benchmark studies, particularly those evaluating their perception and understanding capabilities. Among these, understanding image-evoked…

Multimedia · Computer Science 2025-09-18 Lancheng Gao , Ziheng Jia , Yunhao Zeng , Wei Sun , Yiming Zhang , Wei Zhou , Guangtao Zhai , Xiongkuo Min

Effective human-AI interaction relies on AI's ability to accurately perceive and interpret human emotions. Current benchmarks for vision and vision-language models are severely limited, offering a narrow emotional spectrum that overlooks…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Christoph Schuhmann , Robert Kaczmarczyk , Gollam Rabby , Felix Friedrich , Maurice Kraus , Krishna Kalyan , Kourosh Nadi , Huu Nguyen , Kristian Kersting , Sören Auer

Emotion-Cause analysis has attracted the attention of researchers in recent years. However, most existing datasets are limited in size and number of emotion categories. They often focus on extracting parts of the document that contain the…

Computation and Language · Computer Science 2024-08-09 Mia Huong Nguyen , Yasith Samaradivakara , Prasanth Sasikumar , Chitralekha Gupta , Suranga Nanayakkara

The embodiment of emotional reactions from body parts contains rich information about our affective experiences. We propose a framework that utilizes state-of-the-art large vision-language models (LVLMs) to generate Embodied LVLM Emotion…

Computation and Language · Computer Science 2025-09-25 Mohammad Saim , Phan Anh Duong , Cat Luong , Aniket Bhanderi , Tianyu Jiang

Classification of human emotions remains an important and challenging task for many computer vision algorithms, especially in the era of humanoid robots which coexist with humans in their everyday life. Currently proposed methods for…

Computer Vision and Pattern Recognition · Computer Science 2018-10-26 Ivona Tautkute , Tomasz Trzcinski

Emotion recognition plays a pivotal role in enhancing human-computer interaction, particularly in movie recommendation systems where understanding emotional content is essential. While multimodal approaches combining audio and video have…

Sound · Computer Science 2025-11-25 Xiangrui Xiong , Zhou Zhou , Guocai Nong , Junlin Deng , Ning Wu

This paper proposes a process for a classification model for the facial expressions. The proposed process would aid in specific categorisation of children's emotions from 2 emotions namely 'Happy' and 'Sad'. Since the existing emotion…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Sanchayan Vivekananthan

Emotions are reactions that can be expressed through a variety of social signals. For example, anger can be expressed through a scowl, narrowed eyes, a long stare, or many other expressions. This complexity is problematic when attempting to…

Robotics · Computer Science 2021-03-09 Ghazal Saheb Jam , Jimin Rhim , Angelica Lim

Multimodal emotion understanding requires effective integration of text, audio, and visual modalities for both discrete emotion recognition and continuous sentiment analysis. We present EGMF, a unified framework combining expert-guided…

Computation and Language · Computer Science 2026-01-13 Jiaqi Qiao , Xiujuan Xu , Xinran Li , Yu Liu

There is an increasing consensus among re- searchers that making a computer emotionally intelligent with the ability to decode human affective states would allow a more meaningful and natural way of human-computer interactions (HCIs). One…

Human-Computer Interaction · Computer Science 2016-06-02 Maria S. Perez-Rosero , Behnaz Rezaei , Murat Akcakaya , Sarah Ostadabbas

The Complex Emotion Recognition System (CERS) deciphers complex emotional states by examining combinations of basic emotions expressed, their interconnections, and the dynamic variations. Through the utilization of advanced algorithms, CERS…

Signal Processing · Electrical Eng. & Systems 2024-09-13 Javad Hassannataj Joloudari , Mohammad Maftoun , Bahareh Nakisa , Roohallah Alizadehsani , Meisam Yadollahzadeh-Tabari

Human emotions are inherently ambiguous and impure. When designing systems to anticipate human emotions based on speech, the lack of emotional purity must be considered. However, most of the current methods for speech emotion classification…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-13 Shuiyang Mao , P. C. Ching , Tan Lee

Emotion Recognition in Conversation (ERC) is critical for enabling natural human-machine interactions. However, existing methods predominantly employ categorical or dimensional emotion annotations, which often fail to adequately represent…

Computation and Language · Computer Science 2026-03-10 Yoshiki Tanaka , Ryuichi Uehara , Koji Inoue , Michimasa Inaba

The ability of an intelligent environment to connect and adapt to real internal sates, needs and behaviors' meaning of humans can be made possible by considering users' emotional states as contextual parameters. In this paper, we build on…

Human-Computer Interaction · Computer Science 2009-12-10 Nevin Vunka Jungum , Eric Laurent

Automatic emotion recognition in conversation (ERC) is crucial for emotion-aware conversational artificial intelligence. This paper proposes a distribution-based framework that formulates ERC as a sequence-to-sequence problem for emotion…

Computation and Language · Computer Science 2024-04-02 Wen Wu , Chao Zhang , Philip C. Woodland