English
Related papers

Related papers: Recent Advances in Multimodal Affective Computing:…

200 papers

Traditional psychological evaluations rely heavily on human observation and interpretation, which are prone to subjectivity, bias, fatigue, and inconsistency. To address these limitations, this work presents a multimodal emotion recognition…

Human-Computer Interaction · Computer Science 2024-12-25 Kris Kraack

The field of affective computing has seen significant advancements in exploring the relationship between emotions and emerging technologies. This paper presents a novel and valuable contribution to this field with the introduction of a…

Artificial Intelligence · Computer Science 2025-01-15 Nessrine Farhat , Amine Bohi , Leila Ben Letaifa , Rim Slama

MER2025 is the third year of our MER series of challenges, aiming to bring together researchers in the affective computing community to explore emerging trends and future directions in the field. Previously, MER2023 focused on multi-label…

Multimodal speech emotion recognition (SER) has emerged as pivotal for improving human-machine interaction. Researchers are increasingly leveraging both speech and textual information obtained through automatic speech recognition (ASR) to…

Human-Computer Interaction · Computer Science 2025-09-24 Jiajun He , Xiaohan Shi , Cheng-Hung Hu , Jinyi Mi , Xingfeng Li , Tomoki Toda

Affective Computing (AC) integrates computer science, psychology, and cognitive science to enable machines to recognize, interpret, and simulate human emotions across domains such as social media, finance, healthcare, and education. AC…

Computation and Language · Computer Science 2025-09-09 Yiqun Zhang , Xiaocui Yang , Xingle Xu , Zeran Gao , Yijie Huang , Shiyi Mu , Shi Feng , Daling Wang , Yifei Zhang , Kaisong Song , Ge Yu

Multi-modal large language models (MLLMs) have achieved remarkable performance on objective multimodal perception tasks, but their ability to interpret subjective, emotionally nuanced multimodal content remains largely unexplored. Thus, it…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Qu Yang , Mang Ye , Bo Du

Emotion recognition is a core research area at the intersection of artificial intelligence and human communication analysis. It is a significant technical challenge since humans display their emotions through complex idiosyncratic…

Human-Computer Interaction · Computer Science 2018-09-14 Paul Pu Liang , Amir Zadeh , Louis-Philippe Morency

Aspect-based sentiment analysis (ABSA) aims at analyzing the sentiment of a given aspect in a sentence. Recently, neural network-based methods have achieved promising results in existing ABSA datasets. However, these datasets tend to…

Computation and Language · Computer Science 2020-11-03 Zhen Wu , Chengcan Ying , Xinyu Dai , Shujian Huang , Jiajun Chen

Multimodal emotion recognition (MER), leveraging speech and text, has emerged as a pivotal domain within human-computer interaction, demanding sophisticated methods for effective multimodal integration. The challenge of aligning features…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-31 Xuechen Wang , Shiwan Zhao , Haoqin Sun , Hui Wang , Jiaming Zhou , Yong Qin

With the rapid advancements in multimodal generative technology, Affective Computing research has provoked discussion about the potential consequences of AI systems equipped with emotional intelligence. Affective Computing involves the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Shreya Ghosh , Zhixi Cai , Abhinav Dhall , Dimitrios Kollias , Roland Goecke , Tom Gedeon

Understanding human emotions from multimodal signals poses a significant challenge in affective computing and human-robot interaction. While multimodal large language models (MLLMs) have excelled in general vision-language tasks, their…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Xiaojiang Peng , Jingyi Chen , Zebang Cheng , Bao Peng , Fengyi Wu , Yifei Dong , Shuyuan Tu , Qiyu Hu , Huiting Huang , Yuxiang Lin , Jun-Yan He , Kai Wang , Zheng Lian , Zhi-Qi Cheng

Affective judgment in real interaction is rarely a purely local prediction problem. Emotional meaning often depends on prior trajectory, accumulated context, and multimodal evidence that may be weak, noisy, or incomplete at the current…

Artificial Intelligence · Computer Science 2026-03-25 Deliang Wen , Ke Sun , Yu Wang

Emotion recognition is a topic of significant interest in assistive robotics due to the need to equip robots with the ability to comprehend human behavior, facilitating their effective interaction in our society. Consequently, efficient and…

Human-Computer Interaction · Computer Science 2023-12-05 Rutherford Agbeshi Patamia , Paulo E. Santos , Kingsley Nketia Acheampong , Favour Ekong , Kwabena Sarpong , She Kun

Multimodal aspect-based sentiment analysis (MABSA) aims to identify aspect-level sentiments by jointly modeling textual and visual information, which is essential for fine-grained opinion understanding in social media. Existing approaches…

Computation and Language · Computer Science 2026-01-13 Zhongzheng Wang , Yuanhe Tian , Hongzhi Wang , Yan Song

Facial affective behavior analysis (FABA) is crucial for understanding human mental states from images. However, traditional approaches primarily deploy models to discriminate among discrete emotion categories, and lack the fine granularity…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Yifan Li , Anh Dao , Wentao Bao , Zhen Tan , Tianlong Chen , Huan Liu , Yu Kong

Sentiment Analysis and Emotion Detection in conversation is key in several real-world applications, with an increase in modalities available aiding a better understanding of the underlying emotions. Multi-modal Emotion Detection and…

Computation and Language · Computer Science 2020-08-04 Aman Shenoy , Ashish Sardana

Understanding sentiment in multimodal conversations is a complex yet crucial challenge toward building emotionally intelligent AI systems. The Multimodal Conversational Aspect-based Sentiment Analysis (MCABSA) Challenge invited participants…

Computation and Language · Computer Science 2025-12-30 Zhiqiang Gao , Shihao Gao , Zixing Zhang , Yihao Guo , Hongyu Chen , Jing Han

In the past, several models of consciousness have become popular and have led to the development of models for machine consciousness with varying degrees of success and challenges for simulation and implementations. Moreover, affective…

Artificial Intelligence · Computer Science 2017-01-03 Rohitash Chandra

Emotions play a crucial role in human behavior and decision-making, making emotion recognition a key area of interest in human-computer interaction (HCI). This study addresses the challenges of emotion recognition by integrating facial…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Zaitian Wang , Jian He , Yu Liang , Xiyuan Hu , Tianhao Peng , Kaixin Wang , Jiakai Wang , Chenlong Zhang , Weili Zhang , Shuang Niu , Xiaoyang Xie

Technological advancement and its omnipresent connection have pushed humans past the boundaries and limitations of a computer screen, physical state, or geographical location. It has provided a depth of avenues that facilitate…

Multimedia · Computer Science 2023-11-21 Dayo Samuel Banjo , Connice Trimmingham , Niloofar Yousefi , Nitin Agarwal