English
Related papers

Related papers: MEMO-Bench: A Multiple Benchmark for Text-to-Image…

200 papers

Sentiment and emotion understanding are essential to applications such as human-computer interaction and depression detection. While Multimodal Large Language Models (MLLMs) demonstrate robust general capabilities, they face considerable…

Computation and Language · Computer Science 2025-07-08 Ao Li , Longwei Xu , Chen Ling , Jinghui Zhang , Pengwei Wang

Multimodal Affective Computing (MAC) aims to recognize and interpret human emotions by integrating information from diverse modalities such as text, video, and audio. Recent advancements in Multimodal Large Language Models (MLLMs) have…

Artificial Intelligence · Computer Science 2025-08-05 Miaosen Luo , Jiesen Long , Zequn Li , Yunying Yang , Yuncheng Jiang , Sijie Mai

The human-level performance of Large Language Models (LLMs) across various tasks has raised expectations for the potential of Artificial Intelligence (AI) to possess emotions someday. To explore the capability of current LLMs to express…

Artificial Intelligence · Computer Science 2025-04-23 Shin-nosuke Ishikawa , Atsushi Yoshino

Most existing emotion analysis emphasizes which emotion arises (e.g., happy, sad, angry) but neglects the deeper why. We propose Emotion Interpretation (EI), focusing on causal factors-whether explicit (e.g., observable objects,…

Artificial Intelligence · Computer Science 2025-04-18 Yuxiang Lin , Jingdong Sun , Zhi-Qi Cheng , Jue Wang , Haomin Liang , Zebang Cheng , Yifei Dong , Jun-Yan He , Xiaojiang Peng , Xian-Sheng Hua

Understanding the multi-dimensional attributes and intensity nuances of image-evoked emotions is pivotal for advancing machine empathy and empowering diverse human-computer interaction applications. However, existing models are still…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Lancheng Gao , Ziheng Jia , Zixuan Xing , Wei Sun , Huiyu Duan , Guangtao Zhai , Xiongkuo Min

Understanding how emotional expression in language relates to brain function is a challenge in computational neuroscience and affective computing. Traditional neuroimaging is costly and lab-bound, but abundant digital text offers new…

Computation and Language · Computer Science 2025-12-23 Gideon Vos , Maryam Ebrahimpour , Liza van Eijk , Zoltan Sarnyai , Mostafa Rahimi Azghadi

Humans no doubt use language to communicate about their emotional experiences, but does language in turn help humans understand emotions, or is language just a vehicle of communication? This study used a form of artificial intelligence (AI)…

Artificial Intelligence · Computer Science 2024-11-19 Ming Li , Yusheng Su , Hsiu-Yuan Huang , Jiali Cheng , Xin Hu , Xinmiao Zhang , Huadong Wang , Yujia Qin , Xiaozhi Wang , Kristen A. Lindquist , Zhiyuan Liu , Dan Zhang

The advancing fluency of LLMs raises important questions about their ability to emulate complex human traits, including emotional expression and personality, across diverse linguistic and cultural contexts. This study investigates whether…

Computation and Language · Computer Science 2026-03-25 Nasser A Alsadhan

Multimodal large language models (MLLMs) have shown remarkable progress in high-level semantic tasks such as visual question answering, image captioning, and emotion recognition. However, despite advancements, there remains a lack of…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Shezheng Song , Chengxiang He , Shan Zhao , Chengyu Wang , Qian Wan , Tianwei Yan , Meng Wang

While Multimodal Large Language Models (MLLMs) are adept at answering what is in an image-identifying objects and describing scenes-they often lack the ability to understand how an image feels to a human observer. This gap is most evident…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Yiming Chen , Junlin Han , Tianyi Bai , Shengbang Tong , Filippos Kokkinos , Philip Torr

Effective human-AI interaction relies on AI's ability to accurately perceive and interpret human emotions. Current benchmarks for vision and vision-language models are severely limited, offering a narrow emotional spectrum that overlooks…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Christoph Schuhmann , Robert Kaczmarczyk , Gollam Rabby , Felix Friedrich , Maurice Kraus , Krishna Kalyan , Kourosh Nadi , Huu Nguyen , Kristian Kersting , Sören Auer

Evaluating Large Language Models' (LLMs) anthropomorphic capabilities has become increasingly important in contemporary discourse. Utilizing the emotion appraisal theory from psychology, we propose to evaluate the empathy ability of LLMs,…

Computation and Language · Computer Science 2024-10-08 Jen-tse Huang , Man Ho Lam , Eric John Li , Shujie Ren , Wenxuan Wang , Wenxiang Jiao , Zhaopeng Tu , Michael R. Lyu

Recent multimodal large language models (MLLMs) have shown strong capabilities in perception, reasoning, and generation, and are increasingly used in applications such as social robots and human-computer interaction, where understanding…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 He Hu , Tengjin Weng , Zebang Cheng , Yu Wang , Jiachen Luo , Björn Schuller , Zheng Lian , Laizhong Cui

Affective computing stands at the forefront of artificial intelligence (AI), seeking to imbue machines with the ability to comprehend and respond to human emotions. Central to this field is emotion recognition, which endeavors to identify…

Machine Learning · Computer Science 2024-07-08 Fei Ma , Yucheng Yuan , Yifan Xie , Hongwei Ren , Ivan Liu , Ying He , Fuji Ren , Fei Richard Yu , Shiguang Ni

Emojis have become ubiquitous in online communication, serving as a universal medium to convey emotions and decorative elements. Their widespread use transcends language and cultural barriers, enhancing understanding and fostering more…

Computation and Language · Computer Science 2024-12-24 Rafid Ishrak Jahan , Heng Fan , Haihua Chen , Yunhe Feng

Understanding human emotions from multimodal signals poses a significant challenge in affective computing and human-robot interaction. While multimodal large language models (MLLMs) have excelled in general vision-language tasks, their…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Xiaojiang Peng , Jingyi Chen , Zebang Cheng , Bao Peng , Fengyi Wu , Yifei Dong , Shuyuan Tu , Qiyu Hu , Huiting Huang , Yuxiang Lin , Jun-Yan He , Kai Wang , Zheng Lian , Zhi-Qi Cheng

The goal of achieving Artificial General Intelligence (AGI) is to imitate humans and surpass them. Models such as OpenAI's o1, o3, and DeepSeek's R1 have demonstrated that large language models (LLMs) with human-like reasoning capabilities…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Yansheng Qiu , Li Xiao , Zhaopan Xu , Pengfei Zhou , Zheng Wang , Kaipeng Zhang

Large language models (LLMs) have made significant progress in Emotional Intelligence (EI) and long-context modeling. However, existing benchmarks often overlook the fact that emotional information processing unfolds as a continuous…

Computation and Language · Computer Science 2026-01-13 Weichu Liu , Jing Xiong , Yuxuan Hu , Zixuan Li , Minghuan Tan , Ningning Mao , Hui Shen , Wendong Xu , Chaofan Tao , Min Yang , Chengming Li , Lingpeng Kong , Ngai Wong

With the rapid development of Multimodal Large Language Models (MLLMs), their potential in Micro-Action understanding, a vital role in human emotion analysis, remains unexplored due to the absence of specialized benchmarks. To tackle this…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Kun Li , Jihao Gu , Fei Wang , Zhiliang Wu , Hehe Fan , Dan Guo

The rapid evolution of Multimodal Large Language Models (MLLMs) has brought substantial advancements in artificial intelligence, significantly enhancing the capability to understand and generate multimodal content. While prior studies have…

Artificial Intelligence · Computer Science 2024-09-30 Lin Li , Guikun Chen , Hanrong Shi , Jun Xiao , Long Chen