English
Related papers

Related papers: EmotionQueen: A Benchmark for Evaluating Empathy o…

200 papers

Multimodal emotion recognition is an important research topic in artificial intelligence, whose main goal is to integrate multimodal clues to identify human emotional states. Current works generally assume accurate labels for benchmark…

As Large Language Models (LLMs) continue to evolve, evaluating them remains a persistent challenge. Many recent evaluations use LLMs as judges to score outputs from other LLMs, often relying on a single large model like GPT-4o. However,…

Computation and Language · Computer Science 2025-03-20 Justin Zhao , Flor Miriam Plaza-del-Arco , Benjamin Genchel , Amanda Cercas Curry

While Large Language Models (LLMs) have achieved remarkable success in cognitive and reasoning benchmarks, they exhibit a persistent deficit in anthropomorphic intelligence-the capacity to navigate complex social, emotional, and ethical…

Computation and Language · Computer Science 2025-12-29 Jiaxin Liu , Peiyi Tu , Wenyu Chen , Yihong Zhuang , Xinxia Ling , Anji Zhou , Chenxi Wang , Zhuo Han , Zhengkai Yang , Junbo Zhao , Zenan Huang , Yuanyuan Wang

The performance of speech emotion recognition (SER) is limited by the insufficient emotion information in unimodal systems and the feature alignment difficulties in multimodal systems. Recently, multimodal large language models (MLLMs) have…

Sound · Computer Science 2025-09-22 Yiqing Yang , Man-Wai Mak

Emotions play a critical role in our everyday lives by altering how we perceive, process and respond to our environment. Affective computing aims to instill in computers the ability to detect and act on the emotions of human actors. A core…

Computation and Language · Computer Science 2020-08-31 Connor T. Heaton , David M. Schwartz

This paper delves into enhancing the classification performance on the GoEmotions dataset, a large, manually annotated dataset for emotion detection in text. The primary goal of this paper is to address the challenges of detecting subtle…

Computation and Language · Computer Science 2024-04-10 Kaipeng Wang , Zhi Jing , Yongye Su , Yikun Han

Since the advent of ChatGPT, Large Language Models (LLMs) have excelled in various tasks but remain as black-box systems. Understanding the reasoning bottlenecks of LLMs has become a critical challenge, as these limitations are deeply tied…

Computation and Language · Computer Science 2024-12-24 Zifan Zheng , Yezhaohui Wang , Yuxin Huang , Shichao Song , Mingchuan Yang , Bo Tang , Feiyu Xiong , Zhiyu Li

Large Language Models (LLMs) are widely used for writing economic analysis reports or providing financial advice, but their ability to understand economic knowledge and reason about potential results of specific economic events lacks…

Computation and Language · Computer Science 2024-07-02 Yue Guo , Yi Yang

Emotion recognition in social situations is a complex task that requires integrating information from both facial expressions and the situational context. While traditional approaches to automatic emotion recognition have focused on…

Human-Computer Interaction · Computer Science 2024-08-05 Bin Han , Cleo Yau , Su Lei , Jonathan Gratch

Large language models (LLMs) are increasingly applied to socially grounded tasks, such as online community moderation, media content analysis, and social reasoning games. Success in these contexts depends on a model's social reasoning…

This article provides the first survey of computational models of emotion in reinforcement learning (RL) agents. The survey focuses on agent/robot emotions, and mostly ignores human user emotions. Emotions are recognized as functional in…

Machine Learning · Computer Science 2017-11-30 Thomas M. Moerland , Joost Broekens , Catholijn M. Jonker

In this work, we conduct an analysis to examine the consistency of Large Language Models (LLMs) with respect to their own generated responses in an emotionally-driven conversational context. Specifically, the text generated by LLM is framed…

Computation and Language · Computer Science 2026-05-08 Sneha Oram , Ojaswita Bhushan , Pushpak Bhattacharyya

Multimodal large language models (MLLMs) are designed to process and integrate information from multiple sources, such as text, speech, images, and videos. Despite its success in language understanding, it is critical to evaluate the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Hao Lu , Xuesong Niu , Jiyao Wang , Yin Wang , Qingyong Hu , Jiaqi Tang , Yuting Zhang , Kaishen Yuan , Bin Huang , Zitong Yu , Dengbo He , Shuiguang Deng , Hao Chen , Yingcong Chen , Shiguang Shan

Understanding human emotions from multimodal signals poses a significant challenge in affective computing and human-robot interaction. While multimodal large language models (MLLMs) have excelled in general vision-language tasks, their…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Xiaojiang Peng , Jingyi Chen , Zebang Cheng , Bao Peng , Fengyi Wu , Yifei Dong , Shuyuan Tu , Qiyu Hu , Huiting Huang , Yuxiang Lin , Jun-Yan He , Kai Wang , Zheng Lian , Zhi-Qi Cheng

This paper explores the advancements in making large language models (LLMs) more human-like. We focus on techniques that enhance natural language understanding, conversational coherence, and emotional intelligence in AI systems. The study…

Computation and Language · Computer Science 2026-02-03 Ethem Yağız Çalık , Talha Rüzgar Akkuş

This study introduces a novel method for irony detection, applying Large Language Models (LLMs) with prompt-based learning to facilitate emotion-centric text augmentation. Traditional irony detection techniques typically fall short due to…

Computation and Language · Computer Science 2024-04-23 Yucheng Lin , Yuhan Xia , Yunfei Long

Large language models (LLMs) have shown nearly saturated performance on many natural language processing (NLP) tasks. As a result, it is natural for people to believe that LLMs have also mastered abilities such as time understanding and…

Computation and Language · Computer Science 2023-10-10 Yifan Wei , Yisong Su , Huanhuan Ma , Xiaoyan Yu , Fangyu Lei , Yuanzhe Zhang , Jun Zhao , Kang Liu

Event reasoning is a fundamental ability that underlies many applications. It requires event schema knowledge to perform global reasoning and needs to deal with the diversity of the inter-event relations and the reasoning paradigms. How…

Computation and Language · Computer Science 2024-08-05 Zhengwei Tao , Zhi Jin , Yifan Zhang , Xiancai Chen , Haiyan Zhao , Jia Li , Bing Liang , Chongyang Tao , Qun Liu , Kam-Fai Wong

Understanding how individuals perceive and recall information in their natural environments is critical to understanding potential failures in perception (e.g., sensory loss) and memory (e.g., dementia). Event segmentation, the process of…

Computation and Language · Computer Science 2025-10-20 Ryan A. Panela , Alex J. Barnett , Morgan D. Barense , Björn Herrmann

Large Language Models (LLMs) have demonstrated a number of human-like abilities, however the empathic understanding and emotional state of LLMs is yet to be aligned to that of humans. In this work, we investigate how the emotional state of…

Artificial Intelligence · Computer Science 2024-02-08 Ciaran Regan , Nanami Iwahashi , Shogo Tanaka , Mizuki Oka