English
Related papers

Related papers: Emotionally Numb or Empathetic? Evaluating How LLM…

200 papers

The humanlike responses of large language models (LLMs) have prompted social scientists to investigate whether LLMs can be used to simulate human participants in experiments, opinion polls and surveys. Of central interest in this line of…

Computation and Language · Computer Science 2024-05-14 Nikolay B Petrov , Gregory Serapio-García , Jason Rentfrow

In recent years, Large Language Models (LLMs) have become increasingly more powerful in their ability to complete complex tasks. One such task in which LLMs are often employed is scoring, i.e., assigning a numerical value from a certain…

Computation and Language · Computer Science 2024-12-31 Henry J. Xie , Jinghan Zhang , Xinhao Zhang , Kunpeng Liu

While Large Language Models (LLMs) have achieved remarkable success in cognitive and reasoning benchmarks, they exhibit a persistent deficit in anthropomorphic intelligence-the capacity to navigate complex social, emotional, and ethical…

Computation and Language · Computer Science 2025-12-29 Jiaxin Liu , Peiyi Tu , Wenyu Chen , Yihong Zhuang , Xinxia Ling , Anji Zhou , Chenxi Wang , Zhuo Han , Zhengkai Yang , Junbo Zhao , Zenan Huang , Yuanyuan Wang

Large language models (LLMs) sometimes appear to exhibit emotional reactions. We investigate why this is the case in Claude Sonnet 4.5 and explore implications for alignment-relevant behavior. We find internal representations of emotion…

Previous research has shown that humans are more receptive towards language models that that exhibit empathetic behavior. While empathy is essential for developing helpful dialogue agents, very few large corpora containing empathetic…

Computation and Language · Computer Science 2025-02-26 Run Chen , Jun Shin , Julia Hirschberg

Large Language Models (LLMs) are increasingly deployed in human-centric applications, yet they often fail to provide substantive emotional support. While Reinforcement Learning (RL) has been utilized to enhance empathy of LLMs, existing…

Computation and Language · Computer Science 2026-01-19 Chengbing Wang , Wuqiang Zheng , Yang Zhang , Fengbin Zhu , Junyi Cheng , Yi Xie , Wenjie Wang , Fuli Feng

One open question in the study of Large Language Models (LLMs) is whether they can emulate human ethical reasoning and act as believable proxies for human judgment. To investigate this, we introduce a benchmark dataset comprising 196…

Computation and Language · Computer Science 2025-05-14 Jiashen , Du , Jesse Yao , Allen Liu , Zhekai Zhang

As Large Language Models (LLMs) are integrated with human daily applications rapidly, many societal and ethical concerns are raised regarding the behavior of LLMs. One of the ways to comprehend LLMs' behavior is to analyze their…

Computation and Language · Computer Science 2024-02-23 Xiaoyang Song , Yuta Adachi , Jessie Feng , Mouwei Lin , Linhao Yu , Frank Li , Akshat Gupta , Gopala Anumanchipalli , Simerjot Kaur

Research increasingly leverages audio-visual materials to analyze emotions in political communication. Multimodal large language models (mLLMs) promise to enable such analyses through in-context learning. However, we lack systematic…

Computation and Language · Computer Science 2026-04-07 Hauke Licht

Large language models have increasingly been proposed as a powerful replacement for classical agent-based models (ABMs) to simulate social dynamics. By using LLMs as a proxy for human behavior, the hope of this new approach is to be able to…

Computers and Society · Computer Science 2024-12-09 Da Ju , Adina Williams , Brian Karrer , Maximilian Nickel

This work investigates how large language models (LLMs) internally represent emotion by analyzing the geometry of their hidden-state space. The paper identifies a low-dimensional emotional manifold and shows that emotional representations…

Computation and Language · Computer Science 2026-02-02 Benjamin Reichman , Adar Avsian , Larry Heck

The advancement of large language models (LLMs) has outpaced traditional evaluation methodologies. This progress presents novel challenges, such as measuring human-like psychological constructs, moving beyond static and task-specific…

Computation and Language · Computer Science 2026-03-12 Haoran Ye , Jing Jin , Yuhang Xie , Xin Zhang , Guojie Song

The analysis of students' emotions and behaviors is crucial for enhancing learning outcomes and personalizing educational experiences. Traditional methods often rely on intrusive visual and physiological data collection, posing privacy…

Computation and Language · Computer Science 2024-08-14 Kaito Tanaka , Benjamin Tan , Brian Wong

"How does the person in the bounding box feel?" Achieving human-level recognition of the apparent emotion of a person in real world situations remains an unsolved task in computer vision. Facial expressions are not enough: body pose,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Yasaman Etesam , Özge Nilay Yalçın , Chuxuan Zhang , Angelica Lim

Sentiment and emotion understanding are essential to applications such as human-computer interaction and depression detection. While Multimodal Large Language Models (MLLMs) demonstrate robust general capabilities, they face considerable…

Computation and Language · Computer Science 2025-07-08 Ao Li , Longwei Xu , Chen Ling , Jinghui Zhang , Pengwei Wang

As Large Language Models (LLMs) continue to evolve, evaluating them remains a persistent challenge. Many recent evaluations use LLMs as judges to score outputs from other LLMs, often relying on a single large model like GPT-4o. However,…

Computation and Language · Computer Science 2025-03-20 Justin Zhao , Flor Miriam Plaza-del-Arco , Benjamin Genchel , Amanda Cercas Curry

Emotions guide human decisions, but whether large language models (LLMs) use emotion similarly remains unknown. We tested this using altruistic third-party punishment, where an observer incurs a personal cost to enforce fairness, a hallmark…

Computation and Language · Computer Science 2025-10-22 Hao Liu , Yiqing Dai , Haotian Tan , Yu Lei , Yujia Zhou , Zhen Wu

Large Language Models (LLMs) have become integral to a wide spectrum of applications, ranging from traditional computing tasks to advanced artificial intelligence (AI) applications. This widespread adoption has spurred extensive research…

Computation and Language · Computer Science 2024-05-14 Xu Wang , Cheng Li , Yi Chang , Jindong Wang , Yuan Wu

Evaluating persona-aligned empathy in LLM-based dialogue agents remains challenging. User states are latent, feedback is sparse and difficult to verify in situ, and seemingly supportive turns can still accumulate into trajectories that…

Artificial Intelligence · Computer Science 2026-03-17 Shiya Zhang , Yuhan Zhan , Ruixi Su , Ruihan Sun , Ziyi Song , Zhaohan Chen , Xiaofan Zhang

The potential of Large Language Model (LLM) as agents has been widely acknowledged recently. Thus, there is an urgent need to quantitatively \textit{evaluate LLMs as agents} on challenging tasks in interactive environments. We present…