English
Related papers

Related papers: EmotionQueen: A Benchmark for Evaluating Empathy o…

200 papers

Emotion recognition in social situations is a complex task that requires integrating information from both facial expressions and the situational context. While traditional approaches to automatic emotion recognition have focused on…

Human-Computer Interaction · Computer Science 2025-07-18 Bin Han , Cleo Yau , Su Lei , Jonathan Gratch

Emotion Support Conversation (ESC) is a crucial application, which aims to reduce human stress, offer emotional guidance, and ultimately enhance human mental and physical well-being. With the advancement of Large Language Models (LLMs),…

Computation and Language · Computer Science 2024-10-29 Haiquan Zhao , Lingyu Li , Shisong Chen , Shuqi Kong , Jiaan Wang , Kexin Huang , Tianle Gu , Yixu Wang , Wang Jian , Dandan Liang , Zhixu Li , Yan Teng , Yanghua Xiao , Yingchun Wang

Recognising emotions in context involves identifying an individual's apparent emotions while considering contextual cues from the surrounding scene. Previous approaches to this task have typically designed explicit scene-encoding…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Alexandros Xenos , Niki Maria Foteinopoulou , Ioanna Ntinou , Ioannis Patras , Georgios Tzimiropoulos

With large language models (LLMs) increasingly deployed as cognitive engines for AI agents, the reliability and effectiveness critically hinge on their intrinsic epistemic agency, which remains understudied. Epistemic agency, the ability to…

Artificial Intelligence · Computer Science 2025-06-05 Lingyu Li , Yixu Wang , Haiquan Zhao , Shuqi Kong , Yan Teng , Chunbo Li , Yingchun Wang

Empathy is a critical factor in fostering positive user experiences in conversational AI. While models can display empathy, it is often generic rather than tailored to specific tasks and contexts. In this work, we introduce a novel…

Human-Computer Interaction · Computer Science 2025-11-06 Erfan Shayegani , Jina Suh , Andy Wilson , Nagu Rangan , Javier Hernandez

Speech Language Models (SLMs) have made significant progress in spoken language understanding. Yet it remains unclear whether they can fully perceive non lexical vocal cues alongside spoken words, and respond with empathy that aligns with…

Computation and Language · Computer Science 2026-03-06 Li Zhou , Lutong Yu , You Lyu , Yihang Lin , Zefeng Zhao , Junyi Ao , Yuhao Zhang , Benyou Wang , Haizhou Li

Effective emotional support hinges on understanding users' emotions and needs to provide meaningful comfort during multi-turn interactions. Large Language Models (LLMs) show great potential for expressing empathy; however, they often…

Computation and Language · Computer Science 2025-05-23 Jing Ye , Lu Xiang , Yaping Zhang , Chengqing Zong

Emotion estimation in images is a challenging task, typically using computer vision methods to directly estimate people's emotions using face, body pose and contextual cues. In this paper, we explore whether Large Language Models (LLMs) can…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Vera Yang , Archita Srivastava , Yasaman Etesam , Chuxuan Zhang , Angelica Lim

Mechanistic interpretability has revealed how concepts are encoded in large language models (LLMs), but emotional content remains poorly understood at the mechanistic level. We study whether LLMs process emotional valence through dedicated…

Computation and Language · Computer Science 2026-05-08 Sohan Venkatesh

The autonomous decision-making process, which is increasingly applied to computer systems, requires that the choices made by these systems align with human values. In this context, systems must assess how well their decisions reflect human…

Computers and Society · Computer Science 2025-12-19 Eduardo de la Cruz Fernández , Marcelo Karanik , Sascha Ossowski

Large Language Models primarily operate through text-based inputs and outputs, yet human emotion is communicated through both verbal and non-verbal cues, including facial expressions. While Vision-Language Models analyze facial expressions…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Vaibhav Mehra , Guy Laban , Hatice Gunes

Situations and events evoke emotions in humans, but to what extent do they inform the prediction of emotion detection models? This work investigates how well human-annotated emotion triggers correlate with features that models deemed…

Computation and Language · Computer Science 2024-03-27 Smriti Singh , Cornelia Caragea , Junyi Jessy Li

This work investigates how large language models (LLMs) internally represent emotion by analyzing the geometry of their hidden-state space. The paper identifies a low-dimensional emotional manifold and shows that emotional representations…

Computation and Language · Computer Science 2026-02-02 Benjamin Reichman , Adar Avsian , Larry Heck

The analysis of students' emotions and behaviors is crucial for enhancing learning outcomes and personalizing educational experiences. Traditional methods often rely on intrusive visual and physiological data collection, posing privacy…

Computation and Language · Computer Science 2024-08-14 Kaito Tanaka , Benjamin Tan , Brian Wong

Large Language Models (LLMs) have gained widespread global adoption, showcasing advanced linguistic capabilities across multiple of languages. There is a growing interest in academia to use these models to simulate and study human…

Computation and Language · Computer Science 2024-08-06 Shiran Dudy , Ibrahim Said Ahmad , Ryoko Kitajima , Agata Lapedriza

The emergence of multimodal large language models (MLLMs) advances multimodal emotion recognition (MER) to the next level, from naive discriminative tasks to complex emotion understanding with advanced video understanding abilities and…

Human-Computer Interaction · Computer Science 2025-05-08 Zheng Lian , Haoyu Chen , Lan Chen , Haiyang Sun , Licai Sun , Yong Ren , Zebang Cheng , Bin Liu , Rui Liu , Xiaojiang Peng , Jiangyan Yi , Jianhua Tao

Large language models (LLMs) demonstrate strong cognitive intelligence (IQ), yet many real-world interactions also require emotional intelligence (EQ) to produce responses that are both factually reliable and emotionally appropriate. In…

Computation and Language · Computer Science 2026-03-18 Yifei Zhang , Mingyang Li , Henry Gao , Liang Zhao

Sensitive information detection is crucial in content moderation to maintain safe online communities. Assisting in this traditionally manual process could relieve human moderators from overwhelming and tedious tasks, allowing them to focus…

Cross-lingual emotion detection allows us to analyze global trends, public opinion, and social phenomena at scale. We participated in the Explainability of Cross-lingual Emotion Detection (EXALT) shared task, achieving an F1-score of 0.6046…

Computation and Language · Computer Science 2024-07-03 Long Cheng , Qihao Shao , Christine Zhao , Sheng Bi , Gina-Anne Levow

As large language models (LLMs) continue to develop and gain widespread application, the ability of LLMs to exhibit empathy towards diverse group identities and understand their perspectives is increasingly recognized as critical. Most…

Artificial Intelligence · Computer Science 2024-06-25 Leyan Wang , Yonggang Jin , Tianhao Shen , Tianyu Zheng , Xinrun Du , Chenchen Zhang , Wenhao Huang , Jiaheng Liu , Shi Wang , Ge Zhang , Liuyu Xiang , Zhaofeng He