English
Related papers

Related papers: Are Large Language Models More Empathetic than Hum…

200 papers

We evaluated 4 systems (ELIZA, GPT-4o, LLaMa-3.1-405B, and GPT-4.5) in two randomised, controlled, and pre-registered Turing tests on independent populations. Participants had 5 minute conversations simultaneously with another human…

Computation and Language · Computer Science 2025-04-01 Cameron R. Jones , Benjamin K. Bergen

Large Language Models (LLMs) represent a major step toward artificial general intelligence, significantly advancing our ability to interact with technology. While LLMs perform well on Natural Language Processing tasks -- such as…

Computation and Language · Computer Science 2025-05-15 Brandon Smith , Mohamed Reda Bouadjenek , Tahsin Alamgir Kheya , Phillip Dawson , Sunil Aryal

This paper presents an in-depth analysis of the performance of seven different Large Language Models (LLMs) in solving a diverse set of math advanced calculus problems. The study aims to evaluate these models' accuracy, reliability, and…

Computation and Language · Computer Science 2025-03-07 In Hak Moon

Large Language Models (LLMs) have demonstrated remarkable abilities across numerous disciplines, primarily assessed through tasks in language generation, knowledge utilization, and complex reasoning. However, their alignment with human…

Artificial Intelligence · Computer Science 2023-07-31 Xuena Wang , Xueting Li , Zi Yin , Yue Wu , Liu Jia

In day-to-day communication, people often approximate the truth - for example, rounding the time or omitting details - in order to be maximally helpful to the listener. How do large language models (LLMs) handle such nuanced trade-offs? To…

Computation and Language · Computer Science 2024-02-14 Ryan Liu , Theodore R. Sumers , Ishita Dasgupta , Thomas L. Griffiths

Supportive conversation depends on skills that go beyond language fluency, including reading emotions, adjusting tone, and navigating moments of resistance, frustration, or distress. Despite rapid progress in language models, we still lack…

Computation and Language · Computer Science 2026-02-26 Laya Iyer , Kriti Aggarwal , Sanmi Koyejo , Gail Heyman , Desmond C. Ong , Subhabrata Mukherjee

Large Language Models (LLMs) such as OpenAI's GPT-4 and Meta's LLaMA offer a promising approach for scalable personality assessment from open-ended language. However, inferring personality traits remains challenging, and earlier work often…

Computation and Language · Computer Science 2025-07-22 Jianfeng Zhu , Ruoming Jin , Karin G. Coifman

Modern affective computing systems rely heavily on datasets with human-annotated emotion labels, for training and evaluation. However, human annotations are expensive to obtain, sensitive to study design, and difficult to quality control,…

Computation and Language · Computer Science 2024-12-12 Minxue Niu , Yara El-Tawil , Amrit Romana , Emily Mower Provost

Large Language Models (LLMs) are increasingly deployed in healthcare, yet their communicative alignment with clinical standards remains insufficiently quantified. We conduct a multidimensional evaluation of general-purpose and…

Computation and Language · Computer Science 2026-04-23 Mariano Barone , Francesco Di Serio , Roberto Moio , Marco Postiglione , Giuseppe Riccio , Antonio Romano , Vincenzo Moscato

The rapid advancement of Large Language Models (LLMs) in the realm of mathematical reasoning necessitates comprehensive evaluations to gauge progress and inspire future directions. Existing assessments predominantly focus on problem-solving…

Computation and Language · Computer Science 2024-06-05 Xiaoyuan Li , Wenjie Wang , Moxin Li , Junrong Guo , Yang Zhang , Fuli Feng

Large Language Models (LLMs) like GPT-4 and Gemini have significantly advanced artificial intelligence by enabling machines to generate and comprehend human-like text. Despite their impressive capabilities, LLMs are not immune to…

Computation and Language · Computer Science 2024-12-19 Jiaxu Lou , Yifan Sun

As large language models (LLMs) increasingly mediate emotionally sensitive conversations, especially in mental health contexts, their ability to recognize and respond to high-risk situations becomes a matter of public safety. This study…

Interacting with human via high-quality multi-turn dialogues is a key feature of large language models (LLMs). However, human-based evaluation of such capability involves intensive manual labor. This report provides a preliminary evaluation…

Computation and Language · Computer Science 2023-10-23 Haodong Duan , Jueqi Wei , Chonghua Wang , Hongwei Liu , Yixiao Fang , Songyang Zhang , Dahua Lin , Kai Chen

With large language models (LLMs) becoming increasingly prevalent in daily life, so too has the tendency to attribute to them human-like minds and emotions, or anthropomorphize them. Here, we investigate dimensions people use to…

Emotion recognition capabilities in multimodal AI systems are crucial for developing culturally responsive educational technologies, yet remain underexplored for Arabic language contexts where culturally appropriate learning tools are…

Computation and Language · Computer Science 2025-09-05 Bushra Asseri , Estabraq Abdelaziz , Maha Al Mogren , Tayef Alhefdhi , Areej Al-Wabil

This paper argues that Large Language Models (LLMs) should incorporate explicit mechanisms for human empathy. As LLMs become increasingly deployed in high-stakes human-centered settings, their success depends not only on correctness or…

Computation and Language · Computer Science 2026-04-14 Xiaoxing You , Qiang Huang , Jun Yu

The advent of large language models (LLMs) has gained tremendous attention over the past year. Previous studies have shown the astonishing performance of LLMs not only in other tasks but also in emotion recognition in terms of accuracy,…

Computation and Language · Computer Science 2023-10-24 Liyizhe Peng , Zixing Zhang , Tao Pang , Jing Han , Huan Zhao , Hao Chen , Björn W. Schuller

Large Language Models (LLMs) are demonstrating remarkable human like capabilities across diverse domains, including psychological assessment. This study evaluates whether LLMs, specifically GPT-4o and GPT-4o mini, can infer Big Five…

Computation and Language · Computer Science 2025-01-14 Jianfeng Zhu , Ruoming Jin , Karin G. Coifman

This study is a pioneering endeavor to investigate the capabilities of Large Language Models (LLMs) in addressing conceptual questions within the domain of mechanical engineering with a focus on mechanics. Our examination involves a…

Computation and Language · Computer Science 2024-01-25 Jie Tian , Jixin Hou , Zihao Wu , Peng Shu , Zhengliang Liu , Yujie Xiang , Beikang Gu , Nicholas Filla , Yiwei Li , Ning Liu , Xianyan Chen , Keke Tang , Tianming Liu , Xianqiao Wang

The escalating global mental health crisis, marked by persistent treatment gaps, availability, and a shortage of qualified therapists, positions Large Language Models (LLMs) as a promising avenue for scalable support. While LLMs offer…