English
Related papers

Related papers: Quantitative Introspection in Language Models: Tra…

200 papers

Large language models (LLMs) exhibit advanced reasoning skills, enabling robots to comprehend natural language instructions and strategically plan high-level actions through proper grounding. However, LLM hallucination may result in robots…

Artificial Intelligence · Computer Science 2025-02-12 Kaiqu Liang , Zixu Zhang , Jaime Fernández Fisac

As the utilization of language models in interdisciplinary, human-centered studies grow, expectations of their capabilities continue to evolve. Beyond excelling at conventional tasks, models are now expected to perform well on user-centric…

Computation and Language · Computer Science 2025-09-25 Yuxiang Zhou , Hainiu Xu , Desmond C. Ong , Maria Liakata , Petr Slovak , Yulan He

Background: Mentalization integrates cognitive, affective, and intersubjective components. Large Language Models (LLMs) display an increasing ability to generate reflective texts, raising questions regarding the relationship between…

Computation and Language · Computer Science 2025-12-11 Stefano Epifani , Giuliano Castigliego , Laura Kecskemeti , Giuliano Razzicchia , Elisabeth Seiwald-Sonderegger

Subjective language understanding refers to a broad set of natural language processing tasks where the goal is to interpret or generate content that conveys personal feelings, opinions, or figurative meanings rather than objective facts.…

Computation and Language · Computer Science 2025-08-12 Changhao Song , Yazhou Zhang , Hui Gao , Ben Yao , Peng Zhang

Extracting structured information from clinical notes requires navigating a dense web of interdependent variables where the value of one attribute logically constrains others. Existing Large Language Model (LLM)-based extraction pipelines…

Large language models (LLMs) show promising capabilities in predicting human emotions from text. However, the mechanisms through which these models process emotional stimuli remain largely unexplored. Our study addresses this gap by…

Computation and Language · Computer Science 2025-07-01 Ala N. Tak , Amin Banayeeanzade , Anahita Bolourani , Mina Kian , Robin Jia , Jonathan Gratch

Large Language Models (LLMs) have rapidly become central to NLP, demonstrating their ability to adapt to various tasks through prompting techniques, including sentiment analysis. However, we still have a limited understanding of how these…

Computation and Language · Computer Science 2025-06-02 Dario Di Palma , Alessandro De Bellis , Giovanni Servedio , Vito Walter Anelli , Fedelucio Narducci , Tommaso Di Noia

Large Language Models (LLMs) have significantly improved personalized conversational capabilities. However, existing datasets like Persona Chat, Synthetic Persona Chat, and Blended Skill Talk rely on static, predefined personas. This…

Computation and Language · Computer Science 2024-12-17 Sayantan Pal , Souvik Das , Rohini K. Srihari

This study examines whether LLMs can simulate culturally grounded psychological patterns based on demographic information. Using DeepSeek, we generated 2943 virtual participants matched to demographic distributions from the CFPS2018 and…

Computers and Society · Computer Science 2025-10-01 Ke Luoma , Li Zengyi , Liao Jiangqun , Tong Song , Peng Kaiping

Large language models (LLMs) are increasingly used in emotionally sensitive human-AI applications, yet little is known about how emotion recognition is internally represented. In this work, we investigate the internal mechanisms of emotion…

Computation and Language · Computer Science 2026-04-29 Bangzhao Shu , Arinjay Singh , Mai ElSherief

I study whether emotionally framed evaluation follow-ups change both the behavior and the calm-relative internal representations of small, locally deployed language models. Our main benchmark uses Qwen 3.5 0.8B on four impossible-constraint…

Computation and Language · Computer Science 2026-05-21 Rana Muhammad Usman

Effective patient-provider communication is crucial in clinical care, directly impacting patient outcomes and quality of life. Traditional evaluation methods, such as human ratings, patient feedback, and provider self-assessments, are often…

Computation and Language · Computer Science 2024-09-25 Zhiyuan Wang , Fangxu Yuan , Virginia LeBaron , Tabor Flickinger , Laura E. Barnes

In task-oriented conversational AI evaluation, unsupervised methods poorly correlate with human judgments, and supervised approaches lack generalization. Recent advances in large language models (LLMs) show robust zeroshot and few-shot…

Computation and Language · Computer Science 2024-06-26 Jinghan Jia , Abi Komma , Timothy Leffel , Xujun Peng , Ajay Nagesh , Tamer Soliman , Aram Galstyan , Anoop Kumar

Personality traits have long been studied as predictors of human behavior. Recent advances in Large Language Models (LLMs) suggest similar patterns may emerge in artificial systems, with advanced LLMs displaying consistent behavioral…

Artificial Intelligence · Computer Science 2025-09-08 Pengrui Han , Rafal Kocielnik , Peiyang Song , Ramit Debnath , Dean Mobbs , Anima Anandkumar , R. Michael Alvarez

Subjective well-being is a key metric in economic, medical, and policy decision-making. As artificial intelligence provides scalable tools for modelling human outcomes, it is crucial to evaluate whether large language models (LLMs) can…

Human-Computer Interaction · Computer Science 2025-07-09 Pat Pataranutaporn , Nattavudh Powdthavee , Chayapatr Archiwaranguprok , Pattie Maes

Large language models (LLMs) increasingly exhibit behaviors suggesting awareness of their evaluation context, often adapting their reasoning strategies in benchmark settings. Prior work has shown that such evaluation awareness can distort…

Computation and Language · Computer Science 2026-05-12 Yanshi Li , Xueru Bai , Shuman Liu , Haibo Zhang , Anxiang Zeng

Large Language Models (LLMs) often exhibit strong linguistic abilities while remaining unreliable on multi-step reasoning tasks, particularly when deployed without additional training or fine-tuning. In this work, we study inference-time…

Computation and Language · Computer Science 2026-03-24 Vinay Sharma , Manish Jain

Large language models (LLMs) are increasingly used to assist computational social science research. While prior efforts have focused on text, the potential of leveraging multimodal LLMs (MLLMs) for online video studies remains…

Human-Computer Interaction · Computer Science 2025-03-10 Jiaying "Lizzy" Liu , Yiheng Su , Praneel Seth

It has been found that Transformer-based language models have the ability to perform basic quantitative reasoning. In this paper, we propose a method for studying how these models internally represent numerical data, and use our proposal to…

Computation and Language · Computer Science 2024-04-26 Ulme Wennberg , Gustav Eje Henter

Large language models (LLMs) have offered new opportunities for emotional support, and recent work has shown that they can produce empathic responses to people in distress. However, long-term mental well-being requires emotional…

Computation and Language · Computer Science 2024-08-09 Hongli Zhan , Allen Zheng , Yoon Kyung Lee , Jina Suh , Junyi Jessy Li , Desmond C. Ong