English
Related papers

Related papers: Beyond Self-Reports: Multi-Observer Agents for Per…

200 papers

Large Language Models (LLMs) have demonstrated human-like capabilities in language comprehension and generation, becoming active participants in social and cognitive domains. This study investigates whether LLMs exhibit personality-like…

Computation and Language · Computer Science 2025-05-22 Wang Jiaqi , Wang bo , Guo fa , Cheng cheng , Yang li

Large language models (LLMs) have been extensively studied from computational and cognitive perspectives, yet their behavior as communicative actors in socially structured contexts remains underexplored. This study examines whether…

Computation and Language · Computer Science 2026-05-15 Vinicius Covas , Jorge Alberto Hidalgo Toledo

Recent advancements in generative AI have significantly increased interest in personalized agents. With increased personalization, there is also a greater need for being able to trust decision-making and action taking capabilities of these…

Information Retrieval · Computer Science 2025-04-10 Chirag Shah , Hideo Joho , Kirandeep Kaur , Preetam Prabhu Srikar Dammu

Large language models (LLMs) can serve as judges that offer rapid and reliable assessments of other LLM outputs. However, models may systematically assign overly favorable ratings to their own outputs, a phenomenon known as self-bias, which…

Computation and Language · Computer Science 2025-08-12 Evangelia Spiliopoulou , Riccardo Fogliato , Hanna Burnsky , Tamer Soliman , Jie Ma , Graham Horwood , Miguel Ballesteros

Recent advances in Large Language Models (LLMs) have enabled multi-agent systems that simulate real-world interactions with near-human reasoning. While previous studies have extensively examined biases related to protected attributes such…

Artificial Intelligence · Computer Science 2025-06-03 Min Choi , Keonwoo Kim , Sungwon Chae , Sangyeob Baek

Machine learning can predict human behavior well when substantial structured data and well-defined outcomes are available, but these models are typically limited to specific outcomes and cannot readily be applied to new domains. We test…

Large Language Models (LLMs) have shown remarkable capabilities in general natural language processing tasks but often fall short in complex reasoning tasks. Recent studies have explored human-like problem-solving strategies, such as…

Computation and Language · Computer Science 2023-12-19 Zhenran Xu , Senbao Shi , Baotian Hu , Jindi Yu , Dongfang Li , Min Zhang , Yuxiang Wu

Well-being in family settings involves subtle psychological dynamics that conventional metrics often overlook. In particular, unconscious parental expectations, termed ideal parent bias, can suppress children's emotional expression and…

Human-Computer Interaction · Computer Science 2026-01-13 Rushia Harada , Yuken Kimura , Keito Inoshita

Natural language processing (NLP) has seen remarkable advancements with the development of large language models (LLMs). Despite these advancements, LLMs often produce socially biased outputs. Recent studies have mainly addressed this…

Computation and Language · Computer Science 2025-02-13 Zhenjie Xu , Wenqing Chen , Yi Tang , Xuanying Li , Cheng Hu , Zhixuan Chu , Kui Ren , Zibin Zheng , Zhichao Lu

Large Language Models (LLMs) can be conditioned with explicit personality prompts, yet their behavioral realization often varies depending on context. This study examines how identical personality prompts lead to distinct linguistic,…

Computation and Language · Computer Science 2026-02-03 Bin Han , Deuksin Kwon , Jonathan Gratch

As large language models (LLMs) are increasingly used in human-centered tasks, assessing their psychological traits is crucial for understanding their social impact and ensuring trustworthy AI alignment. While existing reviews have covered…

Computers and Society · Computer Science 2025-05-02 Wenhan Dong , Yuemeng Zhao , Zhen Sun , Yule Liu , Zifan Peng , Jingyi Zheng , Zongmin Zhang , Ziyi Zhang , Jun Wu , Ruiming Wang , Shengmin Xu , Xinyi Huang , Xinlei He

A chatbot's personality design is key to interaction quality. As chatbots evolved from rule-based systems to those powered by large language models (LLMs), evaluating the effectiveness of their personality design has become increasingly…

Human-Computer Interaction · Computer Science 2025-08-11 Huiqi Zou , Pengda Wang , Zihan Yan , Tianjun Sun , Ziang Xiao

Large Language Models (LLMs) are increasingly used as proxies for human perception in urban analysis, yet it remains unclear whether persona prompting produces meaningful and reproducible behavioral diversity. We investigate whether…

Computation and Language · Computer Science 2026-05-25 Neemias B da Silva , Rodrigo Minetto , Daniel Silver , Thiago H Silva

Large language models (LLMs) are increasingly being used in human-centered social scientific tasks, such as data annotation, synthetic data creation, and engaging in dialog. However, these tasks are highly subjective and dependent on human…

Computation and Language · Computer Science 2024-10-18 Salvatore Giorgi , Tingting Liu , Ankit Aich , Kelsey Isman , Garrick Sherman , Zachary Fried , João Sedoc , Lyle H. Ungar , Brenda Curtis

As LLMs integrate into our daily lives, understanding their behavior becomes essential. In this work, we focus on behavioral dispositions$-$the underlying tendencies that shape responses in social contexts$-$and introduce a framework to…

Multimodal large language models (MLLMs) have shown impressive capabilities across tasks involving both visual and textual modalities. However, growing concerns remain about their potential to encode and amplify gender bias, particularly in…

Computation and Language · Computer Science 2025-07-08 Yue Xu , Wenjie Wang

LLM-based autonomous agents have demonstrated strong capabilities in reasoning, planning, and tool use, yet remain limited when tasks require sustained coordination across roles, tools, and environments. Multi-agent systems address this…

An essential aspect of evaluating Large Language Models (LLMs) is identifying potential biases. This is especially relevant considering the substantial evidence that LLMs can replicate human social biases in their text outputs and further…

Human-Computer Interaction · Computer Science 2024-05-21 Paula Akemi Aoyagui , Sharon Ferguson , Anastasia Kuzminykh

Large language models are increasingly used to annotate texts, but their outputs reflect some human perspectives better than others. Existing methods for correcting LLM annotation error assume a single ground truth. However, this assumption…

Computation and Language · Computer Science 2026-03-24 Navya Mehrotra , Adam Visokay , Kristina Gligorić

Creating human-like large language model (LLM) agents is crucial for faithful social simulation. Having LLMs role-play based on demographic information sometimes improves human likeness but often does not. This study assessed whether LLM…

Computation and Language · Computer Science 2024-10-17 Yun-Shiuan Chuang , Krirk Nirunwiroj , Zach Studdiford , Agam Goyal , Vincent V. Frigo , Sijia Yang , Dhavan Shah , Junjie Hu , Timothy T. Rogers