English
Related papers

Related papers: Exploring Persona-dependent LLM Alignment for the …

200 papers

As large language models (LLMs) increasingly mediate ethically sensitive decisions, understanding their moral reasoning processes becomes imperative. This study presents a comprehensive empirical evaluation of 14 leading LLMs, both…

Computation and Language · Computer Science 2025-08-12 Junchen Ding , Penghao Jiang , Zihao Xu , Ziqi Ding , Yichen Zhu , Jiaojiao Jiang , Yuekang Li

Large language models (LLMs) can lead to undesired consequences when misaligned with human values, especially in scenarios involving complex and sensitive social biases. Previous studies have revealed the misalignment of LLMs with human…

Computation and Language · Computer Science 2025-09-18 Yang Liu , Chenhui Chu

Moral judgment is integral to large language models' (LLMs) social reasoning. As multi-agent systems gain prominence, it becomes crucial to understand how LLMs function when collaborating compared to operating as individual agents. In human…

Computation and Language · Computer Science 2025-10-30 Anita Keshmirian , Razan Baltaji , Babak Hemmatian , Hadi Asghari , Lav R. Varshney

This paper investigates the voting behaviors of Large Language Models (LLMs), specifically GPT-4 and LLaMA-2, their biases, and how they align with human voting patterns. Our methodology involved using a dataset from a human voting…

Computation and Language · Computer Science 2024-12-20 Joshua C. Yang , Damian Dailisan , Marcin Korecki , Carina I. Hausladen , Dirk Helbing

Large language models (LLMs) are increasingly used to simulate human behavior in social settings such as legal mediation, negotiation, and dispute resolution. However, it remains unclear whether these simulations reproduce the…

Artificial Intelligence · Computer Science 2026-02-10 Deuksin Kwon , Kaleen Shrestha , Bin Han , Spencer Lin , James Hale , Jonathan Gratch , Maja Matarić , Gale M. Lucas

Large language models (LLMs) are increasingly used to simulate human decision-making, but their intrinsic biases often diverge from real human behavior--limiting their ability to reflect population-level diversity. We address this challenge…

Computer Science and Game Theory · Computer Science 2025-08-27 Ayato Kitadai , Yusuke Fukasawa , Nariaki Nishino

People increasingly rely on Large Language Models (LLMs) for moral advice, which may influence humans' decisions. Yet, little is known about how closely LLMs align with human moral judgments. To address this, we introduce the Moral Dilemma…

Computation and Language · Computer Science 2025-07-24 Giuseppe Russo , Debora Nozza , Paul Röttger , Dirk Hovy

As AI systems increasingly navigate applications in healthcare, law, and governance, understanding how they handle ethically complex scenarios becomes critical. Previous work has mainly examined the moral judgments in large language models…

Computation and Language · Computer Science 2025-10-14 Keenan Samway , Max Kleiman-Weiner , David Guzman Piedrahita , Rada Mihalcea , Bernhard Schölkopf , Zhijing Jin

Contemporary research in social sciences increasingly utilizes state-of-the-art generative language models to annotate or generate content. While these models achieve benchmark-leading performance on common language tasks, their application…

Computation and Language · Computer Science 2025-07-15 Simon Münker

Large Language Models (LLMs) have shown strong performance across many tasks, but their ability to capture culturally diverse moral values remains unclear. In this paper, we examine whether LLMs mirror variations in moral attitudes reported…

Computation and Language · Computer Science 2026-03-31 Hadi Mohammadi , Ayoub Bagheri

As modern large language models (LLMs) become integral to everyday tasks, concerns about their inherent biases and their potential impact on human decision-making have emerged. While bias in models are well-documented, less is known about…

Human-Computer Interaction · Computer Science 2026-03-20 Jillian Fisher , Shangbin Feng , Robert Aron , Thomas Richardson , Yejin Choi , Daniel W. Fisher , Jennifer Pan , Yulia Tsvetkov , Katharina Reinecke

In the rapidly evolving field of artificial intelligence, large language models (LLMs) have emerged as powerful tools for a myriad of applications, from natural language processing to decision-making support systems. However, as these…

Computation and Language · Computer Science 2025-07-08 Jianchao Ji , Yutong Chen , Mingyu Jin , Wujiang Xu , Wenyue Hua , Yongfeng Zhang

The emergence of Large Language Models (LLMs), has opened exciting possibilities for constructing computational simulations designed to replicate human behavior accurately. Current research suggests that LLM-based agents become increasingly…

Computation and Language · Computer Science 2024-12-18 Amir Taubenfeld , Yaniv Dover , Roi Reichart , Ariel Goldstein

Large Language Models (LLMs) have demonstrated impressive capabilities in generating fluent text, as well as tendencies to reproduce undesirable social biases. This study investigates whether LLMs reproduce the moral biases associated with…

Computation and Language · Computer Science 2023-06-21 Gabriel Simmons

Large Language Models (LLMs) exhibit surprisingly diverse risk preferences when acting as AI decision makers, a crucial characteristic whose origins remain poorly understood despite their expanding economic roles. We analyze 50 LLMs using…

General Economics · Economics 2025-06-11 Shumiao Ouyang , Hayong Yun , Xingjian Zheng

Have Large Language Models (LLMs) developed a personality? The short answer is a resounding "We Don't Know!". In this paper, we show that we do not yet have the right tools to measure personality in language models. Personality is an…

Computation and Language · Computer Science 2023-05-25 Xiaoyang Song , Akshat Gupta , Kiyan Mohebbizadeh , Shujie Hu , Anant Singh

The growing interest in employing large language models (LLMs) for decision-making in social and economic contexts has raised questions about their potential to function as agents in these domains. A significant number of societal problems…

Computer Science and Game Theory · Computer Science 2025-11-25 Hadi Hosseini , Samarth Khanna

Large language models (LLMs) are increasingly being used in human-centered social scientific tasks, such as data annotation, synthetic data creation, and engaging in dialog. However, these tasks are highly subjective and dependent on human…

Computation and Language · Computer Science 2024-10-18 Salvatore Giorgi , Tingting Liu , Ankit Aich , Kelsey Isman , Garrick Sherman , Zachary Fried , João Sedoc , Lyle H. Ungar , Brenda Curtis

State of the art large language models (LLMs) have shown impressive performance on a variety of benchmark tasks and are increasingly used as components in larger applications, where LLM-based predictions serve as proxies for human…

Computation and Language · Computer Science 2024-06-14 Michael Franke , Polina Tsvilodub , Fausto Carcassi

Large Language Models (LLMs) behave non-deterministically, and prompting has become a common method for steering their outputs. A popular strategy is to assign a persona to the model to produce more varied, context-sensitive responses,…

Computation and Language · Computer Science 2026-04-21 Bruce W. Lee , Yeongheon Lee , Hyunsoo Cho