English
Related papers

Related papers: Misalignment of LLM-Generated Personas with Human …

200 papers

With the rapid progress of Large Language Models (LLMs), the general public now has easy and affordable access to applications capable of answering most health-related questions in a personalized manner. These LLMs are increasingly proving…

Artificial Intelligence · Computer Science 2025-10-20 Emma Kondrup , Anne Imouza

Generative AI (GenAI) is increasingly used in survey contexts to simulate human preferences. While many research endeavors evaluate the quality of synthetic GenAI data by comparing model-generated responses to gold-standard survey results,…

Machine Learning · Computer Science 2025-02-25 Sarah Ball , Simeon Allmendinger , Frauke Kreuter , Niklas Kühl

Mixed methods research integrates quantitative and qualitative data but faces challenges in aligning their distinct structures, particularly in examining measurement characteristics and individual response patterns. Advances in large…

Computation and Language · Computer Science 2025-05-29 Jihong Zhang , Xinya Liang , Anqi Deng , Nicole Bonge , Lin Tan , Ling Zhang , Nicole Zarrett

Large Language Models (LLMs) are increasingly used in decision-making scenarios that involve risk assessment, yet their alignment with human economic rationality remains unclear. In this study, we investigate whether LLMs exhibit risk…

General Economics · Economics 2025-09-16 Jiaxin Liu , Yixuan Tang , Yi Yang , Kar Yan Tam

This report analyzes the potential for large language models (LLMs) to expedite accurate replication and generalization of published research about message effects in marketing. LLM-powered participants (personas) were tested by replicating…

Computation and Language · Computer Science 2025-04-28 Leo Yeykelis , Kaavya Pichai , James J. Cummings , Byron Reeves

We explore the potential of Large Language Models (LLMs) to replicate human behavior in economic market experiments. Compared to previous studies, we focus on dynamic feedback between LLM agents: the decisions of each LLM impact the market…

General Economics · Economics 2025-05-13 R. Maria del Rio-Chanona , Marco Pangallo , Cars Hommes

The emergence of Large Language Models (LLMs), has opened exciting possibilities for constructing computational simulations designed to replicate human behavior accurately. Current research suggests that LLM-based agents become increasingly…

Computation and Language · Computer Science 2024-12-18 Amir Taubenfeld , Yaniv Dover , Roi Reichart , Ariel Goldstein

Large language models (LLMs) are known to generate biased responses where the opinions of certain groups and populations are underrepresented. Here, we present a novel approach to achieve controllable generation of specific viewpoints using…

Computation and Language · Computer Science 2024-04-04 Junyi Li , Ninareh Mehrabi , Charith Peris , Palash Goyal , Kai-Wei Chang , Aram Galstyan , Richard Zemel , Rahul Gupta

Large Language Models (LLMs) have demonstrated exceptional capabilities in solving various tasks, progressively evolving into general-purpose assistants. The increasing integration of LLMs into society has sparked interest in whether they…

Computation and Language · Computer Science 2025-10-20 Yuan Li , Yue Huang , Hongyi Wang , Ying Cheng , Xiangliang Zhang , James Zou , Lichao Sun

Polite speech poses a fundamental alignment challenge for large language models (LLMs). Humans deploy a rich repertoire of linguistic strategies to balance informational and social goals -- from positive approaches that build rapport…

Computation and Language · Computer Science 2025-10-31 Haoran Zhao , Robert D. Hawkins

Large language models (LLMs) are increasingly used to simulate human behavior in social settings such as legal mediation, negotiation, and dispute resolution. However, it remains unclear whether these simulations reproduce the…

Artificial Intelligence · Computer Science 2026-02-10 Deuksin Kwon , Kaleen Shrestha , Bin Han , Spencer Lin , James Hale , Jonathan Gratch , Maja Matarić , Gale M. Lucas

Large Language Models (LLMs) have demonstrated human-like capabilities in language comprehension and generation, becoming active participants in social and cognitive domains. This study investigates whether LLMs exhibit personality-like…

Computation and Language · Computer Science 2025-05-22 Wang Jiaqi , Wang bo , Guo fa , Cheng cheng , Yang li

Artificial Intelligence (AI) is increasingly being integrated into scientific research, particularly in the social sciences, where understanding human behavior is critical. Large Language Models (LLMs) have shown promise in replicating…

Computation and Language · Computer Science 2025-06-23 Ziyan Cui , Ning Li , Huaikang Zhou

Psychological constructs within individuals are widely believed to be interconnected. We investigated whether and how Large Language Models (LLMs) can model the correlational structure of human psychological traits from minimal quantitative…

Artificial Intelligence · Computer Science 2026-03-24 Yi-Fei Liu , Yi-Long Lu , Di He , Hang Zhang

For socially sensitive tasks like hate speech detection, the quality of explanations from Large Language Models (LLMs) is crucial for factors like user trust and model alignment. While Persona prompting (PP) is increasingly used as a way to…

Computation and Language · Computer Science 2026-01-29 Jing Yang , Moritz Hechtbauer , Elisabeth Khalilov , Evelyn Luise Brinkmann , Vera Schmitt , Nils Feldhus

Large language models (LLMs) are increasingly utilised for social simulation and persona generation, necessitating an understanding of how they represent geopolitical identities. In this paper, we analyse personas generated for Palestinian…

Computation and Language · Computer Science 2026-03-25 Maida Aizaz , Quang Minh Nguyen

Motivated by the remarkable progress of large language models (LLMs) in objective tasks like mathematics and coding, there is growing interest in their potential to simulate human behavior--a capability with profound implications for…

Computation and Language · Computer Science 2026-01-23 Yuxuan Lei , Tianfu Wang , Jianxun Lian , Zhengyu Hu , Defu Lian , Xing Xie

Large Language Models (LLMs) such as OpenAI's GPT-4 and Meta's LLaMA offer a promising approach for scalable personality assessment from open-ended language. However, inferring personality traits remains challenging, and earlier work often…

Computation and Language · Computer Science 2025-07-22 Jianfeng Zhu , Ruoming Jin , Karin G. Coifman

Large language models (LLMs) are revolutionizing every aspect of society. They are increasingly used in problem-solving tasks to substitute human assessment and reasoning. LLMs are trained on what humans write and are thus exposed to human…

Software Engineering · Computer Science 2025-10-14 Fengfei Sun , Ningke Li , Kailong Wang , Lorenz Goette

Contemporary research in social sciences increasingly utilizes state-of-the-art generative language models to annotate or generate content. While these models achieve benchmark-leading performance on common language tasks, their application…

Computation and Language · Computer Science 2025-07-15 Simon Münker