English
Related papers

Related papers: Evaluating LLMs as Human Surrogates in Controlled …

200 papers

Large language models (LLMs) are increasingly being used in human-centered social scientific tasks, such as data annotation, synthetic data creation, and engaging in dialog. However, these tasks are highly subjective and dependent on human…

Computation and Language · Computer Science 2024-10-18 Salvatore Giorgi , Tingting Liu , Ankit Aich , Kelsey Isman , Garrick Sherman , Zachary Fried , João Sedoc , Lyle H. Ungar , Brenda Curtis

Large Language Models (LLMs) demonstrate a remarkable capacity to adopt different personas and roles; however, it remains unclear whether they can manifest behavior that adheres to a coherent, human-like value structure. In this work, we…

Artificial Intelligence · Computer Science 2026-05-29 Asaf Yehudai , Naama Rozen , Ariel Gera

Large Language Models (LLMs) have demonstrated impressive capabilities in role-playing scenarios, particularly in simulating domain-specific experts using tailored prompts. This ability enables LLMs to adopt the persona of individuals with…

Artificial Intelligence · Computer Science 2025-01-14 Xinyao Ma , Rui Zhu , Zihao Wang , Jingwei Xiong , Qingyu Chen , Haixu Tang , L. Jean Camp , Lucila Ohno-Machado

A growing literature uses large language models (LLMs) as synthetic participants to generate cost-effective and nearly instantaneous responses in social science experiments. However, there is limited guidance on when such simulations…

Artificial Intelligence · Computer Science 2026-02-18 Jessica Hullman , David Broska , Huaman Sun , Aaron Shaw

An essential problem in artificial intelligence is whether LLMs can simulate human cognition or merely imitate surface-level behaviors, while existing datasets suffer from either synthetic reasoning traces or population-level aggregation,…

Computation and Language · Computer Science 2026-03-31 Yuxuan Gu , Lunjun Liu , Xiaocheng Feng , Kun Zhu , Weihong Zhong , Lei Huang , Bing Qin

Large language models (LLMs) are increasingly used to model human social behavior, with recent research exploring their ability to simulate social dynamics. Here, we test whether LLMs mirror human behavior in social dilemmas, where…

Social and Information Networks · Computer Science 2024-11-18 Jin Han , Balaraju Battu , Ivan Romić , Talal Rahwan , Petter Holme

In this study, we propose LLM agents as a novel approach in behavioral strategy research, complementing simulations and laboratory experiments to advance our understanding of cognitive processes in decision-making. Specifically, we…

General Economics · Economics 2024-10-10 Daniel Albert , Stephan Billinger

Large language models (LLMs) are increasingly used to support the analysis of complex financial disclosures, yet their reliability, behavioral consistency, and transparency remain insufficiently understood in high-stakes settings. This…

Computation and Language · Computer Science 2026-01-21 Md Talha Mohsin

Large language models (LLMs) have demonstrated unprecedented emergent capabilities, including content generation, translation, and simulation of human behavior. Field experiments, on the other hand, are widely employed in social studies to…

Computers and Society · Computer Science 2025-05-22 Yaoyu Chen , Yuheng Hu , Yingda Lu

Mixed methods research integrates quantitative and qualitative data but faces challenges in aligning their distinct structures, particularly in examining measurement characteristics and individual response patterns. Advances in large…

Computation and Language · Computer Science 2025-05-29 Jihong Zhang , Xinya Liang , Anqi Deng , Nicole Bonge , Lin Tan , Ling Zhang , Nicole Zarrett

The ability of Large Language Models (LLMs) to mimic human behavior triggered a plethora of computational social science research, assuming that empirical studies of humans can be conducted with AI agents instead. Since there have been…

Computation and Language · Computer Science 2025-10-21 Simon Münker , Nils Schwager , Achim Rettinger

The impressive capabilities of Large Language Models (LLMs) raise the possibility that synthetic agents can serve as substitutes for real participants in human-subject research. To evaluate this claim, prior research has largely focused on…

Artificial Intelligence · Computer Science 2026-05-11 James Mooney , Josef Woldense , Zheng Robert Jia , Shirley Anugrah Hayati , My Ha Nguyen , Vipul Raheja , Dongyeop Kang

Large Language Models (LLMs) do not differentially represent numbers, which are pervasive in text. In contrast, neuroscience research has identified distinct neural representations for numbers and words. In this work, we investigate how…

Artificial Intelligence · Computer Science 2024-01-10 Raj Sanjay Shah , Vijay Marupudi , Reba Koenen , Khushi Bhardwaj , Sashank Varma

Prevailing large language models (LLMs) are capable of human responses simulation through its unprecedented content generation and reasoning abilities. However, it is not clear whether and how to leverage LLMs to simulate field experiments.…

Artificial Intelligence · Computer Science 2024-08-20 Yaoyu Chen , Yuheng Hu , Yingda Lu

In recent years, large language models (LLMs) have been extensively utilized for behavioral modeling, for example, to automatically generate sequence diagrams. However, no overview of this work has been published yet. Such an overview will…

Software Engineering · Computer Science 2025-09-30 Muhammad Laiq

Personalizing digital applications for health behavior change is a promising route to making them more engaging and effective. This especially holds for approaches that adapt to users and their specific states (e.g., motivation, knowledge,…

Machine Learning · Computer Science 2025-11-25 Nele Albers , Esra Cemre Su de Groot , Loes Keijsers , Manon H. Hillegers , Emiel Krahmer

People acquire concepts through rich physical and social experiences and use them to understand and navigate the world. In contrast, large language models (LLMs), trained solely through next-token prediction on text, exhibit strikingly…

Computation and Language · Computer Science 2025-11-11 Ningyu Xu , Qi Zhang , Chao Du , Qiang Luo , Xipeng Qiu , Xuanjing Huang , Menghan Zhang

Large language models (LLMs) are the result of a massive experiment in bottom-up, data-driven reverse engineering of language at scale. Despite their utility in a number of downstream NLP tasks, ample research has shown that LLMs are…

Artificial Intelligence · Computer Science 2024-08-05 Walid S. Saba

Large language models (LLMs) increasingly operate in environments where they encounter social information such as other agents' answers, tool outputs, or human recommendations. In humans, such inputs influence judgments in ways that depend…

Artificial Intelligence · Computer Science 2026-02-17 Anooshka Bajaj , Zoran Tiganj

Large Language Models (LLMs) have demonstrated human-like capabilities in language comprehension and generation, becoming active participants in social and cognitive domains. This study investigates whether LLMs exhibit personality-like…

Computation and Language · Computer Science 2025-05-22 Wang Jiaqi , Wang bo , Guo fa , Cheng cheng , Yang li