English
Related papers

Related papers: Predicting Effects, Missing Distributions: Evaluat…

200 papers

The rapid evolution of large language models (LLMs) and their capacity to simulate human cognition and behavior has given rise to LLM-based frameworks and tools that are evaluated and applied based on their ability to perform tasks…

Computation and Language · Computer Science 2024-12-03 Jing Yi Wang , Nicholas Sukiennik , Tong Li , Weikang Su , Qianyue Hao , Jingbo Xu , Zihan Huang , Fengli Xu , Yong Li

Large language model (LLM) simulations of human behavior have the potential to revolutionize the social and behavioral sciences, if and only if they faithfully reflect real human behaviors. Current evaluations of simulation fidelity are…

Computation and Language · Computer Science 2026-04-14 Tiancheng Hu , Joachim Baumann , Lorenzo Lupo , Nigel Collier , Dirk Hovy , Paul Röttger

In the present study, we investigate and compare reasoning in large language models (LLM) and humans using a selection of cognitive psychology tools traditionally dedicated to the study of (bounded) rationality. To do so, we presented to…

Computation and Language · Computer Science 2023-09-25 Nicolas Yax , Hernan Anlló , Stefano Palminteri

With the rapid advancement of large language models (LLMs) for handling complex language tasks, an increasing number of studies are employing LLMs as agents to emulate the sequential decision-making processes of humans often represented as…

Computation and Language · Computer Science 2024-12-19 Jia Gu , Liang Pang , Huawei Shen , Xueqi Cheng

Large Language Models (LLMs) are increasingly employed for simulating human behaviors across diverse domains. However, our position is that current LLM-based human simulations remain insufficiently reliable, as evidenced by significant…

Computation and Language · Computer Science 2025-12-02 Qian Wang , Jiaying Wu , Zichen Jiang , Zhenheng Tang , Bingqiao Luo , Nuo Chen , Wei Chen , Bingsheng He

Large language models (LLMs) have demonstrated unprecedented emergent capabilities, including content generation, translation, and simulation of human behavior. Field experiments, on the other hand, are widely employed in social studies to…

Computers and Society · Computer Science 2025-05-22 Yaoyu Chen , Yuheng Hu , Yingda Lu

Large language models (LLMs) are increasingly used to model human social behavior, with recent research exploring their ability to simulate social dynamics. Here, we test whether LLMs mirror human behavior in social dilemmas, where…

Social and Information Networks · Computer Science 2024-11-18 Jin Han , Balaraju Battu , Ivan Romić , Talal Rahwan , Petter Holme

Recent studies suggest large language models (LLMs) can exhibit human-like reasoning, aligning with human behavior in economic experiments, surveys, and political discourse. This has led many to propose that LLMs can be used as surrogates…

General Economics · Economics 2025-01-24 Yuan Gao , Dokyun Lee , Gordon Burtch , Sina Fazelpour

There is ongoing debate about whether large language models (LLMs) can serve as substitutes for human participants in survey and experimental research. While recent work in fields such as marketing and psychology has explored the potential…

Computation and Language · Computer Science 2025-12-30 Steven Wang , Kyle Hunt , Shaojie Tang , Kenneth Joseph

Accurately simulating human opinion dynamics is crucial for understanding a variety of societal phenomena, including polarization and the spread of misinformation. However, the agent-based models (ABMs) commonly used for such simulations…

Artificial Intelligence (AI) is increasingly being integrated into scientific research, particularly in the social sciences, where understanding human behavior is critical. Large Language Models (LLMs) have shown promise in replicating…

Computation and Language · Computer Science 2025-06-23 Ziyan Cui , Ning Li , Huaikang Zhou

This study explores the potential of large language models (LLMs) to conduct market experiments, aiming to understand their capability to comprehend competitive market dynamics. We model the behavior of market agents in a controlled…

Human-Computer Interaction · Computer Science 2024-11-04 Jingru Jia , Zehua Yuan

We investigate the choice patterns of Large Language Models (LLMs) in the context of Decisions from Experience tasks that involve repeated choice and learning from feedback, and compare their behavior to human participants. We find that on…

Artificial Intelligence · Computer Science 2025-03-14 Idan Horowitz , Ori Plonsky

As LLMs integrate into our daily lives, understanding their behavior becomes essential. In this work, we focus on behavioral dispositions$-$the underlying tendencies that shape responses in social contexts$-$and introduce a framework to…

Large language models (LLMs) are increasingly explored as substitutes for human participants in cognitive tasks, but their ability to simulate human behavioral variability remains unclear. This study examines whether LLMs can approximate…

Computation and Language · Computer Science 2026-02-27 Mengyang Qiu , Zoe Brisebois , Siena Sun

Aligning large language models (LLMs) with human intentions has become a critical task for safely deploying models in real-world systems. While existing alignment approaches have seen empirical success, theoretically understanding how these…

Machine Learning · Computer Science 2024-08-08 Shawn Im , Yixuan Li

Recent advancements in Large Language Models offer promising capabilities to simulate complex human social interactions. We investigate whether LLM-based multi-agent simulations can reproduce core human social dynamics observed in online…

Multiagent Systems · Computer Science 2025-07-31 Hsien-Tsung Lin , Pei-Cing Huang , Chan-Tung Ku , Chan Hsu , Pei-Xuan Shieh , Yihuang Kang

As large language models (LLMs) are increasingly used in human-centered tasks, assessing their psychological traits is crucial for understanding their social impact and ensuring trustworthy AI alignment. While existing reviews have covered…

Computers and Society · Computer Science 2025-05-02 Wenhan Dong , Yuemeng Zhao , Zhen Sun , Yule Liu , Zifan Peng , Jingyi Zheng , Zongmin Zhang , Ziyi Zhang , Jun Wu , Ruiming Wang , Shengmin Xu , Xinyi Huang , Xinlei He

The ability of Large Language Models (LLMs) to mimic human behavior triggered a plethora of computational social science research, assuming that empirical studies of humans can be conducted with AI agents instead. Since there have been…

Computation and Language · Computer Science 2025-10-21 Simon Münker , Nils Schwager , Achim Rettinger

Large Language Models (LLMs) are transforming programming practices, offering significant capabilities for code generation activities. While researchers have explored the potential of LLMs in various domains, this paper focuses on their use…

Software Engineering · Computer Science 2026-05-04 Deborah Etsenake , Meiyappan Nagappan