English
Related papers

Related papers: Systematic Biases in LLM Simulations of Debates

200 papers

Large language models (LLMs) are increasingly proposed as agents in strategic decision environments, yet their behavior in structured geopolitical simulations remains under-researched. We evaluate six popular state-of-the-art LLMs alongside…

Computation and Language · Computer Science 2026-03-03 Veronika Solopova , Viktoria Skorik , Maksym Tereshchenko , Alina Haidun , Ostap Vykhopen

Modeling subrational agents, such as humans or economic households, is inherently challenging due to the difficulty in calibrating reinforcement learning models or collecting data that involves human subjects. Existing work highlights the…

Artificial Intelligence · Computer Science 2024-02-15 Andrea Coletta , Kshama Dwarakanath , Penghang Liu , Svitlana Vyetrenko , Tucker Balch

Large Language Models (LLMs) have emerged as formidable instruments capable of comprehending and producing human-like text. This paper explores the potential of LLMs, to shape user perspectives and subsequently influence their decisions on…

Artificial Intelligence · Computer Science 2024-09-04 Ganesh Prasath Ramani , Shirish Karande , Santhosh V , Yash Bhatia

Languages are shaped by the inductive biases of their users. Using a classical referential game, we investigate how artificial languages evolve when optimised for inductive biases in humans and large language models (LLMs) via Human-Human,…

Computation and Language · Computer Science 2025-05-29 Tom Kouwenhoven , Max Peeperkorn , Roy de Kleijn , Tessa Verhoef

To some, the advent of artificial intelligence (AI) promises better decision-making and increased military effectiveness while reducing the influence of human error and emotions. However, there is still debate about how AI systems,…

Computers and Society · Computer Science 2024-10-04 Max Lamparth , Anthony Corso , Jacob Ganz , Oriana Skylar Mastro , Jacquelyn Schneider , Harold Trinkunas

As Large Language Model (LLM)-based agents increasingly engage with human society, how well do we understand their prosocial behaviors? We (1) investigate how LLM agents' prosocial behaviors can be induced by different personas and…

Computation and Language · Computer Science 2025-11-19 Ji Ma

Detecting biases in the outputs produced by generative models is essential to reduce the potential risks associated with their application in critical settings. However, the majority of existing methodologies for identifying biases in…

Computation and Language · Computer Science 2025-02-04 Erica Coppolillo , Giuseppe Manco , Luca Maria Aiello

Online social networks offer a valuable lens to analyze both individual and collective phenomena. Researchers often use simulators to explore controlled scenarios, and the integration of Large Language Models (LLMs) makes these simulations…

Social and Information Networks · Computer Science 2026-04-06 Elisa Composta , Nicolo' Fontana , Francesco Corso , Francesco Pierri

Large language models are increasingly used in decision-making tasks that require them to process information from a variety of sources, including both human experts and other algorithmic agents. How do LLMs weigh the information provided…

Artificial Intelligence · Computer Science 2026-02-26 Jessica Y. Bo , Lillio Mok , Ashton Anderson

Recent advancements in Large Language Models offer promising capabilities to simulate complex human social interactions. We investigate whether LLM-based multi-agent simulations can reproduce core human social dynamics observed in online…

Multiagent Systems · Computer Science 2025-07-31 Hsien-Tsung Lin , Pei-Cing Huang , Chan-Tung Ku , Chan Hsu , Pei-Xuan Shieh , Yihuang Kang

Humans act via a nuanced process that depends both on rational deliberation and also on identity and contextual factors. In this work, we study how large language models (LLMs) can simulate human action in the context of social dilemma…

Computation and Language · Computer Science 2026-02-03 Suhong Moon , Minwoo Kang , Joseph Suh , Mustafa Safdari , John Canny

The rapid evolution of large language models (LLMs) and their capacity to simulate human cognition and behavior has given rise to LLM-based frameworks and tools that are evaluated and applied based on their ability to perform tasks…

Computation and Language · Computer Science 2024-12-03 Jing Yi Wang , Nicholas Sukiennik , Tong Li , Weikang Su , Qianyue Hao , Jingbo Xu , Zihan Huang , Fengli Xu , Yong Li

The ability of Large Language Models (LLMs) to mimic human behavior triggered a plethora of computational social science research, assuming that empirical studies of humans can be conducted with AI agents instead. Since there have been…

Computation and Language · Computer Science 2025-10-21 Simon Münker , Nils Schwager , Achim Rettinger

Political beliefs vary significantly across different countries, reflecting distinct historical, cultural, and institutional contexts. These ideologies, ranging from liberal democracies to rigid autocracies, influence human societies, as…

Computers and Society · Computer Science 2025-10-07 Natalia Ożegalska-Łukasik , Szymon Łukasik

Simulated Students offer a valuable methodological framework for evaluating pedagogical approaches and modelling diverse learner profiles, tasks which are otherwise challenging to undertake systematically in real-world settings. Recent…

Computers and Society · Computer Science 2025-11-11 Luis Marquez-Carpintero , Alberto Lopez-Sellers , Miguel Cazorla

As modern large language models (LLMs) become integral to everyday tasks, concerns about their inherent biases and their potential impact on human decision-making have emerged. While bias in models are well-documented, less is known about…

Human-Computer Interaction · Computer Science 2026-03-20 Jillian Fisher , Shangbin Feng , Robert Aron , Thomas Richardson , Yejin Choi , Daniel W. Fisher , Jennifer Pan , Yulia Tsvetkov , Katharina Reinecke

The impressive capabilities of Large Language Models (LLMs) raise the possibility that synthetic agents can serve as substitutes for real participants in human-subject research. To evaluate this claim, prior research has largely focused on…

Artificial Intelligence · Computer Science 2026-05-11 James Mooney , Josef Woldense , Zheng Robert Jia , Shirley Anugrah Hayati , My Ha Nguyen , Vipul Raheja , Dongyeop Kang

Rapid advances in large language models (LLMs) have not only empowered autonomous agents to generate social networks, communicate, and form shared and diverging opinions on political issues, but have also begun to play a growing role in…

Social and Information Networks · Computer Science 2025-05-22 Jinghua Piao , Zhihong Lu , Chen Gao , Fengli Xu , Qinghua Hu , Fernando P. Santos , Yong Li , James Evans

Large language models (LLMs) offer emerging opportunities for psychological and behavioral research, but methodological guidance is lacking. This article provides a framework for using LLMs as psychological simulators across two primary…

Computers and Society · Computer Science 2026-04-07 Zhicheng Lin

Large language models (LLMs) are increasingly used in social science simulations. While their performance on reasoning and optimization tasks has been extensively evaluated, less attention has been paid to their ability to simulate human…

Computational Engineering, Finance, and Science · Computer Science 2025-08-25 Yuanjun Feng , Vivek Choudhary , Yash Raj Shrestha