English
Related papers

Related papers: Language Models Exhibit Inconsistent Biases Toward…

200 papers

Intelligent systems must maintain and manipulate task-relevant information online to adapt to dynamic environments and changing goals. This capacity, known as working memory, is fundamental to human reasoning and intelligence. Despite…

Machine Learning · Computer Science 2026-04-14 Hua-Dong Xiong , Li Ji-An , Jiaqi Huang , Robert C. Wilson , Kwonjoon Lee , Xue-Xin Wei

Accurately simulating human opinion dynamics is crucial for understanding a variety of societal phenomena, including polarization and the spread of misinformation. However, the agent-based models (ABMs) commonly used for such simulations…

Researchers have proposed the use of generative large language models (LLMs) to label data for research and applied settings. This literature emphasizes the improved performance of these models relative to other natural language models,…

Computation and Language · Computer Science 2025-06-17 Megan A. Brown , Shubham Atreja , Libby Hemphill , Patrick Y. Wu

The growing interest in employing large language models (LLMs) for decision-making in social and economic contexts has raised questions about their potential to function as agents in these domains. A significant number of societal problems…

Computer Science and Game Theory · Computer Science 2025-11-25 Hadi Hosseini , Samarth Khanna

Recent research has shown that hallucinations, omissions, and biases are prevalent in everyday use-cases of LLMs. However, chatbots used in medical contexts must provide consistent advice in situations where non-medical factors are…

Computation and Language · Computer Science 2025-11-05 Jonathan Liu , Haoling Qiu , Jonathan Lasko , Damianos Karakos , Mahsa Yarmohammadi , Mark Dredze

Large language models (LLMs) are increasingly used in high-stakes settings, where overconfident responses can mislead users. Reliable confidence estimation has been shown to enhance trust and task accuracy. Yet existing methods face…

Computation and Language · Computer Science 2025-09-30 Linwei Tao , Yi-Fan Yeh , Bo Kai , Minjing Dong , Tao Huang , Tom A. Lamb , Jialin Yu , Philip H. S. Torr , Chang Xu

Can AI be cognitively biased in automated information judgment tasks? Despite recent progresses in measuring and mitigating social and algorithmic biases in AI and large language models (LLMs), it is not clear to what extent LLMs behave…

Information Retrieval · Computer Science 2024-11-26 Jiqun Liu , Jiangen He

We conduct a quantitative analysis contrasting human-written English news text with comparable large language model (LLM) output from six different LLMs that cover three different families and four sizes in total. Our analysis spans several…

Computation and Language · Computer Science 2024-09-04 Alberto Muñoz-Ortiz , Carlos Gómez-Rodríguez , David Vilares

Recent advances in Large Language Models (LLMs) have enabled human-like responses across various tasks, raising questions about their ethical decision-making capabilities and potential biases. This study systematically evaluates how nine…

Computers and Society · Computer Science 2025-11-03 Wentao Xu , Yile Yan , Yuqi Zhu

As Large Language Models (LLMs) are increasingly deployed in customer-facing applications, a critical yet underexplored question is how users communicate differently with LLM chatbots compared to human agent. In this study, we present…

Computation and Language · Computer Science 2025-10-06 Fulei Zhang , Zhou Yu

Partner selection is crucial for cooperation and hinges on communication. As artificial agents, especially those powered by large language models (LLMs), become more autonomous, intelligent, and persuasive, they compete with humans for…

Human-Computer Interaction · Computer Science 2025-07-21 Yaomin Jiang , Levin Brinkmann , Anne-Marie Nussberger , Ivan Soraperra , Jean-François Bonnefon , Iyad Rahwan

Whether in agentic workflows, social studies, or chat settings, large language models (LLMs) are increasingly being asked to replace humans in choosing which goals to pursue, rather than completing predefined tasks. However, the assumption…

Computation and Language · Computer Science 2026-05-14 Gaia Molinaro , Dave August , Danielle Perszyk , Anne G. E. Collins

Differentiating generated and human-written content is increasingly difficult. We examine how an incentive to convey humanness and task characteristics shape this human vs AI race across five studies. In Study 1-2 (n=530 and n=610) humans…

Computation and Language · Computer Science 2026-01-26 Bennett Kleinberg , Jari Zegers , Jonas Festor , Stefana Vida , Julian Präsent , Riccardo Loconte , Sanne Peereboom

Humans are accustomed to reading and writing in a forward manner, and this natural bias extends to text understanding in auto-regressive large language models (LLMs). This paper investigates whether LLMs, like humans, struggle with reverse…

Computation and Language · Computer Science 2025-02-25 Sicheng Yu , Yuanchen Xu , Cunxiao Du , Yanying Zhou , Minghui Qiu , Qianru Sun , Hao Zhang , Jiawei Wu

When making decisions under uncertainty, individuals often deviate from rational behavior, which can be evaluated across three dimensions: risk preference, probability weighting, and loss aversion. Given the widespread use of large language…

Artificial Intelligence · Computer Science 2024-11-04 Jingru Jia , Zehua Yuan , Junhao Pan , Paul E. McNamara , Deming Chen

Large language models (LLMs) are increasingly used in domains where causal reasoning matters, yet it remains unclear whether their judgments reflect normative causal computation, human-like shortcuts, or brittle pattern matching. We…

Artificial Intelligence · Computer Science 2026-03-16 Hanna M. Dettki , Charley M. Wu , Bob Rehder

With the increasing prevalence of artificial intelligence, careful evaluation of inherent biases needs to be conducted to form the basis for alleviating the effects these predispositions can have on users. Large language models (LLMs) are…

Computation and Language · Computer Science 2025-05-08 David Exler , Mark Schutera , Markus Reischl , Luca Rettenberger

In the present study, we investigate and compare reasoning in large language models (LLM) and humans using a selection of cognitive psychology tools traditionally dedicated to the study of (bounded) rationality. To do so, we presented to…

Computation and Language · Computer Science 2023-09-25 Nicolas Yax , Hernan Anlló , Stefano Palminteri

The rapid rise in popularity of Large Language Models (LLMs) with emerging capabilities has spurred public curiosity to evaluate and compare different LLMs, leading many researchers to propose their own LLM benchmarks. Noticing preliminary…

Artificial Intelligence · Computer Science 2025-05-15 Timothy R. McIntosh , Teo Susnjak , Nalin Arachchilage , Tong Liu , Paul Watters , Malka N. Halgamuge

Large language model-based agents are becoming increasingly popular as a low-cost mechanism to provide personalized, conversational advice, and have demonstrated impressive capabilities in relatively simple scenarios, such as movie…

Artificial Intelligence · Computer Science 2025-04-16 Takehiro Takayanagi , Kiyoshi Izumi , Javier Sanz-Cruzado , Richard McCreadie , Iadh Ounis