English
Related papers

Related papers: Irrelevant Alternatives Bias Large Language Model …

200 papers

Recent works have showcased the ability of LLMs to embody diverse personas in their responses, exemplified by prompts like 'You are Yoda. Explain the Theory of Relativity.' While this ability allows personalization of LLMs and enables human…

Computation and Language · Computer Science 2024-01-30 Shashank Gupta , Vaishnavi Shrivastava , Ameet Deshpande , Ashwin Kalyan , Peter Clark , Ashish Sabharwal , Tushar Khot

Large language models (LLMs) are increasingly deployed in decision-support systems for high-stakes domains such as hiring and university admissions, where choices often involve selecting among competing alternatives. While prior work has…

Artificial Intelligence · Computer Science 2026-04-15 Haonan Yin , Shai Vardi , Vidyanand Choudhary

As artificial intelligence (AI) tools become widely adopted, large language models (LLMs) are increasingly involved on both sides of decision-making processes, ranging from hiring to content moderation. This dual adoption raises a critical…

Computers and Society · Computer Science 2026-02-10 Jiannan Xu , Gujie Li , Jane Yi Jiang

This study examines the use of Large Language Models (LLMs) for retrieving factual information, addressing concerns over their propensity to produce factually incorrect "hallucinated" responses or to altogether decline to even answer prompt…

Computation and Language · Computer Science 2024-03-15 Lauren Rhue , Sofie Goethals , Arun Sundararajan

Large language models (LLMs) are playing an increasingly integral, though largely informal, role in scholarly peer review. Yet it remains unclear whether LLMs reproduce the biases observed in human decision-making. We adapt a resume-style…

Computers and Society · Computer Science 2025-09-19 Anthony Howell , Jieshu Wang , Luyu Du , Julia Melkers , Varshil Shah

Large Language Models (LLMs) have made substantial progress in the past several months, shattering state-of-the-art benchmarks in many domains. This paper investigates LLMs' behavior with respect to gender stereotypes, a known issue for…

Computation and Language · Computer Science 2023-08-30 Hadas Kotek , Rikker Dockum , David Q. Sun

Recent advancements in Large Language Models (LLMs) have made them a popular information-seeking tool among end users. However, the statistical training methods for LLMs have raised concerns about their representation of under-represented…

Computation and Language · Computer Science 2025-04-09 Shiran Dudy , Thulasi Tholeti , Resmi Ramachandranpillai , Muhammad Ali , Toby Jia-Jun Li , Ricardo Baeza-Yates

Gender bias in artificial intelligence (AI) and natural language processing has garnered significant attention due to its potential impact on societal perceptions and biases. This research paper aims to analyze gender bias in Large Language…

Computation and Language · Computer Science 2023-09-04 Vishesh Thakur

In-context learning enables large language models (LLMs) to perform a variety of tasks, including learning to make reward-maximizing choices in simple bandit tasks. Given their potential use as (autonomous) decision-making agents, it is…

Computation and Language · Computer Science 2024-05-21 William M. Hayes , Nicolas Yax , Stefano Palminteri

Large Language Models (LLMs) such as ChatGPT have received enormous attention over the past year and are now used by hundreds of millions of people every day. The rapid adoption of this technology naturally raises questions about the…

Artificial Intelligence · Computer Science 2024-03-15 Jonathan Shaki , Sarit Kraus , Michael Wooldridge

Large Language Models (LLMs), such as GPT-4 and BERT, have rapidly gained traction in natural language processing (NLP) and are now integral to financial decision-making. However, their deployment introduces critical challenges,…

Computers and Society · Computer Science 2024-10-29 Hui Zhong , Songsheng Chen , Mian Liang

We investigate the choice patterns of Large Language Models (LLMs) in the context of Decisions from Experience tasks that involve repeated choice and learning from feedback, and compare their behavior to human participants. We find that on…

Artificial Intelligence · Computer Science 2025-03-14 Idan Horowitz , Ori Plonsky

The growing capability and availability of generative language models has enabled a wide range of new downstream tasks. Academic research has identified, quantified and mitigated biases present in language models but is rarely tailored to…

Computation and Language · Computer Science 2022-05-24 Conrad Borchers , Dalia Sara Gala , Benjamin Gilburt , Eduard Oravkin , Wilfried Bounsi , Yuki M. Asano , Hannah Rose Kirk

Large language models (LLMs) have demonstrated remarkable capabilities in simulating human behaviour and social intelligence. However, they risk perpetuating societal biases, especially when demographic information is involved. We introduce…

Computers and Society · Computer Science 2025-06-11 Bryan Chen Zhengyu Tan , Roy Ka-Wei Lee

Large language models are increasingly used to support organizational decisions from hiring to governance, raising fairness concerns in AI-assisted evaluation. Prior work has focused mainly on demographic bias and broader preference…

Computers and Society · Computer Science 2026-04-14 Shunqi Mao , Wei Guo , Dingxin Zhang , Chaoyi Zhang , Weidong Cai

Large language models (LLMs) are rapidly being adopted as research assistants, particularly for literature review and reference recommendation, yet little is known about whether they introduce demographic bias into citation workflows. This…

Digital Libraries · Computer Science 2025-08-06 Jiangen He

Large language models (LLMs) are employed to simulate human-like responses in social surveys, yet it remains unclear if they develop biases like social desirability response (SDR) bias. To investigate this, GPT-4 was assigned personas from…

Artificial Intelligence · Computer Science 2024-10-22 Sanguk Lee , Kai-Qi Yang , Tai-Quan Peng , Ruth Heo , Hui Liu

Large Language Models (LLMs) like GPT-4 and Gemini have significantly advanced artificial intelligence by enabling machines to generate and comprehend human-like text. Despite their impressive capabilities, LLMs are not immune to…

Computation and Language · Computer Science 2024-12-19 Jiaxu Lou , Yifan Sun

Social science research has shown that candidates with names indicative of certain races or genders often face discrimination in employment practices. Similarly, Large Language Models (LLMs) have demonstrated racial and gender biases in…

Artificial Intelligence · Computer Science 2024-10-08 Huy Nghiem , John Prindle , Jieyu Zhao , Hal Daumé

Learning-to-rank (LTR) algorithms are ubiquitous and necessary to explore the extensive catalogs of media providers. To avoid the user examining all the results, its preferences are used to provide a subset of relatively small size. The…