中文
相关论文

相关论文: Reducing Selection Bias in Large Language Models

200 篇论文

Large Language Models (LLMs) are increasingly adopted in educational contexts to provide personalized support to students and teachers. The unprecedented capacity of LLM-based applications to understand and generate natural language can…

计算机与社会 · 计算机科学 2024-07-17 Jinsook Lee , Yann Hicke , Renzhe Yu , Christopher Brooks , René F. Kizilcec

Do large language models (LLMs) exhibit sociodemographic biases, even when they decline to respond? To bypass their refusal to "speak," we study this research question by probing contextualized embeddings and exploring whether this bias is…

计算与语言 · 计算机科学 2023-12-01 Raphael Tang , Xinyu Zhang , Jimmy Lin , Ferhan Ture

As large language models (LLMs) become more integrated into societal systems, the risk of them perpetuating and amplifying harmful biases becomes a critical safety concern. Traditional methods for mitigating bias often rely on data…

人工智能 · 计算机科学 2025-08-13 Shivam Dubey

Large language models (LLMs) have demonstrated their potential in social science research by emulating human perceptions and behaviors, a concept referred to as algorithmic fidelity. This study assesses the algorithmic fidelity and bias of…

人工智能 · 计算机科学 2024-08-09 S. Lee , T. Q. Peng , M. H. Goldberg , S. A. Rosenthal , J. E. Kotcher , E. W. Maibach , A. Leiserowitz

While large language models (LLMs) demonstrate impressive capabilities across numerous applications, their robustness remains a critical concern. This paper is motivated by a specific vulnerability: the order sensitivity of LLMs. This…

机器学习 · 计算机科学 2025-05-22 Beni Egressy , Jan Stühmer

Large Language Models (LLMs) are increasingly used for recommendation tasks due to their general-purpose capabilities. While LLMs perform well in rich-context settings, their behavior in cold-start scenarios, where only limited signals such…

信息检索 · 计算机科学 2025-09-09 Alexandre Andre , Gauthier Roy , Eva Dyer , Kai Wang

As educational systems evolve, ensuring that assessment items remain aligned with content standards is essential for maintaining fairness and instructional relevance. Traditional human alignment reviews are accurate but slow and…

人工智能 · 计算机科学 2025-11-26 Farzan Karimi-Malekabadi , Pooya Razavi , Sonya Powers

The rapid integration of Large Language Models (LLMs) into various domains raises concerns about societal inequalities and information bias. This study examines biases in LLMs related to background, gender, and age, with a focus on their…

计算与语言 · 计算机科学 2025-09-15 Willem Huijzer , Jieying Chen

Large Language Models (LLMs) are important tools for reasoning and problem-solving, while they often operate passively, answering questions without actively discovering new ones. This limitation reduces their ability to simulate human-like…

计算工程、金融与科学 · 计算机科学 2025-09-26 Hong Su

Recent studies show that instruction tuning (IT) and reinforcement learning from human feedback (RLHF) improve the abilities of large language models (LMs) dramatically. While these tuning methods can help align models with human objectives…

人工智能 · 计算机科学 2024-04-02 Itay Itzhak , Gabriel Stanovsky , Nir Rosenfeld , Yonatan Belinkov

Large language models (LLMs) are increasingly being integrated into search engines to provide natural language responses tailored to user queries. Customers and end-users are also becoming more dependent on these models for quick and easy…

信息检索 · 计算机科学 2024-09-04 Aounon Kumar , Himabindu Lakkaraju

As Large Language Models (LLMs) are increasingly embedded in real-world decision-making processes, it becomes crucial to examine the extent to which they exhibit cognitive biases. Extensively studied in the field of psychology, cognitive…

计算与语言 · 计算机科学 2025-09-30 R. Alexander Knipper , Charles S. Knipper , Kaiqi Zhang , Valerie Sims , Clint Bowers , Santu Karmaker

Model selection is a critical step in time series forecasting, traditionally requiring extensive performance evaluations across various datasets. Meta-learning approaches aim to automate this process, but they typically depend on…

机器学习 · 计算机科学 2025-04-04 Wang Wei , Tiankai Yang , Hongjie Chen , Ryan A. Rossi , Yue Zhao , Franck Dernoncourt , Hoda Eldardiry

Large language models (LLMs) often exhibit strong biases, e.g, against women or in favor of the number 7. We investigate whether LLMs would be able to output less biased answers when allowed to observe their prior answers to the same…

机器学习 · 计算机科学 2025-05-27 An Vo , Mohammad Reza Taesiri , Daeyoung Kim , Anh Totti Nguyen

Although large language models (LLMs) have demonstrated their effectiveness in a wide range of applications, they have also been observed to perpetuate unwanted biases present in the training data, potentially leading to harm for…

计算与语言 · 计算机科学 2026-03-09 Schrasing Tong , Eliott Zemour , Jessica Lu , Rawisara Lohanimit , Lalana Kagal

This study evaluates item neutralization assisted by the large language model (LLM) to reduce social desirability bias in personality assessment. GPT-o3 was used to rewrite the International Personality Item Pool Big Five Measure…

计算与语言 · 计算机科学 2025-09-25 Sirui Wu , Daijin Yang

Recent studies show that large language models (LLMs) improve their performance through self-feedback on certain tasks while degrade on others. We discovered that such a contrary is due to LLM's bias in evaluating their own output. In this…

计算与语言 · 计算机科学 2024-06-19 Wenda Xu , Guanglei Zhu , Xuandong Zhao , Liangming Pan , Lei Li , William Yang Wang

Despite large language models (LLMs) increasingly becoming important components of news recommender systems, employing LLMs in such systems introduces new risks, such as the influence of cognitive biases in LLMs. Cognitive biases refer to…

信息检索 · 计算机科学 2024-10-07 Yougang Lyu , Xiaoyu Zhang , Zhaochun Ren , Maarten de Rijke

We investigate the choice patterns of Large Language Models (LLMs) in the context of Decisions from Experience tasks that involve repeated choice and learning from feedback, and compare their behavior to human participants. We find that on…

人工智能 · 计算机科学 2025-03-14 Idan Horowitz , Ori Plonsky

Large language models (LLMs) show remarkable capabilities across a variety of tasks. Despite the models only seeing text in training, several recent studies suggest that LLM representations implicitly capture aspects of the underlying…

计算与语言 · 计算机科学 2024-04-16 Yutaro Yamada , Yihan Bao , Andrew K. Lampinen , Jungo Kasai , Ilker Yildirim