中文
相关论文

相关论文: Balancing Rigor and Utility: Mitigating Cognitive …

200 篇论文

Cognitive biases, systematic deviations from rationality in judgment, pose significant challenges in generating objective content. This paper introduces a novel approach for real-time cognitive bias detection in user-generated text using…

计算机与社会 · 计算机科学 2025-03-10 Frederic Lemieux , Aisha Behr , Clara Kellermann-Bryant , Zaki Mohammed

We present a large-scale evaluation of 30 cognitive biases in 20 state-of-the-art large language models (LLMs) under various decision-making scenarios. Our contributions include a novel general-purpose test framework for reliable and…

计算与语言 · 计算机科学 2025-11-04 Simon Malberg , Roman Poletukhin , Carolin M. Schuster , Georg Groh

New Large Language Models (LLMs) become available every few weeks, and modern application developers confronted with the unenviable task of having to decide if they should switch to a new model. While human evaluation remains the gold…

人工智能 · 计算机科学 2025-12-25 Suryaansh Jain , Umair Z. Ahmed , Shubham Sahai , Ben Leong

Large Language Models (LLMs) have revolutionized natural language processing, but their susceptibility to biases poses significant challenges. This comprehensive review examines the landscape of bias in LLMs, from its origins to current…

计算与语言 · 计算机科学 2026-05-04 Yufei Guo , Muzhe Guo , Juntao Su , Zhou Yang , Mengqiu Zhu , Hongfei Li , Mengyang Qiu , Shuo Shuo Liu

Large Language Models (LLMs) have emerged as promising solutions for a variety of medical and clinical decision support applications. However, LLMs are often subject to different types of biases, which can lead to unfair treatment of…

计算与语言 · 计算机科学 2024-08-23 Raphael Poulain , Hamed Fayyaz , Rahmatollah Beheshti

Do large language models (LLMs) display rational reasoning? LLMs have been shown to contain human biases due to the data they have been trained on; whether this is reflected in rational reasoning remains less clear. In this paper, we answer…

计算与语言 · 计算机科学 2024-02-16 Olivia Macmillan-Scott , Mirco Musolesi

We examine whether large language models (LLMs) can predict biased decision-making in conversational settings, and whether their predictions capture not only human cognitive biases but also how those effects change under cognitive load. In…

人机交互 · 计算机科学 2026-02-06 Stephen Pilli , Vivek Nallur

Multiple Choice Question (MCQ) answering is a widely used method for evaluating the performance of Large Language Models (LLMs). However, LLMs often exhibit selection bias in MCQ tasks, where their choices are influenced by factors like…

计算与语言 · 计算机科学 2025-12-01 Blessed Guda , Lawrence Francis , Gabrial Zencha Ashungafac , Carlee Joe-Wong , Moise Busogi

Large language models (LLMs) are revolutionizing every aspect of society. They are increasingly used in problem-solving tasks to substitute human assessment and reasoning. LLMs are trained on what humans write and are thus exposed to human…

软件工程 · 计算机科学 2025-10-14 Fengfei Sun , Ningke Li , Kailong Wang , Lorenz Goette

Recently, there has been a trend of evaluating the Large Language Model (LLM) quality in the flavor of LLM-as-a-Judge, namely leveraging another LLM to evaluate the current output quality. However, existing judges are proven to be biased,…

计算与语言 · 计算机科学 2024-09-26 Hongli Zhou , Hui Huang , Yunfei Long , Bing Xu , Conghui Zhu , Hailong Cao , Muyun Yang , Tiejun Zhao

Large Language Models (LLMs) have fundamentally transformed the field of natural language processing; however, their vulnerability to biases presents a notable obstacle that threatens both fairness and trust. This review offers an extensive…

计算与语言 · 计算机科学 2025-09-19 Kiana Kiashemshaki , Mohammad Jalili Torkamani , Negin Mahmoudi , Meysam Shirdel Bilehsavar

Large language models (LLMs) exhibit cognitive biases -- systematic tendencies of irrational decision-making, similar to those seen in humans. Prior work has found that these biases vary across models and can be amplified by instruction…

计算与语言 · 计算机科学 2025-07-15 Itay Itzhak , Yonatan Belinkov , Gabriel Stanovsky

Large Language Models (LLMs) are being adopted across a wide range of tasks, including decision-making processes in industries where bias in AI systems is a significant concern. Recent research indicates that LLMs can harbor implicit biases…

计算与语言 · 计算机科学 2024-10-18 Divyanshu Kumar , Umang Jain , Sahil Agarwal , Prashanth Harshangi

Large Language Models (LLMs) have advanced various Natural Language Processing (NLP) tasks, such as text generation and translation, among others. However, these models often generate texts that can perpetuate biases. Existing approaches to…

计算与语言 · 计算机科学 2025-01-07 Shaina Raza , Oluwanifemi Bamgbose , Shardul Ghuge , Fatemeh Tavakol , Deepak John Reji , Syed Raza Bashir

Large language models (LLMs) have achieved state-of-the-art performance on a series of natural language understanding tasks. However, these LLMs might rely on dataset bias and artifacts as shortcuts for prediction. This has significantly…

计算与语言 · 计算机科学 2023-05-09 Mengnan Du , Fengxiang He , Na Zou , Dacheng Tao , Xia Hu

Large Language Models (LLMs) are increasingly used in tasks such as psychological text analysis and decision-making in automated workflows. However, their reliability remains a concern due to potential biases inherited from their training…

计算与语言 · 计算机科学 2025-04-29 Yi-Long Lu , Chunhui Zhang , Wei Wang

Do generative AI models, particularly large language models (LLMs), exhibit systematic behavioral biases in economic and financial decisions? If so, how can these biases be mitigated? Drawing on the cognitive psychology and experimental…

综合经济学 · 经济学 2026-02-11 Pietro Bini , Lin William Cong , Xing Huang , Lawrence J. Jin

The widespread adoption of Large Language Models (LLMs) in software development is transforming programming from a solution-generative to a solution-evaluative activity. This shift opens a pathway for new cognitive challenges that amplify…

软件工程 · 计算机科学 2026-01-14 Xinyi Zhou , Zeinadsadat Saghi , Sadra Sabouri , Rahul Pandita , Mollie McGuire , Souti Chattopadhyay

Although large language models (LLMs) have demonstrated remarkable proficiency in modeling text and generating human-like text, they may exhibit biases acquired from training data in doing so. Specifically, LLMs may be susceptible to a…

计算与语言 · 计算机科学 2024-07-24 Pengda Wang , Zilin Xiao , Hanjie Chen , Frederick L. Oswald

Large Language Models (LLMs) face a fundamental challenge in deciding when to rely on rapid, intuitive responses versus engaging in slower, more deliberate reasoning. Inspired by Daniel Kahneman's dual-process theory and his insights on…

计算与语言 · 计算机科学 2025-08-26 Y. Du , C. Guo , W. Wang , G. Tang