中文
相关论文

相关论文: Evaluating Implicit Biases in LLM Reasoning throug…

200 篇论文

This study investigates the reasoning robustness of large language models (LLMs) on mathematical problem-solving tasks under systematically introduced input perturbations. Using the GSM8K dataset as a controlled testbed, we evaluate how…

人工智能 · 计算机科学 2025-04-04 Giannis Chatziveroglou , Richard Yun , Maura Kelleher

Statistical decision algorithms are increasingly deployed in domains where ground-truth labels are hard to obtain, such as hiring, university admissions, and content moderation. In these settings, models are typically trained on historical…

机器学习 · 计算机科学 2026-05-21 Calvin Isley , Johann D. Gaebler , Sharad Goel

Large Audio-Language Models (LALMs) are increasingly integrated into daily applications, yet their generative biases remain underexplored. Existing speech fairness benchmarks rely on synthetic speech and Multiple-Choice Questions (MCQs),…

音频与语音处理 · 电气工程与系统科学 2026-04-21 Yi-Cheng Lin , Yusuke Hirota , Sung-Feng Huang , Hung-yi Lee

Personalized alignment is crucial for enabling Large Language Models (LLMs) to engage effectively in user-centric interactions. However, current methods face a dual challenge: they fail to infer users' deep implicit preferences (including…

人工智能 · 计算机科学 2026-04-29 Peiming Li , Zhiyuan Hu , Yang Tang , Shiyu Li , Xi Chen

Large language models (LLMs) are increasingly used in domains where causal reasoning matters, yet it remains unclear whether their judgments reflect normative causal computation, human-like shortcuts, or brittle pattern matching. We…

人工智能 · 计算机科学 2026-03-16 Hanna M. Dettki , Charley M. Wu , Bob Rehder

Large language models (LLMs) are increasingly used in group decision-making, but their influence risks fostering conformity and reducing epistemic vigilance. Drawing on the Argumentative Theory of Reasoning, we argue that confirmation bias,…

人机交互 · 计算机科学 2025-10-02 Sander de Jong , Rune Møberg Jacobsen , Niels van Berkel

Automated assessment of open-ended student responses is a critical capability for scaling personalized feedback in education. While large language models (LLMs) have shown promise in grading tasks via in-context learning (ICL), their…

人工智能 · 计算机科学 2026-03-03 Yucheng Chu , Hang Li , Kaiqi Yang , Yasemin Copur-Gencturk , Kevin Haudek , Joseph Krajcik , Jiliang Tang

Bias and fairness risks in Large Language Models (LLMs) vary substantially across deployment contexts, yet existing approaches lack systematic guidance for selecting appropriate evaluation metrics. We present a decision framework that maps…

计算与语言 · 计算机科学 2026-05-12 Dylan Bouchard

Recent generations of language models have introduced Large Reasoning Models (LRMs) that generate detailed thinking processes before providing answers. While these models demonstrate improved performance on reasoning benchmarks, their…

人工智能 · 计算机科学 2025-11-21 Parshin Shojaee , Iman Mirzadeh , Keivan Alizadeh , Maxwell Horton , Samy Bengio , Mehrdad Farajtabar

Increasingly, software is making autonomous decisions in case of criminal sentencing, approving credit cards, hiring employees, and so on. Some of these decisions show bias and adversely affect certain social groups (e.g. those defined by…

机器学习 · 计算机科学 2021-07-12 Joymallya Chakraborty , Suvodeep Majumder , Tim Menzies

Large language models are increasingly used to support high-stakes decisions, potentially influencing who is granted bail or receives a loan. Naive chain-of-thought sampling can improve average decision accuracy, but has also been shown to…

机器学习 · 计算机科学 2025-07-16 Zara Hall , Melanie Subbiah , Thomas P Zollo , Kathleen McKeown , Richard Zemel

The widespread deployment of Large Language Models (LLMs) has intensified concerns about subtle social biases embedded in their outputs. Existing guardrails often fail when faced with indirect or contextually complex bias-inducing prompts.…

软件工程 · 计算机科学 2025-12-02 Sina Salimian , Gias Uddin , Sumon Biswas , Henry Leung

In recent years, Large Language Models have attracted growing interest for their significant potential, though concerns have rapidly emerged regarding unsafe behaviors stemming from inherent stereotypes and biases. Most research on…

计算与语言 · 计算机科学 2025-03-06 Akito Nakanishi , Yukie Sano , Geng Liu , Francesco Pierri

As large language models (LLMs) are adopted into frameworks that grant them the capacity to make real decisions, it is increasingly important to ensure that they are unbiased. In this paper, we argue that the predominant approach of simply…

计算机与社会 · 计算机科学 2026-01-13 Addison J. Wu , Ryan Liu , Xuechunzi Bai , Thomas L. Griffiths

Language Models (LMs) have been shown to inherit undesired biases that might hurt minorities and underrepresented groups if such systems were integrated into real-world applications without careful fairness auditing. This paper proposes…

计算与语言 · 计算机科学 2025-05-28 Mattia Setzu , Marta Marchiori Manerba , Pasquale Minervini , Debora Nozza

As black-box machine learning models grow in complexity and find applications in high-stakes scenarios, it is imperative to provide explanations for their predictions. Although Local Interpretable Model-agnostic Explanations (LIME) [22] is…

机器学习 · 计算机科学 2023-11-28 Zeren Tan , Yang Tian , Jian Li

Large language models (LLMs) have achieved remarkable multi-step reasoning capabilities across various domains. However, LLMs still face distinct challenges in complex logical reasoning, as (1) proof-finding requires systematic exploration…

计算与语言 · 计算机科学 2025-09-16 Kang He , Kaushik Roy

A central goal of cognitive science is to provide a computationally explicit account of both the structure of the mind and its development: what are the primitive representational building blocks of cognition, what are the rules via which…

人工智能 · 计算机科学 2025-07-08 Alyssa Loo , Ellie Pavlick , Roman Feiman

Large Language Models (LLMs), though shown to be effective in many applications, can vary significantly in their response quality. In this paper, we investigate this problem of prompt fairness: specifically, the phrasing of a prompt by…

机器学习 · 计算机科学 2025-11-26 Meiyu Zhong , Noel Teku , Ravi Tandon

Large language models (LLMs) are prone to capturing biases from training corpus, leading to potential negative social impacts. Existing prompt-based debiasing methods exhibit instability due to their sensitivity to prompt changes, while…

计算与语言 · 计算机科学 2025-07-08 Yichen Li , Zhiting Fan , Ruizhe Chen , Xiaotang Gai , Luqi Gong , Yan Zhang , Zuozhu Liu