English
Related papers

Related papers: Bias by Necessity: Impossibility Theorems for Sequ…

200 papers

As machine learning and algorithmic decision making systems are increasingly being leveraged in high-stakes human-in-the-loop settings, there is a pressing need to understand the rationale of their predictions. Researchers have responded to…

Machine Learning · Computer Science 2020-12-07 Jonathan Dinu , Jeffrey Bigham , J. Zico Kolter

Idiosyncratic tendency to choose one alternative over others in the absence of an identified reason, is a common observation in two-alternative forced-choice experiments. It is tempting to account for it as resulting from the (unknown)…

Neurons and Cognition · Quantitative Biology 2018-03-21 Lior Lebovich , Ran Darshan , Yoni Lavi , David Hansel , Yonatan Loewenstein

Objective: This paper develops a theoretical framework explaining when and why AI explanations enhance versus impair human decision-making. Background: Transparency is advocated as universally beneficial for human-AI interaction, yet…

Human-Computer Interaction · Computer Science 2026-01-21 Ancuta Margondai , Mustapha Mouloua

Continual learning--the ability to acquire, retain, and refine knowledge over time--has always been fundamental to intelligence, both human and artificial. Historically, different AI paradigms have acknowledged this need, albeit with…

Machine Learning · Computer Science 2025-06-05 Jack Bell , Luigi Quarantiello , Eric Nuertey Coleman , Lanpei Li , Malio Li , Mauro Madeddu , Elia Piccoli , Vincenzo Lomonaco

Transformer architectures have achieved state-of-the-art results on a variety of sequence modeling tasks. However, their attention mechanism comes with a quadratic complexity in sequence lengths, making the computational overhead…

Computation and Language · Computer Science 2022-06-03 Hao Peng , Jungo Kasai , Nikolaos Pappas , Dani Yogatama , Zhaofeng Wu , Lingpeng Kong , Roy Schwartz , Noah A. Smith

Building on the view of machine learning as search, we demonstrate the necessity of bias in learning, quantifying the role of bias (measured relative to a collection of possible datasets, or more generally, information resources) in…

Machine Learning · Computer Science 2019-07-16 George D. Montanez , Jonathan Hayase , Julius Lauw , Dominique Macias , Akshay Trikha , Julia Vendemiatti

Human society had a long history of suffering from cognitive biases leading to social prejudices and mass injustice. The prevalent existence of cognitive biases in large volumes of historical data can pose a threat of being manifested as…

Computers and Society · Computer Science 2020-07-29 Procheta Sen , Debasis Ganguly

AI/ML models have rapidly gained prominence as innovations for solving previously unsolved problems and their unintended consequences from amplifying human biases. Advocates for responsible AI/ML have sought ways to draw on the richer…

Artificial Intelligence · Computer Science 2025-11-27 Peter S. Hovmand , Kari O'Donnell , Callie Ogland-Hand , Brian Biroscak , Douglas D. Gunzler

Prompt-induced cognitive biases are changes in a general-purpose AI (GPAI) system's decisions caused solely by biased wording in the input (e.g., framing, anchors), not task logic. In software engineering (SE) decision support (where…

Software Engineering · Computer Science 2026-04-23 Francesco Sovrano , Gabriele Dominici , Alberto Bacchelli

Large language models are trained primarily on human-generated data and feedback, yet they exhibit persistent errors arising from annotation noise, subjective preferences, and the limited expressive bandwidth of natural language. We argue…

Machine Learning · Computer Science 2026-03-02 Alejandro Rodriguez Dominguez

Language models are known to absorb biases from their training data, leading to predictions driven by statistical regularities rather than semantic relevance. We investigate the impact of these biases on answer choice preferences in the…

Computation and Language · Computer Science 2025-08-12 Kyle Moore , Jesse Roberts , Thao Pham , Douglas Fisher

"Monkey see monkey do" is an age-old adage, referring to na\"ive imitation without a deep understanding of a system's underlying mechanics. Indeed, if a demonstrator has access to information unavailable to the imitator (monkey), such as a…

Machine Learning · Computer Science 2022-08-15 Daniel Kumor , Junzhe Zhang , Elias Bareinboim

While the interpretability of machine learning models is often equated with their mere syntactic comprehensibility, we think that interpretability goes beyond that, and that human interpretability should also be investigated from the point…

Machine Learning · Statistics 2021-09-14 Tomáš Kliegr , Štěpán Bahník , Johannes Fürnkranz

The intersection of causal inference and machine learning for decision-making is rapidly expanding, but the default decision criterion remains an \textit{average} of individual causal outcomes across a population. In practice, various…

Machine Learning · Computer Science 2022-11-08 Wenshuo Guo , Michael I. Jordan , Angela Zhou

Recent research demonstrated that training large language models involves memorization of a significant fraction of training data. Such memorization can lead to privacy violations when training on sensitive user data and thus motivates the…

Machine Learning · Computer Science 2025-10-29 Vitaly Feldman , Guy Kornowski , Xin Lyu

Accurately measuring discrimination in machine learning-based automated decision systems is required to address the vital issue of fairness between subpopulations and/or individuals. Any bias in measuring discrimination can lead to either…

Machine Learning · Computer Science 2023-10-23 Rūta Binkytė , Sami Zhioua , Yassine Turki

Autoregressive language models (ARMs) suffer from the reversal curse: after learning ''$A$ is $B$,'' they often fail on the reverse query ''$B$ is $A$.'' Masked diffusion language models (MDMs) exhibit this failure in a much weaker form,…

Artificial Intelligence · Computer Science 2026-05-13 Moongyu Jeon , Sangwoo Shin , BumJun Kim , Kyelim Lee , Albert No

Large language models improve with scale, yet feedback-based alignment still exhibits systematic deviations from intended behavior. Motivated by bounded rationality in economics and cognitive science, we view judgment as resource-limited…

Machine Learning · Computer Science 2025-09-22 Wenjun Cao

Foundation models excel in stable environments, yet often fail where reliability matters most: medicine, finance, and policy. This Fidelity Paradox is not just a data problem; it is structural. In domains where rules change over time, extra…

Machine Learning · Computer Science 2026-03-27 Steffen Lukas

Inclusion logic is a variant of dependence logic that was shown to have the same expressive power as positive greatest fixed-point logic. Inclusion logic is not axiomatizable in full, but its first-order consequences can be axiomatized. In…

Logic · Mathematics 2020-01-22 Fan Yang