English
Related papers

Related papers: Auditing Predictive Models for Intersectional Bias…

200 papers

Despite the constant development of new bias mitigation methods for machine learning, no method consistently succeeds, and a fundamental question remains unanswered: when and why do bias mitigation techniques fail? In this paper, we…

Machine Learning · Computer Science 2025-07-15 Anissa Alloula , Charles Jones , Ben Glocker , Bartłomiej W. Papież

Deep learning models often achieve high performance by inadvertently learning spurious correlations between targets and non-essential features. For example, an image classifier may identify an object via its background that spuriously…

Machine Learning · Computer Science 2025-06-19 Guangtao Zheng , Wenqian Ye , Aidong Zhang

Few-Shot Event Classification (FSEC) aims at developing a model for event prediction, which can generalize to new event types with a limited number of annotated data. Existing FSEC studies have achieved high accuracy on different…

Computation and Language · Computer Science 2021-08-31 Peiyi Wang , Runxin Xu , Tianyu Liu , Damai Dai , Baobao Chang , Zhifang Sui

A key question in causal inference analyses is how to find subgroups with elevated treatment effects. This paper takes a machine learning approach and introduces a generative model, Causal Rule Sets (CRS), for interpretable subgroup…

Artificial Intelligence · Computer Science 2021-05-21 Tong Wang , Cynthia Rudin

To mitigate the effects of undesired biases in models, several approaches propose to pre-process the input dataset to reduce the risks of discrimination by preventing the inference of sensitive attributes. Unfortunately, most of these…

Machine Learning · Computer Science 2023-02-21 Sébastien Gambs , Rosin Claude Ngueveu

Selection bias arises when the probability that an observation enters a dataset depends on variables related to the quantities of interest, leading to systematic distortions in estimation and uncertainty quantification. For example, in…

We propose a novel taxonomy for bias evaluation of discriminative foundation models, such as Contrastive Language-Pretraining (CLIP), that are used for labeling tasks. We then systematically evaluate existing methods for mitigating bias in…

Computer Vision and Pattern Recognition · Computer Science 2023-10-19 Junaid Ali , Matthaeus Kleindessner , Florian Wenzel , Kailash Budhathoki , Volkan Cevher , Chris Russell

Algorithmic fairness is an increasingly important field concerned with detecting and mitigating biases in machine learning models. There has been a wealth of literature for algorithmic fairness in regression and classification however there…

Computers and Society · Computer Science 2022-07-25 Raphael Sonabend , Florian Pfisterer , Alan Mishler , Moritz Schauer , Lukas Burk , Sumantrak Mukherjee , Sebastian Vollmer

The increasing impact of algorithmic decisions on people's lives compels us to scrutinize their fairness and, in particular, the disparate impacts that ostensibly-color-blind algorithms can have on different groups. Examples include credit…

Machine Learning · Statistics 2020-06-17 Nathan Kallus , Xiaojie Mao , Angela Zhou

The issue of bias (i.e., systematic unfairness) in machine learning models has recently attracted the attention of both researchers and practitioners. For the graph mining community in particular, an important goal toward algorithmic…

Human-Computer Interaction · Computer Science 2022-10-18 Agapi Rissaki , Bruno Scarone , David Liu , Aditeya Pandey , Brennan Klein , Tina Eliassi-Rad , Michelle A. Borkin

In this paper, we study the accuracy of values aggregated over classes predicted by a classification algorithm. The problem is that the resulting aggregates (e.g., sums of a variable) are known to be biased. The bias can be large even for…

Machine Learning · Statistics 2019-12-02 Q. A. Meertens , C. G. H. Diks , H. J. van den Herik , F W Takes

Dataset bias is a significant problem in training fair classifiers. When attributes unrelated to classification exhibit strong biases towards certain classes, classifiers trained on such dataset may overfit to these bias attributes,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Zaiying Zhao , Soichiro Kumano , Toshihiko Yamasaki

Counterfactual reasoning -- the practice of asking ``what if'' by varying inputs and observing changes in model behavior -- has become central to interpretable and fair AI. This thesis develops frameworks that use counterfactuals to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Pushkar Shukla

Group bias in natural language processing tasks manifests as disparities in system error rates across texts authorized by different demographic groups, typically disadvantaging minority groups. Dataset balancing has been shown to be…

Computation and Language · Computer Science 2022-05-17 Xudong Han , Timothy Baldwin , Trevor Cohn

The issue of fairness in machine learning models has recently attracted a lot of attention as ensuring it will ensure continued confidence of the general public in the deployment of machine learning systems. We focus on mitigating the harm…

Machine Learning · Statistics 2021-02-24 Thomas Kehrenberg , Zexun Chen , Novi Quadrianto

While training models and labeling data are resource-intensive, a wealth of pre-trained models and unlabeled data exists. To effectively utilize these resources, we present an approach to actively select pre-trained models while minimizing…

Machine Learning · Computer Science 2025-02-11 Xuefeng Liu , Fangfang Xia , Rick L. Stevens , Yuxin Chen

We consider the task of auditing ML models for individual bias/unfairness. We formalize the task in an optimization problem and develop a suite of inferential tools for the optimal value. Our tools permit us to obtain asymptotic confidence…

Machine Learning · Statistics 2020-03-12 Songkai Xue , Mikhail Yurochkin , Yuekai Sun

As the social impact of visual recognition has been under scrutiny, several protected-attribute balanced datasets emerged to address dataset bias in imbalanced datasets. However, in facial attribute classification, dataset bias stems from…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Jiazhi Li , Wael Abd-Almageed

Machine learning techniques have been widely used in natural language processing (NLP). However, as revealed by many recent studies, machine learning models often inherit and amplify the societal biases in data. Various metrics have been…

Computation and Language · Computer Science 2020-10-07 Jieyu Zhao , Kai-Wei Chang

Intersectional biases in healthcare data can produce compound disparities in clinical machine learning models, yet most fairness evaluations assess demographic attributes independently. FairLogue, a toolkit for intersectional fairness…

Computers and Society · Computer Science 2026-04-21 Nick Souligne , Vignesh Subbian