English
Related papers

Related papers: A Primer on Causal and Statistical Dataset Biases …

200 papers

Machine learning systems exhibit diverse failure modes: unfairness toward protected groups, brittleness to spurious correlations, poor performance on minority sub-populations, which are typically studied in isolation by distinct research…

Machine Learning · Computer Science 2025-11-12 Sushant Mehta

Many practical medical imaging scenarios include categories that are under-represented but still crucial. The relevance of image recognition models to real-world applications lies in their ability to generalize to these rare classes as well…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Daniya Najiha A. Kareem , Jean Lahoud , Mustansar Fiaz , Amandeep Kumar , Hisham Cholakkal

Computer vision technology is being used by many but remains representative of only a few. People have reported misbehavior of computer vision models, including offensive prediction results and lower performance for underrepresented groups.…

Computer Vision and Pattern Recognition · Computer Science 2019-12-18 Kaiyu Yang , Klint Qinami , Li Fei-Fei , Jia Deng , Olga Russakovsky

In recent years, machine learning algorithms have become ubiquitous in a multitude of high-stakes decision-making applications. The unparalleled ability of machine learning algorithms to learn patterns from data also enables them to…

Machine Learning · Computer Science 2022-07-14 José Pombal , André F. Cruz , João Bravo , Pedro Saleiro , Mário A. T. Figueiredo , Pedro Bizarro

Fairness has been identified as an important aspect of Machine Learning and Artificial Intelligence solutions for decision making. Recent literature offers a variety of approaches for debiasing, however many of them fall short when the data…

Machine Learning · Computer Science 2025-06-18 Ata Yalcin , Asli Umay Ozturk , Yigit Sever , Viktoria Pauw , Stephan Hachinger , Ismail Hakki Toroslu , Pinar Karagoz

Fairness constitutes a concern within machine learning (ML) applications. Currently, there is no study on how disparities in classification complexity between privileged and unprivileged groups could influence the fairness of solutions,…

Machine Learning · Computer Science 2025-04-09 Juliett Suárez Ferreira , Marija Slavkovik , Jorge Casillas

Inspired by recent breakthroughs in predictive modeling, practitioners in both industry and government have turned to machine learning with hopes of operationalizing predictions to drive automated decisions. Unfortunately, many social…

Computers and Society · Computer Science 2020-01-28 Sina Fazelpour , Zachary C. Lipton

With the aim of building machine learning systems that incorporate standards of fairness and accountability, we explore explicit subgroup sample complexity bounds. The work is motivated by the observation that classifier predictions for…

Machine Learning · Computer Science 2019-10-28 Ananth Balashankar , Alyssa Lees

In machine learning, training data often capture the behaviour of multiple subgroups of some underlying human population. This behaviour can often be modelled as observations of an unknown dynamical system with an unobserved state. When the…

Machine Learning · Computer Science 2023-05-17 Quan Zhou , Jakub Marecek , Robert N. Shorten

In recent years, there has been increasing interest in causal reasoning for designing fair decision-making systems due to its compatibility with legal frameworks, interpretability for human stakeholders, and robustness to spurious…

Machine Learning · Computer Science 2022-10-27 Aida Rahmattalabi , Alice Xiang

In medical image analysis, model predictions can be affected by sensitive attributes, such as race and gender, leading to fairness concerns and potential biases in diagnostic outcomes. To mitigate this, we present a causal modeling…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Bowei Tian , Yexiao He , Meng Liu , Yucong Dai , Ziyao Wang , Shwai He , Guoheng Sun , Zheyu Shen , Wanghao Ye , Yongkai Wu , Ang Li

Fairness is increasingly recognized as a critical component of machine learning systems. However, it is the underlying data on which these systems are trained that often reflects discrimination, suggesting a data management problem. In this…

Databases · Computer Science 2019-10-02 Babak Salimi , Bill Howe , Dan Suciu

Recent work on fairness in machine learning has focused on various statistical discrimination criteria and how they trade off. Most of these criteria are observational: They depend only on the joint distribution of predictor, protected…

In recent years there has been a rapid increase in classification methods on graph structured data. Both in graph kernels and graph neural networks, one of the implicit assumptions of successful state-of-the-art models was that…

Machine Learning · Computer Science 2019-11-01 Sergei Ivanov , Sergei Sviridov , Evgeny Burnaev

Machine learning models are increasingly being used in important decision-making software such as approving bank loans, recommending criminal sentencing, hiring employees, and so on. It is important to ensure the fairness of these models so…

Machine Learning · Computer Science 2020-09-23 Sumon Biswas , Hridesh Rajan

With the increasing application of machine learning in high-stake decision-making problems, potential algorithmic bias towards people from certain social groups poses negative impacts on individuals and our society at large. In the…

Machine Learning · Computer Science 2022-06-22 Ziwei Wu , Jingrui He

Bias in classifiers is a severe issue of modern deep learning methods, especially for their application in safety- and security-critical areas. Often, the bias of a classifier is a direct consequence of a bias in the training dataset,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Christian Reimers , Paul Bodesheim , Jakob Runge , Joachim Denzler

Machine learning algorithms are extensively used to make increasingly more consequential decisions about people, so achieving optimal predictive performance can no longer be the only focus. A particularly important consideration is fairness…

Machine Learning · Computer Science 2020-06-09 Giulio Morina , Viktoriia Oliinyk , Julian Waton , Ines Marusic , Konstantinos Georgatzis

One of the difficulties of artificial intelligence is to ensure that model decisions are fair and free of bias. In research, datasets, metrics, techniques, and tools are applied to detect and mitigate algorithmic unfairness and bias. This…

This paper revisits the principle of uniform convergence in statistical learning, discusses how it acts as the foundation behind machine learning, and attempts to gain a better understanding of the essential problem that current deep…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Lei Zhang , Heung-Yeung Shum