English
Related papers

Related papers: Measuring and Mitigating Bias for Tabular Datasets…

200 papers

There is a growing body of work that proposes methods for mitigating bias in machine learning systems. These methods typically rely on access to protected attributes such as race, gender, or age. However, this raises two significant…

This paper strives to address image classifier bias, with a focus on both feature and label embedding spaces. Previous works have shown that spurious correlations from protected attributes, such as age, gender, or skin tone, can cause…

Computer Vision and Pattern Recognition · Computer Science 2021-10-28 William Thong , Cees G. M. Snoek

Biased datasets are ubiquitous and present a challenge for machine learning. For a number of categories on a dataset that are equally important but some are sparse and others are common, the learning algorithms will favor the ones with more…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Glauco Amigo , Pablo Rivas Perea , Robert J. Marks

Empirical evidence suggests that algorithmic decisions driven by Machine Learning (ML) techniques threaten to discriminate against legally protected groups or create new sources of unfairness. This work supports the contextual approach to…

Computers and Society · Computer Science 2023-06-16 Lisa Koutsoviti Koumeri , Magali Legast , Yasaman Yousefi , Koen Vanhoof , Axel Legay , Christoph Schommer

Biases in existing datasets used to train algorithmic decision rules can raise ethical and economic concerns due to the resulting disparate treatment of different groups. We propose an algorithm for sequentially debiasing such datasets…

Machine Learning · Computer Science 2023-01-11 Yifan Yang , Yang Liu , Parinaz Naghizadeh

The deployment of Artificial Intelligence in high-risk domains, such as finance and healthcare, necessitates models that are both fair and transparent. While regulatory frameworks, including the EU's AI Act, mandate bias mitigation, they…

Machine Learning · Computer Science 2026-01-28 Jiří Němeček , Mark Kozdoba , Illia Kryvoviaz , Tomáš Pevný , Jakub Mareček

Datasets often contain biases which unfairly disadvantage certain groups, and classifiers trained on such datasets can inherit these biases. In this paper, we provide a mathematical formulation of how this bias can arise. We do so by…

Machine Learning · Computer Science 2019-01-16 Heinrich Jiang , Ofir Nachum

Demographic biases in source datasets have been shown as one of the causes of unfairness and discrimination in the predictions of Machine Learning models. One of the most prominent types of demographic bias are statistical imbalances in the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-26 Iris Dominguez-Catena , Daniel Paternain , Mikel Galar

Although significant progress has been made in face recognition, demographic bias still exists in face recognition systems. For instance, it usually happens that the face recognition performance for a certain demographic group is lower than…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Fu-En Wang , Chien-Yi Wang , Min Sun , Shang-Hong Lai

Objectives: Leveraging artificial intelligence (AI) in conjunction with electronic health records (EHRs) holds transformative potential to improve healthcare. Yet, addressing bias in AI, which risks worsening healthcare disparities, cannot…

Artificial Intelligence · Computer Science 2026-01-08 Feng Chen , Liqin Wang , Julie Hong , Jiaqi Jiang , Li Zhou

We propose a novel method for enforcing AI fairness with respect to protected or sensitive factors. This method uses a dual strategy performing training and representation alteration (TARA) for the mitigation of prominent causes of AI bias…

Machine Learning · Computer Science 2021-08-23 William Paul , Armin Hadzic , Neil Joshi , Fady Alajaji , Phil Burlina

Biases in the dataset often enable the model to achieve high performance on in-distribution data, while poorly performing on out-of-distribution data. To mitigate the detrimental effect of the bias on the networks, previous works have…

Computation and Language · Computer Science 2023-12-07 Eojin Jeon , Mingyu Lee , Juhyeong Park , Yeachan Kim , Wing-Lam Mok , SangKeun Lee

As AI systems become more embedded in everyday life, the development of fair and unbiased models becomes more critical. Considering the social impact of AI systems is not merely a technical challenge but a moral imperative. As evidenced in…

Machine Learning · Computer Science 2025-10-03 Aida Tayebi , Ali Khodabandeh Yalabadi , Mehdi Yazdani-Jahromi , Ozlem Ozmen Garibay

Fairness and bias are crucial concepts in artificial intelligence, yet they are relatively ignored in machine learning applications in clinical psychiatry. We computed fairness metrics and present bias mitigation strategies using a model…

Machine Learning · Computer Science 2022-05-25 Pablo Mosteiro , Jesse Kuiper , Judith Masthoff , Floortje Scheepers , Marco Spruit

We study fairness in supervised few-shot meta-learning models that are sensitive to discrimination (or bias) in historical data. A machine learning model trained based on biased data tends to make unfair predictions for users from minority…

Machine Learning · Computer Science 2020-09-25 Chen Zhao , Feng Chen

Arbitrary, inconsistent, or faulty decision-making raises serious concerns, and preventing unfair models is an increasingly important challenge in Machine Learning. Data often reflect past discriminatory behavior, and models trained on such…

Machine Learning · Computer Science 2023-06-29 I. Oliveira e Silva , C. Soares , I. Sousa , R. Ghani

In the data-driven artificial intelligence paradigm, models heavily rely on large amounts of training data. However, factors like sampling distribution imbalance can lead to issues of bias and unfairness in healthcare data. Sensitive…

Machine Learning · Computer Science 2023-06-08 Yinghao Zhu , Jingkun An , Enshen Zhou , Lu An , Junyi Gao , Hao Li , Haoran Feng , Bo Hou , Wen Tang , Chengwei Pan , Liantao Ma

Increasingly, software is making autonomous decisions in case of criminal sentencing, approving credit cards, hiring employees, and so on. Some of these decisions show bias and adversely affect certain social groups (e.g. those defined by…

Machine Learning · Computer Science 2021-07-12 Joymallya Chakraborty , Suvodeep Majumder , Tim Menzies

Context: Machine learning software can generate models that inappropriately discriminate against specific protected social groups (e.g., groups based on gender, ethnicity, etc). Motivated by those results, software engineering researchers…

Machine Learning · Computer Science 2022-10-31 Kewen Peng , Joymallya Chakraborty , Tim Menzies

Algorithms and technologies are essential tools that pervade all aspects of our daily lives. In the last decades, health care research benefited from new computer-based recruiting methods, the use of federated architectures for data…

Computers and Society · Computer Science 2023-01-26 Chiara Criscuolo , Tommaso Dolci , Mattia Salnitri