English
Related papers

Related papers: Measuring and Mitigating Bias for Tabular Datasets…

200 papers

Bias mitigation in machine learning models is imperative, yet challenging. While several approaches have been proposed, one view towards mitigating bias is through adversarial learning. A discriminator is used to identify the bias…

Machine Learning · Computer Science 2022-02-23 Vinod K Kurmi , Rishabh Sharma , Yash Vardhan Sharma , Vinay P. Namboodiri

Artificial intelligence (AI) holds great promise for transforming healthcare. However, despite significant advances, the integration of AI solutions into real-world clinical practice remains limited. A major barrier is the quality and…

Artificial Intelligence · Computer Science 2025-10-24 Anna Arias-Duart , Maria Eugenia Cardello , Atia Cortés

In today's society, AI systems are increasingly used to make critical decisions such as credit scoring and patient triage. However, great convenience brought by AI systems comes with troubling prevalence of bias against underrepresented…

Machine Learning · Computer Science 2021-05-11 Yan Zhou , Murat Kantarcioglu , Chris Clifton

The vast majority of techniques to train fair models require access to the protected attribute (e.g., race, gender), either at train time or in production. However, in many important applications this protected attribute is largely…

Machine Learning · Computer Science 2023-10-04 Hadi Elzayn , Emily Black , Patrick Vossler , Nathanael Jo , Jacob Goldin , Daniel E. Ho

In this work, we present a framework to measure and mitigate intrinsic biases with respect to protected variables --such as gender-- in visual recognition tasks. We show that trained models significantly amplify the association of target…

Computer Vision and Pattern Recognition · Computer Science 2019-10-14 Tianlu Wang , Jieyu Zhao , Mark Yatskar , Kai-Wei Chang , Vicente Ordonez

Subset selection algorithms are ubiquitous in AI-driven applications, including, online recruiting portals and image search engines, so it is imperative that these tools are not discriminatory on the basis of protected attributes such as…

Computers and Society · Computer Science 2021-02-23 Anay Mehrotra , L. Elisa Celis

Artificial Intelligence (AI) systems are not intrinsically neutral and biases trickle in any type of technological tool. In particular when dealing with people, the impact of AI algorithms' technical errors originating with mislabeled data…

Artificial Intelligence · Computer Science 2025-04-03 Camilla Quaresmini , Giuseppe Primiero

Facial analysis models are increasingly applied in real-world applications that have significant impact on peoples' lives. However, as literature has shown, models that automatically classify facial attributes might exhibit algorithmic…

Computer Vision and Pattern Recognition · Computer Science 2022-06-15 Camila Kolling , Victor Araujo , Adriano Veloso , Soraia Raupp Musse

Whereas previous post-processing approaches for increasing the fairness of predictions of biased classifiers address only group fairness, we propose a method for increasing both individual and group fairness. Our novel framework includes an…

Fairness has been identified as an important aspect of Machine Learning and Artificial Intelligence solutions for decision making. Recent literature offers a variety of approaches for debiasing, however many of them fall short when the data…

Machine Learning · Computer Science 2025-06-18 Ata Yalcin , Asli Umay Ozturk , Yigit Sever , Viktoria Pauw , Stephan Hachinger , Ismail Hakki Toroslu , Pinar Karagoz

Data collected in the real world often encapsulates historical discrimination against disadvantaged groups and individuals. Existing fair machine learning (FairML) research has predominantly focused on mitigating discriminative bias in the…

Machine Learning · Computer Science 2024-06-19 Zhining Liu , Ruizhong Qiu , Zhichen Zeng , Yada Zhu , Hendrik Hamann , Hanghang Tong

Fairness is a critical requirement for Machine Learning (ML) software, driving the development of numerous bias mitigation methods. Previous research has identified a leveling-down effect in bias mitigation for computer vision and natural…

Machine Learning · Computer Science 2025-08-06 Zhenpeng Chen , Xinyue Li , Jie M. Zhang , Weisong Sun , Ying Xiao , Tianlin Li , Yiling Lou , Yang Liu

We tackle societal bias in image-text datasets by removing spurious correlations between protected groups and image attributes. Traditional methods only target labeled attributes, ignoring biases from unlabeled ones. Using text-guided…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Yusuke Hirota , Jerone T. A. Andrews , Dora Zhao , Orestis Papakyriakopoulos , Apostolos Modas , Yuta Nakashima , Alice Xiang

A major problem with using automated classification systems is that if they are not engineered correctly and with fairness considerations, they could be detrimental to certain populations. Furthermore, while engineers have developed…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Dalia Ortiz Pablo , Sushruth Badri , Erik Norén , Christoph Nötzli

The increasing integration of machine learning algorithms in daily life underscores the critical need for fairness and equity in their deployment. As these technologies play a pivotal role in decision-making, addressing biases across…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Guanyu Hu , Eleni Papadopoulou , Dimitrios Kollias , Paraskevi Tzouveli , Jie Wei , Xinyu Yang

Bias originates from both data and algorithmic design, often exacerbated by traditional fairness methods that fail to address the subtle impacts of protected attributes. This study introduces an approach to mitigate bias in machine learning…

Machine Learning · Computer Science 2024-10-08 Khadija Zanna , Akane Sano

Data-driven algorithms are only as good as the data they work with, while data sets, especially social data, often fail to represent minorities adequately. Representation Bias in data can happen due to various reasons ranging from…

Databases · Computer Science 2023-03-21 Nima Shahbazi , Yin Lin , Abolfazl Asudeh , H. V. Jagadish

There are several algorithms for measuring fairness of ML models. A fundamental assumption in these approaches is that the ground truth is fair or unbiased. In real-world datasets, however, the ground truth often contains data that is a…

Machine Learning · Computer Science 2023-11-02 Srinivasan H Sengamedu , Hien Pham

Model fairness is an essential element for Trustworthy AI. While many techniques for model fairness have been proposed, most of them assume that the training and deployment data distributions are identical, which is often not true in…

Machine Learning · Computer Science 2023-02-07 Yuji Roh , Kangwook Lee , Steven Euijong Whang , Changho Suh

In this paper, we consider a theoretical model for injecting data bias, namely, under-representation and label bias (Blum & Stangl, 2019). We empirically study the effect of varying data biases on the accuracy and fairness of fair…

Machine Learning · Computer Science 2023-12-12 Mohit Sharma , Amit Deshpande , Rajiv Ratn Shah