English
Related papers

Related papers: A survey on bias in machine learning research

200 papers

Machine learning models are central to people's lives and impact society in ways as fundamental as determining how people access information. The gravity of these models imparts a responsibility to model developers to ensure that they are…

Applications · Statistics 2020-07-13 Cyrus DiCiccio , Sriram Vasudevan , Kinjal Basu , Krishnaram Kenthapadi , Deepak Agarwal

This work facilitates ensuring fairness of machine learning in the real world by decoupling fairness considerations in compound decisions. In particular, this work studies how fairness propagates through a compound decision-making…

Computers and Society · Computer Science 2017-07-04 Amanda Bower , Sarah N. Kitchen , Laura Niss , Martin J. Strauss , Alexander Vargas , Suresh Venkatasubramanian

This paper clarifies why bias cannot be completely mitigated in Machine Learning (ML) and proposes an end-to-end methodology to translate the ethical principle of justice and fairness into the practice of ML development as an ongoing…

Computers and Society · Computer Science 2023-04-14 Georgina Curto , Flavio Comim

Due to the widespread use of data-powered systems in our everyday lives, concepts like bias and fairness gained significant attention among researchers and practitioners, in both industry and academia. Such issues typically emerge from the…

Machine Learning · Computer Science 2023-05-18 Gianluca Demartini , Kevin Roitero , Stefano Mizzaro

While algorithmic fairness is a thriving area of research, in practice, mitigating issues of bias often gets reduced to enforcing an arbitrarily chosen fairness metric, either by enforcing fairness constraints during the optimization step,…

Machine Learning · Computer Science 2023-10-02 Emily Black , Rakshit Naidu , Rayid Ghani , Kit T. Rodolfa , Daniel E. Ho , Hoda Heidari

While interest in the application of machine learning to improve healthcare has grown tremendously in recent years, a number of barriers prevent deployment in medical practice. A notable concern is the potential to exacerbate entrenched…

Machine Learning · Computer Science 2022-05-19 Isabel Chien , Nina Deliu , Richard E. Turner , Adrian Weller , Sofia S. Villar , Niki Kilbertus

In an ideal world, deployed machine learning models will enhance our society. We hope that those models will provide unbiased and ethical decisions that will benefit everyone. However, this is not always the case; issues arise during the…

Computers and Society · Computer Science 2021-11-25 Jasmine DeHart , Chenguang Xu , Lisa Egede , Christan Grant

Machine learning models are increasingly being used in important decision-making software such as approving bank loans, recommending criminal sentencing, hiring employees, and so on. It is important to ensure the fairness of these models so…

Machine Learning · Computer Science 2020-09-23 Sumon Biswas , Hridesh Rajan

As quantum machine learning (QML) emerges as a promising field at the intersection of quantum computing and artificial intelligence, it becomes crucial to address the biases and challenges that arise from the unique nature of quantum…

Quantum Physics · Physics 2024-10-01 Nandhini Swaminathan , David Danks

Fairness in both Machine Learning (ML) predictions and human decision-making is essential, yet both are susceptible to different forms of bias, such as algorithmic and data-driven in ML, and cognitive or subjective in humans. In this study,…

Computation and Language · Computer Science 2025-08-28 Junhua Liu , Roy Ka-Wei Lee , Kwan Hui Lim

As machine learning (ML) systems get adopted in more critical areas, it has become increasingly crucial to address the bias that could occur in these systems. Several fairness pre-processing algorithms are available to alleviate implicit…

Fairness in machine learning (ML) has become a rapidly growing area of research. But why, in the first place, is unfairness in ML wrong? And why should we care about improving fairness? Most fair-ML research implicitly appeals to…

Machine Learning · Computer Science 2026-02-27 Youjin Kong

A significant impediment to progress in research on bias in machine learning (ML) is the availability of relevant datasets. This situation is unlikely to change much given the sensitivity of such data. For this reason, there is a role for…

Machine Learning · Computer Science 2021-08-05 William Blanzeisky , Pádraig Cunningham , Kenneth Kennedy

As machine learning methods gain prominence within clinical decision-making, addressing fairness concerns becomes increasingly urgent. Despite considerable work dedicated to detecting and ameliorating algorithmic bias, today's methods are…

Machine Learning · Computer Science 2023-08-01 Charles Jones , Daniel C. Castro , Fabio De Sousa Ribeiro , Ozan Oktay , Melissa McCradden , Ben Glocker

Accurately measuring discrimination is crucial to faithfully assessing fairness of trained machine learning (ML) models. Any bias in measuring discrimination leads to either amplification or underestimation of the existing disparity.…

Machine Learning · Computer Science 2023-06-09 Sami Zhioua , Rūta Binkytė

The rise of machine learning (ML) is accompanied by several high-profile cases that have stressed the need for fairness, accountability, explainability and trust in ML systems. The existing literature has largely focused on fully automated…

Computers and Society · Computer Science 2023-06-14 Bhavya Ghai

A significant level of stigma and inequality exists in mental healthcare, especially in under-served populations. Inequalities are reflected in the data collected for scientific purposes. When not properly accounted for, machine learning…

Software bias is an increasingly important operational concern for software engineers. We present a large-scale, comprehensive empirical study of 17 representative bias mitigation methods for Machine Learning (ML) classifiers, evaluated…

Software Engineering · Computer Science 2023-02-13 Zhenpeng Chen , Jie M. Zhang , Federica Sarro , Mark Harman

With the increase in adoption of machine learning tools by organizations risks of unfairness abound, especially when human decision processes in outcomes of socio-economic importance such as hiring, housing, lending, and admissions are…

Computers and Society · Computer Science 2020-09-11 Lily Morse , Mike H. M. Teodorescu , Yazeed Awwad , Gerald Kane

The definition and implementation of fairness in automated decisions has been extensively studied by the research community. Yet, there hides fallacious reasoning, misleading assertions, and questionable practices at the foundations of the…

Computers and Society · Computer Science 2023-06-05 Robert Lee Poe , Soumia Zohra El Mestari