English
Related papers

Related papers: BiMi Sheets: Infosheets for bias mitigation method…

200 papers

Data collected in the real world often encapsulates historical discrimination against disadvantaged groups and individuals. Existing fair machine learning (FairML) research has predominantly focused on mitigating discriminative bias in the…

Machine Learning · Computer Science 2024-06-19 Zhining Liu , Ruizhong Qiu , Zhichen Zeng , Yada Zhu , Hendrik Hamann , Hanghang Tong

Machine learning (ML) algorithms have become integral to decision making in various domains, including healthcare, finance, education, and law enforcement. However, concerns about fairness and bias in these systems pose significant ethical…

Machine Learning · Computer Science 2024-12-18 Ahmed Rashed , Abdelkrim Kallich , Mohamed Eltayeb

Objectives: Leveraging artificial intelligence (AI) in conjunction with electronic health records (EHRs) holds transformative potential to improve healthcare. Yet, addressing bias in AI, which risks worsening healthcare disparities, cannot…

Artificial Intelligence · Computer Science 2026-01-08 Feng Chen , Liqin Wang , Julie Hong , Jiaqi Jiang , Li Zhou

Bias is known to be an impediment to fair decisions in many domains such as human resources, the public sector, health care etc. Recently, hope has been expressed that the use of machine learning methods for taking such decisions would…

Machine Learning · Computer Science 2019-09-05 Jindong Gu , Daniela Oelke

Fairness is a critical requirement for human-related, high-stakes software systems, motivating extensive research on bias mitigation. Prior work has largely focused on tabular data settings using traditional Machine Learning (ML) methods.…

Software Engineering · Computer Science 2026-04-15 Xinyue Li , Sixuan Li , Ying Xiao , Jie M. Zhang , Zhou Yang , Xuanzhe Liu , Zhenpeng Chen

Biases in machine learning pose significant challenges, particularly when models amplify disparities that affect disadvantaged groups. Traditional bias mitigation techniques often lead to a {\itshape leveling-down effect}, whereby improving…

Machine Learning · Computer Science 2025-09-03 Lucas Mansilla , Rodrigo Echeveste , Camila Gonzalez , Diego H. Milone , Enzo Ferrante

The rapid advancement of Language Model technologies has opened new opportunities, but also introduced new challenges related to bias and fairness. This paper explores the uncharted territory of potential biases in state-of-the-art…

Information Retrieval · Computer Science 2024-12-13 Hongliu Cao

Rapid advancements of large language models (LLMs) have enabled the processing, understanding, and generation of human-like text, with increasing integration into systems that touch our social sphere. Despite this success, these models can…

Computation and Language · Computer Science 2024-07-16 Isabel O. Gallegos , Ryan A. Rossi , Joe Barrow , Md Mehrab Tanjim , Sungchul Kim , Franck Dernoncourt , Tong Yu , Ruiyi Zhang , Nesreen K. Ahmed

Fairness in machine learning remains challenging due to its ethical complexity, the absence of a universal definition, and the need for context-specific bias metrics. Existing methods still struggle with intersectionality, multiclass…

Machine Learning · Computer Science 2026-05-01 Jeanne Monnier , Thomas George , Frédéric Guyard , Christèle Tarnec , Marios Kountouris

Machine learning models are increasingly being used in important decision-making software such as approving bank loans, recommending criminal sentencing, hiring employees, and so on. It is important to ensure the fairness of these models so…

Machine Learning · Computer Science 2020-09-23 Sumon Biswas , Hridesh Rajan

Machine learning (ML) is increasingly being used in critical decision-making software, but incidents have raised questions about the fairness of ML predictions. To address this issue, new tools and methods are needed to mitigate bias in…

Software Engineering · Computer Science 2023-08-30 Giang Nguyen , Sumon Biswas , Hridesh Rajan

The advent of AI and ML algorithms has led to opportunities as well as challenges. In this paper, we provide an overview of bias and fairness issues that arise with the use of ML algorithms. We describe the types and sources of data bias,…

Machine Learning · Statistics 2021-05-17 Nengfeng Zhou , Zach Zhang , Vijayan N. Nair , Harsh Singhal , Jie Chen , Agus Sudjianto

Bias in computer vision models remains a significant challenge, often resulting in unfair, unreliable, and non-generalizable AI systems. Although research into bias mitigation has intensified, progress continues to be hindered by fragmented…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Ioannis Sarridis , Christos Koutlis , Symeon Papadopoulos , Christos Diou

Machine learning (ML) has become a critical tool in public health, offering the potential to improve population health, diagnosis, treatment selection, and health system efficiency. However, biases in data and model design can result in…

Machine Learning · Computer Science 2023-04-12 Shaina Raza

As machine learning (ML) systems are increasingly adopted across industries, addressing fairness and bias has become essential. While many solutions focus on ethical challenges in ML, recent studies highlight that data itself is a major…

Software Engineering · Computer Science 2024-12-23 Gianmario Voria , Rebecca Di Matteo , Giammaria Giordano , Gemma Catolino , Fabio Palomba

An increased awareness concerning risks of algorithmic bias has driven a surge of efforts around bias mitigation strategies. A vast majority of the proposed approaches fall under one of two categories: (1) imposing algorithmic fairness…

Machine Learning · Computer Science 2023-07-11 Yunyi Li , Maria De-Arteaga , Maytal Saar-Tsechansky

In the process of evaluating competencies for job or student recruitment through material screening, decision-makers can be influenced by inherent cognitive biases, such as the screening order or anchoring information, leading to…

Human-Computer Interaction · Computer Science 2024-02-15 Qianyu Liu , Haoran Jiang , Zihao Pan , Qiushi Han , Zhenhui Peng , Quan Li

There are several bias mitigators that can reduce algorithmic bias in machine learning models but, unfortunately, the effect of mitigators on fairness is often not stable when measured across different data splits. A popular approach to…

Machine Learning · Computer Science 2022-02-03 Michael Feffer , Martin Hirzel , Samuel C. Hoffman , Kiran Kate , Parikshit Ram , Avraham Shinnar

Machine Learning models have been deployed across many different aspects of society, often in situations that affect social welfare. Although these models offer streamlined solutions to large problems, they may contain biases and treat…

Machine Learning · Computer Science 2021-06-22 Tal Feldman , Ashley Peake

With the growing adoption of Text-to-Image (TTI) systems, the social biases of these models have come under increased scrutiny. Herein we conduct a systematic investigation of one such source of bias for diffusion models: embedding spaces.…

Machine Learning · Computer Science 2024-09-17 Sahil Kuchlous , Marvin Li , Jeffrey G. Wang