English
Related papers

Related papers: Hidden Technical Debts for Fair Machine Learning i…

200 papers

A growing body of literature in fairness-aware machine learning (fairML) aims to mitigate machine learning (ML)-related unfairness in automated decision-making (ADM) by defining metrics that measure fairness of an ML model and by proposing…

Machine Learning · Computer Science 2025-07-14 Ludwig Bothmann , Kristina Peters , Bernd Bischl

The rise in the use of AI/ML applications across industries has sparked more discussions about the fairness of AI/ML in recent times. While prior research on the fairness of AI/ML exists, there is a lack of empirical studies focused on…

Computers and Society · Computer Science 2024-08-02 Aastha Pant , Rashina Hoda , Chakkrit Tantithamthavorn , Burak Turhan

Unfair behaviors of Machine Learning (ML) software have garnered increasing attention and concern among software engineers. To tackle this issue, extensive research has been dedicated to conducting fairness testing of ML software, and this…

Software Engineering · Computer Science 2024-03-07 Zhenpeng Chen , Jie M. Zhang , Max Hort , Mark Harman , Federica Sarro

A machine-learned system that is fair in static decision-making tasks may have biased societal impacts in the long-run. This may happen when the system interacts with humans and feedback patterns emerge, reinforcing old biases in the system…

Computers and Society · Computer Science 2023-05-09 Thomas A. Henzinger , Mahyar Karimi , Konstantin Kueffner , Kaushik Mallik

One of the difficulties of artificial intelligence is to ensure that model decisions are fair and free of bias. In research, datasets, metrics, techniques, and tools are applied to detect and mitigate algorithmic unfairness and bias. This…

Given the inherent non-deterministic nature of machine learning (ML) systems, their behavior in production environments can lead to unforeseen and potentially dangerous outcomes. For a timely detection of unwanted behavior and to prevent…

Software Engineering · Computer Science 2025-10-01 Hira Naveed , John Grundy , Chetan Arora , Hourieh Khalajzadeh , Omar Haggag

The widespread use of machine learning in credit scoring has brought significant advancements in risk assessment and decision-making. However, it has also raised concerns about potential biases, discrimination, and lack of transparency in…

As machine learning (ML) systems are increasingly adopted across industries, addressing fairness and bias has become essential. While many solutions focus on ethical challenges in ML, recent studies highlight that data itself is a major…

Software Engineering · Computer Science 2024-12-23 Gianmario Voria , Rebecca Di Matteo , Giammaria Giordano , Gemma Catolino , Fabio Palomba

As machine learning (ML) systems become central to critical decision-making, concerns over fairness and potential biases have increased. To address this, the software engineering (SE) field has introduced bias mitigation techniques aimed at…

Software Engineering · Computer Science 2025-03-21 Alessandra Parziale , Gianmario Voria , Giammaria Giordano , Gemma Catolino , Gregorio Robles , Fabio Palomba

There is substantial evidence that Artificial Intelligence (AI) and Machine Learning (ML) algorithms can generate bias against minorities, women, and other protected classes. Federal and state laws have been enacted to protect consumers…

Computers and Society · Computer Science 2021-08-23 Nicholas Schmidt , Bryce Stephens

Bias in machine learning has rightly received significant attention over the last decade. However, most fair machine learning (fair-ML) work to address bias in decision-making systems has focused solely on the offline setting. Despite the…

With the growing utilization of machine learning in healthcare, there is increasing potential to enhance healthcare outcomes. However, this also brings the risk of perpetuating biases in data and model design that can harm certain…

Machine Learning · Computer Science 2023-08-15 Shaina Raza , Parisa Osivand Pour , Syed Raza Bashir

Concerns about the societal impact of AI-based services and systems has encouraged governments and other organisations around the world to propose AI policy frameworks to address fairness, accountability, transparency and related topics. To…

Software bias is an increasingly important operational concern for software engineers. We present a large-scale, comprehensive empirical study of 17 representative bias mitigation methods for Machine Learning (ML) classifiers, evaluated…

Software Engineering · Computer Science 2023-02-13 Zhenpeng Chen , Jie M. Zhang , Federica Sarro , Mark Harman

As financial institutions increasingly rely on machine learning models to automate lending decisions, concerns about algorithmic fairness have risen. This paper explores the tradeoff between enforcing fairness constraints (such as…

Computers and Society · Computer Science 2025-06-05 Aayam Bansal

The deployment of biased machine learning (ML) models has resulted in adverse effects in crucial sectors such as criminal justice and healthcare. To address these challenges, a diverse range of machine learning fairness interventions have…

Software Engineering · Computer Science 2025-07-10 Sadia Afrin Mim , Fatema Tuz Zohra , Justin Smith , Brittany Johnson

Recent years have seen the development of many open-source ML fairness toolkits aimed at helping ML practitioners assess and address unfairness in their systems. However, there has been little research investigating how ML practitioners…

Human-Computer Interaction · Computer Science 2023-01-11 Wesley Hanwen Deng , Manish Nagireddy , Michelle Seng Ah Lee , Jatinder Singh , Zhiwei Steven Wu , Kenneth Holstein , Haiyi Zhu

The financial services industry has unique explainability and fairness challenges arising from compliance and ethical considerations in credit decisioning. These challenges complicate the use of model machine learning and artificial…

Machine Learning · Computer Science 2018-09-14 Jiahao Chen

Machine learning (ML) is increasingly being used in critical decision-making software, but incidents have raised questions about the fairness of ML predictions. To address this issue, new tools and methods are needed to mitigate bias in…

Software Engineering · Computer Science 2023-08-30 Giang Nguyen , Sumon Biswas , Hridesh Rajan

Artificial Intelligence (AI) is an important driving force for the development and transformation of the financial industry. However, with the fast-evolving AI technology and application, unintentional bias, insufficient model validation,…

Machine Learning · Statistics 2019-12-17 Yukun Zhang , Longsheng Zhou