English
Related papers

Related papers: BiMi Sheets: Infosheets for bias mitigation method…

200 papers

With the growing utilization of machine learning in healthcare, there is increasing potential to enhance healthcare outcomes. However, this also brings the risk of perpetuating biases in data and model design that can harm certain…

Machine Learning · Computer Science 2023-08-15 Shaina Raza , Parisa Osivand Pour , Syed Raza Bashir

Machine learning (ML) may be oblivious to human bias but it is not immune to its perpetuation. Marginalisation and iniquitous group representation are often traceable in the very data used for training, and may be reflected or even enhanced…

Machine Learning · Computer Science 2024-12-02 Stefano Sarao Mannelli , Federica Gerace , Negar Rostamzadeh , Luca Saglietti

A critical problem in deep learning is that systems learn inappropriate biases, resulting in their inability to perform well on minority groups. This has led to the creation of multiple algorithms that endeavor to mitigate bias. However, it…

Machine Learning · Computer Science 2024-04-24 Robik Shrestha , Kushal Kafle , Christopher Kanan

As machine learning methods are deployed in real-world settings such as healthcare, legal systems, and social science, it is crucial to recognize how they shape social biases and stereotypes in these sensitive decision-making processes.…

Computation and Language · Computer Science 2021-06-25 Paul Pu Liang , Chiyu Wu , Louis-Philippe Morency , Ruslan Salakhutdinov

Understanding and removing bias from the decisions made by machine learning models is essential to avoid discrimination against unprivileged groups. Despite recent progress in algorithmic fairness, there is still no clear answer as to which…

Fairness in machine learning (ML) has garnered significant attention in recent years. While existing research has predominantly focused on the distributive fairness of ML models, there has been limited exploration of procedural fairness.…

Machine Learning · Computer Science 2025-01-14 Ziming Wang , Changwu Huang , Ke Tang , Xin Yao

The effectiveness of machine learning in evaluating the creditworthiness of loan applicants has been demonstrated for a long time. However, there is concern that the use of automated decision-making processes may result in unequal treatment…

Machine Learning · Computer Science 2023-06-23 Darie Moldovan

To mitigate gender bias in contextualized language models, different intrinsic mitigation strategies have been proposed, alongside many bias metrics. Considering that the end use of these language models is for downstream tasks like text…

Computation and Language · Computer Science 2023-01-31 Ewoenam Tokpo , Pieter Delobelle , Bettina Berendt , Toon Calders

Machine learning based systems are reaching society at large and in many aspects of everyday life. This phenomenon has been accompanied by concerns about the ethical issues that may arise from the adoption of these technologies. ML fairness…

Machine Learning · Computer Science 2021-01-01 Luca Oneto , Silvia Chiappa

Fairness,the impartial treatment towards individuals or groups regardless of their inherent or acquired characteristics [20], is a critical challenge for the successful implementation of Artificial Intelligence (AI) in multiple fields like…

Neural and Evolutionary Computing · Computer Science 2025-05-19 Catalina M Jaramillo , Paul Squires , Julian Togelius

Machine learning software is being used in many applications (finance, hiring, admissions, criminal justice) having a huge social impact. But sometimes the behavior of this software is biased and it shows discrimination based on some…

Software Engineering · Computer Science 2020-08-31 Joymallya Chakraborty , Kewen Peng , Tim Menzies

A significant level of stigma and inequality exists in mental healthcare, especially in under-served populations. Inequalities are reflected in the data collected for scientific purposes. When not properly accounted for, machine learning…

Artificial Intelligence and Machine Learning are becoming increasingly present in several aspects of human life, especially, those dealing with decision making. Many of these algorithmic decisions are taken without human supervision and…

Machine Learning · Computer Science 2020-06-19 Vaishnavi Bhargava , Miguel Couceiro , Amedeo Napoli

The importance of addressing fairness and bias in artificial intelligence (AI) systems cannot be over-emphasized. Mainstream media has been awashed with news of incidents around stereotypes and other types of bias in many of these systems…

Computation and Language · Computer Science 2024-09-10 Tosin Adewumi , Lama Alkhaled , Namrata Gurung , Goya van Boven , Irene Pagliai

Ensuring fairness in image classification prevents models from perpetuating and amplifying bias. Concept bottleneck models (CBMs) map images to high-level, human-interpretable concepts before making predictions via a sparse, one-layer…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Schrasing Tong , Antoine Salaun , Vincent Yuan , Annabel Adeyeri , Lalana Kagal

Artificial Intelligence (AI) models are now being utilized in all facets of our lives such as healthcare, education and employment. Since they are used in numerous sensitive environments and make decisions that can be life altering,…

Artificial Intelligence · Computer Science 2024-03-27 Tahsin Alamgir Kheya , Mohamed Reda Bouadjenek , Sunil Aryal

Bias mitigators can improve algorithmic fairness in machine learning models, but their effect on fairness is often not stable across data splits. A popular approach to train more stable models is ensemble learning, but unfortunately, it is…

Machine Learning · Computer Science 2022-10-12 Michael Feffer , Martin Hirzel , Samuel C. Hoffman , Kiran Kate , Parikshit Ram , Avraham Shinnar

Billions of distributed, heterogeneous and resource constrained IoT devices deploy on-device machine learning (ML) for private, fast and offline inference on personal data. On-device ML is highly context dependent, and sensitive to user,…

Machine Learning · Computer Science 2023-03-21 Wiebke Toussaint , Aaron Yi Ding , Fahim Kawsar , Akhil Mathur

Bias can be introduced in diverse ways in machine learning datasets, for example via selection or label bias. Although these bias types in themselves have an influence on important aspects of fair machine learning, their different impact…

Machine Learning · Computer Science 2026-03-11 Magali Legast , Toon Calders , François Fouss

Machine Learning algorithms (ML) impact virtually every aspect of human lives and have found use across diverse sectors including healthcare, finance, and education. Often, ML algorithms have been found to exacerbate societal biases present…

Machine Learning · Computer Science 2025-06-02 Jonathan Vasquez , Carlotta Domeniconi , Huzefa Rangwala