English
Related papers

Related papers: Diversity and Inclusion Metrics in Subset Selectio…

200 papers

Fairness researchers in machine learning (ML) have coalesced around several fairness criteria which provide formal definitions of what it means for an ML model to be fair. However, these criteria have some serious limitations. We identify…

Machine Learning · Computer Science 2022-07-14 Liam Peet-Pare , Nidhi Hegde , Alona Fyshe

We study fairness in classification, where individuals are classified, e.g., admitted to a university, and the goal is to prevent discrimination against individuals based on their membership in some group, while maintaining utility for the…

Computational Complexity · Computer Science 2011-11-30 Cynthia Dwork , Moritz Hardt , Toniann Pitassi , Omer Reingold , Rich Zemel

Fairness in artificial intelligence and machine learning (AI/ML) models is becoming critically important, especially as decisions made by these systems impact diverse groups. In education, a vital sector for all countries, the widespread…

Machine Learning · Computer Science 2024-10-10 Nga Pham , Minh Kha Do , Tran Vu Dai , Pham Ngoc Hung , Anh Nguyen-Duc

The advent of AI and ML algorithms has led to opportunities as well as challenges. In this paper, we provide an overview of bias and fairness issues that arise with the use of ML algorithms. We describe the types and sources of data bias,…

Machine Learning · Statistics 2021-05-17 Nengfeng Zhou , Zach Zhang , Vijayan N. Nair , Harsh Singhal , Jie Chen , Agus Sudjianto

Machine learning tasks may admit multiple competing models that achieve similar performance yet produce conflicting outputs for individual samples -- a phenomenon known as predictive multiplicity. We demonstrate that fairness interventions…

Machine Learning · Computer Science 2023-06-19 Carol Xuan Long , Hsiang Hsu , Wael Alghamdi , Flavio P. Calmon

Ensuring fairness of prediction-based decision making is based on statistical group fairness criteria. Which one of these criteria is the morally most appropriate one depends on the context, and its choice requires an ethical analysis. In…

Machine Learning · Computer Science 2022-10-20 Joachim Baumann , Christoph Heitz

As machine learning (ML) systems become central to critical decision-making, concerns over fairness and potential biases have increased. To address this, the software engineering (SE) field has introduced bias mitigation techniques aimed at…

Software Engineering · Computer Science 2025-03-21 Alessandra Parziale , Gianmario Voria , Giammaria Giordano , Gemma Catolino , Gregorio Robles , Fabio Palomba

The use of machine learning (ML) in health care raises numerous ethical concerns, especially as models can amplify existing health inequities. Here, we outline ethical considerations for equitable ML in the advancement of health care.…

Computers and Society · Computer Science 2021-07-29 Irene Y. Chen , Emma Pierson , Sherri Rose , Shalmali Joshi , Kadija Ferryman , Marzyeh Ghassemi

A growing body of literature in fairness-aware machine learning (fairML) aims to mitigate machine learning (ML)-related unfairness in automated decision-making (ADM) by defining metrics that measure fairness of an ML model and by proposing…

Machine Learning · Computer Science 2025-07-14 Ludwig Bothmann , Kristina Peters , Bernd Bischl

We consider training machine learning models that are fair in the sense that their performance is invariant under certain sensitive perturbations to the inputs. For example, the performance of a resume screening system should be invariant…

Machine Learning · Statistics 2020-03-16 Mikhail Yurochkin , Amanda Bower , Yuekai Sun

Machine learning models have achieved widespread success but often inherit and amplify historical biases, resulting in unfair outcomes. Traditional fairness methods typically impose constraints at the prediction level, without addressing…

Machine Learning · Statistics 2026-02-10 Enze Shi , Pankaj Bhagwat , Zhixian Yang , Linglong Kong , Bei Jiang

Data-driven predictive models are increasingly used in education to support students, instructors, and administrators. However, there are concerns about the fairness of the predictions and uses of these algorithmic systems. In this…

Computers and Society · Computer Science 2021-04-13 René F. Kizilcec , Hansol Lee

With the widespread use of AI systems and applications in our everyday lives, it is important to take fairness issues into consideration while designing and engineering these types of systems. Such systems can be used in many sensitive…

Machine Learning · Computer Science 2022-01-26 Ninareh Mehrabi , Fred Morstatter , Nripsuta Saxena , Kristina Lerman , Aram Galstyan

Machine learning algorithms are now frequently used in sensitive contexts that substantially affect the course of human lives, such as credit lending or criminal justice. This is driven by the idea that `objective' machines base their…

Machine Learning · Computer Science 2019-01-17 Songül Tolan

Fairness is a concept of justice. Various definitions exist, some of them conflicting with each other. In the absence of an uniformly accepted notion of fairness, choosing the right kind for a specific situation has always been a central…

Artificial Intelligence · Computer Science 2021-10-01 Boris Ruf , Marcin Detyniecki

With fairness concerns gaining significant attention in Machine Learning (ML), several bias mitigation techniques have been proposed, often compared against each other to find the best method. These benchmarking efforts tend to use a common…

Machine Learning · Computer Science 2024-11-20 Prakhar Ganesh , Usman Gohar , Lu Cheng , Golnoosh Farnadi

Algorithmic fairness, the research field of making machine learning (ML) algorithms fair, is an established area in ML. As ML technologies expand their application domains, including ones with high societal impact, it becomes essential to…

Machine Learning · Computer Science 2023-12-12 Wenbin Zhang , Zichong Wang , Juyong Kim , Cheng Cheng , Thomas Oommen , Pradeep Ravikumar , Jeremy Weiss

The issue of fairness in machine learning models has recently attracted a lot of attention as ensuring it will ensure continued confidence of the general public in the deployment of machine learning systems. We focus on mitigating the harm…

Machine Learning · Statistics 2021-02-24 Thomas Kehrenberg , Zexun Chen , Novi Quadrianto

Despite the high interest for Machine Learning (ML) in academia and industry, many issues related to the application of ML to real-life problems are yet to be addressed. Here we put forward one limitation which arises from a lack of…

Machine Learning · Computer Science 2019-11-07 Agathe Balayn , Alessandro Bozzon , Zoltan Szlavik

The advent of ML-driven decision-making and policy formation has led to an increasing focus on algorithmic fairness. As clustering is one of the most commonly used unsupervised machine learning approaches, there has naturally been a…

Machine Learning · Statistics 2023-05-30 Abhisek Chakraborty , Anirban Bhattacharya , Debdeep Pati