English
Related papers

Related papers: Biased Models Have Biased Explanations

200 papers

Ensuring fairness in machine learning is a critical and challenging task, as biased data representations often lead to unfair predictions. To address this, we propose Deep Fair Learning, a framework that integrates nonlinear sufficient…

Machine Learning · Statistics 2025-04-10 Enze Shi , Linglong Kong , Bei Jiang

With the current ongoing debate about fairness, explainability and transparency of machine learning models, their application in high-impact clinical decision-making systems must be scrutinized. We consider a real-life example of risk…

Machine Learning · Computer Science 2020-11-13 Sandhya Tripathi , Bradley A. Fritz , Mohamed Abdelhack , Michael S. Avidan , Yixin Chen , Christopher R. King

Fair machine learning is receiving an increasing attention in machine learning fields. Researchers in fair learning have developed correlation or association-based measures such as demographic disparity, mistreatment disparity, calibration,…

Computers and Society · Computer Science 2019-11-20 Wen Huang , Yongkai Wu , Lu Zhang , Xintao Wu

Datasets often contain biases which unfairly disadvantage certain groups, and classifiers trained on such datasets can inherit these biases. In this paper, we provide a mathematical formulation of how this bias can arise. We do so by…

Machine Learning · Computer Science 2019-01-16 Heinrich Jiang , Ofir Nachum

As machine learning systems become increasingly integrated into high-stakes decision-making processes, ensuring fairness in algorithmic outcomes has become a critical concern. Methods to mitigate bias typically fall into three categories:…

Machine Learning · Computer Science 2025-08-22 Brodie Oldfield , Ziqi Xu , Sevvandi Kandanaarachchi

Causal machine learning methods which flexibly generate heterogeneous treatment effect estimates could be very useful tools for governments trying to make and implement policy. However, as the critical artificial intelligence literature has…

Econometrics · Economics 2023-09-06 Patrick Rehill , Nicholas Biddle

Machine learning (ML) models can underperform on certain population groups due to choices made during model development and bias inherent in the data. We categorize sources of discrimination in the ML pipeline into two classes: aleatoric…

Machine Learning · Computer Science 2024-04-17 Hao Wang , Luxi He , Rui Gao , Flavio P. Calmon

In consequential domains such as recidivism prediction, facility inspection, and benefit assignment, it's important for individuals to know the decision-relevant information for the model's prediction. In addition, predictions should be…

Artificial Intelligence · Computer Science 2022-02-11 Moniba Keymanesh , Tanya Berger-Wolf , Micha Elsner , Srinivasan Parthasarathy

The debate around bias in AI systems is central to discussions on algorithmic fairness. However, the term bias often lacks a clear definition, despite frequently being contrasted with fairness, implying that an unbiased model is inherently…

Artificial Intelligence · Computer Science 2025-02-26 Chiara Lindloff , Ingo Siegert

Machine Learning (ML) algorithms shape our lives. Banks use them to determine if we are good borrowers; IT companies delegate them recruitment decisions; police apply ML for crime-prediction, and judges base their verdicts on ML. However,…

Computer Science and Game Theory · Computer Science 2021-01-05 Omer Ben-Porat , Fedor Sandomirskiy , Moshe Tennenholtz

In situations where explanations of black-box models may be useful, the fairness of the black-box is also often a relevant concern. However, the link between the fairness of the black-box model and the behavior of explanations for the…

Machine Learning · Computer Science 2021-06-28 Jessica Dai , Sohini Upadhyay , Stephen H. Bach , Himabindu Lakkaraju

As algorithmic decision-making systems become more prevalent in society, ensuring the fairness of these systems is becoming increasingly important. Whilst there has been substantial research in building fair algorithmic decision-making…

Machine Learning · Computer Science 2023-10-30 Madeleine Waller , Odinaldo Rodrigues , Oana Cocarascu

Machine learning models are increasingly deployed for critical decision-making tasks, making it important to verify that they do not contain gender or racial biases picked up from training data. Typical approaches to achieve fairness…

Machine Learning · Computer Science 2022-12-19 Giorgian Borca-Tasciuc , Xingzhi Guo , Stanley Bak , Steven Skiena

This thesis explores open-sourced machine learning (ML) model explanation tools to understand whether these tools can allow a layman to visualize, understand, and suggest intuitive remedies to unfairness in ML-based decision-support…

Machine Learning · Computer Science 2023-07-12 Normen Yu , Gang Tan , Saeid Tizpaz-Niari

Ensuring fairness has emerged as one of the primary concerns in AI and its related algorithms. Over time, the field of machine learning fairness has evolved to address these issues. This paper provides an extensive overview of this field…

Machine Learning · Computer Science 2024-11-15 Quan Zhou

Bias in machine learning has manifested injustice in several areas, such as medicine, hiring, and criminal justice. In response, computer scientists have developed myriad definitions of fairness to correct this bias in fielded algorithms.…

Computers and Society · Computer Science 2020-07-06 Debjani Saha , Candice Schumann , Duncan C. McElfresh , John P. Dickerson , Michelle L. Mazurek , Michael Carl Tschantz

Machine learning models often preserve biases present in training data, leading to unfair treatment of certain minority groups. Despite an array of existing firm-side bias mitigation techniques, they typically incur utility costs and…

Machine Learning · Computer Science 2025-11-17 Omri Ben-Dov , Samira Samadi , Amartya Sanyal , Alexandru Ţifrea

Current research on bias in machine learning often focuses on fairness, while overlooking the roots or causes of bias. However, bias was originally defined as a "systematic error," often caused by humans at different stages of the research…

Machine Learning · Computer Science 2023-08-23 Agnieszka Mikołajczyk-Bareła , Michał Grochowski

We present a post-processing algorithm for fair classification that covers group fairness criteria including statistical parity, equal opportunity, and equalized odds under a single framework, and is applicable to multiclass problems in…

Machine Learning · Computer Science 2024-12-24 Ruicheng Xian , Han Zhao

Algorithmic decision making systems are ubiquitous across a wide variety of online as well as offline services. These systems rely on complex learning methods and vast amounts of data to optimize the service functionality, satisfaction of…

Machine Learning · Statistics 2017-03-27 Muhammad Bilal Zafar , Isabel Valera , Manuel Gomez Rodriguez , Krishna P. Gummadi
‹ Prev 1 3 4 5 6 7 10 Next ›