English
Related papers

Related papers: Attributing Fair Decisions with Attention Interven…

200 papers

Data-driven AI systems can lead to discrimination on the basis of protected attributes like gender or race. One reason for this behavior is the encoded societal biases in the training data (e.g., females are underrepresented), which is…

Machine Learning · Computer Science 2022-01-05 Vasileios Iosifidis , Arjun Roy , Eirini Ntoutsi

An implicit ambiguity in the field of prediction-based decision-making regards the relation between the concepts of prediction and decision. Much of the literature in the field tends to blur the boundaries between the two concepts and often…

Computers and Society · Computer Science 2024-03-19 Teresa Scantamburlo , Joachim Baumann , Christoph Heitz

The treatment of fairness in decision-making literature usually involves quantifying fairness using objective measures. This work takes a critical stance to highlight the limitations of these approaches (group fairness and individual…

Computers and Society · Computer Science 2024-07-03 Sarra Tajouri , Alexis Tsoukiàs

The fairness of machine learning-based decisions has become an increasingly important focus in the design of supervised machine learning methods. Most fairness approaches optimize a specified trade-off between performance measure(s) (e.g.,…

Machine Learning · Computer Science 2023-02-01 Omid Memarrast , Linh Vu , Brian Ziebart

Ensuring fairness in machine learning is a critical and challenging task, as biased data representations often lead to unfair predictions. To address this, we propose Deep Fair Learning, a framework that integrates nonlinear sufficient…

Machine Learning · Statistics 2025-04-10 Enze Shi , Linglong Kong , Bei Jiang

Existing approaches to algorithmic fairness aim to ensure equitable outcomes if human decision-makers comply perfectly with algorithmic decisions. However, perfect compliance with the algorithm is rarely a reality or even a desirable…

Machine Learning · Computer Science 2025-07-01 Haosen Ge , Hamsa Bastani , Osbert Bastani

Interpretability is an important area of research for safe deployment of machine learning systems. One particular type of interpretability method attributes model decisions to input features. Despite active development, quantitative…

Machine Learning · Computer Science 2019-11-06 Mengjiao Yang , Been Kim

Organizations are rapidly deploying artificial intelligence (AI) systems to manage their workers. However, AI has been found at times to be unfair to workers. Unfairness toward workers has been associated with decreased worker effort and…

Human-Computer Interaction · Computer Science 2020-02-24 Lionel P. Robert , Casey Pierce , Liz Morris , Sangmi Kim , Rasha Alahmad

This paper explores pruning attention heads as a post-processing bias mitigation method for large language models (LLMs). Modern AI systems such as LLMs are expanding into sensitive social contexts where fairness concerns become especially…

Artificial Intelligence · Computer Science 2025-11-26 Vishnu Asutosh Dasu , Md Rafi ur Rashid , Vipul Gupta , Saeid Tizpaz-Niari , Gang Tan

Fairness and accountability are two essential pillars for trustworthy Artificial Intelligence (AI) in healthcare. However, the existing AI model may be biased in its decision marking. To tackle this issue, we propose an adversarial…

Computer Vision and Pattern Recognition · Computer Science 2021-05-12 Xiaoxiao Li , Ziteng Cui , Yifan Wu , Lin Gu , Tatsuya Harada

Fairness research in machine learning often centers on ensuring equitable performance of individual models. However, real-world recommendation systems are built on multiple models and even multiple stages, from candidate retrieval to…

Artificial Intelligence · Computer Science 2025-01-03 Brian Hsu , Cyrus DiCiccio , Natesh Sivasubramoniapillai , Hongseok Namkoong

As the real-world impact of Artificial Intelligence (AI) systems has been steadily growing, so too have these systems come under increasing scrutiny. In response, the study of AI fairness has rapidly developed into a rich field of research…

Computers and Society · Computer Science 2023-09-19 Maarten Buyl , Tijl De Bie

To ensure unbiased and ethical automated predictions, fairness must be a core principle in machine learning applications. Fairness in machine learning aims to mitigate biases present in the training data and model imperfections that could…

Machine Learning · Computer Science 2024-12-03 Jan Pablo Burgard , João Vitor Pamplona

Image classification models have achieved satisfactory performance on many datasets, sometimes even better than human. However, The model attention is unclear since the lack of interpretability. This paper investigates the fidelity and…

Computer Vision and Pattern Recognition · Computer Science 2020-09-30 Wenjia Xu , Jiuniu Wang , Yang Wang , Guangluan Xu , Wei Dai , Yirong Wu

The adoption of automated, data-driven decision making in an ever expanding range of applications has raised concerns about its potential unfairness towards certain social groups. In this context, a number of recent studies have focused on…

Machine learning is increasingly used to inform decision-making in sensitive situations where decisions have consequential effects on individuals' lives. In these settings, in addition to requiring models to be accurate and robust, socially…

Machine Learning · Computer Science 2021-03-02 Amir-Hossein Karimi , Gilles Barthe , Bernhard Schölkopf , Isabel Valera

Fairness and interpretability play an important role in the adoption of decision-making algorithms across many application domains. These requirements are intended to avoid undesirable group differences and to alleviate concerns related to…

Econometrics · Economics 2025-09-16 Nora Bearth , Michael Lechner , Jana Mareckova , Fabian Muny

Recent work in fair machine learning has proposed dozens of technical definitions of algorithmic fairness and methods for enforcing these definitions. However, we still lack an understanding of how to develop machine learning systems with…

Human-Computer Interaction · Computer Science 2021-02-03 Hao-Fei Cheng , Logan Stapleton , Ruiqi Wang , Paige Bullock , Alexandra Chouldechova , Zhiwei Steven Wu , Haiyi Zhu

There has been a prevalence of applying AI software in both high-stakes public-sector and industrial contexts. However, the lack of transparency has raised concerns about whether these data-informed AI software decisions secure fairness…

Machine Learning · Computer Science 2025-11-17 Xiaoyin Xi , Zhe Yu

Artificial Intelligence (AI) has demonstrated remarkable capabilities in domains such as recruitment, finance, healthcare, and the judiciary. However, biases in AI systems raise ethical and societal concerns, emphasizing the need for…