English
Related papers

Related papers: On the Interplay between Fairness and Explainabili…

200 papers

With machine learning models being increasingly used to aid decision making even in high-stakes domains, there has been a growing interest in developing interpretable models. Although many supposedly interpretable models have been proposed,…

Artificial Intelligence · Computer Science 2021-08-17 Forough Poursabzi-Sangdeh , Daniel G. Goldstein , Jake M. Hofman , Jennifer Wortman Vaughan , Hanna Wallach

There is increasing regulatory interest in whether machine learning algorithms deployed in consequential domains (e.g. in criminal justice) treat different demographic groups "fairly." However, there are several proposed notions of…

Theoretical Economics · Economics 2020-02-19 Christopher Jung , Sampath Kannan , Changhwa Lee , Mallesh M. Pai , Aaron Roth , Rakesh Vohra

A central goal of algorithmic fairness is to reduce bias in automated decision making. An unavoidable tension exists between accuracy gains obtained by using sensitive information (e.g., gender or ethnic group) as part of a statistical…

Machine Learning · Statistics 2020-02-03 Luca Oneto , Michele Donini , Amon Elders , Massimiliano Pontil

Algorithmic decision-making systems are increasingly used throughout the public and private sectors to make important decisions or assist humans in making these decisions with real social consequences. While there has been substantial…

Human-Computer Interaction · Computer Science 2020-01-28 Ruotong Wang , F. Maxwell Harper , Haiyi Zhu

Fairness in machine learning is of considerable interest in recent years owing to the propensity of algorithms trained on historical data to amplify and perpetuate historical biases. In this paper, we argue for a formal reconstruction of…

Artificial Intelligence · Computer Science 2023-06-27 Vaishak Belle

Neural rationale models are popular for interpretable predictions of NLP tasks. In these, a selector extracts segments of the input text, called rationales, and passes these segments to a classifier for prediction. Since the rationale is…

Computation and Language · Computer Science 2022-07-26 Yiming Zheng , Serena Booth , Julie Shah , Yilun Zhou

With language models becoming increasingly ubiquitous, it has become essential to address their inequitable treatment of diverse demographic groups and factors. Most research on evaluating and mitigating fairness harms has been concentrated…

Computation and Language · Computer Science 2023-03-01 Krithika Ramesh , Sunayana Sitaram , Monojit Choudhury

While research on applications and evaluations of explanation methods continues to expand, fairness of the explanation methods concerning disparities in their performance across subgroups remains an often overlooked aspect. In this paper,…

Computation and Language · Computer Science 2025-05-05 Mahdi Dhaini , Ege Erdogan , Nils Feldhus , Gjergji Kasneci

We propose a fair machine learning algorithm to model interpretable differences between observed and desired human decision-making, with the latter aimed at reducing disparity in a downstream outcome impacted by the human decision. Prior…

Machine Learning · Computer Science 2025-05-26 Pavan Ravishankar , Rushabh Shah , Daniel B. Neill

Fairness and interpretability play an important role in the adoption of decision-making algorithms across many application domains. These requirements are intended to avoid undesirable group differences and to alleviate concerns related to…

Econometrics · Economics 2025-09-16 Nora Bearth , Michael Lechner , Jana Mareckova , Fabian Muny

Language models are the new state-of-the-art natural language processing (NLP) models and they are being increasingly used in many NLP tasks. Even though there is evidence that language models are biased, the impact of that bias on the…

Computation and Language · Computer Science 2024-04-29 Fatma Elsafoury , Stamos Katsigiannis

The currently dominating artificial intelligence and machine learning technology, neural networks, builds on inductive statistical learning. Neural networks of today are information processing systems void of understanding and reasoning…

Artificial Intelligence · Computer Science 2022-08-26 Lars Holmberg

Explainability methods are used to benchmark the extent to which model predictions align with human rationales i.e., are 'right for the right reasons'. Previous work has failed to acknowledge, however, that what counts as a rationale is…

Computation and Language · Computer Science 2023-10-16 Terne Sasha Thorn Jakobsen , Laura Cabello , Anders Søgaard

Numerous approaches have been recently proposed for learning fair representations that mitigate unfair outcomes in prediction tasks. A key motivation for these methods is that the representations can be used by third parties with unknown…

Machine Learning · Computer Science 2024-06-25 Tianhao Wang , Zana Buçinca , Zilin Ma

Machine learning algorithms are now frequently used in sensitive contexts that substantially affect the course of human lives, such as credit lending or criminal justice. This is driven by the idea that `objective' machines base their…

Machine Learning · Computer Science 2019-01-17 Songül Tolan

Explanations of neural models aim to reveal a model's decision-making process for its predictions. However, recent work shows that current methods giving explanations such as saliency maps or counterfactuals can be misleading, as they are…

Computation and Language · Computer Science 2023-07-03 Pepa Atanasova , Oana-Maria Camburu , Christina Lioma , Thomas Lukasiewicz , Jakob Grue Simonsen , Isabelle Augenstein

The recent advancements in Deep Learning models and techniques have led to significant strides in performance across diverse tasks and modalities. However, while the overall capabilities of models show promising growth, our understanding of…

Artificial Intelligence · Computer Science 2025-04-04 Erik Arakelyan

Fairness for Machine Learning has received considerable attention, recently. Various mathematical formulations of fairness have been proposed, and it has been shown that it is impossible to satisfy all of them simultaneously. The literature…

Computers and Society · Computer Science 2019-12-10 Megha Srivastava , Hoda Heidari , Andreas Krause

Explainability is needed to establish confidence in machine learning results. Some explainable methods take a post hoc approach to explain the weights of machine learning models, others highlight areas of the input contributing to…

Machine Learning · Computer Science 2024-07-15 Paul Whitten , Francis Wolff , Chris Papachristou

In consequential domains such as recidivism prediction, facility inspection, and benefit assignment, it's important for individuals to know the decision-relevant information for the model's prediction. In addition, predictions should be…

Artificial Intelligence · Computer Science 2022-02-11 Moniba Keymanesh , Tanya Berger-Wolf , Micha Elsner , Srinivasan Parthasarathy