English
Related papers

Related papers: Attribution-based Explanations that Provide Recour…

200 papers

Along with the successful deployment of deep neural networks in several application domains, the need to unravel the black-box nature of these networks has seen a significant increase recently. Several methods have been introduced to…

Machine Learning · Computer Science 2023-07-06 Adam Ivankay , Mattia Rigotti , Pascal Frossard

Counterfactuals operationalised through algorithmic recourse have become a powerful tool to make artificial intelligence systems explainable. Conceptually, given an individual classified as y -- the factual -- we seek actions such that…

Feature attribution methods highlight the important input tokens as explanations to model predictions, which have been widely applied to deep neural networks towards trustworthy AI. However, recent works show that explanations provided by…

Computation and Language · Computer Science 2024-01-01 Dongfang Li , Baotian Hu , Qingcai Chen , Shan He

This paper explores the intricate relationship between interpretability and robustness in deep learning models. Despite their remarkable performance across various tasks, deep learning models often exhibit critical vulnerabilities,…

Machine Learning · Computer Science 2024-12-30 Navid Nayyem , Abdullah Rakin , Longwei Wang

Controlling the patterns a model learns is essential to preventing reliance on irrelevant or misleading features. Such reliance on irrelevant features, often called shortcut features, has been observed across domains, including medical…

Machine Learning · Computer Science 2025-09-23 Mihnea Ghitu , Vihari Piratla , Matthew Wicker

Attribution maps are popular tools for explaining neural networks predictions. By assigning an importance value to each input dimension that represents its impact towards the outcome, they give an intuitive explanation of the decision…

Machine Learning · Computer Science 2022-03-09 Adam Ivankay , Ivan Girardi , Chiara Marchiori , Pascal Frossard

Algorithmic Recourse (AR) aims to provide users with actionable steps to overturn unfavourable decisions made by machine learning predictors. However, these actions often take time to implement (e.g., getting a degree can take years), and…

Machine Learning · Computer Science 2025-07-11 Giovanni De Toni , Stefano Teso , Bruno Lepri , Andrea Passerini

Feature attribution is often loosely presented as the process of selecting a subset of relevant features as a rationale of a prediction. Task-dependent by nature, precise definitions of "relevance" encountered in the literature are however…

Machine Learning · Computer Science 2021-07-12 Darius Afchar , Romain Hennequin , Vincent Guigue

As predictive models are increasingly being deployed to make a variety of consequential decisions, there is a growing emphasis on designing algorithms that can provide recourse to affected individuals. Existing recourse algorithms function…

Machine Learning · Computer Science 2021-06-29 Kaivalya Rawal , Ece Kamar , Himabindu Lakkaraju

As predictive models are increasingly being deployed in high-stakes decision making (e.g., loan approvals), there has been growing interest in post hoc techniques which provide recourse to affected individuals. These techniques generate…

Machine Learning · Computer Science 2021-07-14 Sohini Upadhyay , Shalmali Joshi , Himabindu Lakkaraju

Transparency is a fundamental requirement for decision making systems when these should be deployed in the real world. It is usually achieved by providing explanations of the system's behavior. A prominent and intuitive type of explanations…

Machine Learning · Computer Science 2021-07-23 André Artelt , Valerie Vaquet , Riza Velioglu , Fabian Hinder , Johannes Brinkrolf , Malte Schilling , Barbara Hammer

Feature attribution methods are popular in interpretable machine learning. These methods compute the attribution of each input feature to represent its importance, but there is no consensus on the definition of "attribution", leading to…

Machine Learning · Computer Science 2021-12-16 Yilun Zhou , Serena Booth , Marco Tulio Ribeiro , Julie Shah

Machine learning plays a role in many deployed decision systems, often in ways that are difficult or impossible to understand by human stakeholders. Explaining, in a human-understandable way, the relationship between the input and output of…

Machine Learning · Computer Science 2022-11-17 Sahil Verma , Varich Boonsanong , Minh Hoang , Keegan E. Hines , John P. Dickerson , Chirag Shah

Algorithmic recourse -- providing recommendations to those affected negatively by the outcome of an algorithmic system on how they can take action and change that outcome -- has gained attention as a means of giving persons agency in their…

Machine Learning · Computer Science 2024-01-30 Andrew Bell , Joao Fonseca , Carlo Abrate , Francesco Bonchi , Julia Stoyanovich

Widespread use of artificial intelligence (AI) algorithms and machine learning (ML) models on the one hand and a number of crucial issues pertaining to them warrant the need for explainable artificial intelligence (XAI). A key…

Artificial Intelligence · Computer Science 2023-12-13 Jinqiang Yu , Graham Farr , Alexey Ignatiev , Peter J. Stuckey

Counterfactual explanation generation is a powerful method for Explainable Artificial Intelligence. It can help users understand why machine learning models make specific decisions, and how to change those decisions. Evaluating the…

Machine Learning · Computer Science 2024-06-03 Ao Xu , Tieru Wu

Many safety failures in machine learning arise when models are used to assign predictions to people (often in settings like lending, hiring, or content moderation) without accounting for how individuals can change their inputs. In this…

Machine Learning · Computer Science 2025-07-04 Seung Hyun Cheon , Meredith Stewart , Bogdan Kulynych , Tsui-Wei Weng , Berk Ustun

Explaining algorithmic decisions and recommending actionable feedback is increasingly important for machine learning applications. Recently, significant efforts have been invested in finding a diverse set of recourses to cover the wide…

Machine Learning · Computer Science 2023-02-23 Duy Nguyen , Ngoc Bui , Viet Anh Nguyen

Algorithmic recourse aims to provide actionable recommendations to individuals to obtain a more favourable outcome from an automated decision-making system. As it involves reasoning about interventions performed in the physical world,…

Machine Learning · Statistics 2021-06-23 Julius von Kügelgen , Nikita Agarwal , Jakob Zeitler , Afsaneh Mastouri , Bernhard Schölkopf

The goal of algorithmic recourse is to reverse unfavorable decisions (e.g., from loan denial to approval) under automated decision making by suggesting actionable feature changes (e.g., reduce the number of credit cards). To generate…

Machine Learning · Computer Science 2022-11-07 Martin Pawelczyk , Lea Tiyavorabun , Gjergji Kasneci