English
Related papers

Related papers: Contrastive Explanations for Model Interpretabilit…

200 papers

People's decision-making abilities often fail to improve or may even erode when they rely on AI for decision-support, even when the AI provides informative explanations. We argue this is partly because people intuitively seek contrastive…

Human-Computer Interaction · Computer Science 2025-03-20 Zana Buçinca , Siddharth Swaroop , Amanda E. Paluch , Finale Doshi-Velez , Krzysztof Z. Gajos

Counterfactual explanations are a popular type of explanation for making the outcomes of a decision making system transparent to the user. Counterfactual explanations tell the user what to do in order to change the outcome of the system in…

Machine Learning · Computer Science 2022-11-29 André Artelt , Barbara Hammer

Machine learning can greatly benefit from providing learning algorithms with pairs of contrastive training examples -- typically pairs of instances that differ only slightly, yet have different class labels. Intuitively, the difference in…

Machine Learning · Computer Science 2025-06-23 Farnam Mansouri , Hans U. Simon , Adish Singla , Yuxin Chen , Sandra Zilles

With the increasing impact of algorithmic decision-making on human lives, the interpretability of models has become a critical issue in machine learning. Counterfactual explanation is an important method in the field of interpretable…

Machine Learning · Computer Science 2024-07-17 Ao Xu , Tieru Wu

Recent advancements in explainable machine learning provide effective and faithful solutions for interpreting model behaviors. However, many explanation methods encounter efficiency issues, which largely limit their deployments in practical…

Machine Learning · Computer Science 2023-03-07 Yu-Neng Chuang , Guanchu Wang , Fan Yang , Quan Zhou , Pushkar Tripathi , Xuanting Cai , Xia Hu

Contrastive explanation methods go beyond transparency and address the contrastive aspect of explanations. Such explanations are emerging as an attractive option to provide actionable change to scenarios adversely impacted by classifiers'…

Computation and Language · Computer Science 2022-10-18 Julia El Zini , Mariette Awad

Applying language models to natural language processing tasks typically relies on the representations in the final model layer, as intermediate hidden layer representations are presumed to be less informative. In this work, we argue that…

Computation and Language · Computer Science 2023-05-03 Ariel Gera , Roni Friedman , Ofir Arviv , Chulaka Gunasekara , Benjamin Sznajder , Noam Slonim , Eyal Shnarch

Existed pre-trained models have achieved state-of-the-art performance on various text classification tasks. These models have proven to be useful in learning universal language representations. However, the semantic discrepancy between…

Machine Learning · Computer Science 2022-01-07 Jinhe Lan , Qingyuan Zhan , Chenhao Jiang , Kunping Yuan , Desheng Wang

We predict credit applications with off-the-shelf, interchangeable black-box classifiers and we explain single predictions with counterfactual explanations. Counterfactual explanations expose the minimal changes required on the input data…

Artificial Intelligence · Computer Science 2018-11-19 Rory Mc Grath , Luca Costabello , Chan Le Van , Paul Sweeney , Farbod Kamiab , Zhao Shen , Freddy Lecue

This study focuses on exploring the use of local interpretability methods for explaining time series clustering models. Many of the state-of-the-art clustering models are not directly explainable. To provide explanations for these…

Machine Learning · Computer Science 2022-08-03 Ozan Ozyegen , Nicholas Prayogo , Mucahit Cevik , Ayse Basar

Predictive models are being increasingly used to support consequential decision making at the individual level in contexts such as pretrial bail and loan approval. As a result, there is increasing social and legal pressure to provide…

Machine Learning · Computer Science 2020-03-02 Amir-Hossein Karimi , Gilles Barthe , Borja Balle , Isabel Valera

In automated planning, the need for explanations arises when there is a mismatch between a proposed plan and the user's expectation. We frame Explainable AI Planning in the context of the plan negotiation problem, in which a succession of…

Artificial Intelligence · Computer Science 2021-03-30 Benjamin Krarup , Senka Krivic , Daniele Magazzeni , Derek Long , Michael Cashmore , David E. Smith

Linear approximations to the decision boundary of a complex model have become one of the most popular tools for interpreting predictions. In this paper, we study such linear explanations produced either post-hoc by a few recent methods or…

Machine Learning · Computer Science 2018-01-31 Maruan Al-Shedivat , Avinava Dubey , Eric P. Xing

Machine learning models have had discernible achievements in a myriad of applications. However, most of these models are black-boxes, and it is obscure how the decisions are made by them. This makes the models unreliable and untrustworthy.…

Machine Learning · Computer Science 2020-03-23 Raha Moraffah , Mansooreh Karami , Ruocheng Guo , Adrienne Raglin , Huan Liu

In science and medicine, model interpretations may be reported as discoveries of natural phenomena or used to guide patient treatments. In such high-stakes tasks, false discoveries may lead investigators astray. These applications would…

Machine Learning · Statistics 2020-08-18 Collin Burns , Jesse Thomason , Wesley Tansey

Global explanations of a reinforcement learning (RL) agent's expected behavior can make it safer to deploy. However, such explanations are often difficult to understand because of the complicated nature of many RL policies. Effective human…

Machine Learning · Computer Science 2022-11-16 Sanjana Narayanan , Isaac Lage , Finale Doshi-Velez

Trained classification models can unintentionally lead to biased representations and predictions, which can reinforce societal preconceptions and stereotypes. Existing debiasing methods for classification models, such as adversarial…

Computation and Language · Computer Science 2021-09-23 Aili Shen , Xudong Han , Trevor Cohn , Timothy Baldwin , Lea Frermann

Many commonsense reasoning NLP tasks involve choosing between one or more possible answers to a question or prompt based on knowledge that is often implicit. Large pretrained language models (PLMs) can achieve near-human performance on such…

Computation and Language · Computer Science 2021-06-15 Bhargavi Paranjape , Julian Michael , Marjan Ghazvininejad , Luke Zettlemoyer , Hannaneh Hajishirzi

Recently, as an effective way of learning latent representations, contrastive learning has been increasingly popular and successful in various domains. The success of constrastive learning in single-label classifications motivates us to…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Son D. Dao , Ethan Zhao , Dinh Phung , Jianfei Cai

In this paper we propose a novel method that provides contrastive explanations justifying the classification of an input by a black box classifier such as a deep neural network. Given an input we find what should be %necessarily and…

Artificial Intelligence · Computer Science 2018-10-30 Amit Dhurandhar , Pin-Yu Chen , Ronny Luss , Chun-Chen Tu , Paishun Ting , Karthikeyan Shanmugam , Payel Das