English
Related papers

Related papers: High Dimensional Model Explanations: an Axiomatic …

200 papers

The recent criticisms of the robustness of post hoc model approximation explanation methods (like LIME and SHAP) have led to the rise of model-precise abductive explanations. For each data point, abductive explanations provide a minimal…

Artificial Intelligence · Computer Science 2023-10-13 Gagan Biradar , Yacine Izza , Elita Lobo , Vignesh Viswanathan , Yair Zick

Feature attribution methods explain black-box machine learning (ML) models by assigning importance scores to input features. These methods can be computationally expensive for large ML models. To address this challenge, there has been…

Computers and Society · Computer Science 2024-05-31 Lucas Monteiro Paes , Dennis Wei , Flavio P. Calmon

A new approach to the local and global explanation is proposed. It is based on selecting a convex hull constructed for the finite number of points around an explained instance. The convex hull allows us to consider a dual representation of…

Machine Learning · Computer Science 2024-01-30 Andrei V. Konstantinov , Boris V. Kozlov , Stanislav R. Kirpichenko , Lev V. Utkin

Prototype-based explanations offer an intuitive, example-based approach to support the interpretability of machine learning black box classifiers but often lack feature-level granularity. We introduce a framework that integrates feature…

Machine Learning · Computer Science 2026-05-22 Jacek Karolczak , Jerzy Stefanowski

The use of deep neural networks to make high risk decisions creates a need for global and local explanations so that users and experts have confidence in the modeling algorithms. We introduce a novel technique to find global and local…

Machine Learning · Computer Science 2019-08-15 Xochitl Watts , Freddy Lecue

In the domain of black-box model extraction, conventional methods reliant on soft labels or surrogate datasets struggle with scaling to high-dimensional input spaces and managing the complexity of an extensive array of interrelated classes.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Somnath Sendhil Kumar , Yuvaraj Govindarajulu , Pavan Kulkarni , Manojkumar Parmar

Although deep learning models are powerful among various applications, most deep learning models are still a black box, lacking verifiability and interpretability, which means the decision-making process that human beings cannot understand.…

Computer Vision and Pattern Recognition · Computer Science 2021-09-29 Qianmengke Zhao , Ye Wang , Qun Liu

We present an interpretable companion model for any pre-trained black-box classifiers. The idea is that for any input, a user can decide to either receive a prediction from the black-box model, with high accuracy but no explanations, or…

Machine Learning · Statistics 2020-02-12 Danqing Pan , Tong Wang , Satoshi Hara

Data-trained predictive models see widespread use, but for the most part they are used as black boxes which output a prediction or score. It is therefore hard to acquire a deeper understanding of model behavior, and in particular how…

Interpretability has become incredibly important as machine learning is increasingly used to inform consequential decisions. We propose to construct global explanations of complex, blackbox models in the form of a decision tree…

Machine Learning · Computer Science 2019-01-28 Osbert Bastani , Carolyn Kim , Hamsa Bastani

Explainable AI (XAI) has been proposed as a valuable tool to assist in downstream tasks involving human and AI collaboration. Perhaps the most psychologically valid XAI techniques are case based approaches which display 'whole' exemplars to…

Artificial Intelligence · Computer Science 2023-11-07 Eoin Kenny , Eoin Delaney , Mark Keane

In the realm of Artificial Intelligence (AI), the importance of Explainable Artificial Intelligence (XAI) is increasingly recognized, particularly as AI models become more integral to our lives. One notable single-instance XAI approach is…

Machine Learning · Computer Science 2024-06-03 Yukai Zhang , Ao Xu , Zihao Li , Tieru Wu

As larger deep learning models are hard to interpret, there has been a recent focus on generating explanations of these black-box models. In contrast, we may have apriori explanations of how models should behave. In this paper, we formalize…

Machine Learning · Computer Science 2023-12-27 Rattana Pukdee , Dylan Sam , J. Zico Kolter , Maria-Florina Balcan , Pradeep Ravikumar

Explainable Artificial Intelligence (XAI) is an emerging research field bringing transparency to highly complex and opaque machine learning (ML) models. Despite the development of a multitude of methods to explain the decisions of black-box…

Machine Learning · Computer Science 2022-03-16 Leander Weber , Sebastian Lapuschkin , Alexander Binder , Wojciech Samek

Existing interpretation algorithms have found that, even deep models make the same and right predictions on the same image, they might rely on different sets of input features for classification. However, among these sets of features, some…

Machine Learning · Computer Science 2021-09-03 Xuhong Li , Haoyi Xiong , Siyu Huang , Shilei Ji , Dejing Dou

Existing explanation tools for image classifiers usually give only a single explanation for an image's classification. For many images, however, image classifiers accept more than one explanation for the image label. These explanations are…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Hana Chockler , David A. Kelly , Daniel Kroening

Understanding why a model made a certain prediction is crucial in many data science fields. Interpretable predictions engender appropriate trust and provide insight into how the model may be improved. However, with large modern datasets the…

Artificial Intelligence · Computer Science 2016-12-09 Scott Lundberg , Su-In Lee

The encoding of solutions in black-box optimization is a delicate, handcrafted balance between expressiveness and domain knowledge -- between exploring a wide variety of solutions, and ensuring that those solutions are useful. Our main…

Neural and Evolutionary Computing · Computer Science 2020-07-07 Adam Gaier , Alexander Asteroth , Jean-Baptiste Mouret

Rule-based models offer a human-understandable representation, i.e. they are interpretable. For this reason, they are used to explain the decisions of non-interpretable complex models, referred to as black box models. The generation of such…

Artificial Intelligence · Computer Science 2025-03-03 Michał Kozielski , Marek Sikora , Łukasz Wawrowski

A main drawback of eXplainable Artificial Intelligence (XAI) approaches is the feature independence assumption, hindering the study of potential variable dependencies. This leads to approximating black box behaviors by analyzing the effects…

Artificial Intelligence · Computer Science 2024-10-16 Martina Cinquini , Riccardo Guidotti