English
Related papers

Related papers: Contextual Local Explanation for Black Box Classif…

200 papers

Image classification is a primary task in data analysis where explainable models are crucially demanded in various applications. Although amounts of methods have been proposed to obtain explainable knowledge from the black-box classifiers,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Ruitao Xie , Jingbang Chen , Limai Jiang , Rui Xiao , Yi Pan , Yunpeng Cai

The emergence of tools based on artificial intelligence has also led to the need of producing explanations which are understandable by a human being. In most approaches, the system is considered a black box, making it difficult to generate…

Artificial Intelligence · Computer Science 2024-10-23 Germán Vidal

Understanding the predictions made by deep learning models remains a central challenge, especially in high-stakes applications. A promising approach is to equip models with the ability to answer counterfactual questions -- hypothetical…

Machine Learning · Computer Science 2025-10-28 Inwoo Hwang , Yushu Pan , Elias Bareinboim

Machine learning is currently undergoing an explosion in capability, popularity, and sophistication. However, one of the major barriers to widespread acceptance of machine learning (ML) is trustworthiness: most ML models operate as black…

In machine learning algorithm design, there exists a trade-off between the interpretability and performance of the algorithm. In general, algorithms which are simpler and easier for humans to comprehend tend to show worse performance than…

Machine Learning · Computer Science 2024-07-15 Eric M. Vernon , Naoki Masuyama , Yusuke Nojima

Contrastive explanations clarify why an event occurred in contrast to another. They are more inherently intuitive to humans to both produce and comprehend. We propose a methodology to produce contrastive explanations for classification…

Computation and Language · Computer Science 2021-09-15 Alon Jacovi , Swabha Swayamdipta , Shauli Ravfogel , Yanai Elazar , Yejin Choi , Yoav Goldberg

Understanding black-box machine learning models is crucial for their widespread adoption. Learning globally interpretable models is one approach, but achieving high performance with them is challenging. An alternative approach is to explain…

Machine Learning · Computer Science 2022-09-23 Jinsung Yoon , Sercan O. Arik , Tomas Pfister

Surrogate explainers of black-box machine learning predictions are of paramount importance in the field of eXplainable Artificial Intelligence since they can be applied to any type of data (images, text and tabular), are model-agnostic and…

Machine Learning · Computer Science 2019-10-30 Kacper Sokol , Alexander Hepburn , Raul Santos-Rodriguez , Peter Flach

After building a classifier with modern tools of machine learning we typically have a black box at hand that is able to predict well for unseen data. Thus, we get an answer to the question what is the most likely label of a given unseen…

Modern data analytics underpinned by machine learning techniques has become a key enabler to the automation of data-led decision making. As an important branch of state-of-the-art data analytics, business process predictions are also faced…

Artificial Intelligence · Computer Science 2021-07-22 Chun Ouyang , Renuka Sindhgatta , Catarina Moreira

As the use of deep learning techniques has grown across various fields over the past decade, complaints about the opaqueness of the black-box models have increased, resulting in an increased focus on transparency in deep learning models.…

Computation and Language · Computer Science 2024-03-19 Siwen Luo , Hamish Ivison , Caren Han , Josiah Poon

Explaining the behavior of black box machine learning models through human interpretable rules is an important research area. Recent work has focused on explaining model behavior locally i.e. for specific predictions as well as globally…

Machine Learning · Computer Science 2021-05-17 Sukriti Verma , Nikaash Puri , Piyush Gupta , Balaji Krishnamurthy

Both uncertainty estimation and interpretability are important factors for trustworthy machine learning systems. However, there is little work at the intersection of these two areas. We address this gap by proposing a novel method for…

Machine Learning · Statistics 2021-03-19 Javier Antorán , Umang Bhatt , Tameem Adel , Adrian Weller , José Miguel Hernández-Lobato

When it comes to complex machine learning models, commonly referred to as black boxes, understanding the underlying decision making process is crucial for domains such as healthcare and financial services, and also when it is used in…

Machine Learning · Computer Science 2020-12-02 Jürgen Dieber , Sabrina Kirrane

To interpret uncertainty estimates from differentiable probabilistic models, recent work has proposed generating Counterfactual Latent Uncertainty Explanations (CLUEs). However, for a single input, such approaches could output a variety of…

Machine Learning · Computer Science 2021-12-06 Dan Ley , Umang Bhatt , Adrian Weller

Local explanation methods such as LIME have become popular in MIR as tools for generating post-hoc, model-agnostic explanations of a model's classification decisions. The basic idea is to identify a small set of human-understandable…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-07 Verena Praher , Katharina Prinz , Arthur Flexer , Gerhard Widmer

Complex models are commonly used in predictive modeling. In this paper we present R packages that can be used to explain predictions from complex black box models and attribute parts of these predictions to input features. We introduce two…

Machine Learning · Statistics 2019-03-26 Mateusz Staniak , Przemyslaw Biecek

The significant advances in autonomous systems together with an immensely wider application domain have increased the need for trustable intelligent systems. Explainable artificial intelligence is gaining considerable attention among…

Artificial Intelligence · Computer Science 2020-06-02 Sule Anjomshoae , Kary Främling , Amro Najjar

We propose a general model explanation system (MES) for "explaining" the output of black box classifiers. This paper describes extensions to Turner (2015), which is referred to frequently in the text. We use the motivating example of a…

Machine Learning · Statistics 2016-07-01 Ryan Turner

Multimodal classifiers function as opaque black box models. While several techniques exist to interpret their predictions, very few of them are as intuitive and accessible as natural language explanations (NLEs). To build trust, such…

Computation and Language · Computer Science 2025-12-09 Dibyanayan Bandyopadhyay , Soham Bhattacharjee , Mohammed Hasanuzzaman , Asif Ekbal