English
Related papers

Related papers: What made you do this? Understanding black-box dec…

200 papers

Neural networks have emerged as powerful tools across various applications, yet their decision-making process often remains opaque, leading to them being perceived as "black boxes." This opacity raises concerns about their interpretability…

Machine Learning · Computer Science 2024-11-27 Pirzada Suhail , Amit Sethi

Existing algorithms for explaining the outputs of image classifiers are based on a variety of approaches and produce explanations that frequently lack formal rigour. On the other hand, logic-based explanations are formally and rigorously…

Artificial Intelligence · Computer Science 2026-02-20 David A Kelly , Hana Chockler

An important feature of successful supervised machine learning applications is to be able to explain the predictions given by the regression or classification model being used. However, most state-of-the-art models that have good predictive…

Machine Learning · Statistics 2019-10-14 Victor Coscrato , Marco Henrique de Almeida Inácio , Tiago Botari , Rafael Izbicki

Generative models are capable of producing human-expert level content across a variety of topics and domains. As the impact of generative models grows, it is necessary to develop statistical methods to understand collections of available…

Machine Learning · Computer Science 2025-05-23 Hayden Helm , Aranyak Acharyya , Brandon Duderstadt , Youngser Park , Carey E. Priebe

Recent advancements in neural networks have showcased their remarkable capabilities across various domains. Despite these successes, the "black box" problem still remains. Addressing this, we propose a novel framework, WWW, that offers the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Yong Hyun Ahn , Hyeon Bae Kim , Seong Tae Kim

This paper presents a comprehensive theoretical investigation into the parameterized complexity of explanation problems in various machine learning (ML) models. Contrary to the prevalent black-box perception, our study focuses on models…

Artificial Intelligence · Computer Science 2025-11-06 Sebastian Ordyniak , Giacomo Paesani , Mateusz Rychlicki , Stefan Szeider

Inferring from inconsistency and making decisions are two problems which have always been treated separately by researchers in Artificial Intelligence. Consequently, different models have been proposed for each category. Different…

Artificial Intelligence · Computer Science 2012-07-09 Leila Amgoud

Model Interpretation aims at the extraction of insights from the internals of a trained model. A common approach to address this task is the characterization of relevant features internally encoded in the model that are critical for its…

Machine Learning · Computer Science 2024-10-07 Hamed Behzadi-Khormouji , José Oramas

Transformer language models are state of the art in a multitude of NLP tasks. Despite these successes, their opaqueness remains problematic. Recent methods aiming to provide interpretability and explainability to black-box models primarily…

Computation and Language · Computer Science 2022-03-14 Felix Friedrich , Patrick Schramowski , Christopher Tauchmann , Kristian Kersting

Recent advancements in post-hoc and inherently interpretable methods have markedly enhanced the explanations of black box classifier models. These methods operate either through post-analysis or by integrating concept learning during model…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Bor-Shiun Wang , Chien-Yi Wang , Wei-Chen Chiu

Explainable artificial intelligence is proposed to provide explanations for reasoning performed by an Artificial Intelligence. There is no consensus on how to evaluate the quality of these explanations, since even the definition of…

Artificial Intelligence · Computer Science 2025-06-17 Iván Sevillano-García , Julián Luengo-Martín , Francisco Herrera

Recently, interpretable machine learning has re-explored concept bottleneck models (CBM). An advantage of this model class is the user's ability to intervene on predicted concept values, affecting the downstream output. In this work, we…

Machine Learning · Computer Science 2024-10-29 Sonia Laguna , Ričards Marcinkevičs , Moritz Vandenhirtz , Julia E. Vogt

The emergence of tools based on artificial intelligence has also led to the need of producing explanations which are understandable by a human being. In most approaches, the system is considered a black box, making it difficult to generate…

Artificial Intelligence · Computer Science 2024-10-23 Germán Vidal

Black-box Artificial Intelligence (AI) methods, e.g. deep neural networks, have been widely utilized to build predictive models that can extract complex relationships in a dataset and make predictions for new unseen data records. However,…

Artificial Intelligence · Computer Science 2020-09-22 Milad Moradi , Matthias Samwald

Like humans, document summarization models can interpret a document's contents in a number of ways. Unfortunately, the neural models of today are largely black boxes that provide little explanation of how or why they generated a summary in…

Computation and Language · Computer Science 2020-12-15 Wang Haonan , Gao Yang , Bai Yu , Mirella Lapata , Huang Heyan

Explaining the decisions of machine learning models is becoming a necessity in many areas where trust in ML models decision is key to their accreditation/adoption. The ability to explain models decisions also allows to provide diagnosis in…

Machine Learning · Computer Science 2021-06-01 Pierre Blanchart

In this paper we propose a novel method that provides contrastive explanations justifying the classification of an input by a black box classifier such as a deep neural network. Given an input we find what should be %necessarily and…

Artificial Intelligence · Computer Science 2018-10-30 Amit Dhurandhar , Pin-Yu Chen , Ronny Luss , Chun-Chen Tu , Paishun Ting , Karthikeyan Shanmugam , Payel Das

Automated decision making is used routinely throughout our everyday life. Recommender systems decide which jobs, movies, or other user profiles might be interesting to us. Spell checkers help us to make good use of language. Fraud detection…

Machine Learning · Computer Science 2020-07-15 Alexander Jung , Pedro H. J. Nardelli

Constructing accurate model-agnostic explanations for opaque machine learning models remains a challenging task. Classification models for high-dimensional data, like images, are often inherently complex. To reduce this complexity,…

Machine Learning · Computer Science 2020-10-26 Georgios Vlassopoulos , Tim van Erven , Henry Brighton , Vlado Menkovski

In the context of some machine learning applications, obtaining data instances is a relatively easy process but labeling them could become quite expensive or tedious. Such scenarios lead to datasets with few labeled instances and a larger…

Machine Learning · Computer Science 2020-07-21 Isel Grau , Dipankar Sengupta , Maria M. Garcia Lorenzo , Ann Nowe