English
Related papers

Related papers: "Why did you do that?": Explaining black box model…

200 papers

Nowadays, deep neural networks are being used in many domains because of their high accuracy results. However, they are considered as "black box", means that they are not explainable for humans. On the other hand, in some tasks such as…

Machine Learning · Computer Science 2022-04-08 Niloofar Ranjbar , Reza Safabakhsh

In explainable artificial intelligence, there is increasing interest in understanding the behaviour of autonomous agents to build trust and validate performance. Modern agent architectures, such as those trained by deep reinforcement…

Artificial Intelligence · Computer Science 2020-09-22 Tom Bewley , Jonathan Lawry

From a simple text prompt, generative-AI image models can create stunningly realistic and creative images bounded, it seems, by only our imagination. These models have achieved this remarkable feat thanks, in part, to the ingestion of…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Matyas Bohacek , Hany Farid

Selective rationalization has become a common mechanism to ensure that predictive models reveal how they use any available features. The selection may be soft or hard, and identifies a subset of input features relevant for prediction. The…

Computation and Language · Computer Science 2019-12-17 Mo Yu , Shiyu Chang , Yang Zhang , Tommi S. Jaakkola

Even with impressive advances in automated formal methods, certain problems in system verification and synthesis remain challenging. Examples include the verification of quantitative properties of software involving constraints on timing…

Logic in Computer Science · Computer Science 2015-03-19 Sanjit A. Seshia

We present an approach to explain the decisions of black box models for image classification. While using the black box to label images, our explanation method exploits the latent feature space learned through an adversarial autoencoder.…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Riccardo Guidotti , Anna Monreale , Stan Matwin , Dino Pedreschi

Learning and logic are distinct and remarkable approaches to prediction. Machine learning has experienced a surge in popularity because it is robust to noise and achieves high performance; however, ML experiences many issues with knowledge…

Artificial Intelligence · Computer Science 2018-07-16 Jeffrey Cheng

In recent years, deep learning has become prevalent to solve applications from multiple domains. Convolutional Neural Networks (CNNs) particularly have demonstrated state of the art performance for the task of image classification. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Meghna P Ayyar , Jenny Benois-Pineau , Akka Zemmari

Safety critical systems strongly require the quality aspects of artificial intelligence including explainability. In this paper, we analyzed a trained network to extract features which mainly contribute the inference. Based on the analysis,…

Computer Vision and Pattern Recognition · Computer Science 2017-12-11 Hiroshi Kuwajima , Masayuki Tanaka

In machine learning algorithm design, there exists a trade-off between the interpretability and performance of the algorithm. In general, algorithms which are simpler and easier for humans to comprehend tend to show worse performance than…

Machine Learning · Computer Science 2024-07-15 Eric M. Vernon , Naoki Masuyama , Yusuke Nojima

In Autonomous Driving (AD) transparency and safety are paramount, as mistakes are costly. However, neural networks used in AD systems are generally considered black boxes. As a countermeasure, we have methods of explainable AI (XAI), such…

Machine Learning · Computer Science 2024-04-29 Mohamed Roshdi , Julian Petzold , Mostafa Wahby , Hussein Ebrahim , Mladen Berekovic , Heiko Hamann

In an era where black-box AI models are integral to decision-making across industries, robust methods for explaining these models are more critical than ever. While these models leverage complex feature interplay for accurate predictions,…

Human-Computer Interaction · Computer Science 2025-03-24 Anna Kleinau , Bernhard Preim , Monique Meuschke

We develop a method for generating causal post-hoc explanations of black-box classifiers based on a learned low-dimensional representation of the data. The explanation is causal in the sense that changing learned latent factors produces a…

Machine Learning · Computer Science 2020-10-23 Matthew O'Shaughnessy , Gregory Canal , Marissa Connor , Mark Davenport , Christopher Rozell

Despite achieving superior performance in human-level control problems, unlike humans, deep reinforcement learning (DRL) lacks high-order intelligence (e.g., logic deduction and reuse), thus it behaves ineffectively than humans regarding…

Artificial Intelligence · Computer Science 2022-05-30 Yushi Cao , Zhiming Li , Tianpei Yang , Hao Zhang , Yan Zheng , Yi Li , Jianye Hao , Yang Liu

Rapid improvements in the performance of machine learning models have pushed them to the forefront of data-driven decision-making. Meanwhile, the increased integration of these models into various application domains has further highlighted…

Human-Computer Interaction · Computer Science 2021-09-14 Oscar Gomez , Steffen Holter , Jun Yuan , Enrico Bertini

This paper is concerned with synthesizing programs based on black-box oracles: we are interested in the case where there exists an executable implementation of a component or library, but its internal structure is unknown. We are provided…

Programming Languages · Computer Science 2020-10-13 Bruce Collie , Jackson Woodruff , Michael F. P. O'Boyle

The rise of AI methods to make predictions and decisions has led to a pressing need for more explainable artificial intelligence (XAI) methods. One common approach for XAI is to produce a post-hoc explanation, explaining why a black box ML…

Artificial Intelligence · Computer Science 2022-12-01 Jinqiang Yu , Alexey Ignatiev , Peter J. Stuckey , Nina Narodytska , Joao Marques-Silva

The need for transparency of predictive systems based on Machine Learning algorithms arises as a consequence of their ever-increasing proliferation in the industry. Whenever black-box algorithmic predictions influence human affairs, the…

Machine Learning · Computer Science 2020-02-11 Kacper Sokol , Peter Flach

A main drawback of eXplainable Artificial Intelligence (XAI) approaches is the feature independence assumption, hindering the study of potential variable dependencies. This leads to approximating black box behaviors by analyzing the effects…

Artificial Intelligence · Computer Science 2024-10-16 Martina Cinquini , Riccardo Guidotti

As machine learning black boxes are increasingly being deployed in critical domains such as healthcare and criminal justice, there has been a growing emphasis on developing techniques for explaining these black boxes in a human…

Artificial Intelligence · Computer Science 2019-11-18 Himabindu Lakkaraju , Osbert Bastani