English
Related papers

Related papers: Explainable Deep Learning: A Field Guide for the U…

200 papers

Deep learning-based AI models have been extensively applied in genomics, achieving remarkable success across diverse applications. As these models gain prominence, there exists an urgent need for interpretability methods to establish…

Genomics · Quantitative Biology 2025-05-16 Chenyu Wang , Chaoying Zuo , Zihan Su , Yuhang Xing , Lu Li , Maojun Wang , Zeyu Zhang

Deep neural networks (DNNs) have become a crucial instrument in the software development toolkit, due to their ability to efficiently solve complex problems. Nevertheless, DNNs are highly opaque, and can behave in an unexpected manner when…

Software Engineering · Computer Science 2023-01-20 Adiel Ashrov , Guy Katz

The scientific community has been increasingly interested in harnessing the power of deep learning to solve various domain challenges. However, despite the effectiveness in building predictive models, fundamental challenges exist in…

Machine Learning · Computer Science 2020-07-20 Shusen Liu , Bhavya Kailkhura , Jize Zhang , Anna M. Hiszpanski , Emily Robertson , Donald Loveland , T. Yong-Jin Han

There has recently been a surge of work in explanatory artificial intelligence (XAI). This research area tackles the important problem that complex machines and algorithms often cannot provide insights into their behavior and thought…

Artificial Intelligence · Computer Science 2019-02-05 Leilani H. Gilpin , David Bau , Ben Z. Yuan , Ayesha Bajwa , Michael Specter , Lalana Kagal

State of the art Deep Neural Networks (DNN) can now achieve above human level accuracy on image classification tasks. However their outstanding performances come along with a complex inference mechanism making them arduously interpretable…

Machine Learning · Computer Science 2019-11-07 Fei Wu , Thomas Michel , Alexandre Briot

Explaining the output of a complicated machine learning model like a deep neural network (DNN) is a central challenge in machine learning. Several proposed local explanation methods address this issue by identifying what dimensions of a…

Computer Vision and Pattern Recognition · Computer Science 2018-10-09 Julius Adebayo , Justin Gilmer , Ian Goodfellow , Been Kim

Recent breakthroughs in machine and deep learning (ML and DL) research have provided excellent tools for leveraging enormous amounts of data and optimizing huge models with millions of parameters to obtain accurate networks for image…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Mohammadreza Amirian

We propose the fully explainable Decision Tree Graph Neural Network (DT+GNN) architecture. In contrast to existing black-box GNNs and post-hoc explanation methods, the reasoning of DT+GNN can be inspected at every step. To achieve this, we…

Machine Learning · Computer Science 2022-05-27 Peter Müller , Lukas Faber , Karolis Martinkus , Roger Wattenhofer

Deep neural networks (DNNs) have shown exceptional performances in a wide range of tasks and have become the go-to method for problems requiring high-level predictive power. There has been extensive research on how DNNs arrive at their…

Machine Learning · Computer Science 2023-02-21 Mattias Luber , Anton Thielmann , Benjamin Säfken

Deep neural networks (DNNs) may outperform human brains in complex tasks, but the lack of transparency in their decision-making processes makes us question whether we could fully trust DNNs with high stakes problems. As DNNs' operations…

Machine Learning · Computer Science 2020-03-19 Jung Hoon Lee

This paper presents a method to explain the knowledge encoded in a convolutional neural network (CNN) quantitatively and semantically. The analysis of the specific rationale of each prediction made by the CNN presents a key issue of…

Computer Vision and Pattern Recognition · Computer Science 2018-12-19 Runjin Chen , Hao Chen , Ge Huang , Jie Ren , Quanshi Zhang

Deep Neural Networks (DNNs) are widely used for decision making in a myriad of critical applications, ranging from medical to societal and even judicial. Given the importance of these decisions, it is crucial for us to be able to interpret…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Teddy Koker , Fatemehsadat Mireshghallah , Tom Titcombe , Georgios Kaissis

In recent years, the use of sophisticated statistical models that influence decisions in domains of high societal relevance is on the rise. Although these models can often bring substantial improvements in the accuracy and efficiency of…

Machine Learning · Computer Science 2021-04-13 Alfredo Carrillo , Luis F. Cantú , Alejandro Noriega

Recent technological advancements have led to a large number of patents in a diverse range of domains, making it challenging for human experts to analyze and manage. State-of-the-art methods for multi-label patent classification rely on…

Artificial Intelligence · Computer Science 2024-07-30 Md Shajalal , Sebastian Denef , Md. Rezaul Karim , Alexander Boden , Gunnar Stevens

This survey reviews explainability methods for vision-based self-driving systems trained with behavior cloning. The concept of explainability has several facets and the need for explainability is strong in driving, a safety-critical…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Éloi Zablocki , Hédi Ben-Younes , Patrick Pérez , Matthieu Cord

Methods for understanding the decisions of and mechanisms underlying deep neural networks (DNNs) typically rely on building intuition by emphasizing sensory or semantic features of individual examples. For instance, methods aim to visualize…

Computers and Society · Computer Science 2020-10-26 Matthew L. Leavitt , Ari Morcos

The field of explainable natural language processing (NLP) has grown rapidly in recent years. The growing opacity of complex models calls for transparency and explanations of their decisions, which is crucial to understand their reasoning…

Computation and Language · Computer Science 2025-08-14 Mahdi Dhaini , Tobias Müller , Roksoliana Rabets , Gjergji Kasneci

Graph Neural Networks (GNNs) have emerged as the predominant approach for learning over graph-structured data. However, most GNNs operate as black-box models and require post-hoc explanations, which may not suffice in high-stakes scenarios…

Machine Learning · Computer Science 2025-10-14 Maya Bechler-Speicher , Amir Globerson , Ran Gilad-Bachrach

In many practical applications, deep neural networks have been typically deployed to operate as a black box predictor. Despite the high amount of work on interpretability and high demand on the reliability of these systems, they typically…

Artificial Intelligence · Computer Science 2020-12-07 Martin Stano , Wanda Benesova , Lukas Samuel Martak

The ability to navigate robots with natural language instructions in an unknown environment is a crucial step for achieving embodied artificial intelligence (AI). With the improving performance of deep neural models proposed in the field of…

Robotics · Computer Science 2023-10-11 Guanqi Chen , Lei Yang , Guanhua Chen , Jia Pan