English
Related papers

Related papers: Towards Explanation of DNN-based Prediction with G…

200 papers

Graph neural networks (GNNs) are highly effective on a variety of graph-related tasks; however, they lack interpretability and transparency. Current explainability approaches are typically local and treat GNNs as black-boxes. They do not…

Machine Learning · Computer Science 2023-03-10 Han Xuanyuan , Pietro Barbiero , Dobrik Georgiev , Lucie Charlotte Magister , Pietro Lió

One of the key issues in Deep Neural Networks (DNNs) is the black-box nature of their internal feature extraction process. Targeting vision-related domains, this paper focuses on analysing the feature space of a DNN by proposing a decoder…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Kimiaki Shirahama , Miki Yanobu , Kaduki Yamashita , Miho Ohsaki

Deep neural network (DNN) models have demonstrated impressive performance in various domains, yet their application in cognitive neuroscience is limited due to their lack of interpretability. In this study we employ two structurally…

Signal Processing · Electrical Eng. & Systems 2024-09-04 Murat Kucukosmanoglu , Javier O. Garcia , Justin Brooks , Kanika Bansal

Deep convolutional neural networks (CNNs) have achieved breakthrough performance in many pattern recognition tasks such as image classification. However, the development of high-quality deep models typically relies on a substantial amount…

Computer Vision and Pattern Recognition · Computer Science 2016-05-05 Mengchen Liu , Jiaxin Shi , Zhen Li , Chongxuan Li , Jun Zhu , Shixia Liu

Deep neural networks ( DNNs ) are becoming a key enabling technology for many application domains. However, on-device inference on battery-powered, resource-constrained embedding systems is often infeasible due to prohibitively long…

Machine Learning · Computer Science 2019-11-13 Vicent Sanz Marco , Ben Taylor , Zheng Wang , Yehia Elkhatib

Coherent imaging through scatter is a challenging task in computational imaging. Both model-based and data-driven approaches have been explored to solve the inverse scattering problem. In our previous work, we have shown that a deep…

Optics · Physics 2021-02-03 Yuzhe Li , Shiyi Cheng , Yujia Xue , Lei Tian

The recent ground-breaking advances in deep learning networks ( DNNs ) make them attractive for embedded systems. However, it can take a long time for DNNs to make an inference on resource-limited embedded devices. Offloading the…

Performance · Computer Science 2018-05-14 Ben Taylor , Vicent Sanz Marco , Willy Wolff , Yehia Elkhatib , Zheng Wang

This paper proposes a method to visualize the discrimination power of intermediate-layer visual patterns encoded by a DNN. Specifically, we visualize (1) how the DNN gradually learns regional visual patterns in each intermediate layer…

Computer Vision and Pattern Recognition · Computer Science 2021-11-08 Mingjie Li , Shaobo Wang , Quanshi Zhang

Understanding internal feature representations of deep neural networks (DNNs) is a fundamental step toward model interpretability. Inspired by neuroscience methods that probe biological neurons using visual stimuli, recent deep learning…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Hongbo Zhu , Angelo Cangelosi

Despite the recent progress in deep neural networks (DNNs), it remains challenging to explain the predictions made by DNNs. Existing explanation methods for DNNs mainly focus on post-hoc explanations where another explanatory model is…

Machine Learning · Computer Science 2024-01-04 Wei Qian , Chenxu Zhao , Yangyi Li , Fenglong Ma , Chao Zhang , Mengdi Huai

Deep Neural Networks (DNNs) have advanced applications in domains such as healthcare, autonomous systems, and scene understanding, yet the internal semantics of their hidden neurons remain poorly understood. Prior work introduced a Concept…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Moumita Sen Sarma , Samatha Ereshi Akkamahadevi , Pascal Hitzler

Sometimes it is not enough for a DNN to produce an outcome. For example, in applications such as healthcare, users need to understand the rationale of the decisions. Therefore, it is imperative to develop algorithms to learn models with…

Machine Learning · Computer Science 2019-01-29 Yinpeng Dong , Fan Bao , Hang Su , Jun Zhu

Deeply learned representations are the state-of-the-art descriptors for face recognition methods. These representations encode latent features that are difficult to explain, compromising the confidence and interpretability of their…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Matheus Alves Diniz , William Robson Schwartz

Ubiquitous applications of Deep neural networks (DNNs) in different artificial intelligence systems have led to their adoption in solving challenging visualization problems in recent years. While sophisticated DNNs offer an impressive…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Soumya Dutta , Faheem Nizar , Ahmad Amaan , Ayan Acharya

Deep neural networks have demonstrated remarkable performance across various domains, yet their decision-making processes remain opaque. Although many explanation methods are dedicated to bringing the obscurity of DNNs to light, they…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Kanglong Fan , Yunqiao Yang , Chen Ma

Despite their success and widespread adoption, the opaque nature of deep neural networks (DNNs) continues to hinder trust, especially in critical applications. Current interpretability solutions often yield inconsistent or oversimplified…

Machine Learning · Computer Science 2024-10-10 Alec F. Diallo , Vaishak Belle , Paul Patras

Deep neural networks have demonstrated superior performance in artificial intelligence applications, but the opaqueness of their inner working mechanism is one major drawback in their application. The prevailing unit-based interpretation is…

Computer Vision and Pattern Recognition · Computer Science 2024-02-29 Lei Lyu , Chen Pang , Jihua Wang

Ensuring the trustworthiness and interpretability of machine learning models is critical to their deployment in real-world applications. Feature attribution methods have gained significant attention, which provide local explanations of…

Machine Learning · Computer Science 2023-09-20 Md Abdul Kadir , Gowtham Krishna Addluri , Daniel Sonntag

This paper provides an entry point to the problem of interpreting a deep neural network model and explaining its predictions. It is based on a tutorial given at ICASSP 2017. It introduces some recently proposed techniques of interpretation,…

Machine Learning · Computer Science 2017-11-15 Grégoire Montavon , Wojciech Samek , Klaus-Robert Müller

Graph neural networks (GNNs) have become a popular approach to integrating structural inductive biases into NLP models. However, there has been little work on interpreting them, and specifically on understanding which parts of the graphs…

Computation and Language · Computer Science 2022-10-04 Michael Sejr Schlichtkrull , Nicola De Cao , Ivan Titov