English
Related papers

Related papers: Neural network interpretation using descrambler gr…

200 papers

Deep neural network architectures often consist of repetitive structural elements. We introduce an approach that reveals these patterns and can be broadly applied to the study of deep learning. Similarly to how a power strip helps untangle…

Statistical Mechanics · Physics 2025-07-03 Donghee Lee , Hye-Sung Lee , Jaeok Yi

We propose a novel method to explain trained deep neural networks (DNNs), by distilling them into surrogate models using unsupervised clustering. Our method can be applied flexibly to any subset of layers of a DNN architecture and can…

Computer Vision and Pattern Recognition · Computer Science 2020-07-17 Yu-han Liu , Sercan O. Arik

Deep convolutional neural networks accurately classify a diverse range of natural images, but may be easily deceived when designed, imperceptible perturbations are embedded in the images. In this paper, we design a multi-pronged training,…

Computer Vision and Pattern Recognition · Computer Science 2022-08-26 Nathaniel Dean , Dilip Sarkar

Deep neural networks are vulnerable to adversarial attacks and hard to interpret because of their black-box nature. The recently proposed invertible network is able to accurately reconstruct the inputs to a layer from its outputs, thus has…

Machine Learning · Computer Science 2019-10-16 Juntang Zhuang , Nicha C. Dvornek , Xiaoxiao Li , Junlin Yang , James S. Duncan

The inherent "black box" nature of deep neural networks (DNNs) compromises their transparency and reliability. Recently, explainable AI (XAI) has garnered increasing attention from researchers. Several perturbation-based interpretations…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Xuran Hu , Mingzhe Zhu , Zhenpeng Feng , Miloš Daković , Ljubiša Stanković

Tensorizing a neural network involves reshaping some or all of its dense weight matrices into higher-order tensors and approximating them using low-rank tensor network decompositions. This technique has shown promise as a model compression…

Machine Learning · Computer Science 2025-05-27 Safa Hamreras , Sukhbinder Singh , Román Orús

Despite their great success, there is still no comprehensive theoretical understanding of learning with Deep Neural Networks (DNNs) or their inner organization. Previous work proposed to analyze DNNs in the \textit{Information Plane}; i.e.,…

Machine Learning · Computer Science 2017-05-02 Ravid Shwartz-Ziv , Naftali Tishby

Traditional supervised denoising networks learn network weights through "black box" (pixel-oriented) training, which requires clean training labels. The uninterpretability nature of such denoising networks in addition to the requirement for…

Geophysics · Physics 2023-08-08 Sixiu Liu , Shijun Cheng , Tariq Alkhalifah

Neural networks have emerged as powerful tools across various applications, yet their decision-making process often remains opaque, leading to them being perceived as "black boxes." This opacity raises concerns about their interpretability…

Machine Learning · Computer Science 2024-11-28 Pirzada Suhail , Hao Tang , Amit Sethi

Although considerable effort has been dedicated to improving the solution to the hyperspectral unmixing problem, non-idealities such as complex radiation scattering and endmember variability negatively impact the performance of most…

Image and Video Processing · Electrical Eng. & Systems 2023-10-05 Ricardo Augusto Borsoi , Deniz Erdoğmuş , Tales Imbiriba

Current deep neural networks suffer from two problems; first, they are hard to interpret, and second, they suffer from overfitting. There have been many attempts to define interpretability in neural networks, but they typically lack…

Machine Learning · Computer Science 2019-08-15 Sean Tao

Deep neural networks (DNNs) have been shown to outperform traditional machine learning algorithms in a broad variety of application domains due to their effectiveness in modeling complex problems and handling high-dimensional datasets. Many…

Deep learning has become increasingly popular in both supervised and unsupervised machine learning thanks to its outstanding empirical performance. However, because of their intrinsic complexity, most deep learning methods are largely…

Machine Learning · Computer Science 2018-09-07 Yang Young Lu , Yingying Fan , Jinchi Lv , William Stafford Noble

Blind image deblurring remains a topic of enduring interest. Learning based approaches, especially those that employ neural networks have emerged to complement traditional model based methods and in many cases achieve vastly enhanced…

Image and Video Processing · Electrical Eng. & Systems 2019-05-30 Yuelong Li , Mohammad Tofighi , Junyi Geng , Vishal Monga , Yonina C. Eldar

In this paper, we propose a novel Explanation Neural Network (XNN) to explain the predictions made by a deep network. The XNN works by learning a nonlinear embedding of a high-dimensional activation vector of a deep network layer into a…

Computer Vision and Pattern Recognition · Computer Science 2020-12-14 Zhongang Qi , Saeed Khorram , Fuxin Li

We introduce techniques for exploring the functionality of a neural network and extracting simple, human-readable approximations to its performance. By performing gradient ascent on the input space of the network, we are able to produce…

High Energy Physics - Phenomenology · Physics 2018-04-26 Thomas Roxlo , Matthew Reece

Deep Convolutional Neural Networks (CNNs) have been one of the most influential recent developments in computer vision, particularly for categorization. There is an increasing demand for explainable AI as these systems are deployed in the…

Computer Vision and Pattern Recognition · Computer Science 2018-11-21 Tian Xu , Jiayu Zhan , Oliver G. B. Garrod , Philip H. S. Torr , Song-Chun Zhu , Robin A. A. Ince , Philippe G. Schyns

While neural networks have achieved vastly enhanced performance over traditional iterative methods in many cases, they are generally empirically designed and the underlying structures are difficult to interpret. The algorithm unrolling…

Computer Vision and Pattern Recognition · Computer Science 2019-02-18 Yuelong Li , Mohammad Tofighi , Vishal Monga , Yonina C. Eldar

Neural networks have emerged as powerful tools across various applications, yet their decision-making process often remains opaque, leading to them being perceived as "black boxes." This opacity raises concerns about their interpretability…

Machine Learning · Computer Science 2024-11-27 Pirzada Suhail , Amit Sethi

In order for machine learning to be deployed and trusted in many applications, it is crucial to be able to reliably explain why the machine learning algorithm makes certain predictions. For example, if an algorithm classifies a given…

Machine Learning · Statistics 2018-11-07 Amirata Ghorbani , Abubakar Abid , James Zou