English
Related papers

Related papers: A Theoretical Explanation for Perplexing Behaviors…

200 papers

Lack of explainability in artificial intelligence, specifically deep neural networks, remains a bottleneck for implementing models in practice. Popular techniques such as Gradient-weighted Class Activation Mapping (Grad-CAM) provide a…

Computer Vision and Pattern Recognition · Computer Science 2021-11-03 Amil Dravid , Aggelos K. Katsaggelos

Despite transformers being considered as the new standard in computer vision, convolutional neural networks (CNNs) still outperform them in low-data regimes. Nonetheless, CNNs often make decisions based on narrow, specific regions of input…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 David Bertoin , Eduardo Hugo Sanchez , Mehdi Zouitine , Emmanuel Rachelson

We describe the class of convexified convolutional neural networks (CCNNs), which capture the parameter sharing of convolutional neural networks in a convex manner. By representing the nonlinear convolutional filters as vectors in a…

Machine Learning · Computer Science 2016-09-06 Yuchen Zhang , Percy Liang , Martin J. Wainwright

Representations in the hidden layers of Deep Neural Networks (DNN) are often hard to interpret since it is difficult to project them into an interpretable domain. Graph Convolutional Networks (GCN) allow this projection, but existing…

Computation and Language · Computer Science 2019-09-25 Robert Schwarzenberg , Marc Hübner , David Harbecke , Christoph Alt , Leonhard Hennig

Convolutional neural networks (CNNs) underpin many modern computer vision systems. With applications ranging from common to critical areas, a need to explain and understand the model and its decisions (XAI) emerged. Prior works suggest that…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Vojtěch Kůr , Adam Bajger , Adam Kukučka , Marek Hradil , Vít Musil , Tomáš Brázdil

Feed-forward convolutional neural networks (CNNs) are currently state-of-the-art for object classification tasks such as ImageNet. Further, they are quantitatively accurate models of temporally-averaged responses of neurons in the primate…

Neurons and Cognition · Quantitative Biology 2018-10-30 Aran Nayebi , Daniel Bear , Jonas Kubilius , Kohitij Kar , Surya Ganguli , David Sussillo , James J. DiCarlo , Daniel L. K. Yamins

Convolutional Neural Networks (CNNs) have revolutionized the understanding of visual content. This is mainly due to their ability to break down an image into smaller pieces, extract multi-scale localized features and compose them to…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Zachary Wharton , Ardhendu Behera , Asish Bera

The success of recent deep convolutional neural networks (CNNs) depends on learning hidden representations that can summarize the important factors of variation behind the data. However, CNNs often criticized as being black boxes that lack…

Computer Vision and Pattern Recognition · Computer Science 2018-06-27 Bolei Zhou , David Bau , Aude Oliva , Antonio Torralba

Traditional machine learning methods for movement recognition often struggle with limited model interpretability and a lack of insight into human movement dynamics. This study introduces a novel representation learning framework based on…

Machine Learning · Computer Science 2025-07-01 Xingrui Gu , Chuyi Jiang , Erte Wang , Qiang Cui , Leimin Tian , Lianlong Wu , Siyang Song , Chuang Yu

Convolutional networks are ubiquitous in deep learning. They are particularly useful for images, as they reduce the number of parameters, reduce training time, and increase accuracy. However, as a model of the brain they are seriously…

Machine Learning · Computer Science 2022-01-19 Roman Pogodin , Yash Mehta , Timothy P. Lillicrap , Peter E. Latham

Neural networks have shown tremendous potential for reconstructing high-resolution images in inverse problems. The non-convex and opaque nature of neural networks, however, hinders their utility in sensitive applications such as medical…

Machine Learning · Computer Science 2020-12-10 Arda Sahiner , Morteza Mardani , Batu Ozturkler , Mert Pilanci , John Pauly

Convolutional Neural Networks (CNN) have become state-of-the-art in the field of image classification. However, not everything is understood about their inner representations. This paper tackles the interpretability and explainability of…

Computer Vision and Pattern Recognition · Computer Science 2019-11-11 Brian Kenji Iwana , Ryohei Kuroki , Seiichi Uchida

Several recent works have empirically observed that Convolutional Neural Nets (CNNs) are (approximately) invertible. To understand this approximate invertibility phenomenon and how to leverage it more effectively, we focus on a theoretical…

Machine Learning · Statistics 2017-05-25 Anna C. Gilbert , Yi Zhang , Kibok Lee , Yuting Zhang , Honglak Lee

This paper presents a new variational inference framework for image restoration and a convolutional neural network (CNN) structure that can solve the restoration problems described by the proposed framework. Earlier CNN-based image…

Image and Video Processing · Electrical Eng. & Systems 2022-07-20 Jae Woong Soh , Nam Ik Cho

We study the problem of graph structure identification, i.e., of recovering the graph of dependencies among time series. We model these time series data as components of the state of linear stochastic networked dynamical systems. We assume…

Machine Learning · Computer Science 2023-06-29 Sérgio Machado , Anirudh Sridhar , Paulo Gil , Jorge Henriques , José M. F. Moura , Augusto Santos

Tensor decomposition methods are widely used for model compression and fast inference in convolutional neural networks (CNNs). Although many decompositions are conceivable, only CP decomposition and a few others have been applied in…

Machine Learning · Computer Science 2019-11-28 Kohei Hayashi , Taiki Yamaguchi , Yohei Sugawara , Shin-ichi Maeda

Neural networks have proved an effective means of learning control policies for autonomous systems, but these learned policies are difficult to understand due to the black-box nature of neural networks. This lack of interpretability makes…

Machine Learning · Computer Science 2026-05-12 Hector Woods , Philippa Ryan , Rob Alexander

This paper addresses the visualisation of image classification models, learnt using deep Convolutional Networks (ConvNets). We consider two visualisation techniques, based on computing the gradient of the class score with respect to the…

Computer Vision and Pattern Recognition · Computer Science 2014-04-22 Karen Simonyan , Andrea Vedaldi , Andrew Zisserman

Attribution map visualization has arisen as one of the most effective techniques to understand the underlying inference process of Convolutional Neural Networks. In this task, the goal is to compute an score for each image pixel related…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Adria Ruiz , Antonio Agudo , Francesc Moreno

By and large, Backpropagation (BP) is regarded as one of the most important neural computation algorithms at the basis of the progress in machine learning, including the recent advances in deep learning. However, its computational structure…

Artificial Intelligence · Computer Science 2018-08-22 Alessandro Betti , Marco Gori , Giuseppe Marra