English
Related papers

Related papers: The SVD of Convolutional Weights: A CNN Interpreta…

200 papers

Very deep convolutional neural networks (CNNs) have been firmly established as the primary methods for many computer vision tasks. However, most state-of-the-art CNNs are large, which results in high inference latency. Recently, depth-wise…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Yihui He , Jianing Qian , Jianren Wang , Cindy X. Le , Congrui Hetang , Qi Lyu , Wenping Wang , Tianwei Yue

We propose a simple and generic layer formulation that extends the properties of convolutional layers to any domain that can be described by a graph. Namely, we use the support of its adjacency matrix to design learnable weight sharing…

Machine Learning · Computer Science 2017-10-06 Jean-Charles Vialatte , Vincent Gripon , Gilles Coppin

This paper presents a post-processing algorithm for training fair neural network regression models that satisfy statistical parity, utilizing an explainable singular value decomposition (SVD) of the weight matrix. We propose a linear…

Machine Learning · Computer Science 2025-04-07 Zhiqun Zuo , Ding Zhu , Mohammad Mahdi Khalili

In this work, we present tensor-based linear and nonlinear models for hyperspectral data classification and analysis. By exploiting principles of tensor algebra, we introduce new classification architectures, the weight parameters of which…

Computer Vision and Pattern Recognition · Computer Science 2018-12-26 Konstantinos Makantasis , Anastasios Doulamis , Nikolaos Doulamis , Antonis Nikitakis

Deep neural networks excel at finding hierarchical representations that solve complex tasks over large data sets. How can we humans understand these learned representations? In this work, we present network dissection, an analytic framework…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 David Bau , Jun-Yan Zhu , Hendrik Strobelt , Agata Lapedriza , Bolei Zhou , Antonio Torralba

Convolutional neural networks for computer vision are fairly intuitive. In a typical CNN used in image classification, the first layers learn edges, and the following layers learn some filters that can identify an object. But CNNs for…

Computation and Language · Computer Science 2018-04-04 Prudhvi Raj Dachapally , Srikanth Ramanam

Representations in the hidden layers of Deep Neural Networks (DNN) are often hard to interpret since it is difficult to project them into an interpretable domain. Graph Convolutional Networks (GCN) allow this projection, but existing…

Computation and Language · Computer Science 2019-09-25 Robert Schwarzenberg , Marc Hübner , David Harbecke , Christoph Alt , Leonhard Hennig

Deep convolutional neural networks (CNNs) have been successful in many tasks in machine vision, however, millions of weights in the form of thousands of convolutional filters in CNNs makes them difficult for human intepretation or…

Computer Vision and Pattern Recognition · Computer Science 2020-03-26 Reza Abbasi-Asl , Bin Yu

Deep Neural Networks use thousands of mostly incomprehensible features to identify a single class, a decision no human can follow. We propose an interpretable sparse and low dimensional final decision layer in a deep neural network with…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Thomas Norrenbrock , Marco Rudolph , Bodo Rosenhahn

This work aims to help resolve the two main stumbling blocks in the application of Deep Neural Networks (DNNs), that is, the exceedingly large number of trainable parameters and their physical interpretability. This is achieved through a…

Machine Learning · Computer Science 2020-01-07 Giuseppe G. Calvi , Ahmad Moniri , Mahmoud Mahfouz , Qibin Zhao , Danilo P. Mandic

Modern neural networks have revolutionized the fields of computer vision (CV) and Natural Language Processing (NLP). They are widely used for solving complex CV tasks and NLP tasks such as image classification, image generation, and machine…

Machine Learning · Computer Science 2023-07-25 Xingyi Liu , Keshab K. Parhi

In this paper, we describe a novel deep convolutional neural network (CNN) that is deeper and wider than other existing deep networks for hyperspectral image classification. Unlike current state-of-the-art approaches in CNN-based…

Computer Vision and Pattern Recognition · Computer Science 2017-10-11 Hyungtae Lee , Heesung Kwon

This paper proposes a method to modify traditional convolutional neural networks (CNNs) into interpretable CNNs, in order to clarify knowledge representations in high conv-layers of CNNs. In an interpretable CNN, each filter in a high…

Computer Vision and Pattern Recognition · Computer Science 2018-02-15 Quanshi Zhang , Ying Nian Wu , Song-Chun Zhu

It has long been considered a significant problem to improve the visual quality of lossy image and video compression. Recent advances in computing power together with the availability of large training data sets has increased interest in…

Multimedia · Computer Science 2017-03-30 Aaditya Prakash , Nick Moran , Solomon Garber , Antonella DiLillo , James Storer

Despite strong empirical performance for image classification, deep neural networks are often regarded as ``black boxes'' and they are difficult to interpret. On the other hand, sparse convolutional models, which assume that a signal can be…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Xili Dai , Mingyang Li , Pengyuan Zhai , Shengbang Tong , Xingjian Gao , Shao-Lun Huang , Zhihui Zhu , Chong You , Yi Ma

Identifying species of trees in aerial images is essential for land-use classification, plantation monitoring, and impact assessment of natural disasters. The manual identification of trees in aerial images is tedious, costly, and…

Computer Vision and Pattern Recognition · Computer Science 2020-08-31 Italos Estilon de Souza , Alexandre Xavier Falcão

Convolutional Neural Networks (CNNs) have recently been shown to excel at performing visual place recognition under changing appearance and viewpoint. Previously, place recognition has been improved by intelligently selecting relevant…

Robotics · Computer Science 2018-10-31 Stephen Hausler , Adam Jacobson , Michael Milford

Interpretability is an important property for visual models as it helps researchers and users understand the internal mechanism of a complex model. However, generating semantic explanations about the learned representation is challenging…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Yu Yang , Seungbae Kim , Jungseock Joo

The recent advances brought by deep learning allowed to improve the performance in image retrieval tasks. Through the many convolutional layers, available in a Convolutional Neural Network (CNN), it is possible to obtain a hierarchy of…

Computer Vision and Pattern Recognition · Computer Science 2018-08-16 Federico Magliani , Tomaso Fontanini , Andrea Prati

The purpose of feature extraction on convolutional neural networks is to reuse deep representations learnt for a pre-trained model to solve a new, potentially unrelated problem. However, raw feature extraction from all layers is unfeasible…

Neural and Evolutionary Computing · Computer Science 2019-11-11 Victor Gimenez-Abalos , Armand Vilalta , Dario Garcia-Gasulla , Jesus Labarta , Eduard Ayguadé