English
Related papers

Related papers: The SVD of Convolutional Weights: A CNN Interpreta…

200 papers

In this paper, we tackle the problem of explanations in a deep-learning based model for recommendations by leveraging the technique of layer-wise relevance propagation. We use a Deep Convolutional Neural Network to extract relevant features…

Machine Learning · Computer Science 2018-07-18 Homanga Bharadhwaj

Recent studies have shown that a Deep Convolutional Neural Network (DCNN) pretrained on a large image dataset can be used as a universal image descriptor, and that doing so leads to impressive performance for a variety of image…

Computer Vision and Pattern Recognition · Computer Science 2016-12-23 Lingqiao Liu , Chunhua Shen , Anton van den Hengel

The Recurrent Neural Networks and their variants have shown promising performances in sequence modeling tasks such as Natural Language Processing. These models, however, turn out to be impractical and difficult to train when exposed to very…

Computer Vision and Pattern Recognition · Computer Science 2017-07-07 Yinchong Yang , Denis Krompass , Volker Tresp

We present a novel method of compression of deep Convolutional Neural Networks (CNNs) by weight sharing through a new representation of convolutional filters. The proposed method reduces the number of parameters of each convolutional layer…

Machine Learning · Computer Science 2020-04-13 Yingzhen Yang , Jiahui Yu , Nebojsa Jojic , Jun Huan , Thomas S. Huang

Semantic Segmentation using deep convolutional neural network pose more complex challenge for any GPU intensive task. As it has to compute million of parameters, it results to huge memory consumption. Moreover, extracting finer features and…

Computer Vision and Pattern Recognition · Computer Science 2020-05-19 Sharif Amit Kamran , Ali Shihab Sabbir

Compressing convolutional neural networks (CNNs) is essential for transferring the success of CNNs to a wide variety of applications to mobile devices. In contrast to directly recognizing subtle weights or filters as redundant in a given…

Machine Learning · Statistics 2017-07-26 Yunhe Wang , Chang Xu , Jiayan Qiu , Chao Xu , Dacheng Tao

Deep learning based on deep neural networks has been very successful in many practical applications, but it lacks enough theoretical understanding due to the network architectures and structures. In this paper we establish some analysis for…

Machine Learning · Computer Science 2024-01-03 Jianfei Li , Han Feng , Ding-Xuan Zhou

To tackle interpretability in deep learning, we present a novel framework to jointly learn a predictive model and its associated interpretation model. The interpreter provides both local and global interpretability about the predictive…

Machine Learning · Computer Science 2022-02-24 Jayneel Parekh , Pavlo Mozharovskyi , Florence d'Alché-Buc

We present a `CLAssifier-DECoder' architecture (\emph{ClaDec}) which facilitates the comprehension of the output of an arbitrary layer in a neural network (NN). It uses a decoder to transform the non-interpretable representation of the…

Machine Learning · Computer Science 2021-03-01 Johannes Schneider , Michalis Vlachos

Deep learning models develop successive representations of their input in sequential layers, the last of which maps the final representation to the output. Here we investigate the informational content of these representations by observing…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Benjamin L. Badger

Convolutional neural networks have shown successful results in image classification achieving real-time results superior to the human level. However, texture images still pose some challenge to these models due, for example, to the limited…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Lucas O. Lyra , Antonio Elias Fabris , Joao B. Florindo

Convolutional neural networks excel in image recognition tasks, but this comes at the cost of high computational and memory complexity. To tackle this problem, [1] developed a tensor factorization framework to compress fully-connected…

Machine Learning · Computer Science 2016-11-11 Timur Garipov , Dmitry Podoprikhin , Alexander Novikov , Dmitry Vetrov

Convolutional Neural Networks (CNNs) are powerful models that achieve impressive results for image classification. In addition, pre-trained CNNs are also useful for other computer vision tasks as generic feature extractors. This paper aims…

Computer Vision and Pattern Recognition · Computer Science 2015-07-10 Ben Athiwaratkun , Keegan Kang

Deep convolutional neural networks provide a powerful feature learning capability for image classification. The deep image features can be utilized to deal with many image understanding tasks like image classification and object…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 Shaoning Zeng , Bob Zhang , Yanghao Zhang , Jianping Gou

Existing techniques to encode spatial invariance within deep convolutional neural networks (CNNs) apply the same warping field to all the feature channels. This does not account for the fact that the individual feature channels can…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Seungryong Kim , Sabine Süsstrunk , Mathieu Salzmann

Deep Convolutional Neural Networks (CNNs) have been one of the most influential recent developments in computer vision, particularly for categorization. There is an increasing demand for explainable AI as these systems are deployed in the…

Computer Vision and Pattern Recognition · Computer Science 2018-11-21 Tian Xu , Jiayu Zhan , Oliver G. B. Garrod , Philip H. S. Torr , Song-Chun Zhu , Robin A. A. Ince , Philippe G. Schyns

In recent years, deep learning-based models have significantly improved the Natural Language Processing (NLP) tasks. Specifically, the Convolutional Neural Network (CNN), initially used for computer vision, has shown remarkable performance…

Computation and Language · Computer Science 2022-03-11 Sanskar Soni , Satyendra Singh Chouhan , Santosh Singh Rathore

We propose a novel perspective to understand deep neural networks in an interpretable disentanglement form. For each semantic class, we extract a class-specific functional subnetwork from the original full model, with compressed structure…

Machine Learning · Computer Science 2019-10-08 Yulong Wang , Xiaolin Hu , Hang Su

Since the study of deep convolutional neural network became prevalent, one of the important discoveries is that a feature map from a convolutional network can be extracted before going into the fully connected layer and can be used as a…

Computer Vision and Pattern Recognition · Computer Science 2017-10-24 Jonghwa Yim , Kyung-Ah Sohn

Convolutional Neural Networks (CNNs) have recently achieved remarkably strong performance on the practically important task of sentence classification (kim 2014, kalchbrenner 2014, johnson 2014). However, these models require practitioners…

Computation and Language · Computer Science 2016-04-08 Ye Zhang , Byron Wallace