English
Related papers

Related papers: Layer-wise Relevance Propagation for Neural Networ…

200 papers

Reparameterization aims to improve the generalization of deep neural networks by transforming convolutional layers into equivalent multi-branched structures during training. However, there exists a gap in understanding how…

Machine Learning · Computer Science 2023-03-08 Alexander Detkov , Mohammad Salameh , Muhammad Fetrat Qharabagh , Jialin Zhang , Wei Lui , Shangling Jui , Di Niu

In this paper, we introduce Channel-wise recurrent convolutional neural networks (RecNets), a family of novel, compact neural network architectures for computer vision tasks inspired by recurrent neural networks (RNNs). RecNets build upon…

Machine Learning · Computer Science 2020-03-23 George Retsinas , Athena Elafrou , Georgios Goumas , Petros Maragos

Recent results suggest that reinitializing a subset of the parameters of a neural network during training can improve generalization, particularly for small training sets. We study the impact of different reinitialization methods in several…

Machine Learning · Computer Science 2021-09-02 Ibrahim Alabdulmohsin , Hartmut Maennel , Daniel Keysers

Traditional image resizing methods usually work in pixel space and use various saliency measures. The challenge is to adjust the image shape while trying to preserve important content. In this paper we perform image resizing in feature…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Moab Arar , Dov Danon , Daniel Cohen-Or , Ariel Shamir

We propose a novel locally adaptive learning estimator for enhancing the inter- and intra- discriminative capabilities of Deep Neural Networks, which can be used as improved loss layer for semantic image segmentation tasks. Most loss layers…

Computer Vision and Pattern Recognition · Computer Science 2018-04-17 Jinjiang Guo , Pengyuan Ren , Aiguo Gu , Jian Xu , Weixin Wu

Image super-resolution (SR) techniques have been developing rapidly, benefiting from the invention of deep networks and its successive breakthroughs. However, it is acknowledged that deep learning and deep neural networks are difficult to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Jinjin Gu , Chao Dong

Supervised training of neural networks for classification is typically performed with a global loss function. The loss function provides a gradient for the output layer, and this gradient is back-propagated to hidden layers to dictate an…

Machine Learning · Statistics 2019-05-09 Arild Nøkland , Lars Hiller Eidnes

Neural networks have recently been established as a viable classification method for imaging mass spectrometry data for tumor typing. For multi-laboratory scenarios however, certain confounding factors may strongly impede their performance.…

It has been proposed by many researchers that combining deep neural networks with graphical models can create more efficient and better regularized composite models. The main difficulties in implementing this in practice are associated with…

Computer Vision and Pattern Recognition · Computer Science 2020-03-16 Patrick Knöbelreiter , Christian Sormann , Alexander Shekhovtsov , Friedrich Fraundorfer , Thomas Pock

In this paper, we propose a robust and efficient end-to-end non-local spatial propagation network for depth completion. The proposed network takes RGB and sparse depth images as inputs and estimates non-local neighbors and their affinities…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Jinsun Park , Kyungdon Joo , Zhe Hu , Chi-Kuei Liu , In So Kweon

Supervised training of a convolutional network for object classification should make explicit any information related to the class of objects and disregard any auxiliary information associated with the capture of the image or the variation…

Computer Vision and Pattern Recognition · Computer Science 2014-11-25 Ali Sharif Razavian , Hossein Azizpour , Atsuto Maki , Josephine Sullivan , Carl Henrik Ek , Stefan Carlsson

Convolutional Neural Networks (CNN) and the locally connected layer are limited in capturing the importance and relations of different local receptive fields, which are often crucial for tasks such as face verification, visual question…

Machine Learning · Computer Science 2017-11-23 Liang Pang , Yanyan Lan , Jun Xu , Jiafeng Guo , Xueqi Cheng

Local Hebbian learning is believed to be inferior in performance to end-to-end training using a backpropagation algorithm. We question this popular belief by designing a local algorithm that can learn convolutional filters at scale on large…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Leopold Grinberg , John Hopfield , Dmitry Krotov

Dense prediction tasks typically employ encoder-decoder architectures, but the prevalent convolutions in the decoder are not image-adaptive and can lead to boundary artifacts. Different generalized convolution operations have been…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Anne S. Wannenwetsch , Martin Kiefel , Peter V. Gehler , Stefan Roth

Purpose: We propose a novel method for continual learning based on the increasing depth of neural networks. This work explores whether extending neural network depth may be beneficial in a life-long learning setting. Methods: We propose a…

Machine Learning · Computer Science 2023-05-09 Jędrzej Kozal , Michał Woźniak

Face parsing is an important problem in computer vision that finds numerous applications including recognition and editing. Recently, deep convolutional neural networks (CNNs) have been applied to image parsing and segmentation with the…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Sifei Liu , Jianping Shi , Ji Liang , Ming-Hsuan Yang

We propose a new, more actionable view of neural network interpretability and data analysis by leveraging the remarkable matching effectiveness of representations derived from deep networks, guided by an approach for class-conditional…

Computation and Language · Computer Science 2021-06-15 Allen Schmaltz

Recent works have shown that exploiting unlabeled data through label propagation can substantially reduce the labeling cost, which has been a critical issue in developing visual recognition models. Yet, how to propagate labels reliably,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-20 Lei Yang , Qingqiu Huang , Huaiyi Huang , Linning Xu , Dahua Lin

The subject of deep learning has recently attracted users of machine learning from various disciplines, including: medical diagnosis and bioinformatics, financial market analysis and online advertisement, speech and handwriting recognition,…

Machine Learning · Computer Science 2018-03-12 Charles K. Chui , Shao-Bo Lin , Ding-Xuan Zhou

Despite achieving state-of-the-art performance, deep learning methods generally require a large amount of labeled data during training and may suffer from overfitting when the sample size is small. To ensure good generalizability of deep…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Xiaoxu Li , Liyun Yu , Xiaochen Yang , Zhanyu Ma , Jing-Hao Xue , Jie Cao , Jun Guo