English
Related papers

Related papers: Gabor is Enough: Interpretable Deep Denoising with…

200 papers

Filters in a Convolutional Neural Network (CNN) contain model parameters learned from enormous amounts of data. In this paper, we suggest to decompose convolutional filters in CNN as a truncated expansion with pre-fixed bases, namely the…

Machine Learning · Statistics 2018-07-31 Qiang Qiu , Xiuyuan Cheng , Robert Calderbank , Guillermo Sapiro

Image denoising is of vital importance in many imaging or computer vision related areas. With the convolutional neural networks showing strong capability in computer vision tasks, the performance of image denoising has also been brought up…

Computer Vision and Pattern Recognition · Computer Science 2021-12-23 Zhuang Jia

Graph Neural Networks have recently become a prevailing paradigm for various high-impact graph analytical problems. Existing efforts can be mainly categorized as spectral-based and spatial-based methods. The major challenge for the former…

Machine Learning · Computer Science 2022-02-22 Yushun Dong , Kaize Ding , Brian Jalaian , Shuiwang Ji , Jundong Li

This paper proposes a new learning paradigm called filter grafting, which aims to improve the representation capability of Deep Neural Networks (DNNs). The motivation is that DNNs have unimportant (invalid) filters (e.g., l1 norm close to…

Computer Vision and Pattern Recognition · Computer Science 2020-02-27 Fanxu Meng , Hao Cheng , Ke Li , Zhixin Xu , Rongrong Ji , Xing Sun , Gaungming Lu

A fundamental problem in signal processing is to denoise a signal. While there are many well-performing methods for denoising signals defined on regular supports, such as images defined on two-dimensional grids of pixels, many important…

Signal Processing · Electrical Eng. & Systems 2023-02-20 Samuel Rey , Santiago Segarra , Reinhard Heckel , Antonio G. Marques

This paper proposes a learning-based denoising method called FlashLight CNN (FLCNN) that implements a deep neural network for image denoising. The proposed approach is based on deep residual networks and inception networks and it is able to…

Image and Video Processing · Electrical Eng. & Systems 2020-07-06 Pham Huu Thanh Binh , Cristóvão Cruz , Karen Egiazarian

Deep Neural Networks (DNN) and especially Convolutional Neural Networks (CNN) are a de-facto standard for the analysis of large volumes of signals and images. Yet, their development and underlying principles have been largely performed in…

Information Theory · Computer Science 2022-03-24 Ljubisa Stankovic , Danilo Mandic

Deep learning methods are achieving ever-increasing performance on many artificial intelligence tasks. A major limitation of deep models is that they are not amenable to interpretability. This limitation can be circumvented by developing…

Machine Learning · Computer Science 2022-07-05 Hao Yuan , Haiyang Yu , Shurui Gui , Shuiwang Ji

While Graph Neural Networks (GNNs) excel on graph-structured data, their performance is fundamentally limited by the quality of the observed graph, which often contains noise, missing links, or structural properties misaligned with GNNs'…

Machine Learning · Computer Science 2026-01-14 Hao Deng , Bo Liu

We show that the output of a (residual) convolutional neural network (CNN) with an appropriate prior over the weights and biases is a Gaussian process (GP) in the limit of infinitely many convolutional filters, extending similar results for…

Machine Learning · Statistics 2019-05-07 Adrià Garriga-Alonso , Carl Edward Rasmussen , Laurence Aitchison

Recovering an image from a noisy observation is a key problem in signal processing. Recently, it has been shown that data-driven approaches employing convolutional neural networks can outperform classical model-based techniques, because…

Image and Video Processing · Electrical Eng. & Systems 2019-05-30 Diego Valsesia , Giulia Fracastoro , Enrico Magli

Gabor functions have wide-spread applications in image processing and computer vision. In this paper, we prove that 2D Gabor functions are translation-invariant positive-definite kernels and propose a novel formulation for the problem of…

Computer Vision and Pattern Recognition · Computer Science 2017-12-11 Kamaledin Ghiasi-Shirazi

Nonlinear methods such as Deep Neural Networks (DNNs) are the gold standard for various challenging machine learning problems, e.g., image classification, natural language processing or human action recognition. Although these methods…

Machine Learning · Computer Science 2017-11-15 Grégoire Montavon , Sebastian Bach , Alexander Binder , Wojciech Samek , Klaus-Robert Müller

Fingerprint recognition systems stand as pillars in the realm of biometric authentication, providing indispensable security measures across various domains. This study investigates integrating Convolutional Neural Networks (CNNs) with Gabor…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Temirlan Meiramkhanov , Arailym Tleubayeva

This paper reviews recent studies in understanding neural-network representations and learning neural networks with interpretable/disentangled middle-layer representations. Although deep neural networks have exhibited superior performance…

Computer Vision and Pattern Recognition · Computer Science 2018-02-08 Quanshi Zhang , Song-Chun Zhu

Deep neural networks are representation learning techniques. During training, a deep net is capable of generating a descriptive language of unprecedented size and detail in machine learning. Extracting the descriptive language coded within…

Neural and Evolutionary Computing · Computer Science 2018-01-30 Dario Garcia-Gasulla , Ferran Parés , Armand Vilalta , Jonatan Moreno , Eduard Ayguadé , Jesús Labarta , Ulises Cortés , Toyotaro Suzumura

In this paper, we introduce deep learning technology to tackle two traditional low-level image processing problems, companding and inverse halftoning. We make two main contributions. First, to the best knowledge of the authors, this is the…

Computer Vision and Pattern Recognition · Computer Science 2017-07-24 Xianxu Hou , Guoping Qiu

Deep learning has consistently defied state-of-the-art techniques in many fields over the last decade. However, we are just beginning to understand the capabilities of neural learning in symbolic domains. Deep learning architectures that…

Machine Learning · Computer Science 2020-03-10 Henrique Lemos , Marcelo Prates , Pedro Avelar , Luis Lamb

Graph representation learning, aiming to learn low-dimensional representations which capture the geometric dependencies between nodes in the original graph, has gained increasing popularity in a variety of graph analysis tasks, including…

Machine Learning · Computer Science 2019-10-07 Lu Wang , Wenchao Yu , Wei Wang , Wei Cheng , Wei Zhang , Hongyuan Zha , Xiaofeng He , Haifeng Chen

Building large models with parameter sharing accounts for most of the success of deep convolutional neural networks (CNNs). In this paper, we propose doubly convolutional neural networks (DCNNs), which significantly improve the performance…

Machine Learning · Computer Science 2016-11-01 Shuangfei Zhai , Yu Cheng , Weining Lu , Zhongfei Zhang