English
Related papers

Related papers: Generic Deep Networks with Wavelet Scattering

200 papers

We propose a novel semantic segmentation algorithm by learning a deconvolution network. We learn the network on top of the convolutional layers adopted from VGG 16-layer net. The deconvolution network is composed of deconvolution and…

Computer Vision and Pattern Recognition · Computer Science 2015-05-19 Hyeonwoo Noh , Seunghoon Hong , Bohyung Han

The empirical success of deep learning is often attributed to deep networks' ability to exploit hierarchical structure in data, constructing increasingly complex features across layers. Yet despite substantial progress in deep learning…

Machine Learning · Computer Science 2026-01-28 Yunwei Ren , Yatin Dandi , Florent Krzakala , Jason D. Lee

An orthogonal Haar scattering transform is a deep network, computed with a hierarchy of additions, subtractions and absolute values, over pairs of coefficients. It provides a simple mathematical model for unsupervised deep network learning.…

Machine Learning · Computer Science 2015-10-01 Xiuyuan Cheng , Xu Chen , Stephane Mallat

Normalizing flows are a class of probabilistic generative models which allow for both fast density computation and efficient sampling and are effective at modelling complex distributions like images. A drawback among current methods is…

Computer Vision and Pattern Recognition · Computer Science 2020-10-28 Jason J. Yu , Konstantinos G. Derpanis , Marcus A. Brubaker

The success of convolutional networks in learning problems involving planar signals such as images is due to their ability to exploit the translation symmetry of the data distribution through weight sharing. Many areas of science and…

Machine Learning · Computer Science 2019-04-23 Taco Cohen , Mario Geiger , Jonas Köhler , Max Welling

During the last years, Convolutional Neural Networks (CNNs) have achieved state-of-the-art performance in image classification. Their architectures have largely drawn inspiration by models of the primate visual system. However, while recent…

Computer Vision and Pattern Recognition · Computer Science 2017-08-24 Georgios Zoumpourlis , Alexandros Doumanoglou , Nicholas Vretos , Petros Daras

In this paper, we propose a set of transform-based neural network layers as an alternative to the $3\times3$ Conv2D layers in Convolutional Neural Networks (CNNs). The proposed layers can be implemented based on orthogonal transforms such…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Hongyi Pan , Emadeldeen Hamdan , Xin Zhu , Salih Atici , Ahmet Enis Cetin

Deep convolutional neural networks accuracy is heavily impacted by rotations of the input data. In this paper, we propose a convolutional predictor that is invariant to rotations in the input. This architecture is capable of predicting the…

Computer Vision and Pattern Recognition · Computer Science 2021-05-24 Rosemberg Rodriguez Salas , Eva Dokladalova , Petr Dokládal

Although deep learning has shown its powerful performance in many applications, the mathematical principles behind neural networks are still mysterious. In this paper, we consider the problem of learning a one-hidden-layer neural network…

Machine Learning · Computer Science 2019-07-17 Shuhao Xia , Yuanming Shi

It is widely believed that the success of deep convolutional networks is based on progressively discarding uninformative variability about the input with respect to the problem at hand. This is supported empirically by the difficulty of…

Machine Learning · Computer Science 2018-06-25 Jörn-Henrik Jacobsen , Arnold Smeulders , Edouard Oyallon

Object detection is a challenging task in visual understanding domain, and even more so if the supervision is to be weak. Recently, few efforts to handle the task without expensive human annotations is established by promising deep neural…

Computer Vision and Pattern Recognition · Computer Science 2016-11-28 Ali Diba , Vivek Sharma , Ali Pazandeh , Hamed Pirsiavash , Luc Van Gool

Imaging through scattering media is a challenging problem owing to speckle decorrelations from perturbations in the media itself. For in-line imaging modalities, which are appealing because they are compact, require no moving parts, and are…

Optics · Physics 2022-05-16 Siddharth Rawat , Jonathan Wendoloski , Anna Wang

We propose two graph neural network layers for graphs with features in a Riemannian manifold. First, based on a manifold-valued graph diffusion equation, we construct a diffusion layer that can be applied to an arbitrary number of nodes and…

Machine Learning · Computer Science 2025-02-26 Martin Hanik , Gabriele Steidl , Christoph von Tycowicz

We adopt convolutional neural networks (CNN) to predict the basic properties of the porous media. Two different media types are considered: one mimics the sand packings, and the other mimics the systems derived from the extracellular space…

Computational Physics · Physics 2023-06-21 Krzysztof M. Graczyk , Dawid Strzelczyk , Maciej Matyka

Recent work has shown that convolutional networks can be substantially deeper, more accurate, and efficient to train if they contain shorter connections between layers close to the input and those close to the output. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2018-01-30 Gao Huang , Zhuang Liu , Laurens van der Maaten , Kilian Q. Weinberger

Deep learning has received considerable empirical successes in recent years. However, while many ad hoc tricks have been discovered by practitioners, until recently, there has been a lack of theoretical understanding for tricks invented in…

Machine Learning · Computer Science 2020-12-29 Cong Fang , Hanze Dong , Tong Zhang

Data with low-dimensional nonlinear structure are ubiquitous in engineering and scientific problems. We study a model problem with such structure -- a binary classification task that uses a deep fully-connected neural network to classify…

Machine Learning · Statistics 2021-11-01 Tingran Wang , Sam Buchanan , Dar Gilboa , John Wright

In this work we propose a method for learning wavelet filters directly from data. We accomplish this by framing the discrete wavelet transform as a modified convolutional neural network. We introduce an autoencoder wavelet transform network…

Machine Learning · Computer Science 2018-02-09 Daniel Recoskie , Richard Mann

Until quite recently, the backbone of nearly every state-of-the-art computer vision model has been the 2D convolution. At its core, a 2D convolution simultaneously mixes information across both the spatial and channel dimensions of a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 George Cazenavette , Joel Julin , Simon Lucey

Recognizing apparel attributes has recently drawn great interest in the computer vision community. Methods based on various deep neural networks have been proposed for image classification, which could be applied to apparel attributes…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Tianqi Han , Zhihui Fu , Hongyu Li