English
Related papers

Related papers: Invariant Scattering Convolution Networks

200 papers

We introduce a sparse scattering deep convolutional neural network, which provides a simple model to analyze properties of deep representation learning for classification. Learning a single dictionary matrix with a classifier yields a…

Machine Learning · Computer Science 2020-02-21 John Zarka , Louis Thiry , Tomás Angles , Stéphane Mallat

This work attempts to interpret modern deep (convolutional) networks from the principles of rate reduction and (shift) invariant classification. We show that the basic iterative gradient ascent scheme for optimizing the rate reduction of…

Machine Learning · Computer Science 2020-10-30 Kwan Ho Ryan Chan , Yaodong Yu , Chong You , Haozhi Qi , John Wright , Yi Ma

Spatial and spectral approaches are two major approaches for image processing tasks such as image classification and object recognition. Among many such algorithms, convolutional neural networks (CNNs) have recently achieved significant…

Computer Vision and Pattern Recognition · Computer Science 2018-05-23 Shin Fujieda , Kohei Takayama , Toshiya Hachisuka

Feature representations, both hand-designed and learned ones, are often hard to analyze and interpret, even when they are extracted from visual data. We propose a new approach to study image representations by inverting them with an…

Neural and Evolutionary Computing · Computer Science 2016-04-28 Alexey Dosovitskiy , Thomas Brox

An important goal in visual recognition is to devise image representations that are invariant to particular transformations. In this paper, we address this goal with a new type of convolutional neural network (CNN) whose invariance is…

Computer Vision and Pattern Recognition · Computer Science 2015-01-08 Julien Mairal , Piotr Koniusz , Zaid Harchaoui , Cordelia Schmid

We present a method for learning discriminative filters using a shallow Convolutional Neural Network (CNN). We encode rotation invariance directly in the model by tying the weights of groups of filters to several rotated versions of the…

Computer Vision and Pattern Recognition · Computer Science 2017-05-03 Diego Marcos , Michele Volpi , Devis Tuia

The Euclidean scattering transform was introduced nearly a decade ago to improve the mathematical understanding of the success of convolutional neural networks (ConvNets) in image data analysis and other tasks. Inspired by recent interest…

Machine Learning · Statistics 2019-06-06 Michael Perlmutter , Guy Wolf , Matthew Hirn

The manifold scattering transform is a deep feature extractor for data defined on a Riemannian manifold. It is one of the first examples of extending convolutional neural network-like operators to general manifolds. The initial work on this…

In this paper, we apply the scattering transform (ST), a nonlinear map based off of a convolutional neural network (CNN), to classification of underwater objects using sonar signals. The ST formalizes the observation that the filters…

Computer Vision and Pattern Recognition · Computer Science 2017-09-05 Naoki Saito , David S. Weber

In this paper we propose a scalable version of a state-of-the-art deterministic time-invariant feature extraction approach based on consecutive changes of basis and nonlinearities, namely, the scattering network. The first focus of the…

Machine Learning · Statistics 2017-07-20 Randall Balestriero , Herve Glotin

We introduce a ScatterNet that uses a parametric log transformation with Dual-Tree complex wavelets to extract translation invariant representations from a multi-resolution image. The parametric transformation aids the OLS pruning algorithm…

Computer Vision and Pattern Recognition · Computer Science 2017-02-13 Amarjot Singh , Nick Kingsbury

Vision transformers have gained significant attention and achieved state-of-the-art performance in various computer vision tasks, including image classification, instance segmentation, and object detection. However, challenges remain in…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Badri N. Patro , Vijay Srinivas Agneeswaran

Convolutional neural networks (CNNs) constructed natively on the sphere have been developed recently and shown to be highly effective for the analysis of spherical data. While an efficient framework has been formulated, spherical CNNs are…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Jason D. McEwen , Christopher G. R. Wallis , Augustine N. Mavor-Parker

This work develops a flexible and mathematically sound framework for the design and analysis of graph scattering networks with variable branching ratios and generic functional calculus filters. Spectrally-agnostic stability guarantees for…

Machine Learning · Computer Science 2023-01-30 Christian Koke , Gitta Kutyniok

This paper provides an extensive study on the availability of image representations based on convolutional networks (ConvNets) for the task of visual instance retrieval. Besides the choice of convolutional layers, we present an efficient…

Computer Vision and Pattern Recognition · Computer Science 2016-05-10 Ali Sharif Razavian , Josephine Sullivan , Stefan Carlsson , Atsuto Maki

We present a sparse and invariant representation with low asymptotic complexity for robust unsupervised transient and onset zone detection in noisy environments. This unsupervised approach is based on wavelet transforms and leverages the…

Machine Learning · Statistics 2016-11-24 Randall Balestriero , Behnaam Aazhang

Dense pixelwise prediction such as semantic segmentation is an up-to-date challenge for deep convolutional neural networks (CNNs). Many state-of-the-art approaches either tackle the loss of high-resolution information due to pooling in the…

Computer Vision and Pattern Recognition · Computer Science 2018-08-07 Lingni Ma , Jörg Stückler , Tao Wu , Daniel Cremers

This paper examines the possibility of, and the possible advantages to learning the filters of convolutional neural networks (CNNs) for image analysis in the wavelet domain. We are stimulated by both Mallat's scattering transform and the…

Computer Vision and Pattern Recognition · Computer Science 2018-11-16 Fergal Cotter , Nick Kingsbury

Convolutional networks are large linear systems divided into layers and connected by non-linear units. These units are the "articulations" that allow the network to adapt to the input. To understand how a network manages to solve a problem…

Computer Vision and Pattern Recognition · Computer Science 2019-11-15 Pablo Navarrete Michelini , Hanwen Liu , Yunhua Lu , Xingqun Jiang

The aim of this paper is to discuss the use of Haar scattering networks, which is a very simple architecture that naturally supports a large number of stacked layers, yet with very few parameters, in a relatively broad set of pattern…

Signal Processing · Electrical Eng. & Systems 2018-11-30 Fernando Fernandes Neto , Alemayehu Admasu Solomon , Rodrigo de Losso , Claudio Garcia , Pedro Delano Cavalcanti