English
Related papers

Related papers: Scaling the Scattering Transform: Deep Hybrid Netw…

200 papers

In this work, we build a generic architecture of Convolutional Neural Networks to discover empirical properties of neural networks. Our first contribution is to introduce a state-of-the-art framework that depends upon few hyper parameters…

Computer Vision and Pattern Recognition · Computer Science 2017-03-07 Edouard Oyallon

A well-trained deep neural network is shown to gain capability of simultaneously restoring two kinds of images, which are completely destroyed by two distinct scattering medias respectively. The network, based on the U-net architecture, can…

Image and Video Processing · Electrical Eng. & Systems 2019-02-21 Mu Yang , Zheng-Hao Liu , Ze-Di Cheng , Jin-Shi Xu , Chuan-Feng Li , Guang-Can Guo

The aim of this paper is to discuss the use of Haar scattering networks, which is a very simple architecture that naturally supports a large number of stacked layers, yet with very few parameters, in a relatively broad set of pattern…

Signal Processing · Electrical Eng. & Systems 2018-11-30 Fernando Fernandes Neto , Alemayehu Admasu Solomon , Rodrigo de Losso , Claudio Garcia , Pedro Delano Cavalcanti

While deeper convolutional networks are needed to achieve maximum accuracy in visual perception tasks, for many inputs shallower networks are sufficient. We exploit this observation by learning to skip convolutional layers on a per-input…

Computer Vision and Pattern Recognition · Computer Science 2018-07-26 Xin Wang , Fisher Yu , Zi-Yi Dou , Trevor Darrell , Joseph E. Gonzalez

Buildings' segmentation is a fundamental task in the field of earth observation and aerial imagery analysis. Most existing deep learning-based methods in the literature can be applied to a fixed or narrow-range spatial resolution imagery.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Hasan Nasrallah , Mustafa Shukor , Ali J. Ghandour

We present a novel high frequency residual learning framework, which leads to a highly efficient multi-scale network (MSNet) architecture for mobile and embedded vision problems. The architecture utilizes two networks: a low resolution…

Computer Vision and Pattern Recognition · Computer Science 2019-05-08 Bowen Cheng , Rong Xiao , Jianfeng Wang , Thomas Huang , Lei Zhang

Neural networks have been widely used, and most networks achieve excellent performance by stacking certain types of basic units. Compared to increasing the depth and width of the network, designing more effective basic units has become an…

Machine Learning · Computer Science 2020-06-05 Junyi An , Fengshan Liu , Jian Zhao , Furao Shen

Convolutional Neural Networks (CNN) increase depth by stacking convolutional layers, and deeper network models perform better in image recognition. Empirical research shows that simply stacking convolutional layers does not make the network…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Rui-Yang Ju , Jen-Shiun Chiang , Chih-Chia Chen , Yu-Shian Lin

Conventional scaling of neural networks typically involves designing a base network and growing different dimensions like width, depth, etc. of the same by some predefined scaling factors. We introduce an automated scaling approach…

Machine Learning · Computer Science 2024-02-21 Akash Guna R. T , Arnav Chavan , Deepak Gupta

Deeper neural networks are more difficult to train. We present a residual learning framework to ease the training of networks that are substantially deeper than those used previously. We explicitly reformulate the layers as learning…

Computer Vision and Pattern Recognition · Computer Science 2015-12-11 Kaiming He , Xiangyu Zhang , Shaoqing Ren , Jian Sun

PCANet and its variants provided good accuracy results for classification tasks. However, despite the importance of network depth in achieving good classification accuracy, these networks were trained with a maximum of nine layers. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-01-30 Mubarakah Alotaibi , Richard Wilson

We propose a DTCWT ScatterNet Convolutional Neural Network (DTSCNN) formed by replacing the first few layers of a CNN network with a parametric log based DTCWT ScatterNet. The ScatterNet extracts edge based invariant representations that…

Machine Learning · Computer Science 2017-08-31 Amarjot Singh , Nick Kingsbury

Scattering network is a convolutional network, consisting of cascading convolutions using pre-defined wavelets followed by the modulus operator. Since its introduction in 2012, the scattering network is used as one of few mathematical tools…

Numerical Analysis · Mathematics 2022-08-11 Taekyung Ki , Youngmi Hur

Transfer learning with pre-trained neural networks is a common strategy for training classifiers in medical image analysis. Without proper channel selections, this often results in unnecessarily large models that hinder deployment and…

Computer Vision and Pattern Recognition · Computer Science 2021-03-24 Ken C. L. Wong , Satyananda Kashyap , Mehdi Moradi

Surface defect detection is an extremely crucial step to ensure the quality of industrial products. Nowadays, convolutional neural networks (CNNs) based on encoder-decoder architecture have achieved tremendous success in various defect…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Junpu Wang , Guili Xu , Fuju Yan , Jinjin Wang , Zhengsheng Wang

Wavelet scattering networks, which are convolutional neural networks (CNNs) with fixed filters and weights, are promising tools for image analysis. Imposing symmetry on image statistics can improve human interpretability, aid in…

Computer Vision and Pattern Recognition · Computer Science 2021-04-26 Andrew K. Saydjari , Douglas P. Finkbeiner

In this paper, we introduce a new model for leveraging unlabeled data to improve generalization performances of image classifiers: a two-branch encoder-decoder architecture called HybridNet. The first branch receives supervision signal and…

Machine Learning · Computer Science 2018-07-31 Thomas Robert , Nicolas Thome , Matthieu Cord

Deep convolutional networks (CNNs) have exhibited their potential in image inpainting for producing plausible results. However, in most existing methods, e.g., context encoder, the missing parts are predicted by propagating the surrounding…

Computer Vision and Pattern Recognition · Computer Science 2018-04-16 Zhaoyi Yan , Xiaoming Li , Mu Li , Wangmeng Zuo , Shiguang Shan

The scattering transform is a multilayered wavelet-based deep learning architecture that acts as a model of convolutional neural networks. Recently, several works have introduced generalizations of the scattering transform for non-Euclidean…

Machine Learning · Statistics 2023-06-30 Michael Perlmutter , Alexander Tong , Feng Gao , Guy Wolf , Matthew Hirn

It is widely believed that the success of deep convolutional networks is based on progressively discarding uninformative variability about the input with respect to the problem at hand. This is supported empirically by the difficulty of…

Machine Learning · Computer Science 2018-06-25 Jörn-Henrik Jacobsen , Arnold Smeulders , Edouard Oyallon