English
Related papers

Related papers: Structured Receptive Fields in CNNs

200 papers

Graph Convolutional Neural Networks (Graph CNNs) are generalizations of classical CNNs to handle graph data such as molecular data, point could and social networks. Current filters in graph CNNs are built for fixed and shared graph…

Machine Learning · Computer Science 2018-01-11 Ruoyu Li , Sheng Wang , Feiyun Zhu , Junzhou Huang

Convolutional Neural Networks (CNNs) have demonstrated exceptional performance in recent years. Compressing these models not only reduces storage requirements, making deployment to edge devices feasible, but also accelerates inference,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Boyao Wang , Volodymyr Kindratenko

Convolutional neural networks (CNNs) have become widely adopted in gravitational wave (GW) detection pipelines due to their ability to automatically learn hierarchical features from raw strain data. However, the physical meaning of these…

Machine Learning · Computer Science 2025-10-28 Jun Tian , He Wang , Jibo He , Yu Pan , Shuo Cao , Qingquan Jiang

In recent years, Deep Reinforcement Learning has made impressive advances in solving several important benchmark problems for sequential decision making. Many control applications use a generic multilayer perceptron (MLP) for non-vision…

Machine Learning · Computer Science 2020-03-13 Mario Srouji , Jian Zhang , Ruslan Salakhutdinov

We propose an efficient transfer learning method for adapting ImageNet pre-trained Convolutional Neural Network (CNN) to fine-grained image classification task. Conventional transfer learning methods typically face the trade-off between…

Computer Vision and Pattern Recognition · Computer Science 2019-06-13 Xiangxi Mo , Ruizhe Cheng , Tianyi Fang

Often the filters learned by Convolutional Neural Networks (CNNs) from different datasets appear similar. This is prominent in the first few layers. This similarity of filters is being exploited for the purposes of transfer learning and…

Computer Vision and Pattern Recognition · Computer Science 2017-05-03 Ragav Venkatesan , Vijetha Gattupalli , Baoxin Li

Convolutional neural networks have many hyperparameters such as the filter size, number of filters, and pooling size, which require manual tuning. Though deep stacked structures are able to create multi-scale and hierarchical…

Computer Vision and Pattern Recognition · Computer Science 2018-03-02 Ilker Cam , F. Boray Tek

Spatio-temporal receptive field (STRF) models are frequently used to approximate the computation implemented by a sensory neuron. Typically, such STRFs are assumed to be smooth and sparse. Current state-of-the-art approaches for estimating…

Machine Learning · Computer Science 2021-08-23 Ziwei Huang , Yanli Ran , Jonathan Oesterle , Thomas Euler , Philipp Berens

Deep learning is progressively gaining popularity as a viable alternative to i-vectors for speaker recognition. Promising results have been recently obtained with Convolutional Neural Networks (CNNs) when fed by raw speech samples directly.…

Audio and Speech Processing · Electrical Eng. & Systems 2019-08-12 Mirco Ravanelli , Yoshua Bengio

Recently, self-supervised learning has attracted attention due to its remarkable ability to acquire meaningful representations for classification tasks without using semantic labels. This paper introduces a self-supervised learning…

Computer Vision and Pattern Recognition · Computer Science 2022-02-09 Hyungtae Lee , Heesung Kwon

Graph neural networks (GNNs) are shown to be successful in modeling applications with graph structures. However, training an accurate GNN model requires a large collection of labeled data and expressive features, which might be inaccessible…

Machine Learning · Computer Science 2019-06-03 Ziniu Hu , Changjun Fan , Ting Chen , Kai-Wei Chang , Yizhou Sun

Convolutional neural networks (CNNs) have been widely used for hyperspectral image classification. As a common process, small cubes are firstly cropped from the hyperspectral image and then fed into CNNs to extract spectral and spatial…

Image and Video Processing · Electrical Eng. & Systems 2020-06-15 Renlong Hang , Zhu Li , Qingshan Liu , Pedram Ghamisi , Shuvra S. Bhattacharyya

Convolutional Neural Networks (CNNs) have recently led to incredible breakthroughs on a variety of pattern recognition problems. Banks of finite impulse response filters are learned on a hierarchy of layers, each contributing more abstract…

Computer Vision and Pattern Recognition · Computer Science 2017-07-18 Felipe Petroski Such , Shagan Sah , Miguel Dominguez , Suhas Pillai , Chao Zhang , Andrew Michael , Nathan Cahill , Raymond Ptucha

Imaging through scattering is an important, yet challenging problem. Tremendous progress has been made by exploiting the deterministic input-output "transmission matrix" for a fixed medium. However, this "one-to-one" mapping is highly…

Image and Video Processing · Electrical Eng. & Systems 2018-09-27 Yunzhe Li , Yujia Xue , Lei Tian

A central challenge in neuroscience is to understand neural computations and circuit mechanisms that underlie the encoding of ethologically relevant, natural stimuli. In multilayered neural circuits, nonlinear processes such as synaptic…

Neurons and Cognition · Quantitative Biology 2017-02-09 Lane T. McIntosh , Niru Maheswaranathan , Aran Nayebi , Surya Ganguli , Stephen A. Baccus

Training deep networks that generalize to a wide range of variations in test data is essential to building accurate and robust image classifiers. One standard strategy is to apply data augmentation to synthetically enlarge the training set.…

Computer Vision and Pattern Recognition · Computer Science 2020-06-29 Yunhan Zhao , Ye Tian , Charless Fowlkes , Wei Shen , Alan Yuille

It is crucial to learn the shared structures among functional predictors, as these structures characterize how predictor components exert common effects and, more generally, how predictors are homogeneously associated with the response.…

Methodology · Statistics 2026-04-27 Shuhao Jiao , Hernando Ombao , Ian W. McKeague

The convolutional neural networks (CNNs) have proven to be a powerful tool for discriminative learning. Recently researchers have also started to show interest in the generative aspects of CNNs in order to gain a deeper understanding of…

Computer Vision and Pattern Recognition · Computer Science 2015-04-10 Jifeng Dai , Yang Lu , Ying-Nian Wu

In recent years, representation learning approaches have disrupted many multimedia computing tasks. Among those approaches, deep convolutional neural networks (CNNs) have notably reached human level expertise on some constrained image…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Lucas Pascal , Xavier Bost , Benoît Huet

Convolution neural networks (CNNs) have succeeded in compressive image sensing. However, due to the inductive bias of locality and weight sharing, the convolution operations demonstrate the intrinsic limitations in modeling the long-range…

Image and Video Processing · Electrical Eng. & Systems 2022-01-03 Dongjie Ye , Zhangkai Ni , Hanli Wang , Jian Zhang , Shiqi Wang , Sam Kwong