English
Related papers

Related papers: Pooling Revisited: Your Receptive Field is Subopti…

200 papers

Graph pooling is an essential ingredient of Graph Neural Networks (GNNs) in graph classification and regression tasks. For these tasks, different pooling strategies have been proposed to generate a graph-level representation by downsampling…

Machine Learning · Computer Science 2021-04-28 Kashob Kumar Roy , Amit Roy , A K M Mahbubur Rahman , M Ashraful Amin , Amin Ahsan Ali

Deep convolutional neural networks, assisted by architectural design strategies, make extensive use of data augmentation techniques and layers with a high number of feature maps to embed object transformations. That is highly inefficient…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Vittorio Mazzia , Francesco Salvetti , Marcello Chiaberge

Deep learning stands as the modern paradigm for solving cognitive tasks. However, as the problem complexity increases, models grow deeper and computationally prohibitive, hindering advancements in real-world and resource-constrained…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Gustavo Henrique do Nascimento , Ian Pons , Anna Helena Reali Costa , Artur Jordao

With the use of deep learning in many areas, how to improve this technology or how to develop the structure used more effectively and in a shorter time is an issue that is of interest to many people working in this field. Many studies are…

Computer Vision and Pattern Recognition · Computer Science 2021-01-05 Yunus Camgözlü , Yakup Kutlu

This paper addresses the problem of very large-scale image retrieval, focusing on improving its accuracy and robustness. We target enhanced robustness of search to factors such as variations in illumination, object appearance and scale,…

Computer Vision and Pattern Recognition · Computer Science 2019-06-18 Syed Sameed Husain , Miroslaw Bober

Artificial intelligence (AI) is envisioned to play a key role in future wireless technologies, with deep neural networks (DNNs) enabling digital receivers to learn to operate in challenging communication scenarios. However, wireless…

Information Theory · Computer Science 2023-05-15 Tomer Raviv , Sangwoo Park , Osvaldo Simeone , Yonina C. Eldar , Nir Shlezinger

Graph pooling methods have been widely used on downsampling graphs, achieving impressive results on multiple graph-level tasks like graph classification and graph generation. An important line called node dropping pooling aims at exploiting…

Artificial Intelligence · Computer Science 2023-11-01 Gaichao Li , Jinsong Chen , John E. Hopcroft , Kun He

Graph neural networks (GNNs) are one of the most popular approaches to using deep learning on graph-structured data, and they have shown state-of-the-art performances on a variety of tasks. However, according to a recent study, a careful…

Machine Learning · Computer Science 2021-10-08 Jihoon Ko , Taehyung Kwon , Kijung Shin , Juho Lee

The superior performance of Deformable Convolutional Networks arises from its ability to adapt to the geometric variations of objects. Through an examination of its adaptive behavior, we observe that while the spatial support for its neural…

Computer Vision and Pattern Recognition · Computer Science 2018-11-29 Xizhou Zhu , Han Hu , Stephen Lin , Jifeng Dai

We introduce a flexible setup allowing for a neural network to learn both its size and topology during the course of a standard gradient-based training. The resulting network has the structure of a graph tailored to the particular learning…

Machine Learning · Computer Science 2020-07-16 Romuald A. Janik , Aleksandra Nowak

Deep convolutional neural networks (CNNs) have demonstrated impressive performance on many visual tasks. Recently, they became useful models for the visual system in neuroscience. However, it is still not clear what are learned by CNNs in…

Neurons and Cognition · Quantitative Biology 2020-02-19 Qi Yan , Yajing Zheng , Shanshan Jia , Yichen Zhang , Zhaofei Yu , Feng Chen , Yonghong Tian , Tiejun Huang , Jian K. Liu

Deep convolutional networks have attracted great attention in image restoration and enhancement. Generally, restoration quality has been improved by building more and more convolutional block. However, these methods mostly learn a specific…

Computer Vision and Pattern Recognition · Computer Science 2021-05-21 Yukai Shi , Jinghui Qin

The tradeoff between receptive field size and efficiency is a crucial issue in low level vision. Plain convolutional networks (CNNs) generally enlarge the receptive field at the expense of computational cost. Recently, dilated filtering has…

Computer Vision and Pattern Recognition · Computer Science 2018-05-23 Pengju Liu , Hongzhi Zhang , Kai Zhang , Liang Lin , Wangmeng Zuo

Resampling is a key component of sample-based recursive state estimation in particle filters. Recent work explores differentiable particle filters for end-to-end learning. However, resampling remains a challenge in these works, as it is…

Machine Learning · Computer Science 2020-04-28 Michael Zhu , Kevin Murphy , Rico Jonschkowski

Max-Pooling operations are a core component of deep learning architectures. In particular, they are part of most convolutional architectures used in machine vision, since pooling is a natural approach to pattern detection problems. However,…

Machine Learning · Computer Science 2021-03-05 Alon Brutzkus , Amir Globerson

Convolutional neural networks (CNNs) have achieved remarkable success in image recognition. Although the internal patterns of the input images are effectively learned by the CNNs, these patterns only constitute a small proportion of useful…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Zhengsu Chen , Jianwei Niu , Xuefeng Liu , Shaojie Tang

The effective receptive field of a fully convolutional neural network is an important consideration when designing an architecture, as it defines the portion of the input visible to each convolutional kernel. We propose a neural network…

Computer Vision and Pattern Recognition · Computer Science 2022-11-07 Joshua Bruton , Hairong Wang

In recent literature there are plenty of works that combine handcrafted and learnable regularizers to solve inverse imaging problems. While this hybrid approach has demonstrated promising results, the motivation for combining handcrafted…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Alexandros Gkillas , Dimitris Ampeliotis , Kostas Berberidis

In standard Convolutional Neural Networks (CNNs), the receptive fields of artificial neurons in each layer are designed to share the same size. It is well-known in the neuroscience community that the receptive field size of visual cortical…

Computer Vision and Pattern Recognition · Computer Science 2019-03-19 Xiang Li , Wenhai Wang , Xiaolin Hu , Jian Yang

Depth data provide geometric information that can bring progress in RGB-D scene parsing tasks. Several recent works propose RGB-D convolution operators that construct receptive fields along the depth-axis to handle 3D neighborhood relations…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Yajie Xing , Jingbo Wang , Gang Zeng