English
Related papers

Related papers: Beyond Skip Connections: Top-Down Modulation for O…

200 papers

Convolutional networks have been the paradigm of choice in many computer vision applications. The convolution operation however has a significant weakness in that it only operates on a local neighborhood, thus missing global information.…

Computer Vision and Pattern Recognition · Computer Science 2020-09-11 Irwan Bello , Barret Zoph , Ashish Vaswani , Jonathon Shlens , Quoc V. Le

This paper introduces a novel network topology that seamlessly integrates dynamic inference cost with a top-down attention mechanism, addressing two significant gaps in traditional deep learning models. Drawing inspiration from human…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 André Peter Kelm , Niels Hannemann , Bruno Heberle , Lucas Schmidt , Tim Rolff , Christian Wilms , Ehsan Yaghoubi , Simone Frintrop

Skip connections in deep networks have improved both segmentation and classification performance by facilitating the training of deeper network architectures, and reducing the risks for vanishing gradients. They equip encoder-decoder-like…

Computer Vision and Pattern Recognition · Computer Science 2018-05-04 Saeid Asgari Taghanaki , Aicha Bentaieb , Anmol Sharma , S. Kevin Zhou , Yefeng Zheng , Bogdan Georgescu , Puneet Sharma , Sasa Grbic , Zhoubing Xu , Dorin Comaniciu , Ghassan Hamarneh

Skip connections are fundamental units in encoder-decoder networks, which are able to improve the feature propagtion of the neural networks. However, most methods with skip connections just connected features with the same resolution in the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-30 Zhitong Lai , Haichao Sun , Rui Tian , Nannan Ding , Zhiguo Wu , Yanjie Wang

Brain-inspired machine learning is gaining increasing consideration, particularly in computer vision. Several studies investigated the inclusion of top-down feedback connections in convolutional networks; however, it remains unclear how and…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 Andrea Alamia , Milad Mozafari , Bhavin Choksi , Rufin VanRullen

Underwater images typically experience mixed degradations of brightness and structure caused by the absorption and scattering of light by suspended particles. To address this issue, we propose a Real-time Spatial and Frequency Domains…

Computer Vision and Pattern Recognition · Computer Science 2023-02-24 Jingxia Jiang , Jinbin Bai , Yun Liu , Junjie Yin , Sixiang Chen , Tian Ye , Erkang Chen

Camouflaged object detection (COD) aims to detect/segment camouflaged objects embedded in the environment, which has attracted increasing attention over the past decades. Although several COD methods have been developed, they still suffer…

Computer Vision and Pattern Recognition · Computer Science 2022-12-05 Tao Zhou , Yi Zhou , Chen Gong , Jian Yang , Yu Zhang

Biological systems leverage top-down feedback for visual processing, yet most artificial vision models succeed in image classification using purely feedforward or recurrent architectures, calling into question the functional significance of…

Neurons and Cognition · Quantitative Biology 2025-08-12 Antonino Greco , Marco D'Alessandro , Karl J. Friston , Giovanni Pezzulo , Markus Siegel

Small object detection presents a significant challenge in computer vision and object detection. The performance of small object detectors is often compromised by a lack of pixels and less significant features. This issue stems from…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Xiaohui Guo

Deep robot vision models are widely used for recognizing objects from camera images, but shows poor performance when detecting objects at untrained positions. Although such problem can be alleviated by training with large datasets, the…

Robotics · Computer Science 2022-10-26 Hyogo Hiruma , Hiroki Mori , Hiroshi Ito , Tetsuya Ogata

Most 3D instance segmentation methods exploit a bottom-up strategy, typically including resource-exhaustive post-processing. For point grouping, bottom-up methods rely on prior assumptions about the objects in the form of hyperparameters,…

Computer Vision and Pattern Recognition · Computer Science 2023-09-13 Maksim Kolodiazhnyi , Anna Vorontsova , Anton Konushin , Danila Rukhovich

In this paper, we propose a zoom-out-and-in network for generating object proposals. We utilize different resolutions of feature maps in the network to detect object instances of various sizes. Specifically, we divide the anchor candidates…

Computer Vision and Pattern Recognition · Computer Science 2017-02-21 Hongyang Li , Yu Liu , Wanli Ouyang , Xiaogang Wang

Topological deep learning (TDL) is a rapidly growing field that seeks to leverage topological structure in data and facilitate learning from data supported on topological objects, ranging from molecules to 3D shapes. Most TDL architectures…

Machine Learning · Computer Science 2025-02-13 Yam Eitan , Yoav Gelberg , Guy Bar-Shalom , Fabrizio Frasca , Michael Bronstein , Haggai Maron

Monocular Depth Estimation (MDE) aims to predict pixel-wise depth given a single RGB image. For both, the convolutional as well as the recent attention-based models, encoder-decoder-based architectures have been found to be useful due to…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Ashutosh Agarwal , Chetan Arora

Vision transformers are known to be more computationally and data-intensive than CNN models. These transformer models such as ViT, require all the input image tokens to learn the relationship among them. However, many of these tokens are…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Foozhan Ataiefard , Walid Ahmed , Habib Hajimolahoseini , Saina Asani , Farnoosh Javadi , Mohammad Hassanpour , Omar Mohamed Awad , Austin Wen , Kangling Liu , Yang Liu

3D object detection is essential in autonomous driving, providing vital information about moving objects and obstacles. Detecting objects in distant regions with only a few LiDAR points is still a challenge, and numerous strategies have…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Qinghao Meng , Chenming Wu , Liangjun Zhang , Jianbing Shen

Unsupervised salient object detection aims to detect salient objects without using supervision signals eliminating the tedious task of manually labeling salient objects. To improve training efficiency, end-to-end methods for USOD have been…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Yicheng Song , Shuyong Gao , Haozhe Xing , Yiting Cheng , Yan Wang , Wenqiang Zhang

Person Re-Identification is a challenging task that aims to retrieve all instances of a query image across a system of non-overlapping cameras. Due to the various extreme changes of view, it is common that local regions that could be used…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Rodolfo Quispe , Helio Pedrini

Top-down visual attention mechanisms have been used extensively in image captioning and visual question answering (VQA) to enable deeper image understanding through fine-grained analysis and even multiple steps of reasoning. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2018-03-15 Peter Anderson , Xiaodong He , Chris Buehler , Damien Teney , Mark Johnson , Stephen Gould , Lei Zhang

Audio-visual speech separation has gained significant traction in recent years due to its potential applications in various fields such as speech recognition, diarization, scene analysis and assistive technologies. Designing a lightweight…

Sound · Computer Science 2024-01-26 Samuel Pegg , Kai Li , Xiaolin Hu