English
Related papers

Related papers: RFAConv: Receptive-Field Attention Convolution for…

200 papers

The superior performance of Deformable Convolutional Networks arises from its ability to adapt to the geometric variations of objects. Through an examination of its adaptive behavior, we observe that while the spatial support for its neural…

Computer Vision and Pattern Recognition · Computer Science 2018-11-29 Xizhou Zhu , Han Hu , Stephen Lin , Jifeng Dai

Recently, deep neural networks have demonstrated comparable and even better performance with board-certified ophthalmologists in well-annotated datasets. However, the diversity of retinal imaging devices poses a significant challenge:…

Image and Video Processing · Electrical Eng. & Systems 2019-10-18 Peng Liu , Bin Kong , Zhongyu Li , Shaoting Zhang , Ruogu Fang

Large kernel convolutions offer a scalable alternative to vision transformers for high-resolution 3D volumetric analysis, yet naively increasing kernel size often leads to optimization instability. Motivated by the spatial bias inherent in…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Ho Hin Lee , Quan Liu , Shunxing Bao , Yuankai Huo , Bennett A. Landman

Deep learning methods are powerful tools but often suffer from expensive computation and limited flexibility. An alternative is to combine light-weight models with deep representations. As successful cases exist in several visual problems,…

Computer Vision and Pattern Recognition · Computer Science 2015-09-25 Bin Yang , Junjie Yan , Zhen Lei , Stan Z. Li

For person re-identification (re-id), attention mechanisms have become attractive as they aim at strengthening discriminative features and suppressing irrelevant ones, which matches well the key of re-id, i.e., discriminative feature…

Computer Vision and Pattern Recognition · Computer Science 2020-03-30 Zhizheng Zhang , Cuiling Lan , Wenjun Zeng , Xin Jin , Zhibo Chen

Large-scale point cloud consists of a multitude of individual objects, thereby encompassing rich structural and underlying semantic contextual information, resulting in a challenging problem in efficiently segmenting a point cloud. Most…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Zhenchao Lin , Li He , Hongqiang Yang , Xiaoqun Sun , Cuojin Zhang , Weinan Chen , Yisheng Guan , Hong Zhang

3D convolutional neural networks have achieved promising results for video tasks in computer vision, including video saliency prediction that is explored in this paper. However, 3D convolution encodes visual representation merely on fixed…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Ziqiang Wang , Zhi Liu , Gongyang Li , Yang Wang , Tianhong Zhang , Lihua Xu , Jijun Wang

Random feature attention (RFA) adopts random fourier feature (RFF) methods to approximate the softmax function, resulting in a linear time and space attention mechanism that enables the construction of an efficient Transformer. Inspired by…

Machine Learning · Computer Science 2024-08-22 Yuhan Guo , Lizhong Ding , Ye Yuan , Guoren Wang

Magnetic resonance imaging (MRI) is a valuable clinical tool for displaying anatomical structures and aiding in accurate diagnosis. Medical image super-resolution (SR) reconstruction using deep learning techniques can enhance lesion…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Xin Hua , Zhijiang Du , Hongjian Yu , Jixin Maa

Since the Transformer architecture was introduced in 2017 there has been many attempts to bring the self-attention paradigm in the field of computer vision. In this paper we propose a novel self-attention module that can be easily…

Computer Vision and Pattern Recognition · Computer Science 2021-11-19 Roberto Pecoraro , Valerio Basile , Viviana Bono , Sara Gallo

Robustness to out-of-distribution data is crucial for deploying modern neural networks. Recently, Vision Transformers, such as SegFormer for semantic segmentation, have shown impressive robustness to visual corruptions like blur or noise…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Alberto Gonzalo Rodriguez Salgado , Maying Shen , Philipp Harzig , Peter Mayer , Jose M. Alvarez

We propose Re-parameterized Refocusing Convolution (RefConv) as a replacement for regular convolutional layers, which is a plug-and-play module to improve the performance without any inference costs. Specifically, given a pre-trained model,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Zhicheng Cai , Xiaohan Ding , Qiu Shen , Xun Cao

The attention mechanism is one of the most important priori knowledge to enhance convolutional neural networks. Most attention mechanisms are bound to the convolutional layer and use local or global contextual information to recalibrate the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Yu Xue , Ziming Yuan

With the rapid development of measurement technology, LiDAR and depth cameras are widely used in the perception of the 3D environment. Recent learning based methods for robot perception most focus on the image or video, but deep learning…

Computer Vision and Pattern Recognition · Computer Science 2021-11-04 Guangming Wang , Muyao Chen , Hanwen Liu , Yehui Yang , Zhe Liu , Hesheng Wang

Visual perception is driven by the focus on relevant aspects in the surrounding world. To transfer this observation to the digital information processing of computers, attention mechanisms have been introduced to highlight salient image…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Nils Körber

A major advantage of a deep convolutional neural network (CNN) is that the focused receptive field size is increased by stacking multiple convolutional layers. Accordingly, the model can explore the long-range dependency of features from…

Sound · Computer Science 2020-06-17 Xugang Lu , Peng Shen , Sheng Li , Yu Tsao , Hisashi Kawai

We investigate the high-dimensional data clustering problem by proposing a novel and unsupervised representation learning model called Robust Flexible Auto-weighted Local-coordinate Concept Factorization (RFA-LCF). RFA-LCF integrates the…

Computer Vision and Pattern Recognition · Computer Science 2019-05-28 Zhao Zhang , Yan Zhang , Sheng Li , Guangcan Liu , Meng Wang , Shuicheng Yan

Change detection is one of the central problems in earth observation and was extensively investigated over recent decades. In this paper, we propose a novel recurrent convolutional neural network (ReCNN) architecture, which is trained to…

Computer Vision and Pattern Recognition · Computer Science 2019-03-27 Lichao Mou , Lorenzo Bruzzone , Xiao Xiang Zhu

Very deep convolutional neural networks (CNNs) yield state of the art results on a wide variety of visual recognition problems. A number of state of the the art methods for image recognition are based on networks with well over 100 layers…

Computer Vision and Pattern Recognition · Computer Science 2016-07-15 Joel Moniz , Christopher Pal

Finding semantic correspondences is a challenging problem. With the breakthrough of CNNs stronger features are available for tasks like classification but not specifically for the requirements of semantic matching. In the following we…

Computer Vision and Pattern Recognition · Computer Science 2019-06-18 Nikolai Ufer , Kam To Lui , Katja Schwarz , Paul Warkentin , Björn Ommer