English
Related papers

Related papers: Adaptive Attention Span in Computer Vision

200 papers

Convolutional Neural Networks have played a significant role in various medical imaging tasks like classification and segmentation. They provide state-of-the-art performance compared to classical image processing algorithms. However, the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-03 Rakshith Sathish , Swanand Khare , Debdoot Sheet

Encoder transformer models compress information from all tokens in a sequence into a single [CLS] token to represent global context. This approach risks diluting fine-grained or hierarchical features, leading to information loss in…

Computation and Language · Computer Science 2025-09-23 Asif Shahriar , Rifat Shahriyar , M Saifur Rahman

Attention mechanisms have become a popular component in deep neural networks, yet there has been little examination of how different influencing factors and methods for computing attention from these factors affect performance. Toward a…

Computer Vision and Pattern Recognition · Computer Science 2019-04-15 Xizhou Zhu , Dazhi Cheng , Zheng Zhang , Stephen Lin , Jifeng Dai

Objects in aerial images have greater variations in scale and orientation than in typical images, so detection is more difficult. Convolutional neural networks use a variety of frequency- and orientation-specific kernels to identify objects…

Computer Vision and Pattern Recognition · Computer Science 2021-11-08 Guo-Ye Yang , Xiang-Li Li , Ralph R. Martin , Shi-Min Hu

In recent years, there have been attempts to increase the kernel size of Convolutional Neural Nets (CNNs) to mimic the global receptive field of Vision Transformers' (ViTs) self-attention blocks. That approach, however, quickly hit an upper…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Shahaf E. Finder , Roy Amoyal , Eran Treister , Oren Freifeld

In recent years, the use of large convolutional kernels has become popular in designing convolutional neural networks due to their ability to capture long-range dependencies and provide large receptive fields. However, the increase in…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Gang Wu , Junjun Jiang , Yuanchao Bai , Xianming Liu

Self-attention network (SAN) has recently attracted increasing interest due to its fully parallelized computation and flexibility in modeling dependencies. It can be further enhanced with multi-headed attention mechanism by allowing the…

Computation and Language · Computer Science 2019-04-09 Baosong Yang , Longyue Wang , Derek F. Wong , Lidia S. Chao , Zhaopeng Tu

A substantial body of research has focused on developing systems that assist medical professionals during labor-intensive early screening processes, many based on convolutional deep-learning architectures. Recently, multiple studies…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Tristan Piater , Niklas Penzel , Gideon Stein , Joachim Denzler

Recently, self-attention (SA) structures became popular in computer vision fields. They have locally independent filters and can use large kernels, which contradicts the previously popular convolutional neural networks (CNNs). CNNs success…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Nana Arizumi

Visual Attention Networks (VAN) with Large Kernel Attention (LKA) modules have been shown to provide remarkable performance, that surpasses Vision Transformers (ViTs), on a range of vision-based tasks. However, the depth-wise convolutional…

Computer Vision and Pattern Recognition · Computer Science 2023-10-23 Kin Wai Lau , Lai-Man Po , Yasar Abbas Ur Rehman

Existing point-cloud based 3D object detectors use convolution-like operators to process information in a local neighbourhood with fixed-weight kernels and aggregate global context hierarchically. However, non-local neural networks and…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Prarthana Bhattacharyya , Chengjie Huang , Krzysztof Czarnecki

Vision Transformers has demonstrated competitive performance on computer vision tasks benefiting from their ability to capture long-range dependencies with multi-head self-attention modules and multi-layer perceptron. However, calculating…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Xiangyu Chen , Qinghao Hu , Kaidong Li , Cuncong Zhong , Guanghui Wang

We propose a novel self-attention mechanism that can learn its optimal attention span. This allows us to extend significantly the maximum context size used in Transformer, while maintaining control over their memory footprint and…

Machine Learning · Computer Science 2019-08-09 Sainbayar Sukhbaatar , Edouard Grave , Piotr Bojanowski , Armand Joulin

To date, most state-of-the-art sequence modeling architectures use attention to build generative models for language based tasks. Some of these models use all the available sequence tokens to generate an attention distribution which results…

Machine Learning · Computer Science 2020-06-22 Vasileios Lioutas , Yuhong Guo

Convolutional Neural Networks (CNNs), architectures consisting of convolutional layers, have been the standard choice in vision tasks. Recent studies have shown that Vision Transformers (VTs), architectures based on self-attention modules,…

Computer Vision and Pattern Recognition · Computer Science 2022-01-24 Kishaan Jeeveswaran , Senthilkumar Kathiresan , Arnav Varma , Omar Magdy , Bahram Zonooz , Elahe Arani

Unneeded elements in the attention's context degrade performance. We introduce Selective Attention, a simple parameter-free change to the standard attention mechanism which reduces attention to unneeded elements. Selective attention…

Computation and Language · Computer Science 2025-04-25 Yaniv Leviathan , Matan Kalman , Yossi Matias

In recent years, attention mechanisms have significantly enhanced the performance of object detection by focusing on key feature information. However, prevalent methods still encounter difficulties in effectively balancing local and global…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Yifan Shao

Pre-trained language models like BERT and its variants have recently achieved impressive performance in various natural language understanding tasks. However, BERT heavily relies on the global self-attention block and thus suffers large…

Computation and Language · Computer Science 2021-02-03 Zihang Jiang , Weihao Yu , Daquan Zhou , Yunpeng Chen , Jiashi Feng , Shuicheng Yan

Convolution on 3D point clouds that generalized from 2D grid-like domains is widely researched yet far from perfect. The standard convolution characterises feature correspondences indistinguishably among 3D points, presenting an intrinsic…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Haoran Zhou , Yidan Feng , Mingsheng Fang , Mingqiang Wei , Jing Qin , Tong Lu

Convolutional Neural Networks (CNNs) have dominated computer vision for years, due to its ability in capturing locality and translation invariance. Recently, many vision transformer architectures have been proposed and they show promising…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Pichao Wang , Xue Wang , Fan Wang , Ming Lin , Shuning Chang , Hao Li , Rong Jin