English
Related papers

Related papers: Exploring Self-attention for Image Recognition

200 papers

Object-based attention is a key component of the visual system, relevant for perception, learning, and memory. Neurons tuned to features of attended objects tend to be more active than those associated with non-attended objects. There is a…

Neurons and Cognition · Quantitative Biology 2021-06-09 Jordan Lei , Ari S. Benjamin , Konrad P. Kording

Humans are very good at directing their visual attention toward relevant areas when they search for different types of objects. For instance, when we search for cars, we will look at the streets, not at the top of buildings. The motivation…

Computer Vision and Pattern Recognition · Computer Science 2020-06-12 Hughes Perreault , Guillaume-Alexandre Bilodeau , Nicolas Saunier , Maguelonne Héritier

Intra-class variations in the open world lead to various challenges in classification tasks. To overcome these challenges, fine-grained classification was introduced, and many approaches were proposed. Some rely on locating and using…

Computer Vision and Pattern Recognition · Computer Science 2023-02-10 Salwa Al Khatib , Mohamed El Amine Boudjoghra , Jameel Hassan

We present a lightweight network that infers grouping and boundaries, including curves, corners and junctions. It operates in a bottom-up fashion, analogous to classical methods for sub-pixel edge localization and edge-linking, but with a…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Mia Gaia Polansky , Charles Herrmann , Junhwa Hur , Deqing Sun , Dor Verbin , Todd Zickler

While the Transformer architecture has become ubiquitous in the machine learning field, its adaptation to 3D shape recognition is non-trivial. Due to its quadratic computational complexity, the self-attention operator quickly becomes…

Computer Vision and Pattern Recognition · Computer Science 2022-04-11 Axel Berg , Magnus Oskarsson , Mark O'Connor

Multi-head, key-value attention is the backbone of the widely successful Transformer model and its variants. This attention mechanism uses multiple parallel key-value attention blocks (called heads), each performing two fundamental…

Machine Learning · Computer Science 2022-02-15 Sarthak Mittal , Sharath Chandra Raparthy , Irina Rish , Yoshua Bengio , Guillaume Lajoie

Proto-objects - image regions that share common visual properties - offer a promising alternative to traditional attention mechanisms based on rectangular-shaped image patches in neural networks. Although previous work demonstrated that…

Neural and Evolutionary Computing · Computer Science 2025-05-02 Rafael C. Pinto , Anderson R. Tavares

Humans can effectively find salient regions in complex scenes. Self-attention mechanisms were introduced into Computer Vision (CV) to achieve this. Attention Augmented Convolutional Network (AANet) is a mixture of convolution and…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Runqing Zhang , Tianshu Zhu

Convolutional neural networks have allowed remarkable advances in single image super-resolution (SISR) over the last decade. Among recent advances in SISR, attention mechanisms are crucial for high-performance SR models. However, the…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Haoyu Chen , Jinjin Gu , Zhi Zhang

Vision Transformer (ViT) self-attention mechanism is characterized by feature collapse in deeper layers, resulting in the vanishing of low-level visual features. However, such features can be helpful to accurately represent and identify…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Anxhelo Diko , Danilo Avola , Marco Cascio , Luigi Cinque

Self-attention networks have proven to be of profound value for its strength of capturing global dependencies. In this work, we propose to model localness for self-attention networks, which enhances the ability of capturing useful local…

Computation and Language · Computer Science 2018-10-25 Baosong Yang , Zhaopeng Tu , Derek F. Wong , Fandong Meng , Lidia S. Chao , Tong Zhang

Deep image hashing aims to map input images into simple binary hash codes via deep neural networks and thus enable effective large-scale image retrieval. Recently, hybrid networks that combine convolution and Transformer have achieved…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Chao He , Hongxi Wei

Prevalence of deeper networks driven by self-attention is in stark contrast to underexplored point-based methods. In this paper, we propose groupwise self-attention as the basic block to construct our network: SepNet. Our proposed module…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Haoxi Ran , Li Lu

Human visual attention is subjective and biased according to the personal preference of the viewer, however, current works of saliency detection are general and objective, without counting the factor of the observer. This will make the…

Computer Vision and Pattern Recognition · Computer Science 2018-02-23 Sikun Lin , Pan Hui

Convolutional neural networks (CNNs) have been shown to be state-of-the-art models for visual cortical neurons. Cortical neurons in the primary visual cortex are sensitive to contextual information mediated by extensive horizontal and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Isaac Lin , Tianye Wang , Shang Gao , Shiming Tang , Tai Sing Lee

Transformer-based models have emerged as a leading architecture for natural language processing, natural language generation, and image generation tasks. A fundamental element of the transformer architecture is self-attention, which allows…

Machine Learning · Computer Science 2025-07-01 Venmugil Elango

In this work, we propose "Residual Attention Network", a convolutional neural network using attention mechanism which can incorporate with state-of-art feed forward network architecture in an end-to-end training fashion. Our Residual…

Computer Vision and Pattern Recognition · Computer Science 2017-04-25 Fei Wang , Mengqing Jiang , Chen Qian , Shuo Yang , Cheng Li , Honggang Zhang , Xiaogang Wang , Xiaoou Tang

In humans, Attention is a core property of all perceptual and cognitive operations. Given our limited ability to process competing sources, attention mechanisms select, modulate, and focus on the information most relevant to behavior. For…

Machine Learning · Computer Science 2021-04-01 Alana de Santana Correia , Esther Luna Colombini

Convolutional Neural Networks have achieved impressive results in various tasks, but interpreting the internal mechanism is a challenging problem. To tackle this problem, we exploit a multi-channel attention mechanism in feature space. Our…

Computer Vision and Pattern Recognition · Computer Science 2019-05-22 Masanari Kimura , Masayuki Tanaka

Advanced methods of applying deep learning to structured data such as graphs have been proposed in recent years. In particular, studies have focused on generalizing convolutional neural networks to graph data, which includes redefining the…

Machine Learning · Computer Science 2019-06-14 Junhyun Lee , Inyeop Lee , Jaewoo Kang