English
Related papers

Related papers: Where to Look: A Unified Attention Model for Visua…

200 papers

Deep learning architectures are an extremely powerful tool for recognizing and classifying images. However, they require supervised learning and normally work on vectors the size of image pixels and produce the best results when trained on…

Machine Learning · Computer Science 2020-10-20 Ryan Burt , Nina N. Thigpen , Andreas Keil , Jose C. Principe

In fine-grained image recognition (FGIR), the localization and amplification of region attention is an important factor, which has been explored a lot by convolutional neural networks (CNNs) based approaches. The recently developed vision…

Computer Vision and Pattern Recognition · Computer Science 2021-07-20 Yunqing Hu , Xuan Jin , Yin Zhang , Haiwen Hong , Jingfeng Zhang , Yuan He , Hui Xue

A dominant paradigm for deep learning based object detection relies on a "bottom-up" approach using "passive" scoring of class agnostic proposals. These approaches are efficient but lack of holistic analysis of scene-level context. In this…

Computer Vision and Pattern Recognition · Computer Science 2016-12-21 Donggeun Yoo , Sunggyun Park , Kyunghyun Paeng , Joon-Young Lee , In So Kweon

Deep learning is attracting significant interest in the neuroimaging community as a means to diagnose psychiatric and neurological disorders from structural magnetic resonance images. However, there is a tendency amongst researchers to…

Machine Learning · Computer Science 2019-10-22 David Wood , James Cole , Thomas Booth

In this work, we propose "Residual Attention Network", a convolutional neural network using attention mechanism which can incorporate with state-of-art feed forward network architecture in an end-to-end training fashion. Our Residual…

Computer Vision and Pattern Recognition · Computer Science 2017-04-25 Fei Wang , Mengqing Jiang , Chen Qian , Shuo Yang , Cheng Li , Honggang Zhang , Xiaogang Wang , Xiaoou Tang

Due to its perceptual limitations, an agent may have too little information about the state of the environment to act optimally. In such cases, it is important to keep track of the observation history to uncover hidden state. Recent deep…

Machine Learning · Computer Science 2021-02-18 Miguel Suau , Jinke He , Elena Congeduti , Rolf A. N. Starre , Aleksander Czechowski , Frans A. Oliehoek

Visual attention mechanisms are a key component of neural network models for computer vision. By focusing on a discrete set of objects or image regions, these mechanisms identify the most relevant features and use them to build more…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 António Farinhas , André F. T. Martins , Pedro M. Q. Aguiar

Fine-grained classification is challenging because categories can only be discriminated by subtle and local differences. Variances in the pose, scale or rotation usually make the problem more difficult. Most fine-grained classification…

Computer Vision and Pattern Recognition · Computer Science 2014-11-25 Tianjun Xiao , Yichong Xu , Kuiyuan Yang , Jiaxing Zhang , Yuxin Peng , Zheng Zhang

Full attention, which generates an attention value per element of the input feature maps, has been successfully demonstrated to be beneficial in visual tasks. In this work, we propose a fully attentional network, termed {\it channel…

Computer Vision and Pattern Recognition · Computer Science 2020-10-08 Pengfei Fang , Pan Ji , Jieming Zhou , Lars Petersson , Mehrtash Harandi

Convolutional neural networks (CNNs) have demonstrated superior performance in super-resolution (SR). However, most CNN-based SR methods neglect the different importance among feature channels or fail to take full advantage of the…

Computer Vision and Pattern Recognition · Computer Science 2018-10-17 Yue Lu , Yun Zhou , Zhuqing Jiang , Xiaoqiang Guo , Zixuan Yang

In this paper, we propose the joint learning attention and recurrent neural network (RNN) models for multi-label classification. While approaches based on the use of either model exist (e.g., for the task of image captioning), training such…

Computer Vision and Pattern Recognition · Computer Science 2017-12-21 Shang-Fu Chen , Yi-Chen Chen , Chih-Kuan Yeh , Yu-Chiang Frank Wang

We present Attention Zoom, a modular and model-agnostic spatial attention mechanism designed to improve feature extraction in convolutional neural networks (CNNs). Unlike traditional attention approaches that require architecture-specific…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Daniel DeAlcala , Aythami Morales , Julian Fierrez , Ruben Tolosana

Attention models have recently emerged as a powerful approach, demonstrating significant progress in various fields. Visualization techniques, such as class activation mapping, provide visual insights into the reasoning of convolutional…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Ali Caglayan , Nevrez Imamoglu , Oguzhan Guclu , Ali Osman Serhatoglu , Ahmet Burak Can , Ryosuke Nakamura

Deep Recurrent Neural Network (RNN) has gained popularity in many sequence classification tasks. Beyond predicting a correct class for each data instance, data scientists also want to understand what differentiating factors in the data have…

Machine Learning · Computer Science 2019-01-18 Chuan Wang , Takeshi Onishi , Keiichi Nemoto , Kwan-Liu Ma

Most recent gains in visual recognition have originated from the inclusion of attention mechanisms in deep convolutional networks (DCNs). Because these networks are optimized for object recognition, they learn where to attend using only a…

Computer Vision and Pattern Recognition · Computer Science 2019-06-12 Drew Linsley , Dan Shiebler , Sven Eberhardt , Thomas Serre

Although numerous recent tracking approaches have made tremendous advances in the last decade, achieving high-performance visual tracking remains a challenge. In this paper, we propose an end-to-end network model to learn reinforced…

Computer Vision and Pattern Recognition · Computer Science 2020-01-03 Peng Gao , Qiquan Zhang , Fei Wang , Liyi Xiao , Hamido Fujita , Yan Zhang

Top-down attention allows neural networks, both artificial and biological, to focus on the information most relevant for a given task. This is known to enhance performance in visual perception. But it remains unclear how attention brings…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Freddie Bickford Smith , Brett D Roads , Xiaoliang Luo , Bradley C Love

Humans actively observe the visual surroundings by focusing on salient objects and ignoring trivial details. However, computer vision models based on convolutional neural networks (CNN) often analyze visual input all at once through a…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Minkyu Choi , Yizhen Zhang , Kuan Han , Xiaokai Wang , Zhongming Liu

We aim to model the top-down attention of a Convolutional Neural Network (CNN) classifier for generating task-specific attention maps. Inspired by a top-down human visual attention model, we propose a new backpropagation scheme, called…

Computer Vision and Pattern Recognition · Computer Science 2016-08-02 Jianming Zhang , Zhe Lin , Jonathan Brandt , Xiaohui Shen , Stan Sclaroff

Recognizing multiple labels of images is a fundamental but challenging task in computer vision, and remarkable progress has been attained by localizing semantic-aware image regions and predicting their labels with deep convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2017-12-21 Tianshui Chen , Zhouxia Wang , Guanbin Li , Liang Lin