English
Related papers

Related papers: Where to Look: A Unified Attention Model for Visua…

200 papers

Attention Mechanism is a widely used method for improving the performance of convolutional neural networks (CNNs) on computer vision tasks. Despite its pervasiveness, we have a poor understanding of what its effectiveness stems from. It is…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Xiang Ye , Zihang He , Heng Wang , Yong Li

Effective aggregation of temporal information of consecutive frames is the core of achieving video super-resolution. Many scholars have utilized structures such as sliding windows and recurrent to gather spatio-temporal information of…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Yonggui Zhu , Guofang Li

To address the sequential changes of images including poses, in this paper we propose a recurrent regression neural network(RRNN) framework to unify two classic tasks of cross-pose face recognition on still images and video-based face…

Computer Vision and Pattern Recognition · Computer Science 2016-07-26 Yang Li , Wenming Zheng , Zhen Cui

We propose a novel deep supervised neural network for the task of action recognition in videos, which implicitly takes advantage of visual tracking and shares the robustness of both deep Convolutional Neural Network (CNN) and Recurrent…

Computer Vision and Pattern Recognition · Computer Science 2016-07-12 Jialin Wu , Gu Wang , Wukui Yang , Xiangyang Ji

With the increased deployment of face recognition systems in our daily lives, face presentation attack detection (PAD) is attracting much attention and playing a key role in securing face recognition systems. Despite the great performance…

Computer Vision and Pattern Recognition · Computer Science 2021-11-03 Meiling Fang , Naser Damer , Florian Kirchbuchner , Arjan Kuijper

This paper presents experiments extending the work of Ba et al. (2014) on recurrent neural models for attention into less constrained visual environments, specifically fine-grained categorization on the Stanford Dogs data set. In this work…

Computer Vision and Pattern Recognition · Computer Science 2015-04-14 Pierre Sermanet , Andrea Frome , Esteban Real

Bottom-Up (BU) saliency models do not perform well in complex interactive environments where humans are actively engaged in tasks (e.g., sandwich making and playing the video games). In this paper, we leverage Reinforcement Learning (RL) to…

Computer Vision and Pattern Recognition · Computer Science 2017-02-21 Sajad Mousavi , Michael Schukat , Enda Howley , Ali Borji , Nasser Mozayani

Self-attention-based models have achieved remarkable progress in short-text mining. However, the quadratic computational complexities restrict their application in long text processing. Prior works have adopted the chunking strategy to…

Computation and Language · Computer Science 2023-06-13 Xianming Li , Zongxi Li , Xiaotian Luo , Haoran Xie , Xing Lee , Yingbin Zhao , Fu Lee Wang , Qing Li

Deep Convolutional Neural Networks (CNN) have drawn great attention in image super-resolution (SR). Recently, visual attention mechanism, which exploits both of the feature importance and contextual cues, has been introduced to image SR and…

Image and Video Processing · Electrical Eng. & Systems 2019-10-01 Huapeng Wu , Zhengxia Zou , Jie Gui , Wen-Jun Zeng , Jieping Ye , Jun Zhang , Hongyi Liu , Zhihui Wei

Visual attention modeling has recently gained momentum in developing visual hierarchies provided by Convolutional Neural Networks. Despite recent successes of feedforward processing on the abstraction of concepts form raw images, the…

Computer Vision and Pattern Recognition · Computer Science 2017-08-23 Mahdi Biparva , John Tsotsos

Convolutional neural networks have been shown to develop internal representations, which correspond closely to semantically meaningful objects and parts, although trained solely on class labels. Class Activation Mapping (CAM) is a recent…

Computer Vision and Pattern Recognition · Computer Science 2016-05-26 Amir Rosenfeld , Shimon Ullman

Attention-based learning for fine-grained image recognition remains a challenging task, where most of the existing methods treat each object part in isolation, while neglecting the correlations among them. In addition, the multi-stage or…

Computer Vision and Pattern Recognition · Computer Science 2018-06-15 Ming Sun , Yuchen Yuan , Feng Zhou , Errui Ding

The human brain uses selective attention to filter perceptual input so that only the components that are useful for behaviour are processed using its limited computational resources. We focus on one particular form of visual attention known…

Neurons and Cognition · Quantitative Biology 2020-08-31 Sam Blakeman , Denis Mareschal

Weakly supervised learning with only coarse labels can obtain visual explanations of deep neural network such as attention maps by back-propagating gradients. These attention maps are then available as priors for tasks such as object…

Computer Vision and Pattern Recognition · Computer Science 2018-03-01 Kunpeng Li , Ziyan Wu , Kuan-Chuan Peng , Jan Ernst , Yun Fu

Vision Transformer(ViT) is one of the most widely used models in the computer vision field with its great performance on various tasks. In order to fully utilize the ViT-based architecture in various applications, proper visualization…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Saebom Leem , Hyunseok Seo

Deep neural networks have evolved to become power demanding and consequently difficult to apply to small-size mobile platforms. Network parameter reduction methods have been introduced to systematically deal with the computational and…

Computer Vision and Pattern Recognition · Computer Science 2020-05-12 Mahdi Biparva , John Tsotsos

Models based on deep convolutional networks have dominated recent image interpretation tasks; we investigate whether models which are also recurrent, or "temporally deep", are effective for tasks involving sequences, visual and otherwise.…

Computer Vision and Pattern Recognition · Computer Science 2016-06-02 Jeff Donahue , Lisa Anne Hendricks , Marcus Rohrbach , Subhashini Venugopalan , Sergio Guadarrama , Kate Saenko , Trevor Darrell

Inspired by recent work in attention models for image captioning and question answering, we present a soft attention model for the reinforcement learning domain. This model uses a soft, top-down attention mechanism to create a bottleneck in…

Machine Learning · Computer Science 2019-06-07 Alex Mott , Daniel Zoran , Mike Chrzanowski , Daan Wierstra , Danilo J. Rezende

The human visual system employs a selective attention mechanism to understand the visual world in an eficient manner. In this paper, we show how computational models of this mechanism can be exploited for the computer vision application of…

Computer Vision and Pattern Recognition · Computer Science 2013-07-23 Samuel F. Dodge , Lina J. Karam

Neural attention has become central to many state-of-the-art models in natural language processing and related domains. Attention networks are an easy-to-train and effective method for softly simulating alignment; however, the approach does…

Machine Learning · Statistics 2018-11-09 Yuntian Deng , Yoon Kim , Justin Chiu , Demi Guo , Alexander M. Rush