English
Related papers

Related papers: Generating Attention from Classifier Activations f…

200 papers

Attention-based learning for fine-grained image recognition remains a challenging task, where most of the existing methods treat each object part in isolation, while neglecting the correlations among them. In addition, the multi-stage or…

Computer Vision and Pattern Recognition · Computer Science 2018-06-15 Ming Sun , Yuchen Yuan , Feng Zhou , Errui Ding

Audio classification is considered as a challenging problem in pattern recognition. Recently, many algorithms have been proposed using deep neural networks. In this paper, we introduce a new attention-based neural network architecture…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-18 Haoye Lu , Haolong Zhang , Amit Nayak

Fine-grained classification models are designed to focus on the relevant details necessary to distinguish highly similar classes, particularly when intra-class variance is high and inter-class variance is low. Most existing models rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Riccardo La Grassa , Ignazio Gallo , Nicola Landro

We present a neural encoder-decoder model to convert images into presentational markup based on a scalable coarse-to-fine attention mechanism. Our method is evaluated in the context of image-to-LaTeX generation, and we introduce a new…

Computer Vision and Pattern Recognition · Computer Science 2017-06-15 Yuntian Deng , Anssi Kanervisto , Jeffrey Ling , Alexander M. Rush

In this work, we investigate several neural network architectures for fine-grained entity type classification. Particularly, we consider extensions to a recently proposed attentive neural architecture and make three key contributions.…

Computation and Language · Computer Science 2017-02-22 Sonse Shimaoka , Pontus Stenetorp , Kentaro Inui , Sebastian Riedel

Importance estimators are explainability methods that quantify feature importance for deep neural networks (DNN). In vision transformers (ViT), the self-attention mechanism naturally leads to attention maps, which are sometimes interpreted…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Lennart Brocki , Jakub Binda , Neo Christopher Chung

Class Activation Mapping (CAM) is a powerful technique used to understand the decision making of Convolutional Neural Network (CNN) in computer vision. Recently, there have been attempts not only to generate better visual explanations, but…

Machine Learning · Computer Science 2021-05-04 Kwang Hee Lee , Chaewon Park , Junghyun Oh , Nojun Kwak

Attention Mechanism is a widely used method for improving the performance of convolutional neural networks (CNNs) on computer vision tasks. Despite its pervasiveness, we have a poor understanding of what its effectiveness stems from. It is…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Xiang Ye , Zihang He , Heng Wang , Yong Li

Computer vision based fine-grained recognition has received great attention in recent years. Existing works focus on discriminative part localization and feature learning. In this paper, to improve the performance of fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2018-08-15 Hui Feng , Shanshan Wang , Shuzhi Sam Ge

Different from large-scale classification tasks, fine-grained visual classification is a challenging task due to two critical problems: 1) evident intra-class variances and subtle inter-class differences, and 2) overfitting owing to fewer…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Hang Yao , Qiguang Miao , Peipei Zhao , Chaoneng Li , Xin Li , Guanwen Feng , Ruyi Liu

We propose a novel attention mechanism to enhance Convolutional Neural Networks for fine-grained recognition. It learns to attend to lower-level feature activations without requiring part annotations and uses these activations to update and…

Computer Vision and Pattern Recognition · Computer Science 2018-07-25 Pau Rodríguez , Josep M. Gonfaus , Guillem Cucurull , F. Xavier Roca , Jordi Gonzàlez

Fine-grained classification of microscopic image data with limited samples is an open problem in computer vision and biomedical imaging. Deep learning based vision systems mostly deal with high number of low-resolution images, whereas…

Computer Vision and Pattern Recognition · Computer Science 2020-10-07 Mengran Fan , Tapabrata Chakrabort , Eric I-Chao Chang , Yan Xu , Jens Rittscher

Understanding and explaining deep learning models is an imperative task. Towards this, we propose a method that obtains gradient-based certainty estimates that also provide visual attention maps. Particularly, we solve for visual question…

Computer Vision and Pattern Recognition · Computer Science 2019-10-18 Badri N. Patro , Mayank Lunayach , Shivansh Patel , Vinay P. Namboodiri

Unlike images or videos data which can be easily labeled by human being, sensor data annotation is a time-consuming process. However, traditional methods of human activity recognition require a large amount of such strictly labeled data for…

Machine Learning · Computer Science 2019-07-02 Kun Wang , Jun He , Lei Zhang

We address the challenging problem of learning motion representations using deep models for video recognition. To this end, we make use of attention modules that learn to highlight regions in the video and aggregate features for…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Miao Liu , Xin Chen , Yun Zhang , Yin Li , James M. Rehg

Attention is a core component of transformer architecture, whether encoder-only, decoder-only, or encoder-decoder model. However, the standard softmax attention often produces noisy probability distribution, which can impair effective…

Computation and Language · Computer Science 2025-11-11 Dhananjay Ram , Wei Xia , Stefano Soatto

Fine-grained image classification is a challenging problem, since the difficulty of finding discriminative features. To handle this circumstance, basically, there are two ways to go. One is use attention based method to focus on informative…

Computer Vision and Pattern Recognition · Computer Science 2020-01-08 ZiChao Dong , JiLong Wu , TingTing Ren , Yue Wang , MengYing Ge

The increased availability and accuracy of eye-gaze tracking technology has sparked attention-related research in psychology, neuroscience, and, more recently, computer vision and artificial intelligence. The attention mechanism in…

Image and Video Processing · Electrical Eng. & Systems 2022-02-16 Hongzhi Zhu , Septimiu Salcudean , Robert Rohling

Humans are very good at directing their visual attention toward relevant areas when they search for different types of objects. For instance, when we search for cars, we will look at the streets, not at the top of buildings. The motivation…

Computer Vision and Pattern Recognition · Computer Science 2020-06-12 Hughes Perreault , Guillaume-Alexandre Bilodeau , Nicolas Saunier , Maguelonne Héritier

This paper proposes to go beyond the state-of-the-art deep convolutional neural network (CNN) by incorporating the information from object detection, focusing on dealing with fine-grained image classification. Unfortunately, CNN suffers…

Computer Vision and Pattern Recognition · Computer Science 2014-12-11 Xiaoyu Wang , Tianbao Yang , Guobin Chen , Yuanqing Lin