English
Related papers

Related papers: ConAM: Confidence Attention Module for Convolution…

200 papers

Recently, there has been an increasing interest in applying attention mechanisms in Convolutional Neural Networks (CNNs) to solve computer vision tasks. Most of these methods learn to explicitly identify and highlight relevant parts of the…

Computer Vision and Pattern Recognition · Computer Science 2021-11-11 Firas Laakom , Kateryna Chumachenko , Jenni Raitoharju , Alexandros Iosifidis , Moncef Gabbouj

For a speech-enhancement algorithm, it is highly desirable to simultaneously improve perceptual quality and recognition rate. Thanks to computational costs and model complexities, it is challenging to train a model that effectively…

Machine Learning · Computer Science 2018-02-19 Rasool Fakoor , Xiaodong He , Ivan Tashev , Shuayb Zarar

The aim of this paper is threefold. We inform the AI practitioner about the human visual system with an extensive literature review; we propose a novel biologically motivated neural network for image classification; and, finally, we present…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Gianluca Carloni , Sara Colantonio

This paper presents a novel keypoints-based attention mechanism for visual recognition in still images. Deep Convolutional Neural Networks (CNNs) for recognizing images with distinctive classes have shown great success, but their…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Asish Bera , Zachary Wharton , Yonghuai Liu , Nik Bessis , Ardhendu Behera

The challenge of fine-grained visual recognition often lies in discovering the key discriminative regions. While such regions can be automatically identified from a large-scale labeled dataset, a similar method might become less effective…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Yangyang Shu , Baosheng Yu , Haiming Xu , Lingqiao Liu

Video-based computer vision tasks can benefit from estimation of the salient regions and interactions between those regions. Traditionally, this has been done by identifying the object regions in the images by utilizing pre-trained models…

Computer Vision and Pattern Recognition · Computer Science 2022-08-03 Arulkumar Subramaniam , Jayesh Vaidya , Muhammed Abdul Majeed Ameen , Athira Nambiar , Anurag Mittal

In this study, we present an advanced convolutional neural network (CNN) architecture for ship classification based on optical satellite imagery, which significantly enhances performance through the integration of a convolutional block…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Ryan Donghan Kwon , Gangjoo Robin Nam , Jisoo Tak , Junseob Shin , Hyerin Cha , Seung Won Lee

In this work, we propose several attention formulations for multivariate sequence data. We build on top of the recently introduced 2D-Attention and reformulate the attention learning methodology by quantifying the relevance of…

Computer Vision and Pattern Recognition · Computer Science 2022-01-27 Kateryna Chumachenko , Alexandros Iosifidis , Moncef Gabbouj

Self-attention has the promise of improving computer vision systems due to parameter-independent scaling of receptive fields and content-dependent interactions, in contrast to parameter-dependent scaling and content-independent interactions…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Ashish Vaswani , Prajit Ramachandran , Aravind Srinivas , Niki Parmar , Blake Hechtman , Jonathon Shlens

Attention--or attribution--maps methods are methods designed to highlight regions of the model's input that were discriminative for its predictions. However, different attention maps methods can highlight different regions of the input,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Ali Mirzazadeh , Florian Dubost , Maxwell Pike , Krish Maniar , Max Zuo , Christopher Lee-Messer , Daniel Rubin

Anomalous audio in speech recordings is often caused by speaker voice distortion, external noise, or even electric interferences. These obstacles have become a serious problem in some fields, such as high-quality music mixing and speech…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-11 Qiang Huang , Thomas Hain

The demand for lightweight models in image classification tasks under resource-constrained environments necessitates a balance between computational efficiency and robust feature representation. Traditional attention mechanisms, despite…

Machine Learning · Computer Science 2025-04-21 Zhenkai Qin , Feng Zhu , Huan Zeng , Xunyi Nong

Fine-grained visual recognition typically depends on modeling subtle difference from object parts. However, these parts often exhibit dramatic visual variations such as occlusions, viewpoints, and spatial transformations, making it hard to…

Computer Vision and Pattern Recognition · Computer Science 2017-09-19 Lin Wu , Yang Wang

Attention mechanisms have become a popular component in deep neural networks, yet there has been little examination of how different influencing factors and methods for computing attention from these factors affect performance. Toward a…

Computer Vision and Pattern Recognition · Computer Science 2019-04-15 Xizhou Zhu , Dazhi Cheng , Zheng Zhang , Stephen Lin , Jifeng Dai

Convolutional neural networks have allowed remarkable advances in single image super-resolution (SISR) over the last decade. Among recent advances in SISR, attention mechanisms are crucial for high-performance SR models. However, the…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Haoyu Chen , Jinjin Gu , Zhi Zhang

Convolutional neural networks (CNNs) have demonstrated superior performance in super-resolution (SR). However, most CNN-based SR methods neglect the different importance among feature channels or fail to take full advantage of the…

Computer Vision and Pattern Recognition · Computer Science 2018-10-17 Yue Lu , Yun Zhou , Zhuqing Jiang , Xiaoqiang Guo , Zixuan Yang

Convolutions are a fundamental building block of modern computer vision systems. Recent approaches have argued for going beyond convolutions in order to capture long-range dependencies. These efforts focus on augmenting convolutional models…

Computer Vision and Pattern Recognition · Computer Science 2019-06-17 Prajit Ramachandran , Niki Parmar , Ashish Vaswani , Irwan Bello , Anselm Levskaya , Jonathon Shlens

Unlike the constraint frontal face condition, faces in the wild have various unconstrained interference factors, such as complex illumination, changing perspective and various occlusions. Facial expressions recognition (FER) in the wild is…

Computer Vision and Pattern Recognition · Computer Science 2020-02-03 Chuang Wang , Ruimin Hu , Min Hu , Jiang Liu , Ting Ren , Shan He , Ming Jiang , Jing Miao

Existing image recognition techniques based on convolutional neural networks (CNNs) basically assume that the training and test datasets are sampled from i.i.d distributions. However, this assumption is easily broken in the real world…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Kazuki Adachi , Shin'ya Yamaguchi

For person re-identification (re-id), attention mechanisms have become attractive as they aim at strengthening discriminative features and suppressing irrelevant ones, which matches well the key of re-id, i.e., discriminative feature…

Computer Vision and Pattern Recognition · Computer Science 2020-03-30 Zhizheng Zhang , Cuiling Lan , Wenjun Zeng , Xin Jin , Zhibo Chen