English
Related papers

Related papers: Local-Global Attention: An Adaptive Mechanism for …

200 papers

Effective feature fusion of multispectral images plays a crucial role in multi-spectral object detection. Previous studies have demonstrated the effectiveness of feature fusion using convolutional neural networks, but these methods are…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Jifeng Shen , Yifei Chen , Yue Liu , Xin Zuo , Heng Fan , Wankou Yang

Self-attention has the promise of improving computer vision systems due to parameter-independent scaling of receptive fields and content-dependent interactions, in contrast to parameter-dependent scaling and content-independent interactions…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Ashish Vaswani , Prajit Ramachandran , Aravind Srinivas , Niki Parmar , Blake Hechtman , Jonathon Shlens

Intelligent robots require object-level scene understanding to reason about possible tasks and interactions with the environment. Moreover, many perception tasks such as scene reconstruction, image retrieval, or place recognition can…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Cathrin Elich , Iro Armeni , Martin R. Oswald , Marc Pollefeys , Joerg Stueckler

Place recognition plays an essential role in the field of autonomous driving and robot navigation. Point cloud based methods mainly focus on extracting global descriptors from local features of point clouds. Despite having achieved…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Tian-Xing Xu , Yuan-Chen Guo , Zhiqiang Li , Ge Yu , Yu-Kun Lai , Song-Hai Zhang

Global contexts in images are quite valuable in image-to-image translation problems. Conventional attention-based and graph-based models capture the global context to a large extent, however, these are computationally expensive. Moreover,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Ayush Singh , Yash Bhambhu , Himanshu Buckchash , Deepak K. Gupta , Dilip K. Prasad

Recently, encoder-decoder neural networks have shown impressive performance on many sequence-related tasks. The architecture commonly uses an attentional mechanism which allows the model to learn alignments between the source and the target…

Computation and Language · Computer Science 2017-11-06 Andros Tjandra , Sakriani Sakti , Satoshi Nakamura

This work focuses on mitigating two limitations in the joint learning of local feature detectors and descriptors. First, the ability to estimate the local shape (scale, orientation, etc.) of feature points is often neglected during dense…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Zixin Luo , Lei Zhou , Xuyang Bai , Hongkai Chen , Jiahui Zhang , Yao Yao , Shiwei Li , Tian Fang , Long Quan

Self-attention is a useful mechanism to build generative models for language and images. It determines the importance of context elements by comparing each element to the current time step. In this paper, we show that a very lightweight…

Computation and Language · Computer Science 2019-02-26 Felix Wu , Angela Fan , Alexei Baevski , Yann N. Dauphin , Michael Auli

Detecting fashion landmarks is a fundamental technique for visual clothing analysis. Due to the large variation and non-rigid deformation of clothes, localizing fashion landmarks suffers from large spatial variances across poses, scales,…

Computer Vision and Pattern Recognition · Computer Science 2019-08-29 Sumin Lee , Sungchan Oh , Chanho Jung , Changick Kim

Sequential visual task usually requires to pay attention to its current interested object conditional on its previous observations. Different from popular soft attention mechanism, we propose a new attention framework by introducing a novel…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Jun He , Quan-Jie Cao , Lei Zhang

We present a novel approach to place recognition well-suited to environments with many dynamic objects--objects that may or may not be present in an agent's subsequent visits. By incorporating an object-detecting preprocessing step, our…

Computer Vision and Pattern Recognition · Computer Science 2020-06-15 Juan Pablo Munoz , Scott Dexter

We propose an attentive local feature descriptor suitable for large-scale image retrieval, referred to as DELF (DEep Local Feature). The new feature is based on convolutional neural networks, which are trained only with image-level…

Computer Vision and Pattern Recognition · Computer Science 2018-02-06 Hyeonwoo Noh , Andre Araujo , Jack Sim , Tobias Weyand , Bohyung Han

We present a reward-predictive, model-based deep learning method featuring trajectory-constrained visual attention for local planning in visual navigation tasks. Our method learns to place visual attention at locations in latent image space…

Robotics · Computer Science 2022-05-27 Stefan Wapnick , Travis Manderson , David Meger , Gregory Dudek

Attention mechanism has been regarded as an advanced technique to capture long-range feature interactions and to boost the representation capability for convolutional neural networks. However, we found two ignored problems in current…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Zhu Baozhou , Peter Hofstee , Jinho Lee , Zaid Al-Ars

Seeing clearly with high resolution is a foundation of Large Multimodal Models (LMMs), which has been proven to be vital for visual perception and reasoning. Existing works usually employ a straightforward resolution upscaling method, where…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Yi-Fan Zhang , Qingsong Wen , Chaoyou Fu , Xue Wang , Zhang Zhang , Liang Wang , Rong Jin

In recommender systems, models mostly use a combination of embedding layers and multilayer feedforward neural networks. The high-dimensional sparse original features are downscaled in the embedding layer and then fed into the fully…

Information Retrieval · Computer Science 2022-05-19 Mohan Hasama , Jing Li

Attention mechanism has demonstrated great potential in fine-grained visual recognition tasks. In this paper, we present a counterfactual attention learning method to learn more effective attention based on causal inference. Unlike most…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Yongming Rao , Guangyi Chen , Jiwen Lu , Jie Zhou

Top-performing landmark estimation algorithms are based on exploiting the excellent ability of large convolutional neural networks (CNNs) to represent local appearance. However, it is well known that they can only learn weak spatial…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Andrés Prados-Torreblanca , José M. Buenaposada , Luis Baumela

High-dimensional, heterogeneous data with complex feature interactions pose significant challenges for traditional predictive modeling approaches. While Projection to Latent Structures (PLS) remains a popular technique, it struggles to…

Machine Learning · Computer Science 2025-10-21 Farwa Abbas , Hussain Ahmad , Claudia Szabo

Incorporating multi-scale features in fully convolutional neural networks (FCNs) has been a key element to achieving state-of-the-art performance on semantic image segmentation. One common way to extract multi-scale features is to feed…

Computer Vision and Pattern Recognition · Computer Science 2016-06-03 Liang-Chieh Chen , Yi Yang , Jiang Wang , Wei Xu , Alan L. Yuille