English
Related papers

Related papers: Local-Global Attention: An Adaptive Mechanism for …

200 papers

The Large Vision-Language Model (LVLM) integrates computer vision and natural language processing techniques, offering substantial application potential. However, these models demand extensive resources during inference. Adaptive attention…

Artificial Intelligence · Computer Science 2025-02-10 Junyang Zhang , Mu Yuan , Ruiguang Zhong , Puhan Luo , Huiyou Zhan , Ningkang Zhang , Chengchen Hu , Xiangyang Li

Intra-class variations in the open world lead to various challenges in classification tasks. To overcome these challenges, fine-grained classification was introduced, and many approaches were proposed. Some rely on locating and using…

Computer Vision and Pattern Recognition · Computer Science 2023-02-10 Salwa Al Khatib , Mohamed El Amine Boudjoghra , Jameel Hassan

In this paper, we propose a residual non-local attention network for high-quality image restoration. Without considering the uneven distribution of information in the corrupted images, previous methods are restricted by local convolutional…

Computer Vision and Pattern Recognition · Computer Science 2019-03-26 Yulun Zhang , Kunpeng Li , Kai Li , Bineng Zhong , Yun Fu

The paradigm of Transformers using the self-attention mechanism has manifested its advantage in learning graph-structured data. Yet, Graph Transformers are capable of modeling full range dependencies but are often deficient in extracting…

Machine Learning · Computer Science 2024-09-11 Minhong Zhu , Zhenhao Zhao , Weiran Cai

The attention mechanism has gained significant recognition in the field of computer vision due to its ability to effectively enhance the performance of deep neural networks. However, existing methods often struggle to effectively utilize…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Wei Xu , Yi Wan

The aim of object-centric vision is to construct an explicit representation of the objects in a scene. This representation is obtained via a set of interchangeable modules called \emph{slots} or \emph{object files} that compete for local…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Ayush Chakravarthy , Trang Nguyen , Anirudh Goyal , Yoshua Bengio , Michael C. Mozer

The so-called "attention" is an efficient mechanism to improve the performance of convolutional neural networks. It uses contextual information to recalibrate the input to strengthen the propagation of informative features. However, the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Yu Xue , Ziming Yuan , Ferrante Neri

Vision transformer (ViT) has recently shown its strong capability in achieving comparable results to convolutional neural networks (CNNs) on image classification. However, vanilla ViT simply inherits the same architecture from the natural…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Chun-Fu Chen , Rameswar Panda , Quanfu Fan

Transformer-based visual object tracking has been utilized extensively. However, the Transformer structure is lack of enough inductive bias. In addition, only focusing on encoding the global feature does harm to modeling local details,…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Changhong Fu , Weiyu Peng , Sihang Li , Junjie Ye , Ziang Cao

Object detection in 3D point clouds is a crucial task in a range of computer vision applications including robotics, autonomous cars, and augmented reality. This work addresses the object detection task in 3D point clouds using a highly…

Computer Vision and Pattern Recognition · Computer Science 2023-02-14 Sultan Abu Ghazal , Jean Lahoud , Rao Anwer

Semantic change detection is an important task in geoscience and earth observation. By producing a semantic change map for each temporal phase, both the land use land cover categories and change information can be interpreted. Recently some…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Chenyao Zhou , Haotian Zhang , Han Guo , Zhengxia Zou , Zhenwei Shi

This paper focuses on the challenging crowd counting task. As large-scale variations often exist within crowd images, neither fixed-size convolution kernel of CNN nor fixed-size attention of recent vision transformers can well handle this…

Computer Vision and Pattern Recognition · Computer Science 2022-03-08 Hui Lin , Zhiheng Ma , Rongrong Ji , Yaowei Wang , Xiaopeng Hong

We propose a decentralised "local2global"' approach to graph representation learning, that one can a-priori use to scale any embedding technique. Our local2global approach proceeds by first dividing the input graph into overlapping…

Machine Learning · Computer Science 2022-01-14 Lucas G. S. Jeub , Giovanni Colavizza , Xiaowen Dong , Marya Bazzi , Mihai Cucuringu

As an essential ingredient of modern deep learning, attention mechanism, especially self-attention, plays a vital role in the global correlation discovery. However, is hand-crafted attention irreplaceable when modeling the global context?…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Zhengyang Geng , Meng-Hao Guo , Hongxu Chen , Xia Li , Ke Wei , Zhouchen Lin

Collaborative object localization aims to collaboratively estimate locations of objects observed from multiple views or perspectives, which is a critical ability for multi-agent systems such as connected vehicles. To enable collaborative…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Peng Gao , Rui Guo , Hongsheng Lu , Hao Zhang

How to learn a discriminative fine-grained representation is a key point in many computer vision applications, such as person re-identification, fine-grained classification, fine-grained image retrieval, etc. Most of the previous methods…

Computer Vision and Pattern Recognition · Computer Science 2019-12-23 Kai Han , Jianyuan Guo , Chao Zhang , Mingjian Zhu

Robotic manipulation in complex open-world scenarios requires both reliable physical manipulation skills and effective and generalizable perception. In this paper, we propose a method where general purpose pretrained visual models serve as…

Robotics · Computer Science 2017-09-27 Coline Devin , Pieter Abbeel , Trevor Darrell , Sergey Levine

Mining precise class-aware attention maps, a.k.a, class activation maps, is essential for weakly supervised semantic segmentation. In this paper, we present L2G, a simple online local-to-global knowledge transfer framework for high-quality…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Peng-Tao Jiang , Yuqi Yang , Qibin Hou , Yunchao Wei

Even though convolutional neural networks (CNNs) are driving progress in medical image segmentation, standard models still have some drawbacks. First, the use of multi-scale approaches, i.e., encoder-decoder architectures, leads to a…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Ashish Sinha , Jose Dolz

Despite the recent advances of deep neural networks, object detection for adverse weather remains challenging due to the poor perception of some sensors in adverse weather. Instead of relying on one single sensor, multimodal fusion has been…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Saket S. Chaturvedi , Lan Zhang , Xiaoyong Yuan