English
Related papers

Related papers: Interlaced Sparse Self-Attention for Semantic Segm…

200 papers

Attention-based graph neural networks have made great progress in feature matching learning. However, insight of how attention mechanism works for feature matching is lacked in the literature. In this paper, we rethink cross- and…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Yuxin Deng , Jiayi Ma

Semantic segmentation empowers numerous real-world applications, such as autonomous driving and augmented/mixed reality. These applications often operate on high-resolution images (e.g., 8 megapixels) to capture the fine details. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Zhijian Liu , Zhuoyang Zhang , Samir Khaki , Shang Yang , Haotian Tang , Chenfeng Xu , Kurt Keutzer , Song Han

Semantic segmentation based on sparse annotation has advanced in recent years. It labels only part of each object in the image, leaving the remainder unlabeled. Most of the existing approaches are time-consuming and often necessitate a…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Hui Su , Yue Ye , Wei Hua , Lechao Cheng , Mingli Song

Transformer-based architectures have become the prevailing backbone of large language models. However, the quadratic time and memory complexity of self-attention remains a fundamental obstacle to efficient long-context modeling. To address…

Computation and Language · Computer Science 2026-02-10 Yutao Sun , Zhenyu Li , Yike Zhang , Tengyu Pan , Bowen Dong , Yuyi Guo , Jianyong Wang

Attention serves as the fundamental mechanism for long-context modeling in large language models (LLMs), yet dense attention becomes structurally prohibitive for long sequences due to its quadratic complexity. Consequently, sparse attention…

Computation and Language · Computer Science 2026-01-07 Junxiang Qiu , Shuo Wang , Zhengsu Chen , Hengheng Zhang , Jinda Lu , Changcheng Li , Qi Tian

The self-attention mechanism has emerged as a critical component for improving the performance of various backbone neural networks. However, current mainstream approaches individually incorporate newly designed self-attention modules (SAMs)…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Zhongzhan Huang , Senwei Liang , Mingfu Liang , Liang Lin

Automotive radar provides reliable environmental perception in all-weather conditions with affordable cost, but it hardly supplies semantic and geometry information due to the sparsity of radar detection points. With the development of…

Computer Vision and Pattern Recognition · Computer Science 2023-02-07 Jianan Liu , Weiyi Xiong , Liping Bai , Yuxuan Xia , Tao Huang , Wanli Ouyang , Bing Zhu

Transformer-based language models have found many diverse applications requiring them to process sequences of increasing length. For these applications, the causal self-attention -- which is the only component scaling quadratically w.r.t.…

Machine Learning · Computer Science 2023-06-05 Matteo Pagliardini , Daniele Paliotta , Martin Jaggi , François Fleuret

Intra-class variations in the open world lead to various challenges in classification tasks. To overcome these challenges, fine-grained classification was introduced, and many approaches were proposed. Some rely on locating and using…

Computer Vision and Pattern Recognition · Computer Science 2023-02-10 Salwa Al Khatib , Mohamed El Amine Boudjoghra , Jameel Hassan

Semantic segmentation consists of predicting a semantic label for each image pixel. While existing deep learning approaches achieve high accuracy, they often overlook the ordinal relationships between classes, which can provide critical…

Computer Vision and Pattern Recognition · Computer Science 2025-02-06 Ricardo P. M. Cruz , Rafael Cristino , Jaime S. Cardoso

Sparse attention reduces the quadratic complexity of full self-attention but faces two challenges: (1) an attention gap, where applying sparse attention to full-attention-trained models causes performance degradation due to train-inference…

Computation and Language · Computer Science 2026-02-02 Zhenyi Shen , Junru Lu , Lin Gui , Jiazheng Li , Yulan He , Di Yin , Xing Sun

In this paper, we apply the attention mechanism to autonomous driving for steering angle prediction. We propose the first model, applying the recently introduced sparse attention mechanism to visual domain, as well as the aggregated…

Computer Vision and Pattern Recognition · Computer Science 2018-03-16 Sen He , Dmitry Kangin , Yang Mi , Nicolas Pugeault

As its core computation, a self-attention mechanism gauges pairwise correlations across the entire input sequence. Despite favorable performance, calculating pairwise correlations is prohibitively costly. While recent work has shown the…

Machine Learning · Computer Science 2022-09-02 Amir Yazdanbakhsh , Ashkan Moradifirouzabadi , Zheng Li , Mingu Kang

In this paper, we propose a dual aggregation network to adaptively aggregate different information in infant brain MRI segmentation. More precisely, we added two modules based on 3D-UNet to better model information at different levels and…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Zhihao Lei , Lin Qi , Ying Wei , Yunlong Zhou

Deep neural networks suffer from the major limitation of catastrophic forgetting old tasks when learning new ones. In this paper we focus on class incremental continual learning in semantic segmentation, where new categories are made…

Computer Vision and Pattern Recognition · Computer Science 2021-11-25 Umberto Michieli , Pietro Zanuttigh

Recent non-local self-attention methods have proven to be effective in capturing long-range dependencies for semantic segmentation. These methods usually form a similarity map of RC*C (by compressing spatial dimensions) or RHW*HW (by…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Qi Song , Jie Li , Chenghong Li , Hao Guo , Rui Huang

Spatial and channel attentions, modelling the semantic interdependencies in spatial and channel dimensions respectively, have recently been widely used for semantic segmentation. However, computing spatial and channel attentions separately…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Ye Huang , Di Kang , Wenjing Jia , Xiangjian He , Liu Liu

We propose SparseContrast, a new framework that merges dynamic sparse attention with contrastive learning for medical imaging, with a focus on chest X-ray disease detection in low-data settings. Traditional contrastive learning methods rely…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Paarth Prasad , Ruchika Malhotra

Sparse Attention is a technique that approximates standard attention computation with sub-quadratic complexity. This is achieved by selectively ignoring smaller entries in the attention matrix during the softmax function computation.…

Machine Learning · Computer Science 2025-02-13 Yichuan Deng , Zhao Song , Jing Xiong , Chiwun Yang

Few-shot segmentation focuses on the generalization of models to segment unseen object with limited annotated samples. However, existing approaches still face two main challenges. First, huge feature distinction between support and query…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Qi Zhao , Binghao Liu , Shuchang Lyu , Huojin Chen