English
Related papers

Related papers: Self-Supervised Multi-Scale Transformer with Atten…

200 papers

Scene segmentation in images is a fundamental yet challenging problem in visual content understanding, which is to learn a model to assign every image pixel to a categorical label. One of the challenges for this learning task is to consider…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Litao Yu , Zhibin Li , Jian Zhang , Qiang Wu

Transformers have recently gained attention in the computer vision domain due to their ability to model long-range dependencies. However, the self-attention mechanism, which is the core part of the Transformer model, usually suffers from…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Reza Azad , René Arimond , Ehsan Khodapanah Aghdam , Amirhossein Kazerouni , Dorit Merhof

Urinary bladder cancer surveillance requires tracking tumor sites across repeated interventions, yet the deformable and hollow bladder lacks stable landmarks for orientation. While blood vessels visible during endoscopy offer a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Franziska Krauß , Matthias Ege , Zoltan Lovasz , Albrecht Bartz-Schmidt , Igor Tsaur , Oliver Sawodny , Carina Veil

The accurate segmentation of medical images is crucial for diagnosing and treating diseases. Recent studies demonstrate that vision transformer-based methods have significantly improved performance in medical image segmentation, primarily…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Wentao Wang , Xi Xiao , Mingjie Liu , Qing Tian , Xuanyao Huang , Qizhen Lan , Swalpa Kumar Roy , Tianyang Wang

We introduce Attention Free Transformer (AFT), an efficient variant of Transformers that eliminates the need for dot product self attention. In an AFT layer, the key and value are first combined with a set of learned position biases, the…

Machine Learning · Computer Science 2021-09-23 Shuangfei Zhai , Walter Talbott , Nitish Srivastava , Chen Huang , Hanlin Goh , Ruixiang Zhang , Josh Susskind

While the Transformer architecture has become ubiquitous in the machine learning field, its adaptation to 3D shape recognition is non-trivial. Due to its quadratic computational complexity, the self-attention operator quickly becomes…

Computer Vision and Pattern Recognition · Computer Science 2022-04-11 Axel Berg , Magnus Oskarsson , Mark O'Connor

We consider the problem of omni-supervised object detection, which can use unlabeled, fully labeled and weakly labeled annotations, such as image tags, counts, points, etc., for object detection. This is enabled by a unified architecture,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Pei Wang , Zhaowei Cai , Hao Yang , Gurumurthy Swaminathan , Nuno Vasconcelos , Bernt Schiele , Stefano Soatto

Supervised and semi-supervised semantic segmentation algorithms require significant amount of annotated data to achieve a good performance. In many situations, the data is either not available or the annotation is expensive. The objective…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Ram Krishna Pandey , Akshit Achara

Detecting road features is a key enabler for autonomous driving and localization. For instance, a reliable detection of poles which are widespread in road environments can improve localization. Modern deep learning-based perception systems…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Maxime Noizet , Philippe Xu , Philippe Bonnifait

Correlation acts as a critical role in the tracking field, especially in recent popular Siamese-based trackers. The correlation operation is a simple fusion manner to consider the similarity between the template and the search region.…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Xin Chen , Bin Yan , Jiawen Zhu , Dong Wang , Xiaoyun Yang , Huchuan Lu

CLIP exhibits strong visual-textual alignment but struggle with open-vocabulary segmentation due to poor localization. Prior methods enhance spatial coherence by modifying intermediate attention. But, this coherence isn't consistently…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Zhixiang Chi , Yanan Wu , Li Gu , Huan Liu , Ziqiang Wang , Yang Zhang , Yang Wang , Konstantinos N. Plataniotis

Convolutional blocks have played a crucial role in advancing medical image segmentation by excelling in dense prediction tasks. However, their inability to effectively capture long-range dependencies has limited their performance.…

Image and Video Processing · Electrical Eng. & Systems 2026-03-17 Siddhartha Mallick , Aayushman Ghosh , Jayanta Paul , Jaya Sil

Most of the current salient object detection approaches use deeper networks with large backbones to produce more accurate predictions, which results in a significant increase in computational complexity. A great number of network designs…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Yijie Li , Hewei Wang , Aggelos Katsaggelos

Recent advances in autonomous driving (AD) have highlighted the potential of hyperspectral imaging (HSI) for enhanced environmental perception, particularly in challenging weather and lighting conditions. However, efficiently processing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Imad Ali Shah , Jiarong Li , Tim Brophy , Martin Glavin , Edward Jones , Enda Ward , Brian Deegan

Neural networks for visual content understanding have recently evolved from convolutional ones (CNNs) to transformers. The prior (CNN) relies on small-windowed kernels to capture the regional clues, demonstrating solid local expressiveness.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Zixuan Su , Hao Zhang , Jingjing Chen , Lei Pang , Chong-Wah Ngo , Yu-Gang Jiang

Point cloud segmentation, which helps us understand the environment of specific structures and objects, can be performed in class-specific and class-agnostic ways. We propose a novel region-based transformer model called Region-Transformer…

Computer Vision and Pattern Recognition · Computer Science 2024-03-07 Dipesh Gyawali , Jian Zhang , BB Karki

Dense semantic segmentation is essential for autonomous driving, yet many multi-modal datasets lack pixel-level annotations. The Zenseact Open Dataset (ZOD) provides rich multi-sensor data but only bounding-box labels, limiting its use for…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Toomas Tahves , Mauro Bellone , Junyi Gu , Raivo Sell

The paradigm of Transformers using the self-attention mechanism has manifested its advantage in learning graph-structured data. Yet, Graph Transformers are capable of modeling full range dependencies but are often deficient in extracting…

Machine Learning · Computer Science 2024-09-11 Minhong Zhu , Zhenhao Zhao , Weiran Cai

While image segmentation is crucial in various computer vision applications, such as autonomous driving, grasping, and robot navigation, annotating all objects at the pixel-level for training is nearly impossible. Therefore, the study of…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Cuong Manh Hoang , Byeongkeun Kang

Automated pavement crack detection is a challenging task that has been researched for decades due to the complicated pavement conditions in real world. In this paper, a supervised method based on deep learning is proposed, which has the…

Computer Vision and Pattern Recognition · Computer Science 2018-02-08 Zhun Fan , Yuming Wu , Jiewei Lu , Wenji Li