English
Related papers

Related papers: NomMer: Nominate Synergistic Context in Vision Tra…

200 papers

Visual place recognition is a challenging task in the field of computer vision, and autonomous robotics and vehicles, which aims to identify a location or a place from visual inputs. Contemporary methods in visual place recognition employ…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Shyam Sundar Kannan , Byung-Cheol Min

Vision Transformers (ViTs) have achieved comparable or superior performance than Convolutional Neural Networks (CNNs) in computer vision. This empirical breakthrough is even more remarkable since, in contrast to CNNs, ViTs do not embed any…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Samy Jelassi , Michael E. Sander , Yuanzhi Li

Vision Transformers have shown great promise recently for many vision tasks due to the insightful architecture design and attention mechanism. By revisiting the self-attention responses in Transformers, we empirically observe two…

Computer Vision and Pattern Recognition · Computer Science 2022-12-27 Xu Ma , Huan Wang , Can Qin , Kunpeng Li , Xingchen Zhao , Jie Fu , Yun Fu

We consider the problem of naming objects in complex, natural scenes containing widely varying object appearance and subtly different names. Informed by cognitive research, we propose an approach based on sharing context based object…

Computer Vision and Pattern Recognition · Computer Science 2013-09-17 Ishani Chakraborty , Ahmed Elgammal

Side-scan sonar (SSS) imagery presents unique challenges in the classification of man-made objects on the seafloor due to the complex and varied underwater environments. Historically, experts have manually interpreted SSS images, relying on…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 BW Sheffield , Jeffrey Ellen , Ben Whitmore

The success of Vision Transformer (ViT) has been widely reported on a wide range of image recognition tasks. ViT can learn global dependencies superior to CNN, yet CNN's inherent locality can substitute for expensive training resources.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Chenghao Li , Chaoning Zhang

Recent state-of-the-art performances of Vision Transformers (ViT) in computer vision tasks demonstrate that a general-purpose architecture, which implements long-range self-attention, could replace the local feature learning operations of…

Vision transformer has achieved impressive performance for many vision tasks. However, it may suffer from high redundancy in capturing local features for shallow layers. Local self-attention or early-stage convolutions are thus utilized,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-26 Huaibo Huang , Xiaoqiang Zhou , Jie Cao , Ran He , Tieniu Tan

Accurate classification of celestial objects is essential for advancing our understanding of the universe. MargNet is a recently developed deep learning-based classifier applied to SDSS DR16 dataset to segregate stars, quasars, and compact…

Instrumentation and Methods for Astrophysics · Physics 2024-08-29 Srinadh Reddy Bhavanam , Sumohana S. Channappayya , P. K. Srijith , Shantanu Desai

Recent advances on Vision Transformer (ViT) and its improved variants have shown that self-attention-based networks surpass traditional Convolutional Neural Networks (CNNs) in most vision tasks. However, existing ViTs focus on the standard…

Computer Vision and Pattern Recognition · Computer Science 2022-05-24 Xiaofeng Mao , Gege Qi , Yuefeng Chen , Xiaodan Li , Ranjie Duan , Shaokai Ye , Yuan He , Hui Xue

Fine-grained visual classification (FGVC) is a challenging computer vision problem, where the task is to automatically recognise objects from subordinate categories. One of its main difficulties is capturing the most discriminative…

Computer Vision and Pattern Recognition · Computer Science 2024-01-03 Dmitry Demidov , Muhammad Hamza Sharif , Aliakbar Abdurahimov , Hisham Cholakkal , Fahad Shahbaz Khan

Vision transformers (ViTs) have been successfully applied in image classification tasks recently. In this paper, we show that, unlike convolution neural networks (CNNs)that can be improved by stacking more convolutional layers, the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Daquan Zhou , Bingyi Kang , Xiaojie Jin , Linjie Yang , Xiaochen Lian , Zihang Jiang , Qibin Hou , Jiashi Feng

Transformers have recently demonstrated strong performance in computer vision, with Vision Transformers (ViTs) leveraging self-attention to capture both low-level and high-level image features. However, standard ViTs remain computationally…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Ali El Bellaj , Mohammed-Amine Cheddadi , Rhassan Berber

We explore the task of language-guided video segmentation (LVS). Previous algorithms mostly adopt 3D CNNs to learn video representation, struggling to capture long-term context and easily suffering from visual-linguistic misalignment. In…

Computer Vision and Pattern Recognition · Computer Science 2024-01-22 Chen Liang , Wenguan Wang , Tianfei Zhou , Jiaxu Miao , Yawei Luo , Yi Yang

Vision Transformers (ViTs) have demonstrated strong potential in medical imaging; however, their high computational demands and tendency to overfit on small datasets limit their applicability in real-world clinical scenarios. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Aon Safdar , Mohamed Saadeldin

Vision Transformers (ViTs) have redefined image classification by leveraging self-attention to capture complex patterns and long-range dependencies between image patches. However, a key challenge for ViTs is efficiently incorporating…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Shravan Venkatraman , Jaskaran Singh Walia , Joe Dhanith P R

Vision Transformers (ViTs) have attracted a lot of popularity in recent years, due to their exceptional capabilities in modeling long-range spatial dependencies and scalability for large scale training. Although the training parallelism of…

Computer Vision and Pattern Recognition · Computer Science 2024-01-29 Ali Hatamizadeh , Michael Ranzinger , Shiyi Lan , Jose M. Alvarez , Sanja Fidler , Jan Kautz

Convolutional Neural Networks (CNNs) for computer vision sometimes struggle with understanding images in a global context, as they mainly focus on local patterns. On the other hand, Vision Transformers (ViTs), inspired by models originally…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Dimitrios N. Vlachogiannis , Dimitrios A. Koutsomitropoulos

Vision Transformers (ViT) have emerged as the de-facto choice for numerous industry grade vision solutions. But their inference cost can be prohibitive for many settings, as they compute self-attention in each layer which suffers from…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Rajat Koner , Gagan Jain , Prateek Jain , Volker Tresp , Sujoy Paul

Remote sensing datasets offer significant promise for tackling key classification tasks such as land-use categorization, object presence detection, and rural/urban classification. However, many existing studies tend to focus on narrow tasks…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Gautam Siddharth Kashyap , Manaswi Kulahara , Nipun Joshi , Usman Naseem