English
Related papers

Related papers: Similarity-Guided Layer-Adaptive Vision Transforme…

200 papers

Visual object tracking is essential to intelligent robots. Most existing approaches have ignored the online latency that can cause severe performance degradation during real-world processing. Especially for unmanned aerial vehicles (UAVs),…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Bowen Li , Ziyuan Huang , Junjie Ye , Yiming Li , Sebastian Scherer , Hang Zhao , Changhong Fu

Vision Transformers (ViTs) have revolutionized computer vision, yet their self-attention mechanism lacks explicit spatial inductive biases, leading to suboptimal performance on spatially-structured tasks. Existing approaches introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Yuxin Mao , Zhen Qin , Jinxing Zhou , Bin Fan , Jing Zhang , Yiran Zhong , Yuchao Dai

This paper addresses the problem of visual target tracking in scenarios where a pursuer may experience intermittent loss of visibility of the target. The design of a Switched Visual Tracker (SVT) is presented which aims to meet the…

Robotics · Computer Science 2024-11-14 Yangge Li , Benjamin C Yang , Sayan Mitra

This work targets to merge various Vision Transformers (ViTs) trained on different tasks (i.e., datasets with different object categories) or domains (i.e., datasets with the same categories but different environments) into one unified…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Peng Ye , Chenyu Huang , Mingzhu Shen , Tao Chen , Yongqi Huang , Yuning Zhang , Wanli Ouyang

Vision Transformers (ViTs) have demonstrated strong capabilities in capturing global dependencies but often struggle to efficiently represent fine-grained local details. Existing multi-scale approaches alleviate this issue by integrating…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Qiyang Yu , Yu Fang , Tianrui Li , Xuemei Cao , Yan Chen , Jianghao Li , Fan Min

Vision transformers (ViTs) have become essential backbones in advanced computer vision applications and multi-modal foundation models. Despite their strengths, ViTs remain vulnerable to adversarial perturbations, comparable to or even…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Bhavna Gopal , Huanrui Yang , Mark Horton , Yiran Chen

Machine learning researchers strive to develop better and better algorithms to solve computer vision problems, such as image classification. In recent years, the classification of micro-Doppler spectrograms has also benefited from these…

Signal Processing · Electrical Eng. & Systems 2025-12-02 Arkadiusz Czuba

The emergence of vision transformers (ViTs) in image classification has shifted the methodologies for visual representation learning. In particular, ViTs learn visual representation at full receptive field per layer across all the image…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Li Zhang , Jiachen Lu , Sixiao Zheng , Xinxuan Zhao , Xiatian Zhu , Yanwei Fu , Tao Xiang , Jianfeng Feng , Philip H. S. Torr

Pretraining Vision Transformers (ViTs) has achieved great success in visual recognition. A following scenario is to adapt a ViT to various image and video recognition tasks. The adaptation is challenging because of heavy computation and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Shoufa Chen , Chongjian Ge , Zhan Tong , Jiangliu Wang , Yibing Song , Jue Wang , Ping Luo

Vision Transformer(ViT) is one of the most widely used models in the computer vision field with its great performance on various tasks. In order to fully utilize the ViT-based architecture in various applications, proper visualization…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Saebom Leem , Hyunseok Seo

Most existing RGB-T tracking networks extract modality features in a separate manner, which lacks interaction and mutual guidance between modalities. This limits the network's ability to adapt to the diverse dual-modality appearances of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Jianqiang Xia , DianXi Shi , Ke Song , Linna Song , XiaoLei Wang , Songchang Jin , Li Zhou , Yu Cheng , Lei Jin , Zheng Zhu , Jianan Li , Gang Wang , Junliang Xing , Jian Zhao

This paper tackles a significant challenge faced by Vision Transformers (ViTs): their constrained scalability across different image resolutions. Typically, ViTs experience a performance decline when processing resolutions different from…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Qihang Fan , Quanzeng You , Xiaotian Han , Yongfei Liu , Yunzhe Tao , Huaibo Huang , Ran He , Hongxia Yang

Relying on Transformer for complex visual feature learning, object tracking has witnessed the new standard for state-of-the-arts (SOTAs). However, this advancement accompanies by larger training data and longer training period, making…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Mingzhe Guo , Zhipeng Zhang , Heng Fan , Liping Jing

Being intensively studied, visual object tracking has witnessed great advances in either speed (e.g., with correlation filters) or accuracy (e.g., with deep features). Real-time and high accuracy tracking algorithms, however, remain scarce.…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Heng Fan , Haibin Ling

Vision Transformer (ViT) has shown high potential in video recognition, owing to its flexible design, adaptable self-attention mechanisms, and the efficacy of masked pre-training. Yet, it remains unclear how to adapt these pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Min Yang , Huan Gao , Ping Guo , Limin Wang

Vision Transformers (ViTs) have become ubiquitous in computer vision. Despite their success, ViTs lack inductive biases, which can make it difficult to train them with limited data. To address this challenge, prior studies suggest training…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Srijan Das , Tanmay Jain , Dominick Reilly , Pranav Balaji , Soumyajit Karmakar , Shyam Marjit , Xiang Li , Abhijit Das , Michael S. Ryoo

Vision transformers (ViT) have demonstrated impressive performance across various machine vision problems. These models are based on multi-head self-attention mechanisms that can flexibly attend to a sequence of image patches to encode…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Muzammal Naseer , Kanchana Ranasinghe , Salman Khan , Munawar Hayat , Fahad Shahbaz Khan , Ming-Hsuan Yang

Visual tracking is adopted to extensive unmanned aerial vehicle (UAV)-related applications, which leads to a highly demanding requirement on the robustness of UAV trackers. However, adding imperceptible perturbations can easily fool the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-04 Changhong Fu , Sihang Li , Xinnan Yuan , Junjie Ye , Ziang Cao , Fangqiang Ding

Vision Transformers (ViTs) have recently garnered considerable attention, emerging as a promising alternative to convolutional neural networks (CNNs) in several vision-related applications. However, their large model sizes and high…

Machine Learning · Computer Science 2024-05-02 Dayou Du , Gu Gong , Xiaowen Chu

Recent Transformer-based visual tracking models have showcased superior performance. Nevertheless, prior works have been resource-intensive, requiring prolonged GPU training hours and incurring high GFLOPs during inference due to…

Computer Vision and Pattern Recognition · Computer Science 2023-09-07 Qingmao Wei , Guotian Zeng , Bi Zeng