English
Related papers

Related papers: Adaptively Bypassing Vision Transformer Blocks for…

200 papers

Template-matching methods for visual tracking have gained popularity recently due to their good performance and fast speed. However, they lack effective ways to adapt to changes in the target object's appearance, making their tracking…

Computer Vision and Pattern Recognition · Computer Science 2019-12-02 Tianyu Yang , Antoni B. Chan

We introduce A-ViT, a method that adaptively adjusts the inference cost of vision transformer (ViT) for images of different complexity. A-ViT achieves this by automatically reducing the number of tokens in vision transformers that are…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Hongxu Yin , Arash Vahdat , Jose Alvarez , Arun Mallya , Jan Kautz , Pavlo Molchanov

While current Vision Transformer (ViT) adapter methods have shown promising accuracy, their inference speed is implicitly hindered by inefficient memory access operations, e.g., standard normalization and frequent reshaping. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Dong Zhang , Rui Yan , Pingcheng Dong , Kwang-Ting Cheng

Siamese network-based trackers have shown remarkable success in aerial tracking. Most previous works, however, usually perform template matching only between the initial template and the search region and thus fail to deal with rapidly…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Xincong Liu , Tingfa Xu , Ying Wang , Zhinong Yu , Xiaoying Yuan , Haolin Qin , Jianan Li

Multi-object tracking (MOT) is a vital component of intelligent video analytics applications such as surveillance and autonomous driving. The time and storage complexity required to execute deep learning models for visual object tracking…

Computer Vision and Pattern Recognition · Computer Science 2022-10-28 Keivan Nalaie , Rong Zheng

Self-attention and transformers have been widely used in deep learning. Recent efforts have been devoted to incorporating transformer blocks into different neural architectures, including those with convolutions, leading to various visual…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Yancheng Wang , Yingzhen Yang

Being intensively studied, visual object tracking has witnessed great advances in either speed (e.g., with correlation filters) or accuracy (e.g., with deep features). Real-time and high accuracy tracking algorithms, however, remain scarce.…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Heng Fan , Haibin Ling

Vision-language tracking aims to locate the target object in the video sequence using a template patch and a language description provided in the initial frame. To achieve robust tracking, especially in complex long-term scenarios that…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 X. Feng , S. Hu , X. Li , D. Zhang , M. Wu , J. Zhang , X. Chen , K. Huang

Visual token pruning is a promising approach for reducing the computational cost of vision-language models (VLMs), and existing methods often rely on early pruning decisions to improve efficiency. While effective on coarse-grained reasoning…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Chen Qian , Xinran Yu , Danyang Li , Guoxuan Chi , Zheng Yang , Qiang Ma , Xin Miao

The adoption of Vision Transformers (ViTs) in resource-constrained applications necessitates improvements in inference throughput. To this end several token pruning and merging approaches have been proposed that improve efficiency by…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Benjamin Bergner , Christoph Lippert , Aravindh Mahendran

RGBT tracking has been widely used in various fields such as robotics, surveillance processing, and autonomous driving. Existing RGBT trackers fully explore the spatial information between the template and the search region and locate the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-03 Hongyu Wang , Xiaotao Liu , Yifan Li , Meng Sun , Dian Yuan , Jing Liu

Visual object tracking, which is representing a major interest in image processing field, has facilitated numerous real world applications. Among them, equipping unmanned aerial vehicle (UAV) with real time robust visual trackers for all…

Computer Vision and Pattern Recognition · Computer Science 2021-01-26 Bowen Li , Changhong Fu , Fangqiang Ding , Junjie Ye , Fuling Lin

Compared with real-time multi-object tracking (MOT), offline multi-object tracking (OMOT) has the advantages to perform 2D-3D detection fusion, erroneous link correction, and full track optimization but has to deal with the challenges from…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Kemiao Huang , Yinqi Chen , Meiying Zhang , Qi Hao

Previous visual object tracking methods employ image-feature regression models or coordinate autoregression models for bounding box prediction. Image-feature regression methods heavily depend on matching results and do not utilize…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Xinyu Zhou , Jinglun Li , Lingyi Hong , Kaixun Jiang , Pinxue Guo , Weifeng Ge , Wenqiang Zhang

Transformers are transforming the landscape of computer vision, especially for recognition tasks. Detection transformers are the first fully end-to-end learning systems for object detection, while vision transformers are the first fully…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Hwanjun Song , Deqing Sun , Sanghyuk Chun , Varun Jampani , Dongyoon Han , Byeongho Heo , Wonjae Kim , Ming-Hsuan Yang

Vision transformers have demonstrated remarkable success in classification by leveraging global self-attention to capture long-range dependencies. However, this same mechanism can obscure fine-grained spatial details crucial for tasks such…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Sina Hajimiri , Farzad Beizaee , Fereshteh Shakeri , Christian Desrosiers , Ismail Ben Ayed , Jose Dolz

Transformer-based visual trackers have demonstrated significant advancements due to their powerful modeling capabilities. However, their practicality is limited on resource-constrained devices because of their slow processing speeds. To…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Ben Kang , Xin Chen , Jie Zhao , Chunjuan Bo , Dong Wang , Huchuan Lu

Vision Transformer (ViT) models have made breakthroughs in image embedding extraction, which provide state-of-the-art performance in tasks such as zero-shot image classification. However, the models suffer from a high computational burden.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Takahiro Naruko , Hiroaki Akutsu

Prior correlation filter (CF)-based tracking methods for unmanned aerial vehicles (UAVs) have virtually focused on tracking in the daytime. However, when the night falls, the trackers will encounter more harsh scenes, which can easily lead…

Computer Vision and Pattern Recognition · Computer Science 2021-06-07 Bowen Li , Changhong Fu , Fangqiang Ding , Junjie Ye , Fuling Lin

Visual object tracking, which is primarily based on visible light image sequences, encounters numerous challenges in complicated scenarios, such as low light conditions, high dynamic ranges, and background clutter. To address these…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Hongze Sun , Rui Liu , Wuque Cai , Jun Wang , Yue Wang , Huajin Tang , Yan Cui , Dezhong Yao , Daqing Guo