English
Related papers

Related papers: Exploring Lightweight Hierarchical Vision Transfor…

200 papers

Recent advances in transformer-based lightweight object tracking have established new standards across benchmarks, leveraging the global receptive field and powerful feature extraction capabilities of attention mechanisms. Despite these…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Junze Shi , Yang Yu , Jian Shi , Haibo Luo

3D single object tracking plays an essential role in many applications, such as autonomous driving. It remains a challenging problem due to the large appearance variation and the sparsity of points caused by occlusion and limited sensor…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Tian-Xing Xu , Yuan-Chen Guo , Yu-Kun Lai , Song-Hai Zhang

We present Multiscale Vision Transformers (MViT) for video and image recognition, by connecting the seminal idea of multiscale feature hierarchies with transformer models. Multiscale Transformers have several channel-resolution scale…

Computer Vision and Pattern Recognition · Computer Science 2021-04-23 Haoqi Fan , Bo Xiong , Karttikeya Mangalam , Yanghao Li , Zhicheng Yan , Jitendra Malik , Christoph Feichtenhofer

Vision Transformers (ViT) have shown rapid progress in computer vision tasks, achieving promising results on various benchmarks. However, due to the massive number of parameters and model design, \textit{e.g.}, attention mechanism,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Yanyu Li , Geng Yuan , Yang Wen , Ju Hu , Georgios Evangelidis , Sergey Tulyakov , Yanzhi Wang , Jian Ren

The Vision Transformer (ViT) has demonstrated state-of-the-art performance in various computer vision tasks, but its high computational demands make it impractical for edge devices with limited resources. This paper presents MicroViT, a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Novendra Setyawan , Chi-Chia Sun , Mao-Hsiu Hsu , Wen-Kai Kuo , Jun-Wei Hsieh

Vision Transformers (ViTs) have recently become the state-of-the-art across many computer vision tasks. In contrast to convolutional networks (CNNs), ViTs enable global information sharing even within shallow layers of a network, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Jongwoo Park , Kumara Kahatapitiya , Donghyun Kim , Shivchander Sudalairaj , Quanfu Fan , Michael S. Ryoo

Vision transformers (ViTs) have emerged as a popular backbone for visual tracking. However, complete ViT architectures are too cumbersome to deploy for unmanned aerial vehicle (UAV) tracking which extremely emphasizes efficiency. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Chaocan Xue , Bineng Zhong , Qihua Liang , Yaozong Zheng , Ning Li , Yuanliang Xue , Shuxiang Song

Obstacle detection and tracking represent a critical component in robot autonomous navigation. In this paper, we propose ODTFormer, a Transformer-based model to address both obstacle detection and tracking problems. For the detection task,…

Robotics · Computer Science 2024-10-28 Tianye Ding , Hongyu Li , Huaizu Jiang

Transformer architecture has been showing its great strength in visual object tracking, for its effective attention mechanism. Existing transformer-based approaches adopt the pixel-to-pixel attention strategy on flattened image features and…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Zikai Song , Junqing Yu , Yi-Ping Phoebe Chen , Wei Yang

The goal of multi-object tracking (MOT) is detecting and tracking all the objects in a scene, while keeping a unique identifier for each object. In this paper, we present a new robust state-of-the-art tracker, which can combine the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-08 Nir Aharon , Roy Orfaig , Ben-Zion Bobrovsky

Transformer trackers have achieved impressive advancements recently, where the attention mechanism plays an important role. However, the independent correlation computation in the attention mechanism could result in noisy and ambiguous…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Shenyuan Gao , Chunluan Zhou , Chao Ma , Xinggang Wang , Junsong Yuan

Due to the challenges of processing temporal information, most trackers depend solely on visual discriminability and overlook the unique temporal coherence of video data. In this paper, we propose a lightweight and plug-and-play motion…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Jie Zhao , Xin Chen , Yongsheng Yuan , Michael Felsberg , Dong Wang , Huchuan Lu

Vision Transformers (ViTs) have established new performance benchmarks in vision tasks such as image recognition and object detection. However, these advancements come with significant demands for memory and computational resources,…

Hardware Architecture · Computer Science 2026-02-10 Cong Wang , Zexin Fu , Jiayi Huang , Shanshi Huang

Template-based discriminative trackers are currently the dominant tracking methods due to their robustness and accuracy, and the Siamese-network-based methods that depend on cross-correlation operation between features extracted from…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 Moju Zhao , Kei Okada , Masayuki Inaba

Visual object tracking performance has been dramatically improved in recent years, but some severe challenges remain open, like distractors and occlusions. We suspect the reason is that the feature representations of the tracking targets…

Computer Vision and Pattern Recognition · Computer Science 2021-10-29 Mengmeng Wang , Xiaoqian Yang , Yong Liu

Recently, the transformer has enabled the speed-oriented trackers to approach state-of-the-art (SOTA) performance with high-speed thanks to the smaller input size or the lighter feature extraction backbone, though they still substantially…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Yutong Kou , Jin Gao , Bing Li , Gang Wang , Weiming Hu , Yizheng Wang , Liang Li

Object tracking is an important functionality of edge video analytic systems and services. Multi-object tracking (MOT) detects the moving objects and tracks their locations frame by frame as real scenes are being captured into a video.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-07 Sanjana Vijay Ganesh , Yanzhao Wu , Gaowen Liu , Ramana Kompella , Ling Liu

Recently, vision transformers (ViTs) have superseded convolutional neural networks in numerous applications, including classification, detection, and segmentation. However, the high computational requirements of ViTs hinder their widespread…

Computer Vision and Pattern Recognition · Computer Science 2024-05-20 Jemin Lee , Yongin Kwon , Sihyeong Park , Misun Yu , Jeman Park , Hwanjun Song

Hierarchical structures are popular in recent vision transformers, however, they require sophisticated designs and massive datasets to work well. In this paper, we explore the idea of nesting basic local transformers on non-overlapping…

Computer Vision and Pattern Recognition · Computer Science 2022-01-03 Zizhao Zhang , Han Zhang , Long Zhao , Ting Chen , Sercan O. Arik , Tomas Pfister

We explore the application of Vision Transformer (ViT) for handwritten text recognition. The limited availability of labeled data in this domain poses challenges for achieving high performance solely relying on ViT. Previous…

Computer Vision and Pattern Recognition · Computer Science 2024-09-16 Yuting Li , Dexiong Chen , Tinglong Tang , Xi Shen