English
Related papers

Related papers: Temporal Adaptive RGBT Tracking with Modality Prom…

200 papers

Efficiently modeling spatio-temporal relations of objects is a key challenge in visual object tracking (VOT). Existing methods track by appearance-based similarity or long-term relation modeling, resulting in rich temporal contexts between…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Yushan Han , Kaer Huang

Existing multi-modal object tracking approaches primarily focus on dual-modal paradigms, such as RGB-Depth or RGB-Thermal, yet remain challenged in complex scenarios due to limited input modalities. To address this gap, this work introduces…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Xue-Feng Zhu , Tianyang Xu , Yifan Pan , Jinjie Gu , Xi Li , Jiwen Lu , Xiao-Jun Wu , Josef Kittler

We propose a universal video-level modality-awareness tracking model with online dense temporal token learning (called {\modaltracker}). It is designed to support various tracking tasks, including RGB, RGB+Thermal, RGB+Depth, and RGB+Event,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Yaozong Zheng , Bineng Zhong , Qihua Liang , Shengping Zhang , Guorong Li , Xianxian Li , Rongrong Ji

Multi-Camera Multi-Object Tracking (MC-MOT) utilizes information from multiple views to better handle problems with occlusion and crowded scenes. Recently, the use of graph-based approaches to solve tracking problems has become very…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Cheng-Che Cheng , Min-Xuan Qiu , Chen-Kuo Chiang , Shang-Hong Lai

RGB and thermal source data suffer from both shared and specific challenges, and how to explore and exploit them plays a critical role to represent the target appearance in RGBT tracking. In this paper, we propose a novel challenge-aware…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Chenglong Li , Lei Liu , Andong Lu , Qing Ji , Jin Tang

Robust object tracking requires knowledge of tracked objects' appearance, motion and their evolution over time. Although motion provides distinctive and complementary information especially for fast moving objects, most of the recent…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Hasan Saribas , Hakan Cevikalp , Okan Köpüklü , Bedirhan Uzun

Existing Transformer-based RGBT tracking methods either use cross-attention to fuse the two modalities, or use self-attention and cross-attention to model both modality-specific and modality-sharing information. However, the significant…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Yabin Zhu , Chenglong Li , Xiao Wang , Jin Tang , Zhixiang Huang

How to effectively exploit spatio-temporal information is crucial to capture target appearance changes in visual tracking. However, most deep learning-based trackers mainly focus on designing a complicated appearance model or template…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Liangtao Shi , Bineng Zhong , Qihua Liang , Ning Li , Shengping Zhang , Xianxian Li

In this paper, we explore adapter tuning and introduce a novel dual-adapter architecture for spatio-temporal multimodal tracking, dubbed DMTrack. The key of our DMTrack lies in two simple yet effective modules, including a spatio-temporal…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Weihong Li , Shaohua Dong , Haonan Lu , Yanhao Zhang , Heng Fan , Libo Zhang

Current RGBT tracking research relies on the complete multi-modal input, but modal information might miss due to some factors such as thermal sensor self-calibration and data transmission error, called modality-missing challenge in this…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Andong Lu , Jiacong Zhao , Chenglong Li , Jin Tang , Bin Luo

Boosting performance of the offline trained siamese trackers is getting harder nowadays since the fixed information of the template cropped from the first frame has been almost thoroughly mined, but they are poorly capable of resisting…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Zhihong Fu , Qingjie Liu , Zehua Fu , Yunhong Wang

Sparse representation has been widely studied in visual tracking, which has shown promising tracking performance. Despite a lot of progress, the visual tracking problem is still a challenging task due to appearance variations over time. In…

Computer Vision and Pattern Recognition · Computer Science 2016-05-03 Xue Yang , Fei Han , Hua Wang , Hao Zhang

Recent advances in transformer-based lightweight object tracking have established new standards across benchmarks, leveraging the global receptive field and powerful feature extraction capabilities of attention mechanisms. Despite these…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Junze Shi , Yang Yu , Jian Shi , Haibo Luo

The current popular two-stream, two-stage tracking framework extracts the template and the search region features separately and then performs relation modeling, thus the extracted features lack the awareness of the target and have limited…

Computer Vision and Pattern Recognition · Computer Science 2022-12-21 Botao Ye , Hong Chang , Bingpeng Ma , Shiguang Shan , Xilin Chen

Temporal information is crucial for visual tracking, but existing multi-frame trackers are vulnerable to model drift caused by naively aggregating noisy historical predictions. In this paper, we introduce DTPTrack, a lightweight and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Yuqing Huang , Liting Lin , Weijun Zhuang , Zhenyu He , Xin Li

Siamese network-based trackers have shown remarkable success in aerial tracking. Most previous works, however, usually perform template matching only between the initial template and the search region and thus fail to deal with rapidly…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Xincong Liu , Tingfa Xu , Ying Wang , Zhinong Yu , Xiaoying Yuan , Haolin Qin , Jianan Li

Multi-modal tracking is essential in single-object tracking (SOT), as different sensor types contribute unique capabilities to overcome challenges caused by variations in object appearance. However, existing unified RGB-X trackers (X…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 He Wang , Tianyang Xu , Zhangyong Tang , Xiao-Jun Wu , Josef Kittler

More powerful feature representations derived from deep neural networks benefit visual tracking algorithms widely. However, the lack of exploitation on temporal information prevents tracking algorithms from adapting to appearances changing…

Computer Vision and Pattern Recognition · Computer Science 2019-08-05 Tao Hu , Lichao Huang , Xianming Liu , Han Shen

Cross-modal object tracking (CMOT) is an emerging task that maintains target consistency while the video stream switches between different modalities, with only one modality available in each frame, mostly focusing on RGB-Near Infrared…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Boyue Xu , Ruichao Hou , Tongwei Ren , Dongming Zhou , Gangshan Wu , Jinde Cao

The ability to learn robust multi-modality representation has played a critical role in the development of RGBT tracking. However, the regular fusion paradigm and the invariable tracking template remain restrictive to the feature…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Ruichao Hou , Boyue Xu , Tongwei Ren , Gangshan Wu