English
Related papers

Related papers: DMTrack: Spatio-Temporal Multimodal Tracking via D…

200 papers

Multi-modal object tracking has attracted considerable attention by integrating multiple complementary inputs (e.g., thermal, depth, and event data) to achieve outstanding performance. Although current general-purpose multi-modal trackers…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Qihua Liang , Liang Chen , Yaozong Zheng , Jian Nong , Zhiyi Mo , Bineng Zhong

Most existing multimodal trackers adopt uniform fusion strategies, overlooking the inherent differences between modalities. Moreover, they propagate temporal information through mixed tokens, leading to entangled and less discriminative…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Shilei Wang , Pujian Lai , Dong Gao , Jifeng Ning , Gong Cheng

Due to the limited availability of paired multi-modal data, multi-modal trackers are typically built by adopting pre-trained RGB models with parameter-efficient fine-tuning modules. However, these fine-tuning methods overlook advanced…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 He Wang , Tianyang Xu , Zhangyong Tang , Xiao-Jun Wu , Josef Kittler

Multimodal tracking has garnered widespread attention as a result of its ability to effectively address the inherent limitations of traditional RGB tracking. However, existing multimodal trackers mainly focus on the fusion and enhancement…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Xiantao Hu , Ying Tai , Xu Zhao , Chen Zhao , Zhenyu Zhang , Jun Li , Bineng Zhong , Jian Yang

Recently, many multi-modal trackers prioritize RGB as the dominant modality, treating other modalities as auxiliary, and fine-tuning separately various multi-modal tasks. This imbalance in modality dependence limits the ability of methods…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Xiantao Hu , Bineng Zhong , Qihua Liang , Zhiyi Mo , Liangtao Shi , Ying Tai , Jian Yang

Multimodal Visual Object Tracking (VOT) has recently gained significant attention due to its robustness. Early research focused on fully fine-tuning RGB-based trackers, which was inefficient and lacked generalized representation due to the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Xiaojun Hou , Jiazheng Xing , Yijie Qian , Yaowei Guo , Shuo Xin , Junhao Chen , Kai Tang , Mengmeng Wang , Zhengkai Jiang , Liang Liu , Yong Liu

Parameter-efficient fine-tuning (PEFT) in multimodal tracking reveals a concerning trend where recent performance gains are often achieved at the cost of inflated parameter budgets, which fundamentally erodes PEFT's efficiency promise. In…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Junbin Su , Ziteng Xue , Shihui Zhang , Kun Chen , Weiming Hu , Zhipeng Zhang

Multi-object tracking (MOT) from unmanned aerial vehicles (UAVs) presents unique challenges due to unpredictable object motion, frequent occlusions, and limited appearance cues inherent to aerial viewpoints. These issues are further…

Systems and Control · Electrical Eng. & Systems 2025-10-22 Zenghuang Fu , Xiaofeng Han , Mingda Jia , Jin ming Yang , Qi Zeng , Muyang Zahng , Changwei Wang , Weiliang Meng , Xiaopeng Zhang

RGBT tracking has been widely used in various fields such as robotics, surveillance processing, and autonomous driving. Existing RGBT trackers fully explore the spatial information between the template and the search region and locate the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-03 Hongyu Wang , Xiaotao Liu , Yifan Li , Meng Sun , Dian Yuan , Jing Liu

Multimodal remote sensing object detection aims to achieve more accurate and robust perception under challenging conditions by fusing complementary information from different modalities. However, existing approaches that rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Jianhong Han , Yupei Wang , Yuan Zhang , Liang Chen

Multi-modal tracking gains attention due to its ability to be more accurate and robust in complex scenarios compared to traditional RGB-based tracking. Its key lies in how to fuse multi-modal data and reduce the gap between modalities.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Jinyu Yang , Zhe Li , Feng Zheng , Aleš Leonardis , Jingkuan Song

Multi-modal tracking is essential in single-object tracking (SOT), as different sensor types contribute unique capabilities to overcome challenges caused by variations in object appearance. However, existing unified RGB-X trackers (X…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 He Wang , Tianyang Xu , Zhangyong Tang , Xiao-Jun Wu , Josef Kittler

Parameter-efficient fine-tuning (PEFT) techniques, such as prompts and adapters, are widely used in multi-modal tracking because they alleviate issues of full-model fine-tuning, including time inefficiency, high resource consumption,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yabin Zhu , Jianqi Li , Chenglong Li , Jiaxiang Wang , Chengjie Gu , Jin Tang

With the advent of Transformer-based one-stream trackers that possess strong capability in inter-frame relation modeling, recent research has increasingly focused on how to introduce spatio-temporal context. However, most existing methods…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Wenrui Cai , Zhenyi Lu , Yuzhe Li , Yongchao Feng , Jinqing Zhang , Qingjie Liu , Yunhong Wang

Effectively modeling and utilizing spatiotemporal features from RGB and other modalities (\eg, depth, thermal, and event data, denoted as X) is the core of RGB-X tracker design. Existing methods often employ two parallel branches to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 X. Feng , D. Zhang , S. Hu , X. Li , M. Wu , J. Zhang , X. Chen , K. Huang

Existing nighttime aerial trackers based on prompt learning rely solely on spatial localization supervision, which fails to provide fine-grained cues that point to target features and inevitably produces vague prompts. This limitation…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Zhiqiang Zhu , Xinbo Gao , Wen Lu , Jie Li , Zhaoyang Wang , Mingqian Ge

Prompt-learning-based multi-modal trackers have made strong progress by using lightweight visual adapters to inject auxiliary-modality cues into frozen foundation models. However, they still underutilize two essentials: modality-specific…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Boyue Xu , Ruichao Hou , Tongwei Ren , Dongming zhou , Gangshan Wu , Jinde Cao

Recent advances in transformer-based lightweight object tracking have established new standards across benchmarks, leveraging the global receptive field and powerful feature extraction capabilities of attention mechanisms. Despite these…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Junze Shi , Yang Yu , Jian Shi , Haibo Luo

Multimodal data is known to be helpful for visual tracking by improving robustness to appearance variations. However, sensor synchronization challenges often compromise data availability, particularly in video settings where shortages can…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Yuedong Tan , Jiawei Shao , Eduard Zamfir , Ruanjun Li , Zhaochong An , Chao Ma , Danda Paudel , Luc Van Gool , Radu Timofte , Zongwei Wu

Many state-of-the-art RGB-T trackers have achieved remarkable results through modality fusion. However, these trackers often either overlook temporal information or fail to fully utilize it, resulting in an ineffective balance between…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Zhirong Zeng , Xiaotao Liu , Meng Sun , Hongyu Wang , Jing Liu
‹ Prev 1 2 3 10 Next ›