English
Related papers

Related papers: Adaptive Perception for Unified Visual Multi-modal…

200 papers

Due to the limited availability of paired multi-modal data, multi-modal trackers are typically built by adopting pre-trained RGB models with parameter-efficient fine-tuning modules. However, these fine-tuning methods overlook advanced…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 He Wang , Tianyang Xu , Zhangyong Tang , Xiao-Jun Wu , Josef Kittler

Multi-modal tracking is essential in single-object tracking (SOT), as different sensor types contribute unique capabilities to overcome challenges caused by variations in object appearance. However, existing unified RGB-X trackers (X…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 He Wang , Tianyang Xu , Zhangyong Tang , Xiao-Jun Wu , Josef Kittler

Transformer-based models have improved visual tracking, but most still cannot run in real time on resource-limited devices, especially for unmanned aerial vehicle (UAV) tracking. To achieve a better balance between performance and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 You Wu , Yongxin Li , Mengyuan Liu , Xucheng Wang , Xiangyang Yang , Hengzhou Ye , Dan Zeng , Qijun Zhao , Shuiwang Li

Most existing multimodal trackers adopt uniform fusion strategies, overlooking the inherent differences between modalities. Moreover, they propagate temporal information through mixed tokens, leading to entangled and less discriminative…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Shilei Wang , Pujian Lai , Dong Gao , Jifeng Ning , Gong Cheng

Multi-modal tracking gains attention due to its ability to be more accurate and robust in complex scenarios compared to traditional RGB-based tracking. Its key lies in how to fuse multi-modal data and reduce the gap between modalities.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Jinyu Yang , Zhe Li , Feng Zheng , Aleš Leonardis , Jingkuan Song

Research in Anti-UAV (Unmanned Aerial Vehicle) tracking has explored various modalities, including RGB, TIR, and RGB-T fusion. However, a unified framework for cross-modal collaboration is still lacking. Existing approaches have primarily…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Qionglin Ren , Dawei Zhang , Chunxu Tian , Dan Zhang

With growing real-world demands, efficient tracking has received increasing attention. However, most existing methods are limited to RGB inputs and struggle in multi-modal scenarios. Moreover, current multi-modal tracking approaches…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Ben Kang , Jie Zhao , Xin Chen , Wanting Geng , Bin Zhang , Lu Zhang , Dong Wang , Huchuan Lu

Empowered by transformer-based models, visual tracking has advanced significantly. However, the slow speed of current trackers limits their applicability on devices with constrained computational resources. To address this challenge, we…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Xiangyang Yang , Dan Zeng , Xucheng Wang , You Wu , Hengzhou Ye , Qijun Zhao , Shuiwang Li

Due to the rapid development of computer vision, single-modal (RGB) object tracking has made significant progress in recent years. Considering the limitation of single imaging sensor, multi-modal images (RGB, Infrared, etc.) are introduced…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Bing Cao , Junliang Guo , Pengfei Zhu , Qinghua Hu

In the realm of video object tracking, auxiliary modalities such as depth, thermal, or event data have emerged as valuable assets to complement the RGB trackers. In practice, most existing RGB trackers learn a single set of parameters to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Zongwei Wu , Jilai Zheng , Xiangxuan Ren , Florin-Alexandru Vasluianu , Chao Ma , Danda Pani Paudel , Luc Van Gool , Radu Timofte

Multimodal sensing has proven valuable for visual tracking, as different sensor types offer unique strengths in handling one specific challenging scene where object appearance varies. While a generalist model capable of leveraging all…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Yuedong Tan , Zongwei Wu , Yuqian Fu , Zhuyun Zhou , Guolei Sun , Eduard Zamfi , Chao Ma , Danda Pani Paudel , Luc Van Gool , Radu Timofte

One-stream Transformer-based trackers achieve advanced performance in visual object tracking but suffer from significant computational overhead that hinders real-time deployment. While token pruning offers a path to efficiency, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Hao Wu , Xudong Wang , Jialiang Zhang , Junlong Tong , Xinghao Chen , Junyan Lin , Yunpu Ma , Xiaoyu Shen

Multi-modal object tracking has attracted considerable attention by integrating multiple complementary inputs (e.g., thermal, depth, and event data) to achieve outstanding performance. Although current general-purpose multi-modal trackers…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Qihua Liang , Liang Chen , Yaozong Zheng , Jian Nong , Zhiyi Mo , Bineng Zhong

Multimodal visual object tracking can be divided into to several kinds of tasks (e.g. RGB and RGB+X tracking), based on the input modality. Existing methods often train separate models for each modality or rely on pretrained models to adapt…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Lingyi Hong , Jinglun Li , Xinyu Zhou , Kaixun Jiang , Pinxue Guo , Zhaoyu Chen , Runze Li , Xingdong Sheng , Wenqiang Zhang

Parameter-efficient fine-tuning (PEFT) in multimodal tracking reveals a concerning trend where recent performance gains are often achieved at the cost of inflated parameter budgets, which fundamentally erodes PEFT's efficiency promise. In…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Junbin Su , Ziteng Xue , Shihui Zhang , Kun Chen , Weiming Hu , Zhipeng Zhang

The task of RGBT tracking aims to take the complementary advantages from visible spectrum and thermal infrared data to achieve robust visual tracking, and receives more and more attention in recent years. Existing works focus on…

Computer Vision and Pattern Recognition · Computer Science 2019-07-18 Chenglong Li , Andong Lu , Aihua Zheng , Zhengzheng Tu , Jin Tang

Multi-modal object tracking integrates auxiliary modalities such as depth, thermal infrared, event flow, and language to provide additional information beyond RGB images, showing great potential in improving tracking stabilization in…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Shiyu Xuan , Zechao Li , Jinhui Tang

With the development of depth sensors in recent years, RGBD object tracking has received significant attention. Compared with the traditional RGB object tracking, the addition of the depth modality can effectively solve the target and…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Shang Gao , Jinyu Yang , Zhe Li , Feng Zheng , Aleš Leonardis , Jingkuan Song

Significant progress has been achieved in multi-object tracking (MOT) through the evolution of detection and re-identification (ReID) techniques. Despite these advancements, accurately tracking objects in scenarios with homogeneous…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Changcheng Xiao , Qiong Cao , Yujie Zhong , Long Lan , Xiang Zhang , Zhigang Luo , Dacheng Tao

Multimodal Visual Object Tracking (VOT) has recently gained significant attention due to its robustness. Early research focused on fully fine-tuning RGB-based trackers, which was inefficient and lacked generalized representation due to the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Xiaojun Hou , Jiazheng Xing , Yijie Qian , Yaowei Guo , Shuo Xin , Junhao Chen , Kai Tang , Mengmeng Wang , Zhengkai Jiang , Liang Liu , Yong Liu
‹ Prev 1 2 3 10 Next ›