English
Related papers

Related papers: Transformer RGBT Tracking with Spatio-Temporal Mul…

200 papers

Many RGB-T trackers attempt to attain robust feature representation by utilizing an adaptive weighting scheme (or attention mechanism). Different from these works, we propose a new dynamic modality-aware filter generation module (named…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Xiao Wang , Xiujun Shu , Shiliang Zhang , Bo Jiang , Yaowei Wang , Yonghong Tian , Feng Wu

Existing multi-modal object tracking approaches primarily focus on dual-modal paradigms, such as RGB-Depth or RGB-Thermal, yet remain challenged in complex scenarios due to limited input modalities. To address this gap, this work introduces…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Xue-Feng Zhu , Tianyang Xu , Yifan Pan , Jinjie Gu , Xi Li , Jiwen Lu , Xiao-Jun Wu , Josef Kittler

Tracking multiple tiny objects is highly challenging due to their weak appearance and limited features. Existing multi-object tracking algorithms generally focus on single-modality scenes, and overlook the complementary characteristics of…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Qingyu Xu , Longguang Wang , Weidong Sheng , Yingqian Wang , Chao Xiao , Chao Ma , Wei An

Template-matching methods for visual tracking have gained popularity recently due to their good performance and fast speed. However, they lack effective ways to adapt to changes in the target object's appearance, making their tracking…

Computer Vision and Pattern Recognition · Computer Science 2019-12-02 Tianyu Yang , Antoni B. Chan

Correlation acts as a critical role in the tracking field, especially in recent popular Siamese-based trackers. The correlation operation is a simple fusion manner to consider the similarity between the template and the search region.…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Xin Chen , Bin Yan , Jiawen Zhu , Dong Wang , Xiaoyun Yang , Huchuan Lu

RGBT tracking has attracted increasing attention since RGB and thermal infrared data have strong complementary advantages, which could make trackers all-day and all-weather work. However, how to effectively represent RGBT data for visual…

Computer Vision and Pattern Recognition · Computer Science 2021-07-07 Andong Lu , Chenglong Li , Yuqing Yan , Jin Tang , Bin Luo

We address the problem of multi-modal object tracking in video and explore various options of fusing the complementary information conveyed by the visible (RGB) and thermal infrared (TIR) modalities including pixel-level, feature-level and…

Computer Vision and Pattern Recognition · Computer Science 2022-01-24 Zhangyong Tang , Tianyang Xu , Hui Li , Xiao-Jun Wu , Xuefeng Zhu , Josef Kittler

Tracking multiple objects in videos relies on modeling the spatial-temporal interactions of the objects. In this paper, we propose a solution named TransMOT, which leverages powerful graph transformers to efficiently model the spatial and…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Peng Chu , Jiang Wang , Quanzeng You , Haibin Ling , Zicheng Liu

Existing RGB-T tracking algorithms have made remarkable progress by leveraging the global interaction capability and extensive pre-trained models of the Transformer architecture. Nonetheless, these methods mainly adopt imagepair appearance…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Simiao Lai , Chang Liu , Jiawen Zhu , Ben Kang , Yang Liu , Dong Wang , Huchuan Lu

With the development of depth sensors in recent years, RGBD object tracking has received significant attention. Compared with the traditional RGB object tracking, the addition of the depth modality can effectively solve the target and…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Shang Gao , Jinyu Yang , Zhe Li , Feng Zheng , Aleš Leonardis , Jingkuan Song

Template-matching methods for visual tracking have gained popularity recently due to their comparable performance and fast speed. However, they lack effective ways to adapt to changes in the target object's appearance, making their tracking…

Computer Vision and Pattern Recognition · Computer Science 2018-09-05 Tianyu Yang , Antoni B. Chan

RGB-T tracking, a vital downstream task of object tracking, has made remarkable progress in recent years. Yet, it remains hindered by two major challenges: 1) the trade-off between performance and efficiency; 2) the scarcity of training…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Qiming Wang , Yongqiang Bai , Hongxing Song

Visual object tracking, as a fundamental task in computer vision, has drawn much attention in recent years. To extend trackers to a wider range of applications, researchers have introduced information from multiple modalities to handle…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Pengyu Zhang , Dong Wang , Huchuan Lu

How to make a good trade-off between performance and computational cost is crucial for a tracker. However, current famous methods typically focus on complicated and time-consuming learning that combining temporal and appearance information…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Jinxia Xie , Bineng Zhong , Qihua Liang , Ning Li , Zhiyi Mo , Shuxiang Song

Multi-modal feature fusion as a core investigative component of RGBT tracking emerges numerous fusion studies in recent years. However, existing RGBT tracking methods widely adopt fixed fusion structures to integrate multi-modal feature,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Andong Lu , Wanyu Wang , Chenglong Li , Jin Tang , Bin Luo

We propose a universal video-level modality-awareness tracking model with online dense temporal token learning (called {\modaltracker}). It is designed to support various tracking tasks, including RGB, RGB+Thermal, RGB+Depth, and RGB+Event,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Yaozong Zheng , Bineng Zhong , Qihua Liang , Shengping Zhang , Guorong Li , Xianxian Li , Rongrong Ji

Multi-modal systems are quite common in the context of human activity recognition; widely used RGB-D sensors (Kinect is the most prominent example) give access to parallel data streams, typically RGB images, depth data, skeleton…

Computer Vision and Pattern Recognition · Computer Science 2019-12-05 Annalisa Franco , Antonio Magnani , Dario Maio

How to effectively exploit spatio-temporal information is crucial to capture target appearance changes in visual tracking. However, most deep learning-based trackers mainly focus on designing a complicated appearance model or template…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Liangtao Shi , Bineng Zhong , Qihua Liang , Ning Li , Shengping Zhang , Xianxian Li

Refining visual representations by eliminating their internal feature-level redundancy is crucial for simultaneously optimizing the performance and computational cost of models in visual tracking. To enhance their performance, many…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Weijing Wu , Qihua Liang , Bineng Zhong , Haiying Xia , Zhiyi Mo , Shuxiang Song

RGB-Thermal (RGBT) tracking aims to exploit visible and thermal infrared modalities for robust all-weather object tracking. However, existing RGBT trackers struggle to resolve modality discrepancies, which poses great challenges for robust…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Hao Li , Yuhao Wang , Xiantao Hu , Wenning Hao , Pingping Zhang , Dong Wang , Huchuan Lu