English
Related papers

Related papers: RGB-T Object Tracking:Benchmark and Baseline

200 papers

Existing multi-modal object tracking approaches primarily focus on dual-modal paradigms, such as RGB-Depth or RGB-Thermal, yet remain challenged in complex scenarios due to limited input modalities. To address this gap, this work introduces…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Xue-Feng Zhu , Tianyang Xu , Yifan Pan , Jinjie Gu , Xi Li , Jiwen Lu , Xiao-Jun Wu , Josef Kittler

RGB and thermal source data suffer from both shared and specific challenges, and how to explore and exploit them plays a critical role to represent the target appearance in RGBT tracking. In this paper, we propose a novel challenge-aware…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Chenglong Li , Lei Liu , Andong Lu , Qing Ji , Jin Tang

Visual object tracking with the visible (RGB) and thermal infrared (TIR) electromagnetic waves, shorted in RGBT tracking, recently draws increasing attention in the tracking community. Considering the rapid development of deep learning, a…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Zhangyong Tang , Tianyang Xu , Xiao-Jun Wu

RGB-T tracking involves the use of images from both visible and thermal modalities. The primary objective is to adaptively leverage the relatively dominant modality in varying conditions to achieve more robust tracking compared to…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Yang Luo , Xiqing Guo , Mingtao Dong , Jin Yu

In this paper, we propose a self-supervised RGB-T tracking method. Different from existing deep RGB-T trackers that use a large number of annotated RGB-T image pairs for training, our RGB-T tracker is trained using unlabeled RGB-T video…

Computer Vision and Pattern Recognition · Computer Science 2023-01-27 Xingchen Zhang , Yiannis Demiris

RGBD object tracking is gaining momentum in computer vision research thanks to the development of depth sensors. Although numerous RGBD trackers have been proposed with promising performance, an in-depth review for comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Jinyu Yang , Zhe Li , Song Yan , Feng Zheng , Aleš Leonardis , Joni-Kristian Kämäräinen , Ling Shao

Single-modality tracking (RGB-only) struggles under low illumination, weather, and occlusion. Multimodal tracking addresses this by combining complementary cues. While Vision Transformer-based trackers achieve strong accuracy, they are…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Mahdi Falaki , Maria A. Amer

In this study, we propose a novel RGB-T tracking framework by jointly modeling both appearance and motion cues. First, to obtain a robust appearance model, we develop a novel late fusion method to infer the fusion weight maps of both RGB…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Pengyu Zhang , Jie Zhao , Dong Wang , Huchuan Lu , Xiaoyun Yang

RGBT tracking receives a surge of interest in the computer vision community, but this research field lacks a large-scale and high-diversity benchmark dataset, which is essential for both the training of deep RGBT trackers and the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-22 Chenglong Li , Wanlin Xue , Yaqing Jia , Zhichen Qu , Bin Luo , Jin Tang , Dengdi Sun

The main problem in RGB-T tracking is the correct and optimal merging of the cross-modal features of visible and thermal images. Some previous methods either do not fully exploit the potential of RGB and TIR information for channel and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Yunfeng Li , Bo Wang , Ye Li

This paper investigates how to perform robust visual tracking in adverse and challenging conditions using complementary visual and thermal infrared data (RGBT tracking). We propose a novel deep network architecture called qualityaware…

Computer Vision and Pattern Recognition · Computer Science 2019-10-15 Yabin Zhu , Chenglong Li , Bin Luo , Jin Tang

Multi-Object Tracking in thermal images is essential for surveillance systems, particularly in challenging environments where RGB cameras struggle due to low visibility or poor lighting conditions. Thermal sensors enhance recognition tasks…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Duong Nguyen-Ngoc Tran , Long Hoang Pham , Chi Dai Tran , Quoc Pham-Nam Ho , Huy-Hung Nguyen , Jae Wook Jeon

Small object detection (SOD) has been a longstanding yet challenging task for decades, with numerous datasets and algorithms being developed. However, they mainly focus on either visible or thermal modality, while visible-thermal (RGBT)…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Xinyi Ying , Chao Xiao , Ruojing Li , Xu He , Boyang Li , Xu Cao , Zhaoxu Li , Yingqian Wang , Mingyuan Hu , Qingyu Xu , Zaiping Lin , Miao Li , Shilin Zhou , Wei An , Weidong Sheng , Li Liu

Multiple human tracking (MHT) is a fundamental task in many computer vision applications. Appearance-based approaches, primarily formulated on RGB data, are constrained and affected by problems arising from occlusions and/or illumination…

Computer Vision and Pattern Recognition · Computer Science 2016-06-15 Massimo Camplani , Adeline Paiement , Majid Mirmehdi , Dima Damen , Sion Hannuna , Tilo Burghardt , Lili Tao

Multi-object tracking from RGB-D video sequences is a challenging problem due to the combination of changing viewpoints, motion, and occlusions over time. We observe that having the complete geometry of objects aids in their tracking, and…

Computer Vision and Pattern Recognition · Computer Science 2020-12-17 Norman Müller , Yu-Shiang Wong , Niloy J. Mitra , Angela Dai , Matthias Nießner

Advances in perception modeling have significantly improved the performance of object tracking. However, the current methods for specifying the target object in the initial frame are either by 1) using a box or mask template, or by 2)…

Computer Vision and Pattern Recognition · Computer Science 2024-01-01 Jiawen Zhu , Zhi-Qi Cheng , Jun-Yan He , Chenyang Li , Bin Luo , Huchuan Lu , Yifeng Geng , Xuansong Xie

RGB-T tracking leverages the complementary strengths of RGB and thermal infrared (TIR) modalities to address challenging scenarios such as low illumination and adverse weather. However, existing methods often fail to effectively integrate…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Zhongxuan Zhang , Bi Zeng , Xinyu Ni , Yimin Du

Salient object detection segments attractive objects in scenes. RGB and thermal modalities provide complementary information and scribble annotations alleviate large amounts of human labor. Based on the above facts, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Zhengyi Liu , Xiaoshen Huang , Guanghui Zhang , Xianyong Fang , Linbo Wang , Bin Tang

In many visual systems, visual tracking often bases on RGB image sequences, in which some targets are invalid in low-light conditions, and tracking performance is thus affected significantly. Introducing other modalities such as depth and…

Computer Vision and Pattern Recognition · Computer Science 2021-11-12 Chenglong Li , Tianhao Zhu , Lei Liu , Xiaonan Si , Zilin Fan , Sulan Zhai

RGB-T tracking, a vital downstream task of object tracking, has made remarkable progress in recent years. Yet, it remains hindered by two major challenges: 1) the trade-off between performance and efficiency; 2) the scarcity of training…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Qiming Wang , Yongqiang Bai , Hongxing Song