English
Related papers

Related papers: Collaborating Vision, Depth, and Thermal Signals f…

200 papers

Cross-modal object tracking (CMOT) is an emerging task that maintains target consistency while the video stream switches between different modalities, with only one modality available in each frame, mostly focusing on RGB-Near Infrared…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Boyue Xu , Ruichao Hou , Tongwei Ren , Dongming Zhou , Gangshan Wu , Jinde Cao

RGB-Thermal object tracking attempt to locate target object using complementary visual and thermal infrared data. Existing RGB-T trackers fuse different modalities by robust feature representation learning or adaptive modal weighting.…

Computer Vision and Pattern Recognition · Computer Science 2019-08-14 Rui Yang , Yabin Zhu , Xiao Wang , Chenglong Li , Jin Tang

Robust person tracking is a critical capability for autonomous mobile robots operating in diverse and unpredictable environments. While RGB-D tracking has shown high precision, its performance severely degrades under challenging…

Robotics · Computer Science 2026-04-02 Yuki Minase , Kanji Tanaka

The fusion of camera- and LiDAR-based detections offers a promising solution to mitigate tracking failures in 3D multi-object tracking (MOT). However, existing methods predominantly exploit camera detections to correct tracking failures…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Lipeng Gu , Xuefeng Yan , Weiming Wang , Honghua Chen , Dingkun Zhu , Liangliang Nan , Mingqiang Wei

Compared with traditional RGB-only visual tracking, few datasets have been constructed for RGB-D tracking. In this paper, we propose ARKitTrack, a new RGB-D tracking dataset for both static and dynamic scenes captured by consumer-grade…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Haojie Zhao , Junsong Chen , Lijun Wang , Huchuan Lu

Recently, many multi-modal trackers prioritize RGB as the dominant modality, treating other modalities as auxiliary, and fine-tuning separately various multi-modal tasks. This imbalance in modality dependence limits the ability of methods…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Xiantao Hu , Bineng Zhong , Qihua Liang , Zhiyi Mo , Liangtao Shi , Ying Tai , Jian Yang

The target representation learned by convolutional neural networks plays an important role in Thermal Infrared (TIR) tracking. Currently, most of the top-performing TIR trackers are still employing representations learned by the model…

Computer Vision and Pattern Recognition · Computer Science 2021-08-03 Jingxian Sun , Lichao Zhang , Yufei Zha , Abel Gonzalez-Garcia , Peng Zhang , Wei Huang , Yanning Zhang

In this paper, we present DSERT-RoLL, a driving dataset that incorporates stereo event, RGB, and thermal cameras together with 4D radar and dual LiDAR, collected across diverse weather and illumination conditions. The dataset provides…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Hoonhee Cho , Jae-Young Kang , Yuhwan Jeong , Yunseo Yang , Wonyoung Lee , Youngho Kim , Kuk-Jin Yoon

We propose an end-to-end tracking framework for fusing the RGB and TIR modalities in RGB-T tracking. Our baseline tracker is DiMP (Discriminative Model Prediction), which employs a carefully designed target prediction network trained…

Computer Vision and Pattern Recognition · Computer Science 2019-09-02 Lichao Zhang , Martin Danelljan , Abel Gonzalez-Garcia , Joost van de Weijer , Fahad Shahbaz Khan

Visual Object Tracking (VOT) is an attractive and significant research area in computer vision, which aims to recognize and track specific targets in video sequences where the target objects are arbitrary and class-agnostic. The VOT…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Mengmeng Wang , Teli Ma , Shuo Xin , Xiaojun Hou , Jiazheng Xing , Guang Dai , Jingdong Wang , Yong Liu

The task of RGBT tracking aims to take the complementary advantages from visible spectrum and thermal infrared data to achieve robust visual tracking, and receives more and more attention in recent years. Existing works focus on…

Computer Vision and Pattern Recognition · Computer Science 2019-07-18 Chenglong Li , Andong Lu , Aihua Zheng , Zhengzheng Tu , Jin Tang

The advantage of RGB-Thermal (RGB-T) detection lies in its ability to perform modality fusion and integrate cross-modality complementary information, enabling robust detection under diverse illumination and weather conditions. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Chao Tian , Zikun Zhou , Chao Yang , Guoqing Zhu , Fu'an Zhong , Zhenyu He

Multi-object tracking (MOT) is an important and practical task related to both surveillance systems and moving camera applications, such as autonomous driving and robotic vision. However, due to unreliable detection, occlusion and fast…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 Gaoang Wang , Yizhou Wang , Haotian Zhang , Renshu Gu , Jenq-Neng Hwang

Effectively modeling and utilizing spatiotemporal features from RGB and other modalities (\eg, depth, thermal, and event data, denoted as X) is the core of RGB-X tracker design. Existing methods often employ two parallel branches to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 X. Feng , D. Zhang , S. Hu , X. Li , M. Wu , J. Zhang , X. Chen , K. Huang

Object tracking is divided into single-object tracking (SOT) and multi-object tracking (MOT). MOT aims to maintain the identities of multiple objects across a series of continuous video sequences. In recent years, MOT has made rapid…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Yukuan Zhang , Yunhua Jia , Housheng Xie , Mengzhen Li , Limin Zhao , Yang Yang , Shan Zhao

Multi-target multi-camera tracking is a crucial task that involves identifying and tracking individuals over time using video streams from multiple cameras. This task has practical applications in various fields, such as visual…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Sanghyun Woo , Kwanyong Park , Inkyu Shin , Myungchul Kim , In So Kweon

Visual object tracking with the visible (RGB) and thermal infrared (TIR) electromagnetic waves, shorted in RGBT tracking, recently draws increasing attention in the tracking community. Considering the rapid development of deep learning, a…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Zhangyong Tang , Tianyang Xu , Xiao-Jun Wu

RGB-Thermal (RGB-T) pedestrian detection aims to locate the pedestrians in RGB-T image pairs to exploit the complementation between the two modalities for improving detection robustness in extreme conditions. Most existing algorithms assume…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Chao Tian , Zikun Zhou , Yuqing Huang , Gaojun Li , Zhenyu He

Multiple human tracking (MHT) is a fundamental task in many computer vision applications. Appearance-based approaches, primarily formulated on RGB data, are constrained and affected by problems arising from occlusions and/or illumination…

Computer Vision and Pattern Recognition · Computer Science 2016-06-15 Massimo Camplani , Adeline Paiement , Majid Mirmehdi , Dima Damen , Sion Hannuna , Tilo Burghardt , Lili Tao

With the proliferation of low altitude unmanned aerial vehicles (UAVs), visual multi-object tracking is becoming a critical security technology, demanding significant robustness even in complex environmental conditions. However, tracking…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Tianyang Xu , Jinjie Gu , Xuefeng Zhu , XiaoJun Wu , Josef Kittler