English
Related papers

Related papers: RT-RMOT: A Dataset and Framework for RGB-Thermal R…

200 papers

Existing RGB-T tracking algorithms have made remarkable progress by leveraging the global interaction capability and extensive pre-trained models of the Transformer architecture. Nonetheless, these methods mainly adopt imagepair appearance…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Simiao Lai , Chang Liu , Jiawen Zhu , Ben Kang , Yang Liu , Dong Wang , Huchuan Lu

To address this challenge, we introduce CattleFace-RGBT, a RGB-T Cattle Facial Landmark dataset consisting of 2,300 RGB-T image pairs, a total of 4,600 images. Creating a landmark dataset is time-consuming, but AI-assisted annotation can…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Ethan Coffman , Reagan Clark , Nhat-Tan Bui , Trong Thang Pham , Beth Kegley , Jeremy G. Powell , Jiangchao Zhao , Ngan Le

RGBT tracking has been widely used in various fields such as robotics, surveillance processing, and autonomous driving. Existing RGBT trackers fully explore the spatial information between the template and the search region and locate the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-03 Hongyu Wang , Xiaotao Liu , Yifan Li , Meng Sun , Dian Yuan , Jing Liu

We address the problem of multi-modal object tracking in video and explore various options of fusing the complementary information conveyed by the visible (RGB) and thermal infrared (TIR) modalities including pixel-level, feature-level and…

Computer Vision and Pattern Recognition · Computer Science 2022-01-24 Zhangyong Tang , Tianyang Xu , Hui Li , Xiao-Jun Wu , Xuefeng Zhu , Josef Kittler

Correlation filter (CF)-based trackers have gained significant attention for their computational efficiency in thermal infrared (TIR) target tracking. However, ex-isting methods struggle with challenges such as low-resolution imagery,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Shang Zhang , Yuke Hou , Guoqiang Gong , Ruoyan Xiong , Yue Zhang

RGB-Thermal (RGB-T) crowd counting is a challenging task, which uses thermal images as complementary information to RGB images to deal with the decreased performance of unimodal RGB-based methods in scenes with low-illumination or similar…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Pengyu Chen , Junyu Gao , Yuan Yuan , Qi Wang

RGB-T tracking leverages the complementary strengths of RGB and thermal infrared (TIR) modalities to address challenging scenarios such as low illumination and adverse weather. However, existing methods often fail to effectively integrate…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Zhongxuan Zhang , Bi Zeng , Xinyu Ni , Yimin Du

Salient object detection in complex scenes and environments is a challenging research topic. Most works focus on RGB-based salient object detection, which limits its performance of real-life applications when confronted with adverse…

Computer Vision and Pattern Recognition · Computer Science 2022-05-24 Zhengzheng Tu , Yan Ma , Zhun Li , Chenglong Li , Jieming Xu , Yongtao Liu

Multi-object tracking under low-light environments is prevalent in real life. Recent years have seen rapid development in the field of multi-object tracking. However, due to the lack of datasets and the high cost of annotations,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Zijing Zhao , Jianlong Yu , Lin Zhang , Shunli Zhang

Advances in perception modeling have significantly improved the performance of object tracking. However, the current methods for specifying the target object in the initial frame are either by 1) using a box or mask template, or by 2)…

Computer Vision and Pattern Recognition · Computer Science 2024-01-01 Jiawen Zhu , Zhi-Qi Cheng , Jun-Yan He , Chenyang Li , Bin Luo , Huchuan Lu , Yifeng Geng , Xuansong Xie

Multi-object tracking (MOT) is an important and practical task related to both surveillance systems and moving camera applications, such as autonomous driving and robotic vision. However, due to unreliable detection, occlusion and fast…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 Gaoang Wang , Yizhou Wang , Haotian Zhang , Renshu Gu , Jenq-Neng Hwang

Most existing multi-object tracking methods typically learn visual tracking features via maximizing dis-similarities of different instances and minimizing similarities of the same instance. While such a feature learning scheme achieves…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Yuhao Li , Jiale Cao , Muzammal Naseer , Yu Zhu , Jinqiu Sun , Yanning Zhang , Fahad Shahbaz Khan

While Multi-Object Tracking (MOT) has made substantial advancements, it is limited by heavy reliance on prior knowledge and limited to predefined categories. In contrast, Generic Multiple Object Tracking (GMOT), tracking multiple objects…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Duy Le Dinh Anh , Kim Hoang Tran , Ngan Hoang Le

Recent multi-object tracking (MOT) systems have leveraged highly accurate object detectors; however, training such detectors requires large amounts of labeled data. Although such data is widely available for humans and vehicles, it is…

Computer Vision and Pattern Recognition · Computer Science 2022-11-09 Travis Mandel , Mark Jimenez , Emily Risley , Taishi Nammoto , Rebekka Williams , Max Panoff , Meynard Ballesteros , Bobbie Suarez

Cross-modal object tracking (CMOT) is an emerging task that maintains target consistency while the video stream switches between different modalities, with only one modality available in each frame, mostly focusing on RGB-Near Infrared…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Boyue Xu , Ruichao Hou , Tongwei Ren , Dongming Zhou , Gangshan Wu , Jinde Cao

Many RGB-T trackers attempt to attain robust feature representation by utilizing an adaptive weighting scheme (or attention mechanism). Different from these works, we propose a new dynamic modality-aware filter generation module (named…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Xiao Wang , Xiujun Shu , Shiliang Zhang , Bo Jiang , Yaowei Wang , Yonghong Tian , Feng Wu

The task of RGBT tracking aims to take the complementary advantages from visible spectrum and thermal infrared data to achieve robust visual tracking, and receives more and more attention in recent years. Existing works focus on…

Computer Vision and Pattern Recognition · Computer Science 2019-07-18 Chenglong Li , Andong Lu , Aihua Zheng , Zhengzheng Tu , Jin Tang

We introduce RGB-Th-Bench, the first benchmark designed to evaluate the ability of Vision-Language Models (VLMs) to comprehend RGB-Thermal image pairs. While VLMs have demonstrated remarkable progress in visual reasoning and multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Mehdi Moshtaghi , Siavash H. Khajavi , Joni Pajarinen

The dominant trackers generate a fixed-size rectangular region based on the previous prediction or initial bounding box as the model input, i.e., search region. While this manner obtains promising tracking efficiency, a fixed-size search…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Jiawen Zhu , Xin Chen , Pengyu Zhang , Xinying Wang , Dong Wang , Wenda Zhao , Huchuan Lu

The main challenge of Multi-Object Tracking~(MOT) lies in maintaining a continuous trajectory for each target. Existing methods often learn reliable motion patterns to match the same target between adjacent frames and discriminative…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Zheng Qin , Sanping Zhou , Le Wang , Jinghai Duan , Gang Hua , Wei Tang