English
Related papers

Related papers: RT-RMOT: A Dataset and Framework for RGB-Thermal R…

200 papers

In this paper, we propose a simple yet unified single object tracking (SOT) framework, dubbed SUTrack. It consolidates five SOT tasks (RGB-based, RGB-Depth, RGB-Thermal, RGB-Event, RGB-Language Tracking) into a unified model trained in a…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Xin Chen , Ben Kang , Wanting Geng , Jiawen Zhu , Yi Liu , Dong Wang , Huchuan Lu

Small object detection (SOD) has been a longstanding yet challenging task for decades, with numerous datasets and algorithms being developed. However, they mainly focus on either visible or thermal modality, while visible-thermal (RGBT)…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Xinyi Ying , Chao Xiao , Ruojing Li , Xu He , Boyang Li , Xu Cao , Zhaoxu Li , Yingqian Wang , Mingyuan Hu , Qingyu Xu , Zaiping Lin , Miao Li , Shilin Zhou , Wei An , Weidong Sheng , Li Liu

RGB and thermal source data suffer from both shared and specific challenges, and how to explore and exploit them plays a critical role to represent the target appearance in RGBT tracking. In this paper, we propose a novel challenge-aware…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Chenglong Li , Lei Liu , Andong Lu , Qing Ji , Jin Tang

Tracking objects can be a difficult task in computer vision, especially when faced with challenges such as occlusion, changes in lighting, and motion blur. Recent advances in deep learning have shown promise in challenging these conditions.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Abbas Türkoğlu , Erdem Akagündüz

Existing event stream based trackers undergo evaluation on short-term tracking datasets, however, the tracking of real-world scenarios involves long-term tracking, and the performance of existing tracking algorithms in these scenarios…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Xiao Wang , Xufeng Lou , Shiao Wang , Ju Huang , Lan Chen , Bo Jiang

Robots navigating autonomously need to perceive and track the motion of objects and other agents in its surroundings. This information enables planning and executing robust and safe trajectories. To facilitate these processes, the motion…

Computer Vision and Pattern Recognition · Computer Science 2020-07-23 Abhijeet Shenoi , Mihir Patel , JunYoung Gwak , Patrick Goebel , Amir Sadeghian , Hamid Rezatofighi , Roberto Martín-Martín , Silvio Savarese

Referring multi-object tracking (RMOT) aims to track multiple objects based on input textual descriptions. Previous works realize it by simply integrating an extra textual module into the multi-object tracker. However, they typically need…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Yunhao Du , Cheng Lei , Zhicheng Zhao , Fei Su

Multi-object tracking (MOT) has profound applications in a variety of fields, including surveillance, sports analytics, self-driving, and cooperative robotics. Despite considerable advancements, existing MOT methodologies tend to falter…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Hamza Mukhtar , Muhammad Usman Ghani Khan

The problem of multi-object tracking is a fundamental computer vision research focus, widely used in public safety, transport, autonomous vehicles, robotics, and other regions involving artificial intelligence. Because of the complexity of…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Kai Ren , Chuanping Hu

Multimodal Large Language Models (MLLM) are primarily pre-trained on the RGB modality, thereby limiting their performance on other modalities, such as infrared, depth, and event data, which are crucial for complex scenarios. To address…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Jiahe Wu , Bing Cao , Qilong Wang , Qinghua Hu , Dongdong Li , Pengfei Zhu

Visual Object Tracking (VOT) is an attractive and significant research area in computer vision, which aims to recognize and track specific targets in video sequences where the target objects are arbitrary and class-agnostic. The VOT…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Mengmeng Wang , Teli Ma , Shuo Xin , Xiaojun Hou , Jiazheng Xing , Guang Dai , Jingdong Wang , Yong Liu

Multiple human tracking (MHT) is a fundamental task in many computer vision applications. Appearance-based approaches, primarily formulated on RGB data, are constrained and affected by problems arising from occlusions and/or illumination…

Computer Vision and Pattern Recognition · Computer Science 2016-06-15 Massimo Camplani , Adeline Paiement , Majid Mirmehdi , Dima Damen , Sion Hannuna , Tilo Burghardt , Lili Tao

Object tracking is divided into single-object tracking (SOT) and multi-object tracking (MOT). MOT aims to maintain the identities of multiple objects across a series of continuous video sequences. In recent years, MOT has made rapid…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Yukuan Zhang , Yunhua Jia , Housheng Xie , Mengzhen Li , Limin Zhao , Yang Yang , Shan Zhao

Multi-object Tracking (MOT) generally can be split into two sub-tasks, i.e., detection and association. Many previous methods follow the tracking by detection paradigm, which first obtain detections at each frame and then associate them…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Mingfei Chen , Yue Liao , Si Liu , Fei Wang , Jenq-Neng Hwang

Multi-Object Tracking (MOT) is evolving from geometric localization to Semantic MOT (SMOT) to answer complex relational queries, yet progress is hindered by semantic data scarcity and a structural disconnect between tracking architectures…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Pan Liao , Feng Yang , Di Wu , Jinwen Yu , Yuhua Zhu , Wenhui Zhao , Dingwen Zhang

In many visual systems, visual tracking often bases on RGB image sequences, in which some targets are invalid in low-light conditions, and tracking performance is thus affected significantly. Introducing other modalities such as depth and…

Computer Vision and Pattern Recognition · Computer Science 2021-11-12 Chenglong Li , Tianhao Zhu , Lei Liu , Xiaonan Si , Zilin Fan , Sulan Zhai

RGB-Thermal (RGBT) tracking aims to exploit visible and thermal infrared modalities for robust all-weather object tracking. However, existing RGBT trackers struggle to resolve modality discrepancies, which poses great challenges for robust…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Hao Li , Yuhao Wang , Xiantao Hu , Wenning Hao , Pingping Zhang , Dong Wang , Huchuan Lu

In this paper, we focus on the multi-object tracking (MOT) problem of automatic driving and robot navigation. Most existing MOT methods track multiple objects using a singular RGB camera, which are prone to camera field-of-view and suffer…

Computer Vision and Pattern Recognition · Computer Science 2021-06-01 Yuhang He , Wentao Yu , Jie Han , Xing Wei , Xiaopeng Hong , Yihong Gong

Crowd counting is a fundamental yet challenging task, which desires rich information to generate pixel-wise crowd density maps. However, most previous methods only used the limited information of RGB images and cannot well discover…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Lingbo Liu , Jiaqi Chen , Hefeng Wu , Guanbin Li , Chenglong Li , Liang Lin

RGB-Thermal (RGB-T) semantic segmentation has shown great potential in handling low-light conditions where RGB-based segmentation is hindered by poor RGB imaging quality. The key to RGB-T semantic segmentation is to effectively leverage the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Zikun Zhou , Shukun Wu , Guoqing Zhu , Hongpeng Wang , Zhenyu He