English
Related papers

Related papers: Cross-Modal Object Tracking: Modality-Aware Repres…

200 papers

Visual tracking often faces challenges such as invalid targets and decreased performance in low-light conditions when relying solely on RGB image sequences. While incorporating additional modalities like depth and infrared data has proven…

Computer Vision and Pattern Recognition · Computer Science 2023-12-25 Lei Liu , Mengya Zhang , Cheng Li , Chenglong Li , Jin Tang

Thanks for the cross-modal retrieval techniques, visible-infrared (RGB-IR) person re-identification (Re-ID) is achieved by projecting them into a common space, allowing person Re-ID in 24-hour surveillance systems. However, with respect to…

Computer Vision and Pattern Recognition · Computer Science 2022-08-05 Xinyu Lin , Jinxing Li , Zeyu Ma , Huafeng Li , Shuang Li , Kaixiong Xu , Guangming Lu , David Zhang

Visual object tracking, as a fundamental task in computer vision, has drawn much attention in recent years. To extend trackers to a wider range of applications, researchers have introduced information from multiple modalities to handle…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Pengyu Zhang , Dong Wang , Huchuan Lu

Cross-modal object tracking (CMOT) is an emerging task that maintains target consistency while the video stream switches between different modalities, with only one modality available in each frame, mostly focusing on RGB-Near Infrared…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Boyue Xu , Ruichao Hou , Tongwei Ren , Dongming Zhou , Gangshan Wu , Jinde Cao

This paper focuses on the area of RGB(visible)-NIR(near-infrared) cross-modality image registration, which is crucial for many downstream vision tasks to fully leverage the complementary information present in visible and infrared images.…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Huadong Li , Shichao Dong , Jin Wang , Rong Fu , Minhao Jing , Jiajun Liang , Haoqiang Fan , Renhe Ji

Existing multi-modal object tracking approaches primarily focus on dual-modal paradigms, such as RGB-Depth or RGB-Thermal, yet remain challenged in complex scenarios due to limited input modalities. To address this gap, this work introduces…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Xue-Feng Zhu , Tianyang Xu , Yifan Pan , Jinjie Gu , Xi Li , Jiwen Lu , Xiao-Jun Wu , Josef Kittler

Single object tracking aims to localize target object with specific reference modalities (bounding box, natural language or both) in a sequence of specific video modalities (RGB, RGB+Depth, RGB+Thermal or RGB+Event.). Different reference…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Yinchao Ma , Yuyang Tang , Wenfei Yang , Tianzhu Zhang , Xu Zhou , Feng Wu

With the proliferation of low altitude unmanned aerial vehicles (UAVs), visual multi-object tracking is becoming a critical security technology, demanding significant robustness even in complex environmental conditions. However, tracking…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Tianyang Xu , Jinjie Gu , Xuefeng Zhu , XiaoJun Wu , Josef Kittler

Visual object tracking in real-world scenarios presents numerous challenges including occlusion, interference from similar objects and complex backgrounds-all of which limit the effectiveness of RGB-based trackers. Multispectral imagery,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Tao Feng , Tingfa Xu , Haolin Qin , Tianhao Li , Shuaihao Han , Xuyang Zou , Zhan Lv , Jianan Li

Cross-modal object tracking is an important research topic in the field of information fusion, and it aims to address imaging limitations in challenging scenarios by integrating switchable visible and near-infrared modalities. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-25 Lei Liu , Chenglong Li , Futian Wang , Longfeng Shen , Jin Tang

Due to the rapid development of computer vision, single-modal (RGB) object tracking has made significant progress in recent years. Considering the limitation of single imaging sensor, multi-modal images (RGB, Infrared, etc.) are introduced…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Bing Cao , Junliang Guo , Pengfei Zhu , Qinghua Hu

Multispectral object detection, utilizing RGB and TIR (thermal infrared) modalities, is widely recognized as a challenging task. It requires not only the effective extraction of features from both modalities and robust fusion strategies,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Chen Zhou , Peng Cheng , Junfeng Fang , Yifan Zhang , Yibo Yan , Xiaojun Jia , Yanyan Xu , Kun Wang , Xiaochun Cao

Multimodal sensing has proven valuable for visual tracking, as different sensor types offer unique strengths in handling one specific challenging scene where object appearance varies. While a generalist model capable of leveraging all…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Yuedong Tan , Zongwei Wu , Yuqian Fu , Zhuyun Zhou , Guolei Sun , Eduard Zamfi , Chao Ma , Danda Pani Paudel , Luc Van Gool , Radu Timofte

Existing cross-modal pedestrian detection (CMPD) employs complementary information from RGB and thermal-infrared (TIR) modalities to detect pedestrians in 24h-surveillance systems.RGB captures rich pedestrian details under daylight, while…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Qian Bie , Xiao Wang , Bin Yang , Zhixi Yu , Jun Chen , Xin Xu

Existing datasets for RGB-DVS tracking are collected with DVS346 camera and their resolution ($346 \times 260$) is low for practical applications. Actually, only visible cameras are deployed in many practical systems, and the newly designed…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 Yabin Zhu , Xiao Wang , Chenglong Li , Bo Jiang , Lin Zhu , Zhixiang Huang , Yonghong Tian , Jin Tang

Visual Object Tracking (VOT) is an attractive and significant research area in computer vision, which aims to recognize and track specific targets in video sequences where the target objects are arbitrary and class-agnostic. The VOT…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Mengmeng Wang , Teli Ma , Shuo Xin , Xiaojun Hou , Jiazheng Xing , Guang Dai , Jingdong Wang , Yong Liu

Integrating multispectral data in object detection, especially visible and infrared images, has received great attention in recent years. Since visible (RGB) and infrared (IR) images can provide complementary information to handle light…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Maoxun Yuan , Yinyan Wang , Xingxing Wei

Cross-view multi-object tracking aims to link objects between frames and camera views with substantial overlaps. Although cross-view multi-object tracking has received increased attention in recent years, existing datasets still have…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Shenghao Hao , Peiyuan Liu , Yibing Zhan , Kaixun Jin , Zuozhu Liu , Mingli Song , Jenq-Neng Hwang , Gaoang Wang

With the development of depth sensors in recent years, RGBD object tracking has received significant attention. Compared with the traditional RGB object tracking, the addition of the depth modality can effectively solve the target and…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Shang Gao , Jinyu Yang , Zhe Li , Feng Zheng , Aleš Leonardis , Jingkuan Song

Object tracking based on the fusion of visible and thermal im-ages, known as RGB-T tracking, has gained increasing atten-tion from researchers in recent years. How to achieve a more comprehensive fusion of information from the two…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Yang Luo , Xiqing Guo , Hui Feng , Lei Ao
‹ Prev 1 2 3 10 Next ›