English
Related papers

Related papers: Cross-Modal Object Tracking: Modality-Aware Repres…

200 papers

We study an important, yet largely unexplored problem of large-scale cross-modal visual localization by matching ground RGB images to a geo-referenced aerial LIDAR 3D point cloud (rendered as depth images). Prior works were demonstrated on…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Niluthpol Chowdhury Mithun , Karan Sikka , Han-Pang Chiu , Supun Samarasekera , Rakesh Kumar

In many applications of advanced robotic manipulation, six degrees of freedom (6DoF) object pose estimates are continuously required. In this work, we develop a multi-modality tracker that fuses information from visual appearance and…

Computer Vision and Pattern Recognition · Computer Science 2023-02-23 Manuel Stoiber , Mariam Elsayed , Anne E. Reichert , Florian Steidle , Dongheui Lee , Rudolph Triebel

Multi-modal object tracking integrates auxiliary modalities such as depth, thermal infrared, event flow, and language to provide additional information beyond RGB images, showing great potential in improving tracking stabilization in…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Shiyu Xuan , Zechao Li , Jinhui Tang

Multi-object tracking under low-light environments is prevalent in real life. Recent years have seen rapid development in the field of multi-object tracking. However, due to the lack of datasets and the high cost of annotations,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Zijing Zhao , Jianlong Yu , Lin Zhang , Shunli Zhang

We address the problem of multi-modal object tracking in video and explore various options of fusing the complementary information conveyed by the visible (RGB) and thermal infrared (TIR) modalities including pixel-level, feature-level and…

Computer Vision and Pattern Recognition · Computer Science 2022-01-24 Zhangyong Tang , Tianyang Xu , Hui Li , Xiao-Jun Wu , Xuefeng Zhu , Josef Kittler

Feature matching is a cornerstone task in computer vision, essential for applications such as image retrieval, stereo matching, 3D reconstruction, and SLAM. This survey comprehensively reviews modality-based feature matching, exploring…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Weide Liu , Wei Zhou , Jun Liu , Ping Hu , Jun Cheng , Jungong Han , Weisi Lin

Visible-infrared person re-identification (VI-ReID) aims to retrieve images of the same pedestrian from different modalities, where the challenges lie in the significant modality discrepancy. To alleviate the modality gap, recent methods…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Zhihao Qian , Yutian Lin , Bo Du

Multi-modal tracking gains attention due to its ability to be more accurate and robust in complex scenarios compared to traditional RGB-based tracking. Its key lies in how to fuse multi-modal data and reduce the gap between modalities.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Jinyu Yang , Zhe Li , Feng Zheng , Aleš Leonardis , Jingkuan Song

Person re-identification (Re-ID) across visible and infrared modalities is crucial for 24-hour surveillance systems, but existing datasets primarily focus on ground-level perspectives. While ground-based IR systems offer nighttime…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Huy Nguyen , Kien Nguyen , Akila Pemasiri , Akmal Jahan , Clinton Fookes , Sridha Sridharan

Drone-based multi-object tracking is essential yet highly challenging due to small targets, severe occlusions, and cluttered backgrounds. Existing RGB-based tracking algorithms heavily depend on spatial appearance cues such as color and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Tianhao Li , Tingfa Xu , Ying Wang , Haolin Qin , Xu Lin , Jianan Li

Visual object tracking is a significant computer vision task which can be applied to many domains such as visual surveillance, human computer interaction, and video compression. In the literature, researchers have proposed a variety of 2D…

Computer Vision and Pattern Recognition · Computer Science 2013-03-21 Xi Li , Weiming Hu , Chunhua Shen , Zhongfei Zhang , Anthony Dick , Anton van den Hengel

Large-scale vision-language models (e.g., CLIP) have recently achieved remarkable performance in retrieval tasks, yet their potential for Video-based Visible-Infrared Person Re-Identification (VVI-ReID) remains largely unexplored. The…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Chenyang Yu , Xuehu Liu , Pingping Zhang , Huchuan Lu

In this paper, we propose a visual tracker based on a metric-weighted linear representation of appearance. In order to capture the interdependence of different feature dimensions, we develop two online distance metric learning methods using…

Computer Vision and Pattern Recognition · Computer Science 2016-11-17 Xi Li , Chunhua Shen , Anthony Dick , Zhongfei Zhang , Yueting Zhuang

Falls are one of the leading cause of injury-related deaths among the elderly worldwide. Effective detection of falls can reduce the risk of complications and injuries. Fall detection can be performed using wearable devices or ambient…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Stefan Denkovski , Shehroz S. Khan , Brandon Malamis , Sae Young Moon , Bing Ye , Alex Mihailidis

The complementary benefits from visible and thermal infrared data are widely utilized in various computer vision task, such as visual tracking, semantic segmentation and object detection, but rarely explored in Multiple Object Tracking…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Yabin Zhu , Qianwu Wang , Chenglong Li , Jin Tang , Zhixiang Huang

RGB-Infrared person re-identification (RGB-IR Re-ID) aims to match persons from heterogeneous images captured by visible and thermal cameras, which is of great significance in the surveillance system under poor light conditions. Facing…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Can Zhang , Hong Liu , Wei Guo , Mang Ye

Multi-object tracking is a classic field in computer vision. Among them, pedestrian tracking has extremely high application value and has become the most popular research category. Existing methods mainly use motion or appearance…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Teng Fu , Yuwen Chen , Zhuofan Chen , Mengyang Zhao , Bin Li , Xiangyang Xue

Visible-Infrared person Re-IDentification (VI-ReID) is a challenging cross-modality image retrieval task that aims to match pedestrians' images across visible and infrared cameras. To solve the modality gap, existing mainstream methods…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Tengfei Liang , Yi Jin , Wu Liu , Tao Wang , Songhe Feng , Yidong Li

RGB-Thermal (RGB-T) object tracking receives more and more attention due to the strongly complementary benefits of thermal information to visible data. However, RGB-T research is limited by lacking a comprehensive evaluation platform. In…

Computer Vision and Pattern Recognition · Computer Science 2018-05-24 Chenglong Li , Xinyan Liang , Yijuan Lu , Nan Zhao , Jin Tang

Multi-object tracking from RGB-D video sequences is a challenging problem due to the combination of changing viewpoints, motion, and occlusions over time. We observe that having the complete geometry of objects aids in their tracking, and…

Computer Vision and Pattern Recognition · Computer Science 2020-12-17 Norman Müller , Yu-Shiang Wong , Niloy J. Mitra , Angela Dai , Matthias Nießner