English
Related papers

Related papers: Cross-Modal Object Tracking: Modality-Aware Repres…

200 papers

Cross-spectral person re-identification, which aims to associate identities to pedestrians across different spectra, faces a main challenge of the modality discrepancy. In this paper, we address the problem from both image-level and…

Computer Vision and Pattern Recognition · Computer Science 2023-02-03 Lei Tan , Yukang Zhang , Shengmei Shen , Yan Wang , Pingyang Dai , Xianming Lin , Yongjian Wu , Rongrong Ji

Online 3D multi-object tracking (MOT) has witnessed significant research interest in recent years, largely driven by demand from the autonomous systems community. However, 3D offline MOT is relatively less explored. Labeling 3D trajectory…

Computer Vision and Pattern Recognition · Computer Science 2022-05-17 Martin Buchner , Abhinav Valada

In this paper, we propose a self-supervised learning procedure for training a robust multi-object tracking (MOT) model given only unlabeled video. While several self-supervisory learning signals have been proposed in prior work on…

Computer Vision and Pattern Recognition · Computer Science 2021-11-12 Favyen Bastani , Songtao He , Sam Madden

Infrared and visible object detection (IVOD) is essential for numerous around-the-clock applications. Despite notable advancements, current IVOD models exhibit notable performance declines when confronted with incomplete modality data,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Shuo Yang , Yinghui Xing , Shizhou Zhang , Zhilong Niu

Near infrared (NIR) to Visible (VIS) face matching is challenging due to the significant domain gaps as well as a lack of sufficient data for cross-modality model training. To overcome this problem, we propose a novel method for paired…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Yunqi Miao , Alexandros Lattas , Jiankang Deng , Jungong Han , Stefanos Zafeiriou

The problem of Multiple Object Tracking (MOT) consists in following the trajectory of different objects in a sequence, usually a video. In recent years, with the rise of Deep Learning, the algorithms that provide a solution to this problem…

Computer Vision and Pattern Recognition · Computer Science 2019-11-21 Gioele Ciaparrone , Francisco Luque Sánchez , Siham Tabik , Luigi Troiano , Roberto Tagliaferri , Francisco Herrera

Multi-object tracking in videos requires to solve a fundamental problem of one-to-one assignment between objects in adjacent frames. Most methods address the problem by first discarding impossible pairs whose feature distances are larger…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Yifu Zhang , Chunyu Wang , Xinggang Wang , Wenjun Zeng , Wenyu Liu

Cross modal face matching between the thermal and visible spectrum is a much desired capability for night-time surveillance and security applications. Due to a very large modality gap, thermal-to-visible face recognition is one of the most…

Computer Vision and Pattern Recognition · Computer Science 2016-08-01 M. Saquib Sarfraz , Rainer Stiefelhagen

Visible (VIS) to near infrared (NIR) face matching is a challenging problem due to the significant domain discrepancy between the domains and a lack of sufficient data for training cross-modal matching algorithms. Existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2019-01-24 Xiang Wu , Huaibo Huang , Vishal M. Patel , Ran He , Zhenan Sun

Multi-modal 3D object understanding has gained significant attention, yet current approaches often assume complete data availability and rigid alignment across all modalities. We present CrossOver, a novel framework for cross-modal 3D scene…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Sayan Deb Sarkar , Ondrej Miksik , Marc Pollefeys , Daniel Barath , Iro Armeni

Current gait recognition research mainly focuses on identifying pedestrians captured by the same type of sensor, neglecting the fact that individuals may be captured by different sensors in order to adapt to various environments. A more…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Rui Wang , Chuanfu Shen , Manuel J. Marin-Jimenez , George Q. Huang , Shiqi Yu

Recent advances in representation learning have demonstrated an ability to represent information from different modalities such as video, text, and audio in a single high-level embedding vector. In this work we present a self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2021-06-11 Alexander H. Liu , SouYoung Jin , Cheng-I Jeff Lai , Andrew Rouditchenko , Aude Oliva , James Glass

Due to the availability of multi-modal remote sensing (RS) image archives, one of the most important research topics is the development of cross-modal RS image retrieval (CM-RSIR) methods that search semantically similar images across…

Computer Vision and Pattern Recognition · Computer Science 2023-01-24 Gencer Sumbul , Markus Müller , Begüm Demir

Planar object tracking is a critical computer vision problem and has drawn increasing interest owing to its key roles in robotics, augmented reality, etc. Despite rapid progress, its further development, especially in the deep learning era,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Xinran Liu , Xiaoqiong Liu , Ziruo Yi , Xin Zhou , Thanh Le , Libo Zhang , Yan Huang , Qing Yang , Heng Fan

Multi-object tracking (MOT) is a challenging practical problem for vision based applications. Most recent approaches for MOT use precomputed detections from models such as Faster RCNN, performing fine-tuning of bounding boxes and…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Parthesh Soni , Falak Shah , Nisarg Vyas

The tracking-by-detection paradigm today has become the dominant method for multi-object tracking and works by detecting objects in each frame and then performing data association across frames. However, its sequential frame-wise matching…

Computer Vision and Pattern Recognition · Computer Science 2022-12-21 Sanghyun Woo , Kwanyong Park , Seoung Wug Oh , In So Kweon , Joon-Young Lee

This paper proposes a novel model, named Continuity-Discrimination Convolutional Neural Network (CD-CNN), for visual object tracking. Existing state-of-the-art tracking methods do not deal with temporal relationship in video sequences,…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Shen Li , Bingpeng Ma , Hong Chang , Shiguang Shan , Xilin Chen

Semantic segmentation across arbitrary sensor modalities faces significant challenges due to diverse sensor characteristics, and the traditional configurations for this task result in redundant development efforts. We address these…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Jiong Liu , Yingjie Xu , Xingcheng Zhou , Rui Song , Walter Zimmer , Alois Knoll , Hu Cao

Multi-Object Tracking (MOT) aims to detect and associate all desired objects across frames. Most methods accomplish the task by explicitly or implicitly leveraging strong cues (i.e., spatial and appearance information), which exhibit…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Mingzhan Yang , Guangxin Han , Bin Yan , Wenhua Zhang , Jinqing Qi , Huchuan Lu , Dong Wang

This paper pays close attention to the cross-modality visible-infrared person re-identification (VI Re-ID) task, which aims to match pedestrian samples between visible and infrared modes. In order to reduce the modality-discrepancy between…

Computer Vision and Pattern Recognition · Computer Science 2022-02-10 Guangwei Gao , Hao Shao , Fei Wu , Meng Yang , Yi Yu