English
Related papers

Related papers: Cross-Modal Object Tracking: Modality-Aware Repres…

200 papers

Visible-infrared cross-modality person re-identification is a challenging ReID task, which aims to retrieve and match the same identity's images between the heterogeneous visible and infrared modalities. Thus, the core of this task is to…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Tengfei Liang , Yi Jin , Yajun Gao , Wu Liu , Songhe Feng , Tao Wang , Yidong Li

Visible-infrared person re-identification (VI-ReID) aims to match individuals across different camera modalities, a critical task in modern surveillance systems. While current VI-ReID methods focus on cross-modality matching, real-world…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Mahdi Alehdaghi , Rajarshi Bhattacharya , Pourya Shamsolmoali , Rafael M. O. Cruz , Eric Granger

In the realm of video object tracking, auxiliary modalities such as depth, thermal, or event data have emerged as valuable assets to complement the RGB trackers. In practice, most existing RGB trackers learn a single set of parameters to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Zongwei Wu , Jilai Zheng , Xiangxuan Ren , Florin-Alexandru Vasluianu , Chao Ma , Danda Pani Paudel , Luc Van Gool , Radu Timofte

Vision sensors are becoming more important in Intelligent Transportation Systems (ITS) for traffic monitoring, management, and optimization as the number of network cameras continues to rise. However, manual object tracking and matching…

Computer Vision and Pattern Recognition · Computer Science 2025-05-02 Muhammad Imran Zaman , Usama Ijaz Bajwa , Gulshan Saleem , Rana Hammad Raza

In this paper, we focus on the multi-object tracking (MOT) problem of automatic driving and robot navigation. Most existing MOT methods track multiple objects using a singular RGB camera, which are prone to camera field-of-view and suffer…

Computer Vision and Pattern Recognition · Computer Science 2021-06-01 Yuhang He , Wentao Yu , Jie Han , Xing Wei , Xiaopeng Hong , Yihong Gong

This paper presents a novel approach to visual tracking: Similarity Matching Ratio (SMR). The traditional approach of tracking is minimizing some measures of the difference between the template and a patch from the frame. This approach is…

Computer Vision and Pattern Recognition · Computer Science 2012-09-13 Aysegul Dundar , Jonghoon Jin , Eugenio Culurciello

Multi-modal object tracking (MMOT) is an emerging field that combines data from various modalities, \eg vision (RGB), depth, thermal infrared, event, language and audio, to estimate the state of an arbitrary object in a video sequence. It…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Chunhui Zhang , Li Liu , Hao Wen , Xi Zhou , Yanfeng Wang

Drone-based vehicle detection aims at finding the vehicle locations and categories in an aerial image. It empowers smart city traffic management and disaster rescue. Researchers have made mount of efforts in this area and achieved…

Computer Vision and Pattern Recognition · Computer Science 2021-10-15 Yiming Sun , Bing Cao , Pengfei Zhu , Qinghua Hu

Visual object tracking, which is primarily based on visible light image sequences, encounters numerous challenges in complicated scenarios, such as low light conditions, high dynamic ranges, and background clutter. To address these…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Hongze Sun , Rui Liu , Wuque Cai , Jun Wang , Yue Wang , Huajin Tang , Yan Cui , Dezhong Yao , Daqing Guo

Multi-object tracking (MOT) aims to associate target objects across video frames in order to obtain entire moving trajectories. With the advancement of deep neural networks and the increasing demand for intelligent video analysis, MOT has…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Gaoang Wang , Mingli Song , Jenq-Neng Hwang

Developing robust multi-modal feature representations is crucial for enhancing object tracking performance. In pursuit of this objective, a novel X Modality Assisting Network (X-Net) is introduced, which explores the impact of the fusion…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Zhaisheng Ding , Haiyan Li , Ruichao Hou , Yanyu Liu , Shidong Xie

In recent years, there has been significant research focusing on addressing security concerns in single-modal person re-identification (ReID) systems that are based on RGB images. However, the safety of cross-modality scenarios, which are…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Yunpeng Gong , Zhun Zhong , Yansong Qu , Zhiming Luo , Rongrong Ji , Min Jiang

We propose a universal video-level modality-awareness tracking model with online dense temporal token learning (called {\modaltracker}). It is designed to support various tracking tasks, including RGB, RGB+Thermal, RGB+Depth, and RGB+Event,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Yaozong Zheng , Bineng Zhong , Qihua Liang , Shengping Zhang , Guorong Li , Xianxian Li , Rongrong Ji

Modern multi-object tracking (MOT) systems usually model the trajectories by associating per-frame detections. However, when camera motion, fast motion, and occlusion challenges occur, it is difficult to ensure long-range tracking or even…

Computer Vision and Pattern Recognition · Computer Science 2020-09-21 Shoudong Han , Piao Huang , Hongwei Wang , En Yu , Donghaisheng Liu , Xiaofeng Pan , Jun Zhao

Since the differences in viewing range, resolution and relative position, the multi-modality sensing module composed of infrared and visible cameras needs to be registered so as to have more accurate scene perception. In practice, manual…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Zhiying Jiang , Zengxi Zhang , Jinyuan Liu , Xin Fan , Risheng Liu

Multimodal vision-language (VL) learning has noticeably pushed the tendency toward generic intelligence owing to emerging large foundation models. However, tracking, as a fundamental vision problem, surprisingly enjoys less bonus from…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Mingzhe Guo , Zhipeng Zhang , Liping Jing , Haibin Ling , Heng Fan

Object tracking is a key challenge of computer vision with various applications that all require different architectures. Most tracking systems have limitations such as constraining all movement to a 2D plane and they often track only one…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Lars Bredereke , Yale Hartmann , Tanja Schultz

Image matching for both cross-view and cross-modality plays a critical role in multimodal perception. In practice, the modality gap caused by different imaging systems/styles poses great challenges to the matching task. Existing works try…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Jiangwei Ren , Xingyu Jiang , Zizhuo Li , Dingkang Liang , Xin Zhou , Xiang Bai

Unsupervised visible-infrared person re-identification (USVI-ReID) aims to match individuals across visible and infrared cameras without relying on any annotation. Given the significant gap across visible and infrared modality, estimating…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Menglin Wang , Xiaojin Gong , Jiachen Li , Genlin Ji

Recently, many multi-modal trackers prioritize RGB as the dominant modality, treating other modalities as auxiliary, and fine-tuning separately various multi-modal tasks. This imbalance in modality dependence limits the ability of methods…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Xiantao Hu , Bineng Zhong , Qihua Liang , Zhiyi Mo , Liangtao Shi , Ying Tai , Jian Yang