English
Related papers

Related papers: Awesome Multi-modal Object Tracking

200 papers

The development of visual object tracking has continued for decades. Recent years, as the wide accessibility of the low-cost RGBD sensors, the task of visual object tracking on RGB-D videos has drawn much attention. Compared to conventional…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Xue-Feng Zhu , Tianyang Xu , Xiao-Jun Wu

Multiple object tracking (MOT) is a significant task in achieving autonomous driving. Traditional works attempt to complete this task, either based on point clouds (PC) collected by LiDAR, or based on images captured from cameras. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Guangming Wang , Chensheng Peng , Jinpeng Zhang , Hesheng Wang

The main challenge of Multi-Object Tracking~(MOT) lies in maintaining a continuous trajectory for each target. Existing methods often learn reliable motion patterns to match the same target between adjacent frames and discriminative…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Zheng Qin , Sanping Zhou , Le Wang , Jinghai Duan , Gang Hua , Wei Tang

Multispectral object detection, utilizing both visible (RGB) and thermal infrared (T) modals, has garnered significant attention for its robust performance across diverse weather and lighting conditions. However, effectively exploiting the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Jinzhong Wang , Xuetao Tian , Shun Dai , Tao Zhuo , Haorui Zeng , Hongjuan Liu , Jiaqi Liu , Xiuwei Zhang , Yanning Zhang

Multi-object tracking (MOT) is a fundamental task in computer vision that requires continuously tracking multiple targets while maintaining consistent identities across frames. However, most existing approaches primarily rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Yanchao Wang , Dawei Zhang , Chengzhuan Yang , Wei Liu , Minglu Li , Hua Wang , Zhonglong Zheng , Ming-Hsuan Yang

Multiple object tracking (MOT) has been successfully investigated in computer vision. However, MOT for the videos captured by unmanned aerial vehicles (UAV) is still challenging due to small object size, blurred object appearance, and very…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Mufeng Yao , Jiaqi Wang , Jinlong Peng , Mingmin Chi , Chao Liu

Multiple Object Tracking (MOT) aims to find bounding boxes and identities of targeted objects in consecutive video frames. While fully-supervised MOT methods have achieved high accuracy on existing datasets, they cannot generalize well on a…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Pha Nguyen , Kha Gia Quach , John Gauch , Samee U. Khan , Bhiksha Raj , Khoa Luu

Recently, many multi-modal trackers prioritize RGB as the dominant modality, treating other modalities as auxiliary, and fine-tuning separately various multi-modal tasks. This imbalance in modality dependence limits the ability of methods…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Xiantao Hu , Bineng Zhong , Qihua Liang , Zhiyi Mo , Liangtao Shi , Ying Tai , Jian Yang

Multi-modal reasoning systems rely on a pre-trained object detector to extract regions of interest from the image. However, this crucial module is typically used as a black box, trained independently of the downstream task and on a fixed…

Computer Vision and Pattern Recognition · Computer Science 2021-10-13 Aishwarya Kamath , Mannat Singh , Yann LeCun , Gabriel Synnaeve , Ishan Misra , Nicolas Carion

Multi-object tracking (MOT) is a vital component of intelligent video analytics applications such as surveillance and autonomous driving. The time and storage complexity required to execute deep learning models for visual object tracking…

Computer Vision and Pattern Recognition · Computer Science 2022-10-28 Keivan Nalaie , Rong Zheng

Current multi-object tracking (MOT) algorithms typically overlook issues inherent in low-quality videos, leading to significant degradation in tracking performance when confronted with real-world image deterioration. Therefore, advancing…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Jun Du , Weiwei Xing , Ming Li , Fei Richard Yu

Temporal modeling of objects is a key challenge in multiple object tracking (MOT). Existing methods track by associating detections through motion-based and appearance-based similarity heuristics. The post-processing nature of association…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Fangao Zeng , Bin Dong , Yuang Zhang , Tiancai Wang , Xiangyu Zhang , Yichen Wei

Multiple-Object Tracking (MOT) is of crucial importance for applications such as retail video analytics and video surveillance. Object detectors are often the computational bottleneck of modern MOT systems, limiting their use for real-time…

Computer Vision and Pattern Recognition · Computer Science 2019-08-14 Richard Cobos , Jefferson Hernandez , Andres G. Abad

Cross-Modal Retrieval (CMR), which retrieves relevant items from one modality (e.g., audio) given a query in another modality (e.g., visual), has undergone significant advancements in recent years. This capability is crucial for robots to…

Robotics · Computer Science 2024-07-31 Jagoda Wojcik , Jiaqi Jiang , Jiacheng Wu , Shan Luo

Multi-Object Tracking (MOT) remains a vital component of intelligent video analysis, which aims to locate targets and maintain a consistent identity for each target throughout a video sequence. Existing works usually learn a discriminative…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Yizhe Li , Sanping Zhou , Zheng Qin , Le Wang , Jinjun Wang , Nanning Zheng

Multi-object tracking in sports scenes plays a critical role in gathering players statistics, supporting further analysis, such as automatic tactical analysis. Yet existing MOT benchmarks cast little attention on the domain, limiting its…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Yutao Cui , Chenkai Zeng , Xiaoyu Zhao , Yichun Yang , Gangshan Wu , Limin Wang

Multi-modal tracking gains attention due to its ability to be more accurate and robust in complex scenarios compared to traditional RGB-based tracking. Its key lies in how to fuse multi-modal data and reduce the gap between modalities.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Jinyu Yang , Zhe Li , Feng Zheng , Aleš Leonardis , Jingkuan Song

Multiple object tracking (MOT) is a task in computer vision that aims to detect the position of various objects in videos and to associate them to a unique identity. We propose an approach based on Constraint Programming (CP) whose goal is…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Rémi Nahon , Guillaume-Alexandre Bilodeau , Gilles Pesant

Significant progress has been achieved in multi-object tracking (MOT) through the evolution of detection and re-identification (ReID) techniques. Despite these advancements, accurately tracking objects in scenarios with homogeneous…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Changcheng Xiao , Qiong Cao , Yujie Zhong , Long Lan , Xiang Zhang , Zhigang Luo , Dacheng Tao

Multiple Object Tracking (MOT) plays an important role in solving many fundamental problems in video analysis in computer vision. Most MOT methods employ two steps: Object Detection and Data Association. The first step detects objects of…

Computer Vision and Pattern Recognition · Computer Science 2019-07-17 ShiJie Sun , Naveed Akhtar , HuanSheng Song , Ajmal Mian , Mubarak Shah