English
Related papers

Related papers: Robust Multi-Modality Multi-Object Tracking

200 papers

Multi-Object Tracking (MOT) has been notoriously difficult to evaluate. Previous metrics overemphasize the importance of either detection or association. To address this, we present a novel MOT evaluation metric, HOTA (Higher Order Tracking…

Computer Vision and Pattern Recognition · Computer Science 2020-10-09 Jonathon Luiten , Aljosa Osep , Patrick Dendorfer , Philip Torr , Andreas Geiger , Laura Leal-Taixe , Bastian Leibe

Single object tracking aims to localize target object with specific reference modalities (bounding box, natural language or both) in a sequence of specific video modalities (RGB, RGB+Depth, RGB+Thermal or RGB+Event.). Different reference…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Yinchao Ma , Yuyang Tang , Wenfei Yang , Tianzhu Zhang , Xu Zhou , Feng Wu

Multi-Object Tracking (MOT) is evolving from geometric localization to Semantic MOT (SMOT) to answer complex relational queries, yet progress is hindered by semantic data scarcity and a structural disconnect between tracking architectures…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Pan Liao , Feng Yang , Di Wu , Jinwen Yu , Yuhua Zhu , Wenhui Zhao , Dingwen Zhang

Multi-object tracking (MOT) is an important problem in computer vision which has a wide range of applications. Formulating MOT as multi-task learning of object detection and re-ID in a single network is appealing since it allows joint…

Computer Vision and Pattern Recognition · Computer Science 2021-10-20 Yifu Zhang , Chunyu Wang , Xinggang Wang , Wenjun Zeng , Wenyu Liu

In this paper, we propose a novel concept of path consistency to learn robust object matching without using manual object identity supervision. Our key idea is that, to track a object through frames, we can obtain multiple different…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Zijia Lu , Bing Shuai , Yanbei Chen , Zhenlin Xu , Davide Modolo

Accurately distinguishing each object is a fundamental goal of Multi-object tracking (MOT) algorithms. However, achieving this goal still remains challenging, primarily due to: (i) For crowded scenes with occluded objects, the high overlap…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Jiapeng Wu , Yichen Liu

Recent advances of monocular 3D object detection facilitate the 3D multi-object tracking task based on low-cost camera sensors. In this paper, we find that the motion cue of objects along different time frames is critical in 3D multi-object…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Kuan-Chih Huang , Ming-Hsuan Yang , Yi-Hsuan Tsai

Multi-object tracking (MOT) is critical in numerous real-world applications, including surveillance, autonomous driving, and robotics. Accurately predicting object motion is fundamental to MOT, but current methods struggle with the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Nhat-Tan Do , Le-Huy Tu , Nhi Ngoc-Yen Nguyen , Dieu-Phuong Nguyen , Trong-Hop Do

Unifying multiple multi-modal visual object tracking (MMVOT) tasks draws increasing attention due to the complementary nature of different modalities in building robust tracking systems. Existing practices mix all data sensor types in a…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Zhangyong Tang , Tianyang Xu , Xuefeng Zhu , Chunyang Cheng , Tao Zhou , Xiaojun Wu , Josef Kittler

Multi-object tracking (MOT) is a fundamental problem in computer vision with numerous applications, such as intelligent surveillance and automated driving. Despite the significant progress made in MOT, pedestrian attributes, such as gender,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Yunhao Li , Zhen Xiao , Lin Yang , Dan Meng , Xin Zhou , Heng Fan , Libo Zhang

This paper presents a robust multi-class multi-object tracking (MCMOT) formulated by a Bayesian filtering framework. Multi-object tracking for unlimited object classes is conducted by combining detection responses and changing point…

Computer Vision and Pattern Recognition · Computer Science 2018-05-30 Byungjae Lee , Enkhbayar Erdenee , Songguo Jin , Phill Kyu Rhee

Multi-object tracking (MOT) aims at estimating bounding boxes and identities of objects in videos. Most methods can be roughly classified as tracking-by-detection and joint-detection-association paradigms. Although the latter has elicited…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Run Luo , JinLin Wei , Qiao Lin

What constitutes an object? This has been a long-standing question in computer vision. Towards this goal, numerous learning-free and learning-based approaches have been developed to score objectness. However, they generally do not scale…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Muhammad Maaz , Hanoona Rasheed , Salman Khan , Fahad Shahbaz Khan , Rao Muhammad Anwer , Ming-Hsuan Yang

Transformer-based multi-object tracking (MOT) methods have captured the attention of many researchers in recent years. However, these models often suffer from slow inference speeds due to their structure or other issues. To address this…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Pan Liao , Feng Yang , Di Wu , Jinwen Yu , Wenhui Zhao , Dingwen Zhang

Multi-camera multi-object tracking (MCMOT) faces significant challenges in maintaining consistent object identities across varying camera perspectives, particularly when precise calibration and extensive annotations are required. In this…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Ruiqi Xian , Deep Patel , Iain Melvin , Sanjoy Kundu , Martin Renqiang Min , Dinesh Manocha

Multispectral image pairs can provide the combined information, making object detection applications more reliable and robust in the open world. To fully exploit the different modalities, we present a simple yet effective cross-modality…

Image and Video Processing · Electrical Eng. & Systems 2022-10-05 Fang Qingyun , Han Dapeng , Wang Zhaokui

Comprehensive understanding of dynamic scenes is a critical prerequisite for intelligent robots to autonomously operate in their environment. Research in this domain, which encompasses diverse perception problems, has primarily been focused…

Computer Vision and Pattern Recognition · Computer Science 2021-11-05 Juana Valeria Hurtado , Rohit Mohan , Wolfram Burgard , Abhinav Valada

Modern multi-object tracking (MOT) system usually involves separated modules, such as motion model for location and appearance model for data association. However, the compatible problems within both motion and appearance models are always…

Computer Vision and Pattern Recognition · Computer Science 2020-03-18 Piao Huang , Shoudong Han , Jun Zhao , Donghaisheng Liu , Hongwei Wang , En Yu , Alex ChiChung Kot

Object detection has been extensively utilized in autonomous systems in recent years, encompassing both 2D and 3D object detection. Recent research in this field has primarily centered around multimodal approaches for addressing this…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Wendong Zhang

We propose a method for joint detection and tracking of multiple objects in 3D point clouds, a task conventionally treated as a two-step process comprising object detection followed by data association. Our method embeds both steps into a…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Jyoti Kini , Ajmal Mian , Mubarak Shah