English
Related papers

Related papers: MUTR3D: A Multi-camera Tracking Framework via 3D-t…

200 papers

Multiple Object Tracking (MOT) is crucial to autonomous vehicle perception. End-to-end transformer-based algorithms, which detect and track objects simultaneously, show great potential for the MOT task. However, most existing methods focus…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Ce Zhang , Chengjie Zhang , Yiluan Guo , Lingji Chen , Michael Happold

Camera localization in 3D LiDAR maps has gained increasing attention due to its promising ability to handle complex scenarios, surpassing the limitations of visual-only localization methods. However, existing methods mostly focus on…

Robotics · Computer Science 2024-10-28 Huai Yu , Kuangyi Chen , Wen Yang , Sebastian Scherer , Gui-Song Xia

Recent advances of monocular 3D object detection facilitate the 3D multi-object tracking task based on low-cost camera sensors. In this paper, we find that the motion cue of objects along different time frames is critical in 3D multi-object…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Kuan-Chih Huang , Ming-Hsuan Yang , Yi-Hsuan Tsai

3D Multi-object tracking (MOT) ensures consistency during continuous dynamic detection, conducive to subsequent motion planning and navigation tasks in autonomous driving. However, camera-based methods suffer in the case of occlusions and…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Li Wang , Xinyu Zhang , Wenyuan Qin , Xiaoyu Li , Lei Yang , Zhiwei Li , Lei Zhu , Hong Wang , Jun Li , Huaping Liu

Recent advances in 4D imaging radar have enabled robust perception in adverse weather, while camera sensors provide dense semantic information. Fusing the these complementary modalities has great potential for cost-effective 3D perception.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Xiaozhi Li , Huijun Di , Jian Li , Feng Liu , Wei Liang

Online multi-object tracking (MOT) is extremely important for high-level spatial reasoning and path planning for autonomous and highly-automated vehicles. In this paper, we present a modular framework for tracking multiple objects…

Computer Vision and Pattern Recognition · Computer Science 2019-02-20 Akshay Rangesh , Mohan M. Trivedi

Multi-object tracking (MOT) aims to track multiple objects while maintaining consistent identities across frames of a given video. In unmanned aerial vehicle (UAV) recorded videos, frequent viewpoint changes and complex UAV-ground relative…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Jianbo Ma , Hui Luo , Qi Chen , Yuankai Qi , Yumei Sun , Amin Beheshti , Jianlin Zhang , Ming-Hsuan Yang

3D Multi-Object Tracking (MOT) is an important part of the unmanned vehicle perception module. Most methods optimize object detection and data association independently. These methods make the network structure complicated and limit the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-07 Yueling Shen , Guangming Wang , Hesheng Wang

Multi-object tracking is a cornerstone capability of any robotic system. The quality of tracking is largely dependent on the quality of the detector used. In many applications, such as autonomous vehicles, it is preferable to over-detect…

Computer Vision and Pattern Recognition · Computer Science 2023-02-08 Tara Sadjadpour , Jie Li , Rares Ambrus , Jeannette Bohg

We introduce the first data-driven multi-view 3D point tracker, designed to track arbitrary points in dynamic scenes using multiple camera views. Unlike existing monocular trackers, which struggle with depth ambiguities and occlusion, or…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Frano Rajič , Haofei Xu , Marko Mihajlovic , Siyuan Li , Irem Demir , Emircan Gündoğdu , Lei Ke , Sergey Prokudin , Marc Pollefeys , Siyu Tang

In this work, we present a unified framework for multi-modality 3D object detection, named UVTR. The proposed method aims to unify multi-modality representations in the voxel space for accurate and robust single- or cross-modality 3D…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Yanwei Li , Yilun Chen , Xiaojuan Qi , Zeming Li , Jian Sun , Jiaya Jia

To enable self-driving vehicles accurate detection and tracking of surrounding objects is essential. While Light Detection and Ranging (LiDAR) sensors have set the benchmark for high-performance systems, the appeal of camera-only solutions…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Nicolas Baumann , Michael Baumgartner , Edoardo Ghignone , Jonas Kühne , Tobias Fischer , Yung-Hsu Yang , Marc Pollefeys , Michele Magno

In this paper, we propose a new joint object detection and tracking (JoDT) framework for 3D object detection and tracking based on camera and LiDAR sensors. The proposed method, referred to as 3D DetecTrack, enables the detector and tracker…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 Junho Koh , Jaekyum Kim , Jinhyuk Yoo , Yecheol Kim , Dongsuk Kum , Jun Won Choi

Multi-object tracking is an important ability for an autonomous vehicle to safely navigate a traffic scene. Current state-of-the-art follows the tracking-by-detection paradigm where existing tracks are associated with detected objects…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Hsu-kuang Chiu , Jie Li , Rares Ambrus , Jeannette Bohg

Many query-based approaches for 3D Multi-Object Tracking (MOT) adopt the tracking-by-attention paradigm, utilizing track queries for identity-consistent detection and object queries for identity-agnostic track spawning.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Shuxiao Ding , Lukas Schneider , Marius Cordts , Juergen Gall

The MS-GLMB filter offers a robust framework for tracking multiple objects through the use of multi-sensor data. Building on this, the MV-GLMB and MV-GLMB-AB filters enhance the MS-GLMB capabilities by employing cameras for 3D multi-sensor…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Linh Van Ma , Muhammad Ishfaq Hussain , Kin-Choong Yow , Moongu Jeon

Compared with real-time multi-object tracking (MOT), offline multi-object tracking (OMOT) has the advantages to perform 2D-3D detection fusion, erroneous link correction, and full track optimization but has to deal with the challenges from…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Kemiao Huang , Yinqi Chen , Meiying Zhang , Qi Hao

The fusion of camera- and LiDAR-based detections offers a promising solution to mitigate tracking failures in 3D multi-object tracking (MOT). However, existing methods predominantly exploit camera detections to correct tracking failures…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Lipeng Gu , Xuefeng Yan , Weiming Wang , Honghua Chen , Dingkun Zhu , Liangliang Nan , Mingqiang Wei

In the recent literature, on the one hand, many 3D multi-object tracking (MOT) works have focused on tracking accuracy and neglected computation speed, commonly by designing rather complex cost functions and feature extractors. On the other…

Computer Vision and Pattern Recognition · Computer Science 2022-08-29 Xiyang Wang , Chunyun Fu , Zhankun Li , Ying Lai , Jiawei He

Following the tracking-by-attention paradigm, this paper introduces an object-centric, transformer-based framework for tracking in 3D. Traditional model-based tracking approaches incorporate the geometric effect of object- and ego motion…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Simon Doll , Niklas Hanselmann , Lukas Schneider , Richard Schulz , Markus Enzweiler , Hendrik P. A. Lensch