English
Related papers

Related papers: Joint 3D Object Detection and Tracking Using Spati…

200 papers

Today's state-of-the-art methods for 3D object detection are based on lidar, stereo, or monocular cameras. Lidar-based methods achieve the best accuracy, but have a large footprint, high cost, and mechanically-limited angular sampling…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Frank Julca-Aguilar , Jason Taylor , Mario Bijelic , Fahim Mannan , Ethan Tseng , Felix Heide

Object detection and object tracking are usually treated as two separate processes. Significant progress has been made for object detection in 2D images using deep learning networks. The usual tracking-by-detection pipeline for object…

Computer Vision and Pattern Recognition · Computer Science 2019-02-06 Chenge Li , Gregory Dobler , Xin Feng , Yao Wang

Multiple Object Tracking (MOT) focuses on modeling the relationship of detected objects among consecutive frames and merge them into different trajectories. MOT remains a challenging task as noisy and confusing detection results often…

Computer Vision and Pattern Recognition · Computer Science 2023-02-07 Tao Wang , Kean Chen , Weiyao Lin , John See , Zenghui Zhang , Qian Xu , Xia Jia

This paper presents a novel multi-modal Multi-Object Tracking (MOT) algorithm for self-driving cars that combines camera and LiDAR data. Camera frames are processed with a state-of-the-art 3D object detector, whereas classical clustering…

Robotics · Computer Science 2024-05-14 Riccardo Pieroni , Simone Specchia , Matteo Corno , Sergio Matteo Savaresi

Joint detection and embedding (JDE) based methods usually estimate bounding boxes and embedding features of objects with a single network in Multi-Object Tracking (MOT). In the tracking stage, JDE-based methods fuse the target motion…

Computer Vision and Pattern Recognition · Computer Science 2022-03-09 Jiaxin Li , Yan Ding , Hualiang Wei

Accurate moving object segmentation is an essential task for autonomous driving. It can provide effective information for many downstream tasks, such as collision avoidance, path planning, and static map construction. How to effectively…

Computer Vision and Pattern Recognition · Computer Science 2022-07-06 Jiadai Sun , Yuchao Dai , Xianjing Zhang , Jintao Xu , Rui Ai , Weihao Gu , Xieyuanli Chen

Image-based 3D object detection is an inevitable part of autonomous driving because cheap onboard cameras are already available in most modern cars. Because of the accurate depth information, currently, most state-of-the-art 3D object…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Hendrik Königshof , Kun Li , Christoph Stiller

Supervised 3D Object Detection models have been displaying increasingly better performance in single-domain cases where the training data comes from the same environment and sensor as the testing data. However, in real-world scenarios data…

Computer Vision and Pattern Recognition · Computer Science 2023-08-03 Louis Soum-Fontez , Jean-Emmanuel Deschaud , François Goulette

The recent trend in 2D multiple object tracking (MOT) is jointly solving detection and tracking, where object detection and appearance feature (or motion) are learned simultaneously. Despite competitive performance, in crowded scenes, joint…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Weihong Ren , Denglu Wu , Hui Cao , Xi'ai Chen , Zhi Han , Honghai Liu

A reliable and accurate 3D tracking framework is essential for predicting future locations of surrounding objects and planning the observer's actions in numerous applications such as autonomous driving. We propose a framework that can…

Computer Vision and Pattern Recognition · Computer Science 2021-03-15 Hou-Ning Hu , Yung-Hsu Yang , Tobias Fischer , Trevor Darrell , Fisher Yu , Min Sun

Online 3D multi-object tracking (MOT) has witnessed significant research interest in recent years, largely driven by demand from the autonomous systems community. However, 3D offline MOT is relatively less explored. Labeling 3D trajectory…

Computer Vision and Pattern Recognition · Computer Science 2022-05-17 Martin Buchner , Abhinav Valada

Multiple object tracking (MOT) is a significant task in achieving autonomous driving. Traditional works attempt to complete this task, either based on point clouds (PC) collected by LiDAR, or based on images captured from cameras. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Guangming Wang , Chensheng Peng , Jinpeng Zhang , Hesheng Wang

Monocular 3D Object Detection represents a challenging Computer Vision task due to the nature of the input used, which is a single 2D image, lacking in any depth cues and placing the depth estimation problem as an ill-posed one. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Diana-Alexandra Sas , Florin Oniga

3D object proposals, quickly detected regions in a 3D scene that likely contain an object of interest, are an effective approach to improve the computational efficiency and accuracy of the object detection framework. In this work, we…

Robotics · Computer Science 2018-06-27 Ramanpreet Singh Pahwa , Tian Tsong Ng , Minh N. Do

Tracking of objects in 3D is a fundamental task in computer vision that finds use in a wide range of applications such as autonomous driving, robotics or augmented reality. Most recent approaches for 3D multi object tracking (MOT) from…

Computer Vision and Pattern Recognition · Computer Science 2021-04-26 Jan-Nico Zaech , Dengxin Dai , Alexander Liniger , Martin Danelljan , Luc Van Gool

Recent years have witnessed huge successes in 3D object detection to recognize common objects for autonomous driving (e.g., vehicles and pedestrians). However, most methods rely heavily on a large amount of well-labeled training data. This…

Computer Vision and Pattern Recognition · Computer Science 2023-02-09 Jiawei Liu , Xingping Dong , Sanyuan Zhao , Jianbing Shen

3D object detection with surround-view images is an essential task for autonomous driving. In this work, we propose DETR4D, a Transformer-based framework that explores sparse attention and direct feature query for 3D object detection in…

Computer Vision and Pattern Recognition · Computer Science 2022-12-16 Zhipeng Luo , Changqing Zhou , Gongjie Zhang , Shijian Lu

The Detection Transformer (DETR) has revolutionized the design of CNN-based object detection systems, showcasing impressive performance. However, its potential in the domain of multi-frame 3D object detection remains largely unexplored. In…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Yifan Zhang , Zhiyu Zhu , Junhui Hou , Dapeng Wu

In this article, we propose a novel LiDAR and event camera fusion modality for subterranean (SubT) environments for fast and precise object and human detection in a wide variety of adverse lighting conditions, such as low or no light,…

3D multi-object tracking in LiDAR point clouds is a key ingredient for self-driving vehicles. Existing methods are predominantly based on the tracking-by-detection pipeline and inevitably require a heuristic matching step for the detection…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Chenxu Luo , Xiaodong Yang , Alan Yuille