English
Related papers

Related papers: High-level camera-LiDAR fusion for 3D object detec…

200 papers

3D object detection is a fundamental and challenging task for 3D scene understanding, and the monocular-based methods can serve as an economical alternative to the stereo-based or LiDAR-based methods. However, accurately detecting objects…

Computer Vision and Pattern Recognition · Computer Science 2022-01-27 Zhiyu Chong , Xinzhu Ma , Hong Zhang , Yuxin Yue , Haojie Li , Zhihui Wang , Wanli Ouyang

Reliable dynamic object detection in cluttered environments remains a critical challenge for autonomous navigation. Purely geometric LiDAR pipelines that rely on clustering and heuristic filtering can miss dynamic obstacles when they move…

Robotics · Computer Science 2026-03-18 Juan Rached , Yixuan Jia , Kota Kondo , Jonathan P. How

Autonomous driving, in recent years, has been receiving increasing attention for its potential to relieve drivers' burdens and improve the safety of driving. In modern autonomous driving pipelines, the perception system is an indispensable…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Jiageng Mao , Shaoshuai Shi , Xiaogang Wang , Hongsheng Li

LiDAR and camera are two essential sensors for 3D object detection in autonomous driving. LiDAR provides accurate and reliable 3D geometry information while the camera provides rich texture with color. Despite the increasing popularity of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Qi Jiang , Hao Sun , Xi Zhang

In this survey, we first introduce the background of popular sensors used for self-driving, their data properties, and the corresponding object detection algorithms. Next, we discuss existing datasets that can be used for evaluating…

Computer Vision and Pattern Recognition · Computer Science 2023-03-08 Yingjie Wang , Qiuyu Mao , Hanqi Zhu , Jiajun Deng , Yu Zhang , Jianmin Ji , Houqiang Li , Yanyong Zhang

This article describes a multi-modal method using simulated Lidar data via ray tracing and image pixel loss with differentiable rendering to optimize an object's position with respect to an observer or some referential objects in a computer…

Systems and Control · Electrical Eng. & Systems 2023-09-07 Sean Zanyk-McLean , Krishna Kumar , Paul Navratil

A common dilemma in 3D object detection for autonomous driving is that high-quality, dense point clouds are only available during training, but not testing. We use knowledge distillation to bridge the gap between a model trained on…

Computer Vision and Pattern Recognition · Computer Science 2020-09-25 Yue Wang , Alireza Fathi , Jiajun Wu , Thomas Funkhouser , Justin Solomon

Multimodal sensor fusion methods for 3D object detection have been revolutionizing the autonomous driving research field. Nevertheless, most of these methods heavily rely on dense LiDAR data and accurately calibrated sensors which is often…

Robotics · Computer Science 2023-06-14 Maciej K. Wozniak , Viktor Karefjards , Marko Thiel , Patric Jensfelt

The estimation of uncertainty in robotic vision, such as 3D object detection, is an essential component in developing safe autonomous systems aware of their own performance. However, the deployment of current uncertainty estimation methods…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Matthew Pitropov , Chengjie Huang , Vahdat Abdelzad , Krzysztof Czarnecki , Steven Waslander

We present a system for automatic converting of 2D mask object predictions and raw LiDAR point clouds into full 3D bounding boxes of objects. Because the LiDAR point clouds are partial, directly fitting bounding boxes to the point clouds is…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Robert McCraith , Eldar Insafutdinov , Lukas Neumann , Andrea Vedaldi

The ability to accurately detect and localize objects is recognized as being the most important for the perception of self-driving cars. From 2D to 3D object detection, the most difficult is to determine the distance from the ego-vehicle to…

Computer Vision and Pattern Recognition · Computer Science 2021-05-31 Nguyen Anh Minh Mai , Pierre Duthon , Louahdi Khoudour , Alain Crouzil , Sergio A. Velastin

Multimodal 3D object detectors leverage the strengths of both geometry-aware LiDAR point clouds and semantically rich RGB images to enhance detection performance. However, the inherent heterogeneity between these modalities, including…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Zhuoqun Su , Huimin Lu , Shuaifeng Jiao , Junhao Xiao , Yaonan Wang , Xieyuanli Chen

Existing LiDAR-Camera fusion methods have achieved strong results in 3D object detection. To address the sparsity of point clouds, previous approaches typically construct spatial pseudo point clouds via depth completion as auxiliary input…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Jijun Wang , Yan Wu , Yujian Mo , Junqiao Zhao , Jun Yan , Yinghao Hu

In recent times, the scope of LIDAR (Light Detection and Ranging) sensor-based technology has spread across numerous fields. It is popularly used to map terrain and navigation information into reliable 3D point cloud data, potentially…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Aakash Kumar , Jyoti Kini , Mubarak Shah , Ajmal Mian

To assure that an autonomous car is driving safely on public roads, its object detection module should not only work correctly, but show its prediction confidence as well. Previous object detectors driven by deep learning do not explicitly…

Robotics · Computer Science 2018-09-10 Di Feng , Lars Rosenbaum , Klaus Dietmayer

An automated vehicle operating in an urban environment must be able to perceive and recognise object/obstacles in a three-dimensional world while navigating in a constantly changing environment. In order to plan and execute accurate…

Computer Vision and Pattern Recognition · Computer Science 2020-07-13 Julie Stephany Berrio , Mao Shan , Stewart Worrall , Eduardo Nebot

Reliable and accurate 3D object detection is a necessity for safe autonomous driving. Although LiDAR sensors can provide accurate 3D point cloud estimates of the environment, they are also prohibitively expensive for many settings.…

Computer Vision and Pattern Recognition · Computer Science 2020-05-15 Rui Qian , Divyansh Garg , Yan Wang , Yurong You , Serge Belongie , Bharath Hariharan , Mark Campbell , Kilian Q. Weinberger , Wei-Lun Chao

Estimating 3D bounding boxes from monocular images is an essential component in autonomous driving, while accurate 3D object detection from this kind of data is very challenging. In this work, by intensive diagnosis experiments, we quantify…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Xinzhu Ma , Yinmin Zhang , Dan Xu , Dongzhan Zhou , Shuai Yi , Haojie Li , Wanli Ouyang

Within the past decade, the rise of applications based on artificial intelligence (AI) in general and machine learning (ML) in specific has led to many significant contributions within different domains. The applications range from robotics…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Christoph Sager , Patrick Zschech , Niklas Kühl

Accurate moving object segmentation is an essential task for autonomous driving. It can provide effective information for many downstream tasks, such as collision avoidance, path planning, and static map construction. How to effectively…

Computer Vision and Pattern Recognition · Computer Science 2022-07-06 Jiadai Sun , Yuchao Dai , Xianjing Zhang , Jintao Xu , Rui Ai , Weihao Gu , Xieyuanli Chen