English
Related papers

Related papers: Multistream Network for LiDAR and Camera-based 3D …

200 papers

In recent years, the field of autonomous driving has witnessed remarkable advancements, driven by the integration of a multitude of sensors, including cameras and LiDAR systems, in different prototypes. However, with the proliferation of…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Irene Cortés , Jorge Beltrán , Arturo de la Escalera , Fernando García

In this paper, we propose a new joint object detection and tracking (JoDT) framework for 3D object detection and tracking based on camera and LiDAR sensors. The proposed method, referred to as 3D DetecTrack, enables the detector and tracker…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 Junho Koh , Jaekyum Kim , Jinhyuk Yoo , Yecheol Kim , Dongsuk Kum , Jun Won Choi

LiDAR-based 3D object detection, semantic segmentation, and panoptic segmentation are usually implemented in specialized networks with distinctive architectures that are difficult to adapt to each other. This paper presents LidarMultiNet, a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Dongqiangzi Ye , Zixiang Zhou , Weijia Chen , Yufei Xie , Yu Wang , Panqu Wang , Hassan Foroosh

In this paper we propose to exploit multiple related tasks for accurate multi-sensor 3D object detection. Towards this goal we present an end-to-end learnable architecture that reasons about 2D and 3D object detection as well as ground…

Computer Vision and Pattern Recognition · Computer Science 2020-12-24 Ming Liang , Bin Yang , Yun Chen , Rui Hu , Raquel Urtasun

Compared with real-time multi-object tracking (MOT), offline multi-object tracking (OMOT) has the advantages to perform 2D-3D detection fusion, erroneous link correction, and full track optimization but has to deal with the challenges from…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Kemiao Huang , Yinqi Chen , Meiying Zhang , Qi Hao

Light Detection And Ranging (LiDAR) has been widely used in autonomous vehicles for perception and localization. However, the cost of a high-resolution LiDAR is still prohibitively expensive, while its low-resolution counterpart is much…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Lin Bai , Yiming Zhao , Xinming Huang

The purpose of this work is to review the state-of-the-art LiDAR-based 3D object detection methods, datasets, and challenges. We describe novel data augmentation methods, sampling strategies, activation functions, attention mechanisms, and…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Walter Zimmer , Emec Ercelik , Xingcheng Zhou , Xavier Jair Diaz Ortiz , Alois Knoll

Monocular 3D scene understanding tasks, such as object size estimation, heading angle estimation and 3D localization, is challenging. Successful modern day methods for 3D scene understanding require the use of a 3D sensor. On the other…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Xinshuo Weng , Kris Kitani

3D object detection using LiDAR data is an indispensable component for autonomous driving systems. Yet, only a few LiDAR-based 3D object detection methods leverage segmentation information to further guide the detection process. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-03-07 Hamidreza Fazlali , Yixuan Xu , Yuan Ren , Bingbing Liu

In this paper, we propose a new deep architecture for fusing camera and LiDAR sensors for 3D object detection. Because the camera and LiDAR sensor signals have different characteristics and distributions, fusing these two modalities is…

Computer Vision and Pattern Recognition · Computer Science 2020-12-10 Jin Hyeok Yoo , Yecheol Kim , Jisong Kim , Jun Won Choi

Accurately localizing 3D objects like pedestrians, cyclists, and other vehicles is essential in Autonomous Driving. To ensure high detection performance, Autonomous Vehicles complement RGB cameras with LiDAR sensors, but effectively…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Carlo Sgaravatti , Riccardo Pieroni , Matteo Corno , Sergio M. Savaresi , Luca Magri , Giacomo Boracchi

LiDAR datasets for autonomous driving exhibit biases in properties such as point cloud density, range, and object dimensions. As a result, object detection networks trained and evaluated in different environments often experience…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Deepti Hegde , Suhas Lohit , Kuan-Chuan Peng , Michael J. Jones , Vishal M. Patel

3D detection is a critical task that enables machines to identify and locate objects in three-dimensional space. It has a broad range of applications in several fields, including autonomous driving, robotics and augmented reality. Monocular…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Aakash Kumar , Chen Chen , Ajmal Mian , Neils Lobo , Mubarak Shah

This paper tackles the 3D object detection problem, which is of vital importance for applications such as autonomous driving. Our framework uses a Machine Learning (ML) pipeline on a combination of monocular camera and LiDAR data to detect…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Gustavo A. Salazar-Gomez , Miguel A. Saavedra-Ruiz , Victor A. Romero-Cano

Understanding driving situations regardless the conditions of the traffic scene is a cornerstone on the path towards autonomous vehicles; however, despite common sensor setups already include complementary devices such as LiDAR or radar,…

Computer Vision and Pattern Recognition · Computer Science 2018-05-04 Jorge Beltran , Carlos Guindel , Francisco Miguel Moreno , Daniel Cruzado , Fernando Garcia , Arturo de la Escalera

Multi-object tracking (MOT) with camera-LiDAR fusion demands accurate results of object detection, affinity computation and data association in real time. This paper presents an efficient multi-modal MOT framework with online joint…

Computer Vision and Pattern Recognition · Computer Science 2021-08-11 Kemiao Huang , Qi Hao

3D object detection is a key component of many robotic applications such as self-driving vehicles. While many approaches rely on expensive 3D sensors such as LiDAR to produce accurate 3D estimates, methods that exploit stereo cameras have…

Computer Vision and Pattern Recognition · Computer Science 2021-08-03 Yan Wang , Bin Yang , Rui Hu , Ming Liang , Raquel Urtasun

Multi-modal depth estimation is one of the key challenges for endowing autonomous machines with robust robotic perception capabilities. There have been outstanding advances in the development of uni-modal depth estimation techniques based…

Robotics · Computer Science 2023-07-21 Johan S. Obando-Ceron , Victor Romero-Cano , Sildomar Monteiro

State-of-the-art lidar-based 3D object detection methods rely on supervised learning and large labeled datasets. However, annotating lidar data is resource-consuming, and depending only on supervised learning limits the applicability of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Ekim Yurtsever , Emeç Erçelik , Mingyu Liu , Zhijie Yang , Hanzhen Zhang , Pınar Topçam , Maximilian Listl , Yılmaz Kaan Çaylı , Alois Knoll

The estimation of uncertainty in robotic vision, such as 3D object detection, is an essential component in developing safe autonomous systems aware of their own performance. However, the deployment of current uncertainty estimation methods…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Matthew Pitropov , Chengjie Huang , Vahdat Abdelzad , Krzysztof Czarnecki , Steven Waslander