English
Related papers

Related papers: Multi-Task Multi-Sensor Fusion for 3D Object Detec…

200 papers

The state of the art in 3D object detection using sensor fusion heavily relies on calibration quality, which is difficult to maintain in large scale deployment outside a lab environment. We present the first calibration-free approach for 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Michael Fürst , Rahul Jakkamsetty , René Schuster , Didier Stricker

We propose a deep convolutional object detector for automated driving applications that also estimates classification, pose and shape uncertainty of each detected object. The input consists of a multi-layer grid map which is well-suited for…

Robotics · Computer Science 2019-02-01 Sascha Wirges , Marcel Reith-Braun , Martin Lauer , Christoph Stiller

Object detection in remote sensing is a crucial computer vision task that has seen significant advancements with deep learning techniques. However, most existing works in this area focus on the use of generic object detection and do not…

Computer Vision and Pattern Recognition · Computer Science 2023-07-14 Abdelbadie Belmouhcine , Jean-Christophe Burnel , Luc Courtrai , Minh-Tan Pham , Sébastien Lefèvre

Many LiDAR-based methods for detecting large objects, single-class object detection, or under easy situations were claimed to perform quite well. However, their performances of detecting small objects or under hard situations did not…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Chia-Hung Wang , Hsueh-Wei Chen , Li-Chen Fu

Multimodal camera-LiDAR fusion technology has found extensive application in 3D object detection, demonstrating encouraging performance. However, existing methods exhibit significant performance degradation in challenging scenarios…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Sixian Liu , Chen Xu , Qiang Wang , Donghai Shi , Yiwen Li

Accurate detection of objects in 3D point clouds is a key problem in autonomous driving systems. Collaborative perception can incorporate information from spatially diverse sensors and provide significant benefits for improving the…

Computer Vision and Pattern Recognition · Computer Science 2022-05-25 Junyong Wang , Yuan Zeng , Yi Gong

LiDAR is crucial for robust 3D scene perception in autonomous driving. LiDAR perception has the largest body of literature after camera perception. However, multi-task learning across tasks like detection, segmentation, and motion…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Sambit Mohapatra , Senthil Yogamani , Varun Ravi Kumar , Stefan Milz , Heinrich Gotzig , Patrick Mäder

3D Multi-Object Tracking (MOT) is an important part of the unmanned vehicle perception module. Most methods optimize object detection and data association independently. These methods make the network structure complicated and limit the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-07 Yueling Shen , Guangming Wang , Hesheng Wang

Multi-object tracking (MOT) has important applications in monitoring, logistics, and other fields. This paper develops a real-time multi-object tracking and prediction system in rugged environments. A 3D object detection algorithm based on…

Robotics · Computer Science 2023-08-24 Shixing Huang , Zhihao Wang , Junyuan Ouyang , Haoyao Chen

We address the problem of 3D object detection from 2D monocular images in autonomous driving scenarios. We propose to lift the 2D images to 3D representations using learned neural networks and leverage existing networks working directly on…

Computer Vision and Pattern Recognition · Computer Science 2019-10-14 Siddharth Srivastava , Frederic Jurie , Gaurav Sharma

Monocular 3D Object Detection represents a challenging Computer Vision task due to the nature of the input used, which is a single 2D image, lacking in any depth cues and placing the depth estimation problem as an ill-posed one. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Diana-Alexandra Sas , Florin Oniga

In this paper, we propose a new deep architecture for fusing camera and LiDAR sensors for 3D object detection. Because the camera and LiDAR sensor signals have different characteristics and distributions, fusing these two modalities is…

Computer Vision and Pattern Recognition · Computer Science 2020-12-10 Jin Hyeok Yoo , Yecheol Kim , Jisong Kim , Jun Won Choi

Many recent works on 3D object detection have focused on designing neural network architectures that can consume point cloud data. While these approaches demonstrate encouraging performance, they are typically based on a single modality and…

Computer Vision and Pattern Recognition · Computer Science 2019-04-04 Vishwanath A. Sindagi , Yin Zhou , Oncel Tuzel

Edge computing-based 3D perception has received attention in intelligent transportation systems (ITS) because real-time monitoring of traffic candidates potentially strengthens Vehicle-to-Everything (V2X) orchestration. Thanks to the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Haolin Zhang , M S Mekala , Zulkar Nain , Dongfang Yang , Ju H. Park , Ho-Youl Jung

Sensor fusion is an essential topic in many perception systems, such as autonomous driving and robotics. Transformers-based detection head and CNN-based feature encoder to extract features from raw sensor-data has emerged as one of the best…

Computer Vision and Pattern Recognition · Computer Science 2023-02-23 Apoorv Singh

LiDAR and camera are two essential sensors for 3D object detection in autonomous driving. LiDAR provides accurate and reliable 3D geometry information while the camera provides rich texture with color. Despite the increasing popularity of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Qi Jiang , Hao Sun , Xi Zhang

Detecting objects in 3D space using multiple cameras, known as Multi-Camera 3D Object Detection (MC3D-Det), has gained prominence with the advent of bird's-eye view (BEV) approaches. However, these methods often struggle when faced with…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Hao Lu , Yunpeng Zhang , Qing Lian , Dalong Du , Yingcong Chen

LIDAR point clouds and RGB-images are both extremely essential for 3D object detection. So many state-of-the-art 3D detection algorithms dedicate in fusing these two types of data effectively. However, their fusion methods based on Birds…

Computer Vision and Pattern Recognition · Computer Science 2019-12-03 Liang Xie , Chao Xiang , Zhengxu Yu , Guodong Xu , Zheng Yang , Deng Cai , Xiaofei He

The ability for an autonomous agent or robot to track and identify potentially multiple objects in a dynamic environment is essential for many applications, such as automated surveillance, traffic monitoring, human-robot interaction, etc.…

Computer Vision and Pattern Recognition · Computer Science 2016-05-26 Aijun Bai

Multi-sensor fusion is essential for accurate 3D object detection in self-driving systems. Camera and LiDAR are the most commonly used sensors, and usually, their fusion happens at the early or late stages of 3D detectors with the help of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Javed Ahmad , Alessio Del Bue