English
Related papers

Related papers: Multi-Modal 3D Object Detection in Autonomous Driv…

200 papers

The perception module of self-driving vehicles relies on a multi-sensor system to understand its environment. Recent advancements in deep learning have led to the rapid development of approaches that integrate multi-sensory measurements to…

Robotics · Computer Science 2023-07-14 Xi Zhu , Likang Wang , Caifa Zhou , Xiya Cao , Yue Gong , Lei Chen

Point clouds and images could provide complementary information when representing 3D objects. Fusing the two kinds of data usually helps to improve the detection results. However, it is challenging to fuse the two data modalities, due to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Xun Tan , Xingyu Chen , Guowei Zhang , Jishiyu Ding , Xuguang Lan

Object detection is one of the most important and challenging branches of computer vision, which has been widely applied in peoples life, such as monitoring security, autonomous driving and so on, with the purpose of locating instances of…

Computer Vision and Pattern Recognition · Computer Science 2019-10-18 Licheng Jiao , Fan Zhang , Fang Liu , Shuyuan Yang , Lingling Li , Zhixi Feng , Rong Qu

The state of the art in 3D object detection using sensor fusion heavily relies on calibration quality, which is difficult to maintain in large scale deployment outside a lab environment. We present the first calibration-free approach for 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Michael Fürst , Rahul Jakkamsetty , René Schuster , Didier Stricker

Driven by deep learning techniques, perception technology in autonomous driving has developed rapidly in recent years, enabling vehicles to accurately detect and interpret surrounding environment for safe and efficient navigation. To…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Shanliang Yao , Runwei Guan , Xiaoyu Huang , Zhuoxiao Li , Xiangyu Sha , Yong Yue , Eng Gee Lim , Hyungjoon Seo , Ka Lok Man , Xiaohui Zhu , Yutao Yue

Automotive traffic scenes are complex due to the variety of possible scenarios, objects, and weather conditions that need to be handled. In contrast to more constrained environments, such as automated underground trains, automotive…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Felix Nobis , Ehsan Shafiei , Phillip Karle , Johannes Betz , Markus Lienkamp

Reliable detection and tracking of surrounding objects are indispensable for comprehensive motion prediction and planning of autonomous vehicles. Due to the limitations of individual sensors, the fusion of multiple sensor modalities is…

Robotics · Computer Science 2023-10-13 Phillip Karle , Felix Fent , Sebastian Huch , Florian Sauerbeck , Markus Lienkamp

This work aims to address the challenges in autonomous driving by focusing on the 3D perception of the environment using roadside LiDARs. We design a 3D object detection model that can detect traffic participants in roadside LiDARs in…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Walter Zimmer , Jialong Wu , Xingcheng Zhou , Alois C. Knoll

Perception and prediction modules are critical components of autonomous driving systems, enabling vehicles to navigate safely through complex environments. The perception module is responsible for perceiving the environment, including…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Lucas Dal'Col , Miguel Oliveira , Vítor Santos

Aiming at highly accurate object detection for connected and automated vehicles (CAVs), this paper presents a Deep Neural Network based 3D object detection model that leverages a three-stage feature extractor by developing a novel…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Yiming Hou , Mahdi Rezaei , Richard Romano

This work presents a probabilistic deep neural network that combines LiDAR point clouds and RGB camera images for robust, accurate 3D object detection. We explicitly model uncertainties in the classification and regression tasks, and…

Robotics · Computer Science 2020-02-04 Di Feng , Yifan Cao , Lars Rosenbaum , Fabian Timm , Klaus Dietmayer

This paper tackles the 3D object detection problem, which is of vital importance for applications such as autonomous driving. Our framework uses a Machine Learning (ML) pipeline on a combination of monocular camera and LiDAR data to detect…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Gustavo A. Salazar-Gomez , Miguel A. Saavedra-Ruiz , Victor A. Romero-Cano

3D object detection with surrounding cameras has been a promising direction for autonomous driving. In this paper, we present SimMOD, a Simple baseline for Multi-camera Object Detection, to solve the problem. To incorporate multi-view…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Yunpeng Zhang , Wenzhao Zheng , Zheng Zhu , Guan Huang , Jie Zhou , Jiwen Lu

In this paper, we propose a monocular 3D object detection framework in the domain of autonomous driving. Unlike previous image-based methods which focus on RGB feature extracted from 2D images, our method solves this problem in the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Xinzhu Ma , Zhihui Wang , Haojie Li , Pengbo Zhang , Xin Fan , Wanli Ouyang

The 3D object detection capabilities in urban environments have been enormously improved by recent developments in Light Detection and Range (LiDAR) technology. This paper presents a novel framework that transforms the detection and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Nawfal Guefrachi , Hakim Ghazzai , Ahmad Alsharoa

Accurate and robust object detection is critical for autonomous driving. Image-based detectors face difficulties caused by low visibility in adverse weather conditions. Thus, radar-camera fusion is of particular interest but presents…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Huawei Sun , Hao Feng , Georg Stettinger , Lorenzo Servadei , Robert Wille

Online multi-object tracking (MOT) is extremely important for high-level spatial reasoning and path planning for autonomous and highly-automated vehicles. In this paper, we present a modular framework for tracking multiple objects…

Computer Vision and Pattern Recognition · Computer Science 2019-02-20 Akshay Rangesh , Mohan M. Trivedi

Multi-sensor modal fusion has demonstrated strong advantages in 3D object detection tasks. However, existing methods that fuse multi-modal features require transforming features into the bird's eye view space and may lose certain…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Chunyong Hu , Hang Zheng , Kun Li , Jianyun Xu , Weibo Mao , Maochun Luo , Lingxuan Wang , Mingxia Chen , Qihao Peng , Kaixuan Liu , Yiru Zhao , Peihan Hao , Minzhe Liu , Kaicheng Yu

Vehicle location prediction or vehicle tracking is a significant topic within connected vehicles. This task, however, is difficult if only a single modal data is available, probably causing bias and impeding the accuracy. With the…

Computer Vision and Pattern Recognition · Computer Science 2018-11-08 Yue Zhang , Bin Song , Xiaojiang Du , Mohsen Guizani

Multi-modal fusion is imperative to the implementation of reliable object detection and tracking in complex environments. Exploiting the synergy of heterogeneous modal information endows perception systems the ability to achieve more…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Kun Shi , Shibo He , Zhenyu Shi , Anjun Chen , Zehui Xiong , Jiming Chen , Jun Luo