English
Related papers

Related papers: LiDAR-as-Camera for End-to-End Driving

200 papers

Traditional autonomous driving methods adopt a modular design, decomposing tasks into sub-tasks. In contrast, end-to-end autonomous driving directly outputs actions from raw sensor data, avoiding error accumulation. However, training an…

Robotics · Computer Science 2024-11-22 Zeyu Dong , Yimin Zhu , Yansong Li , Kevin Mahon , Yu Sun

Loop closure based on camera images provides excellent results on benchmarking datasets, but might struggle in real-world adverse weather conditions like direct sun, rain, fog, or just darkness at night. In automotive applications, the…

Robotics · Computer Science 2020-09-09 Kamil Żywanowski , Adam Banaszczyk , Michał Nowicki

In autonomous systems, sensor calibration is essential for safe and efficient navigation in dynamic environments. Accurate calibration is a prerequisite for reliable perception and planning tasks such as object detection and obstacle…

Robotics · Computer Science 2026-02-02 Ilir Tahiraj , Markus Edinger , Dominik Kulmer , Markus Lienkamp

In the autonomous driving domain, data collection and annotation from real vehicles are expensive and sometimes unsafe. Simulators are often used for data augmentation, which requires realistic sensor models that are hard to formulate and…

Computer Vision and Pattern Recognition · Computer Science 2019-05-20 Ahmad El Sallab , Ibrahim Sobh , Mohamed Zahran , Nader Essam

Nighttime camera-based depth estimation is a highly challenging task, especially for autonomous driving applications, where accurate depth perception is essential for ensuring safe navigation. Models trained on daytime data often fail in…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Simon de Moreau , Yasser Almehio , Andrei Bursuc , Hafid El-Idrissi , Bogdan Stanciulescu , Fabien Moutarde

Autonomous driving systems are highly dependent on sensors like cameras, LiDAR, and inertial measurement units (IMU) to perceive the environment and estimate their motion. Among these sensors, perception-based sensors are not protected from…

LiDAR is a crucial sensor in autonomous driving, commonly used alongside cameras. By exploiting this camera-LiDAR setup and recent advances in image representation learning, prior studies have shown the promising potential of image-to-LiDAR…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Wonjun Jo , Kwon Byung-Ki , Kim Ji-Yeon , Hawook Jeong , Kyungdon Joo , Tae-Hyun Oh

- Both Lidars and Radars are sensors for obstacle detection. While Lidars are very accurate on obstacles positions and less accurate on their velocities, Radars are more precise on obstacles velocities and less precise on their positions.…

Robotics · Computer Science 2019-07-02 Hatem Hajri , Mohamed-Cherif Rahal

LiDAR-camera extrinsic calibration (LCEC) is crucial for multi-modal data fusion in autonomous robotic systems. Existing methods, whether target-based or target-free, typically rely on customized calibration targets or fixed scene types,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Zhiwei Huang , Jiaqi Li , Hongbo Zhao , Xiao Ma , Ping Zhong , Xiaohu Zhou , Wei Ye , Rui Fan

Fully autonomous driving systems require fast detection and recognition of sensitive objects in the environment. In this context, intelligent vehicles should share their sensor data with computing platforms and/or other vehicles, to detect…

Networking and Internet Architecture · Computer Science 2021-04-27 Valentina Rossi , Paolo Testolina , Marco Giordani , Michele Zorzi

We present a generic evidential grid mapping pipeline designed for imaging sensors such as LiDARs and cameras. Our grid-based evidential model contains semantic estimates for cell occupancy and ground separately. We specify the estimation…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Sven Richter , Frank Bieder , Sascha Wirges , Christoph Stiller

3D LiDAR point cloud data is crucial for scene perception in computer vision, robotics, and autonomous driving. Geometric and semantic scene understanding, involving 3D point clouds, is essential for advancing autonomous driving…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Li Li

In this paper, a complete framework for Autonomous Self Driving is implemented. LIDAR, Camera and IMU sensors are used together. The entire data communication is managed using Robot Operating System which provides a robust platform for…

Robotics · Computer Science 2022-12-15 Rahul M K , Sumukh B , Praveen L Uppunda , Vinayaka Raju , C Gururaj

LiDAR has become one of the primary sensors in robotics and autonomous system for high-accuracy situational awareness. In recent years, multi-modal LiDAR systems emerged, and among them, LiDAR-as-a-camera sensors provide not only 3D point…

Robotics · Computer Science 2023-08-15 Ha Sier , Xianjia Yu , Iacopo Catalano , Jorge Pena Queralta , Zhuo Zou , Tomi Westerlund

Autonomous vehicles face significant challenges in navigating adverse weather, particularly rain, due to the visual impairment of camera-based systems. In this study, we leveraged contemporary deep learning techniques to mitigate these…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Mark A. Seferian , Jidong J. Yang

Autonomous driving has received a lot of attention in the automotive industry and is often seen as the future of transportation. Passenger vehicles equipped with a wide array of sensors (e.g., cameras, front-facing radars, LiDARs, and IMUs)…

Machine Learning · Computer Science 2022-05-27 Andrey Pak , Hemanth Manjunatha , Dimitar Filev , Panagiotis Tsiotras

Generative world models have become essential data engines for autonomous driving, yet most existing efforts focus on videos or occupancy grids, overlooking the unique LiDAR properties. Extending LiDAR generation to dynamic 4D world…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Ao Liang , Youquan Liu , Yu Yang , Dongyue Lu , Linfeng Li , Lingdong Kong , Huaici Zhao , Wei Tsang Ooi

Lidar point cloud distortion from moving object is an important problem in autonomous driving, and recently becomes even more demanding with the emerging of newer lidars, which feature back-and-forth scanning patterns. Accurately estimating…

Robotics · Computer Science 2022-07-05 Wen Yang , Zheng Gong , Baifu Huang , Xiaoping Hong

Optical sensors and learning algorithms for autonomous vehicles have dramatically advanced in the past few years. Nonetheless, the reliability of today's autonomous vehicles is hindered by the limited line-of-sight sensing capability and…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Jiaxun Cui , Hang Qiu , Dian Chen , Peter Stone , Yuke Zhu

Accurate LiDAR simulation is crucial for autonomous driving, especially under adverse weather conditions. Existing methods struggle to capture the complex interactions between LiDAR signals and atmospheric phenomena, leading to unrealistic…

Robotics · Computer Science 2026-04-03 Vivek Anand , Bharat Lohani , Rakesh Mishra , Gaurav Pandey