English
Related papers

Related papers: Road Segmentation with Image-LiDAR Data Fusion

200 papers

The ability to detect and segment moving objects in a scene is essential for building consistent maps, making future state predictions, avoiding collisions, and planning. In this paper, we address the problem of moving object segmentation…

Radars, due to their robustness to adverse weather conditions and ability to measure object motions, have served in autonomous driving and intelligent agents for years. However, Radar-based perception suffers from its unintuitive sensing…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Liu Liu , Shuaifeng Zhi , Zhenhua Du , Li Liu , Xinyu Zhang , Kai Huo , Weidong Jiang

Semantic segmentation algorithms that can robustly segment objects across multiple camera viewpoints are crucial for assuring navigation and safety in emerging applications such as autonomous driving. Existing algorithms treat each image in…

Computer Vision and Pattern Recognition · Computer Science 2019-10-04 Brigit Schroeder , Hanlin Tang , Alexandre Alahi

To navigate through urban roads, an automated vehicle must be able to perceive and recognize objects in a three-dimensional environment. A high-level contextual understanding of the surroundings is necessary to plan and execute accurate…

Robotics · Computer Science 2020-03-05 Julie Stephany Berrio , Mao Shan , Stewart Worrall , James Ward , Eduardo Nebot

Autonomous robotic systems and self driving cars rely on accurate perception of their surroundings as the safety of the passengers and pedestrians is the top priority. Semantic segmentation is one the essential components of environmental…

Computer Vision and Pattern Recognition · Computer Science 2021-02-10 Ran Cheng , Ryan Razani , Ehsan Taghavi , Enxu Li , Bingbing Liu

Fully autonomous driving systems require fast detection and recognition of sensitive objects in the environment. In this context, intelligent vehicles should share their sensor data with computing platforms and/or other vehicles, to detect…

Networking and Internet Architecture · Computer Science 2021-04-27 Valentina Rossi , Paolo Testolina , Marco Giordani , Michele Zorzi

The use of infrastructure sensor technology for traffic detection has already been proven several times. However, extrinsic sensor calibration is still a challenge for the operator. While previous approaches are unable to calibrate the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Laurent Kloeker , Christian Kotulla , Lutz Eckstein

Lidars and cameras are critical sensors that provide complementary information for 3D detection in autonomous driving. While prevalent multi-modal methods simply decorate raw lidar point clouds with camera features and feed them directly to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Yingwei Li , Adams Wei Yu , Tianjian Meng , Ben Caine , Jiquan Ngiam , Daiyi Peng , Junyang Shen , Bo Wu , Yifeng Lu , Denny Zhou , Quoc V. Le , Alan Yuille , Mingxing Tan

In this paper, we propose PointSeg, a real-time end-to-end semantic segmentation method for road-objects based on spherical images. We take the spherical image, which is transformed from the 3D LiDAR point clouds, as input of the…

Computer Vision and Pattern Recognition · Computer Science 2018-09-26 Yuan Wang , Tianyue Shi , Peng Yun , Lei Tai , Ming Liu

Robust semantic perception for autonomous vehicles relies on effectively combining multiple sensors with complementary strengths and weaknesses. State-of-the-art sensor fusion approaches to semantic perception often treat sensor data…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Tim Broedermannn , Christos Sakaridis , Luigi Piccinelli , Wim Abbeloos , Luc Van Gool

Within a perception framework for autonomous mobile and robotic systems, semantic analysis of 3D point clouds typically generated by LiDARs is key to numerous applications, such as object detection and recognition, and scene reconstruction.…

Robotics · Computer Science 2024-10-14 Samir Abou Haidar , Alexandre Chariot , Mehdi Darouich , Cyril Joly , Jean-Emmanuel Deschaud

We present an end-to-end method for object detection and trajectory prediction utilizing multi-view representations of LiDAR returns and camera images. In this work, we recognize the strengths and weaknesses of different view…

Computer Vision and Pattern Recognition · Computer Science 2021-10-20 Sudeep Fadadu , Shreyash Pandey , Darshan Hegde , Yi Shi , Fang-Chieh Chou , Nemanja Djuric , Carlos Vallespi-Gonzalez

This paper presents Camera-LiDAR Fusion Transformer (CLFT) models for traffic object segmentation, which leverage the fusion of camera and LiDAR data using vision transformers. Building on the methodology of visual transformers that exploit…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Toomas Tahves , Junyi Gu , Mauro Bellone , Raivo Sell

LiDAR sensor is essential to the perception system in autonomous vehicles and intelligent robots. To fulfill the real-time requirements in real-world applications, it is necessary to efficiently segment the LiDAR scans. Most of previous…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Song Wang , Jianke Zhu , Ruixiang Zhang

LiDAR and camera are two modalities available for 3D semantic segmentation in autonomous driving. The popular LiDAR-only methods severely suffer from inferior segmentation on small and distant objects due to insufficient laser points, while…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Jiale Li , Hang Dai , Hao Han , Yong Ding

Image semantic segmentation aims at the pixel-level classification of images, which has requirements for both accuracy and speed in practical application. Existing semantic segmentation methods mainly rely on the high-resolution input to…

Computer Vision and Pattern Recognition · Computer Science 2022-11-07 Tianjiao Jiang , Yi Jin , Tengfei Liang , Xu Wang , Yidong Li

The integration of data from diverse sensor modalities (e.g., camera and LiDAR) constitutes a prevalent methodology within the ambit of autonomous driving scenarios. Recent advancements in efficient point cloud transformers have underscored…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Yutao Zhu , Xiaosong Jia , Xinyu Yang , Junchi Yan

When localizing and detecting 3D objects for autonomous driving scenes, obtaining information from multiple sensor (e.g. camera, LIDAR) typically increases the robustness of 3D detectors. However, the efficient and effective fusion of…

Computer Vision and Pattern Recognition · Computer Science 2020-09-11 Can Chen , Luca Zanotti Fragonara , Antonios Tsourdos

2D RGB images and 3D LIDAR point clouds provide complementary knowledge for the perception system of autonomous vehicles. Several 2D and 3D fusion methods have been explored for the LIDAR semantic segmentation task, but they suffer from…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Jun Cen , Shiwei Zhang , Yixuan Pei , Kun Li , Hang Zheng , Maochun Luo , Yingya Zhang , Qifeng Chen

Fusing data from cameras and LiDAR sensors is an essential technique to achieve robust 3D object detection. One key challenge in camera-LiDAR fusion involves mitigating the large domain gap between the two sensors in terms of coordinates…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Yecheol Kim , Konyul Park , Minwook Kim , Dongsuk Kum , Jun Won Choi