English
Related papers

Related papers: LiSTAR: Ray-Centric World Models for 4D LiDAR Sequ…

200 papers

For an autonomous vehicle, the ability to sense its surroundings and to build an overall representation of the environment by fusing different sensor data streams is fundamental. To this end, the poses of all sensors need to be accurately…

Robotics · Computer Science 2022-11-07 Brahayam Ponton , Magda Ferri , Lars Koenig , Marcus Bartels

3D LiDAR scanners are playing an increasingly important role in autonomous driving as they can generate depth information of the environment. However, creating large 3D LiDAR point cloud datasets with point-level labels requires a…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Xiangyu Yue , Bichen Wu , Sanjit A. Seshia , Kurt Keutzer , Alberto L. Sangiovanni-Vincentelli

Building accurate maps is a key building block to enable reliable localization, planning, and navigation of autonomous vehicles. We propose a novel approach for building accurate maps of dynamic environments utilizing a sequence of LiDAR…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Xingguang Zhong , Yue Pan , Cyrill Stachniss , Jens Behley

Building world models with spatial consistency and real-time interactivity remains a fundamental challenge in computer vision. Current video generation paradigms often struggle with a lack of spatial persistence and insufficient visual…

Temporal semantic scene understanding is critical for self-driving cars or robots operating in dynamic environments. In this paper, we propose 4D panoptic LiDAR segmentation to assign a semantic class and a temporally-consistent instance ID…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Mehmet Aygün , Aljoša Ošep , Mark Weber , Maxim Maximov , Cyrill Stachniss , Jens Behley , Laura Leal-Taixé

LiDAR provides accurate geometric measurements of the 3D world. Unfortunately, dense LiDARs are very expensive and the point clouds captured by low-beam LiDAR are often sparse. To address these issues, we present UltraLiDAR, a data-driven…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Yuwen Xiong , Wei-Chiu Ma , Jingkang Wang , Raquel Urtasun

By enabling capturing of 3D point clouds that reflect the geometry of the immediate environment, LiDAR has emerged as a primary sensor for autonomous systems. If a LiDAR scan is too sparse, occluded by obstacles, or too small in range,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Ryan Faulkner , Luke Haub , Simon Ratcliffe , Anh-Dzung Doan , Ian Reid , Tat-Jun Chin

LiDAR novel view synthesis (NVS) has emerged as a novel task within LiDAR simulation, offering valuable simulated point cloud data from novel viewpoints to aid in autonomous driving systems. However, existing LiDAR NVS methods typically…

Computer Vision and Pattern Recognition · Computer Science 2025-02-06 Junzhe Jiang , Chun Gu , Yurui Chen , Li Zhang

Recent research has begun exploring novel view synthesis (NVS) for LiDAR point clouds, aiming to generate realistic LiDAR scans from unseen viewpoints. However, most existing approaches do not reconstruct semantic labels, which are crucial…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Yi Chen , Tianchen Deng , Wentao Zhao , Xiaoning Wang , Wenqian Xi , Weidong Chen , Jingchuan Wang

4D driving simulation is essential for developing realistic autonomous driving simulators. Despite advancements in existing methods for generating driving scenes, significant challenges remain in view transformation and spatial-temporal…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Lening Wang , Wenzhao Zheng , Dalong Du , Yunpeng Zhang , Yilong Ren , Han Jiang , Zhiyong Cui , Haiyang Yu , Jie Zhou , Jiwen Lu , Shanghang Zhang

Photorealistic 3D scene reconstruction plays an important role in autonomous driving, enabling the generation of novel data from existing datasets to simulate safety-critical scenarios and expand training data without additional acquisition…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Pou-Chun Kung , Xianling Zhang , Katherine A. Skinner , Nikita Jaipuria

Generating realistic and diverse LiDAR point clouds is crucial for autonomous driving simulation. Although previous methods achieve LiDAR point cloud generation from user inputs, they struggle to attain high-quality results while enabling…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Haiyun Wei , Fan Lu , Yunwei Zhu , Zehan Zheng , Weiyi Xue , Lin Shao , Xudong Zhang , Ya Wu , Rong Fu , Guang Chen

Autonomous vehicles operate in a dynamic environment, where the speed with which a vehicle can perceive and react impacts the safety and efficacy of the system. LiDAR provides a prominent sensory modality that informs many existing…

Computer Vision and Pattern Recognition · Computer Science 2020-05-06 Wei Han , Zhengdong Zhang , Benjamin Caine , Brandon Yang , Christoph Sprunk , Ouais Alsharif , Jiquan Ngiam , Vijay Vasudevan , Jonathon Shlens , Zhifeng Chen

End-to-end autonomous driving solutions, which directly process multimodal sensory data and output fine-grained control commands, have gradually become a mainstream direction with the development of autonomous driving technology. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Runyi Huang , Ni Ding , Ruidan Xing , Yuheng Shi , Lei He , Keqiang Li

We present a LiDAR-based and real-time capable 3D perception system for automated driving in urban domains. The hierarchical system design is able to model stationary and movable parts of the environment simultaneously and under real-time…

Robotics · Computer Science 2020-05-08 Jens Rieken , Markus Maurer

We present LiSTA (LiDAR Spatio-Temporal Analysis), a system to detect probabilistic object-level change over time using multi-mission SLAM. Many applications require such a system, including construction, robotic navigation, long-term…

Robotics · Computer Science 2024-03-06 Joseph Rowell , Lintong Zhang , Maurice Fallon

Computer vision techniques play a central role in the perception stack of autonomous vehicles. Such methods are employed to perceive the vehicle surroundings given sensor data. 3D LiDAR sensors are commonly used to collect sparse 3D point…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Lucas Nunes , Rodrigo Marcuzzi , Benedikt Mersch , Jens Behley , Cyrill Stachniss

Perception systems play a crucial role in autonomous driving, incorporating multiple sensors and corresponding computer vision algorithms. 3D LiDAR sensors are widely used to capture sparse point clouds of the vehicle's surroundings.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Helin Cao , Sven Behnke

In recent studies, numerous previous works emphasize the importance of semantic segmentation of LiDAR data as a critical component to the development of driver-assistance systems and autonomous vehicles. However, many state-of-the-art…

The emergence of low-cost, small form factor and light-weight solid-state LiDAR sensors have brought new opportunities for autonomous unmanned aerial vehicles (UAVs) by advancing navigation safety and computation efficiency. Yet the…

Robotics · Computer Science 2022-12-02 Fanze Kong , Xiyuan Liu , Benxu Tang , Jiarong Lin , Yunfan Ren , Yixi Cai , Fangcheng Zhu , Nan Chen , Fu Zhang