English
Related papers

Related papers: Real-time Neural Rendering of LiDAR Point Clouds

200 papers

This study advances real-time volumetric cloud rendering in Computer Graphics (CG) by developing a specialized shader in Unreal Engine (UE), focusing on realistic cloud modeling and lighting. By leveraging ray-casting-based lighting…

Graphics · Computer Science 2025-02-13 Shruti Singh , Shantanu Kumar

In Autonomous Driving (AD), detection and tracking of obstacles on the roads is a critical task. Deep-learning based methods using annotated LiDAR data have been the most widely adopted approach for this. Unfortunately, annotating 3D point…

Computer Vision and Pattern Recognition · Computer Science 2021-07-02 Jin Fang , Dingfu Zhou , Feilong Yan , Tongtong Zhao , Feihu Zhang , Yu Ma , Liang Wang , Ruigang Yang

Large-scale terrain scans are the basis for many important tasks, such as topographic mapping, forestry, agriculture, and infrastructure planning. The resulting point cloud data sets are so massive in size that even basic tasks like viewing…

Graphics · Computer Science 2025-09-25 Philipp Erler , Lukas Herzberger , Michael Wimmer , Markus Schütz

In this work, we present RadCloud, a novel real time framework for directly obtaining higher-resolution lidar-like 2D point clouds from low-resolution radar frames on resource-constrained platforms commonly used in unmanned aerial and…

Point cloud is a promising 3D representation for volumetric streaming in emerging AR/VR applications. Despite recent advances in point cloud compression, decoding and rendering high-quality images from lossy compressed point clouds is still…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Yueyu Hu , Ran Gong , Yao Wang

Identifying changes in a pair of 3D aerial LiDAR point clouds, obtained during two distinct time periods over the same geographic region presents a significant challenge due to the disparities in spatial coverage and the presence of noise…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Peter Naylor , Diego Di Carlo , Arianna Traviglia , Makoto Yamada , Marco Fiorucci

We propose a methodology for robust, real-time place recognition using an imaging lidar, which yields image-quality high-resolution 3D point clouds. Utilizing the intensity readings of an imaging lidar, we project the point cloud and obtain…

Computer Vision and Pattern Recognition · Computer Science 2021-04-23 Tixiao Shan , Brendan Englot , Fabio Duarte , Carlo Ratti , Daniela Rus

Airborne topographic LiDAR is an active remote sensing technology that emits near-infrared light to map objects on the Earth's surface. Derived products of LiDAR are suitable to service a wide range of applications because of their rich…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Mariona Caros , Ariadna Just , Santi Segui , Jordi Vitria

We present a technique for rendering highly complex 3D scenes in real-time by generating uniformly distributed points on the scene's visible surfaces. The technique is applicable to a wide range of scene types, like scenes directly based on…

Graphics · Computer Science 2019-04-18 Sascha Brandt , Claudius Jähn , Matthias Fischer , Friedhelm Meyer auf der Heide

Volumetric neural rendering methods like NeRF generate high-quality view synthesis results but are optimized per-scene leading to prohibitive reconstruction time. On the other hand, deep multi-view stereo methods can quickly reconstruct…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Qiangeng Xu , Zexiang Xu , Julien Philip , Sai Bi , Zhixin Shu , Kalyan Sunkavalli , Ulrich Neumann

LiDARs have been widely adopted to modern self-driving vehicles, providing 3D information of the scene and surrounding objects. However, adverser weather conditions still pose significant challenges to LiDARs since point clouds captured…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Ming-Yuan Yu , Ram Vasudevan , Matthew Johnson-Roberson

Perception and localization are essential for autonomous delivery vehicles, mostly estimated from 3D LiDAR sensors due to their precise distance measurement capability. This paper presents a strategy to obtain the real-time pseudo point…

Computer Vision and Pattern Recognition · Computer Science 2022-05-18 Sabir Hossain , Xianke Lin

Multi-beam LiDAR sensors, as used on autonomous vehicles and mobile robots, acquire sequences of 3D range scans ("frames"). Each frame covers the scene sparsely, due to limited angular scanning resolution and occlusion. The sparsity…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Shengyu Huang , Zan Gojcic , Jiahui Huang , Andreas Wieser , Konrad Schindler

We present a new deep point cloud rendering pipeline through multi-plane projections. The input to the network is the raw point cloud of a scene and the output are image or image sequences from a novel view or along a novel camera…

Computer Vision and Pattern Recognition · Computer Science 2020-06-26 Peng Dai , Yinda Zhang , Zhuwen Li , Shuaicheng Liu , Bing Zeng

Point clouds obtained from 3D sensors are usually sparse. Existing methods mainly focus on upsampling sparse point clouds in a supervised manner by using dense ground truth point clouds. In this paper, we propose a self-supervised point…

Computer Vision and Pattern Recognition · Computer Science 2021-08-04 Yifan Zhao , Le Hui , Jin Xie

Dense point cloud generation from a sparse or incomplete point cloud is a crucial and challenging problem in 3D computer vision and computer graphics. So far, the existing methods are either computationally too expensive, suffer from…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Abol Basher , Jani Boutellier

Neural rendering provides a fundamentally new way to render photorealistic images. Similar to traditional light-baking methods, neural rendering utilizes neural networks to bake representations of scenes, materials, and lights into latent…

Graphics · Computer Science 2024-05-30 Ziyang Zhang , Edgar Simo-Serra

Detecting objects from LiDAR point clouds is an important component of self-driving car technology as LiDAR provides high resolution spatial information. Previous work on point-cloud 3D object detection has re-purposed convolutional…

Computer Vision and Pattern Recognition · Computer Science 2019-12-04 Jiquan Ngiam , Benjamin Caine , Wei Han , Brandon Yang , Yuning Chai , Pei Sun , Yin Zhou , Xi Yi , Ouais Alsharif , Patrick Nguyen , Zhifeng Chen , Jonathon Shlens , Vijay Vasudevan

LiDAR object detection algorithms based on neural networks for autonomous driving require large amounts of data for training, validation, and testing. As real-world data collection and labeling are time-consuming and expensive,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Sebastian Huch , Luca Scalerandi , Esteban Rivera , Markus Lienkamp

This paper explores a machine learning approach for generating high resolution point clouds from a single-chip mmWave radar. Unlike lidar and vision-based systems, mmWave radar can operate in harsh environments and see through occlusions…