English
Related papers

Related papers: Neural Point Cloud Rendering via Multi-Plane Proje…

200 papers

Controllable generation of 3D assets is important for many practical applications like content creation in movies, games and engineering, as well as in AR/VR. Recently, diffusion models have shown remarkable results in generation quality of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Philipp Schröppel , Christopher Wewer , Jan Eric Lenssen , Eddy Ilg , Thomas Brox

Point cloud is a critical 3D representation with many emerging applications. Because of the point sparsity and irregularity, high-quality rendering of point clouds is challenging and often requires complex computations to recover the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Yueyu Hu , Ran Gong , Qi Sun , Yao Wang

Recent development of 3D sensors allows the acquisition of extremely dense 3D point clouds of large-scale scenes. The main challenge of processing such large point clouds remains in the size of the data, which induce expensive computational…

Computer Vision and Pattern Recognition · Computer Science 2021-09-24 Thomas Richard , Florent Dupont , Guillaume Lavoue

Many applications in robotics and human-computer interaction can benefit from understanding 3D motion of points in a dynamic environment, widely noted as scene flow. While most previous methods focus on stereo and RGB-D images as input, few…

Computer Vision and Pattern Recognition · Computer Science 2019-07-23 Xingyu Liu , Charles R. Qi , Leonidas J. Guibas

We introduce Neural Point Light Fields that represent scenes implicitly with a light field living on a sparse point cloud. Combining differentiable volume rendering with learned implicit density representations has made it possible to…

Computer Vision and Pattern Recognition · Computer Science 2022-06-08 Julian Ost , Issam Laradji , Alejandro Newell , Yuval Bahat , Felix Heide

In this article we describe a new convolutional neural network (CNN) to classify 3D point clouds of urban or indoor scenes. Solutions are given to the problems encountered working on scene point clouds, and a network is described that…

Computer Vision and Pattern Recognition · Computer Science 2018-04-11 Xavier Roynard , Jean-Emmanuel Deschaud , François Goulette

In this work, we study 3D object detection from RGB-D data in both indoor and outdoor scenes. While previous methods focus on images or 3D voxels, often obscuring natural 3D patterns and invariances of 3D data, we directly operate on raw…

Computer Vision and Pattern Recognition · Computer Science 2018-04-16 Charles R. Qi , Wei Liu , Chenxia Wu , Hao Su , Leonidas J. Guibas

Synthesizing photo-realistic images from a point cloud is challenging because of the sparsity of point cloud representation. Recent Neural Radiance Fields and extensions are proposed to synthesize realistic images from 2D input. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Tao Hu , Xiaogang Xu , Shu Liu , Jiaya Jia

There has recently been great interest in neural rendering methods. Some approaches use 3D geometry reconstructed with Multi-View Stereo (MVS) but cannot recover from the errors of this process, while others directly learn a volumetric…

Computer Vision and Pattern Recognition · Computer Science 2021-09-09 Georgios Kopanas , Julien Philip , Thomas Leimkühler , George Drettakis

We propose a novel and efficient representation for single-view depth estimation using Convolutional Neural Networks (CNNs). Point-cloud is generally used for CNN-based 3D scene reconstruction; however it has some drawbacks: (1) it is…

Computer Vision and Pattern Recognition · Computer Science 2020-03-12 Masaya Kaneko , Ken Sakurada , Kiyoharu Aizawa

As a collection of 3D points sampled from surfaces of objects, a 3D point cloud is widely used in robotics, autonomous driving and augmented reality. Due to the physical limitations of 3D sensing devices, 3D point clouds are usually noisy,…

Computational Geometry · Computer Science 2018-07-03 Chaojing Duan , Siheng Chen , Jelena Kovačević

3D reconstruction from images is a core problem in computer vision. With recent advances in deep learning, it has become possible to recover plausible 3D shapes even from single RGB images for the first time. However, obtaining detailed…

Computer Vision and Pattern Recognition · Computer Science 2019-12-24 Tao Hu , Geng Lin , Zhizhong Han , Matthias Zwicker

In this paper, we propose a pipeline to generate 3D point cloud of an object from a single-view RGB image. Most previous work predict the 3D point coordinates from single RGB images directly. We decompose this problem into depth estimation…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Wei Zeng , Sezer Karaoglu , Theo Gevers

Current learning-based methods predict NeRF or 3D Gaussians from point clouds to achieve photo-realistic rendering but still depend on categorical priors, dense point clouds, or additional refinements. Hence, we introduce a novel point…

Computer Vision and Pattern Recognition · Computer Science 2025-05-15 Ma Changfeng , Bi Ran , Guo Jie , Wang Chongjun , Guo Yanwen

Semantic segmentation of 3D point clouds is a challenging problem with numerous real-world applications. While deep learning has revolutionized the field of image semantic segmentation, its impact on point cloud data has been limited so…

Computer Vision and Pattern Recognition · Computer Science 2017-05-10 Felix Järemo Lawin , Martin Danelljan , Patrik Tosteberg , Goutam Bhat , Fahad Shahbaz Khan , Michael Felsberg

We present a neural point cloud rendering pipeline through a novel multi-frequency-aware patch adversarial learning framework. The proposed approach aims to improve the rendering realness by minimizing the spectrum discrepancy between real…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Jay Karhade , Haiyue Zhu , Ka-Shing Chung , Rajesh Tripathy , Wei Lin , Marcelo H. Ang

Point clouds are naturally sparse, while image pixels are dense. The inconsistency limits feature fusion from both modalities for point-wise scene flow estimation. Previous methods rarely predict scene flow from the entire point clouds of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Chensheng Peng , Guangming Wang , Xian Wan Lo , Xinrui Wu , Chenfeng Xu , Masayoshi Tomizuka , Wei Zhan , Hesheng Wang

Neural volumetric representations have become a widely adopted model for radiance fields in 3D scenes. These representations are fully implicit or hybrid function approximators of the instantaneous volumetric radiance in a scene, which are…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Yuval Bahat , Yuxuan Zhang , Hendrik Sommerhoff , Andreas Kolb , Felix Heide

Learning and analyzing 3D point clouds with deep networks is challenging due to the sparseness and irregularity of the data. In this paper, we present a data-driven point cloud upsampling technique. The key idea is to learn multi-level…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Lequan Yu , Xianzhi Li , Chi-Wing Fu , Daniel Cohen-Or , Pheng-Ann Heng

In the last few years, deep neural networks opened the doors for big advances in novel view synthesis. Many of these approaches are based on a (coarse) proxy geometry obtained by structure from motion algorithms. Small deficiencies in this…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Linus Franke , Darius Rückert , Laura Fink , Matthias Innmann , Marc Stamminger