English
Related papers

Related papers: Neural Point Light Fields

200 papers

Implicit neural representations have shown powerful capacity in modeling real-world 3D scenes, offering superior performance in novel view synthesis. In this paper, we target a more challenging scenario, i.e., joint scene novel view…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Yuxin Wang , Wayne Wu , Dan Xu

Very recently neural implicit rendering techniques have been rapidly evolved and shown great advantages in novel view synthesis and 3D scene reconstruction. However, existing neural rendering methods for editing purposes offer limited…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Bangbang Yang , Chong Bao , Junyi Zeng , Hujun Bao , Yinda Zhang , Zhaopeng Cui , Guofeng Zhang

We propose a new method for realistic real-time novel-view synthesis (NVS) of large scenes. Existing neural rendering methods generate realistic results, but primarily work for small scale scenes (<50 square meters) and have difficulty at…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Jeffrey Yunfan Liu , Yun Chen , Ze Yang , Jingkang Wang , Sivabalan Manivasagam , Raquel Urtasun

Labeling LiDAR point clouds for training autonomous driving is extremely expensive and difficult. LiDAR simulation aims at generating realistic LiDAR data with labels for training and verifying self-driving algorithms more efficiently.…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Junge Zhang , Feihu Zhang , Shaochen Kuang , Li Zhang

Neural Radiance Fields (NeRF) achieve photo-realistic view synthesis with densely captured input images. However, the geometry of NeRF is extremely under-constrained given sparse views, resulting in significant degradation of novel view…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Zheng Chen , Chen Wang , Yuan-Chen Guo , Song-Hai Zhang

We revisit NPBG, the popular approach to novel view synthesis that introduced the ubiquitous point feature neural rendering paradigm. We are interested in particular in data-efficient learning with fast view synthesis. We achieve this…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Shubhendu Jena , Franck Multon , Adnane Boukhayma

Novel-view synthesis with sparse input views is important for real-world applications like AR/VR and autonomous driving. Recent methods have integrated depth information into NeRFs for sparse input synthesis, leveraging depth prior for…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Shuai Guo , Qiuwen Wang , Yijie Gao , Rong Xie , Li Song

Accurate 3D scene representation and panoptic understanding are essential for applications such as virtual reality, robotics, and autonomous driving. However, challenges persist with existing methods, including precise 2D-to-3D mapping,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Shenghao Li

We present a unified and compact scene representation for robotics, where each object in the scene is depicted by a latent code capturing geometry and appearance. This representation can be decoded for various tasks such as novel view…

Creating realistic virtual assets is a time-consuming process: it usually involves an artist designing the object, then spending a lot of effort on tweaking its appearance. Intricate details and certain effects, such as subsurface…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Aljaž Božič , Denis Gladkov , Luke Doukakis , Christoph Lassner

Recently neural scene representations have provided very impressive results for representing 3D scenes visually, however, their study and progress have mainly been limited to visualization of virtual models in computer graphics or scene…

Computer Vision and Pattern Recognition · Computer Science 2022-09-26 Yassine Ahmine , Arnab Dey , Andrew I. Comport

Light field (LF) representations aim to provide photo-realistic, free-viewpoint viewing experiences. However, the most popular LF representations are images from multiple views. Multi-view image-based representations generally need to…

Multimedia · Computer Science 2018-05-30 Xiang Zhang , Philip A. Chou , Ming-Ting Sun , Maolong Tang , Shanshe Wang , Siwei Ma , Wen Gao

Neural Radiance Field (NeRF) is a framework that represents a 3D scene in the weights of a fully connected neural network, known as the Multi-Layer Perception(MLP). The method was introduced for the task of novel view synthesis and is able…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Mohamed Debbagh

Novel view synthesis in 360$^\circ$ scenes from extremely sparse input views is essential for applications like virtual reality and augmented reality. This paper presents a novel framework for novel view synthesis in extremely sparse-view…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Guangan Chen , Anh Minh Truong , Hanhe Lin , Michiel Vlaminck , Wilfried Philips , Hiep Luong

This paper addresses the challenge of novel view synthesis for a human performer from a very sparse set of camera views. Some recent works have shown that learning implicit neural representations of 3D scenes achieves remarkable view…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Sida Peng , Yuanqing Zhang , Yinghao Xu , Qianqian Wang , Qing Shuai , Hujun Bao , Xiaowei Zhou

Recent years have witnessed significant progress in the field of neural surface reconstruction. While the extensive focus was put on volumetric and implicit approaches, a number of works have shown that explicit graphics primitives such as…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Sergey Prokudin , Qianli Ma , Maxime Raafat , Julien Valentin , Siyu Tang

Reliably reconstructing physical fields from sparse sensor data is a challenge that frequently arises in many scientific domains. In practice, the process generating the data often is not understood to sufficient accuracy. Therefore, there…

Machine Learning · Computer Science 2024-01-23 Xihaier Luo , Wei Xu , Yihui Ren , Shinjae Yoo , Balu Nadiga

Recently introduced implicit field representations offer an effective way of generating 3D object shapes. They leverage implicit decoder trained to take a 3D point coordinate concatenated with a shape encoding and to output a value which…

Computer Vision and Pattern Recognition · Computer Science 2021-10-13 Magdalena Proszewska , Marcin Mazur , Tomasz Trzciński , Przemysław Spurek

In this work we target a learnable output representation that allows continuous, high resolution outputs of arbitrary shape. Recent works represent 3D surfaces implicitly with a Neural Network, thereby breaking previous barriers in…

Computer Vision and Pattern Recognition · Computer Science 2020-10-28 Julian Chibane , Aymen Mir , Gerard Pons-Moll

We present a technique for visualizing point clouds using a neural network. Our technique allows for an instant preview of any point cloud, and bypasses the notoriously difficult surface reconstruction problem or the need to estimate…

Graphics · Computer Science 2022-02-22 Gal Metzer , Rana Hanocka , Raja Giryes , Niloy J. Mitra , Daniel Cohen-Or