English
Related papers

Related papers: Light Field Networks: Neural Scene Representations…

200 papers

Recently, several approaches have emerged for generating neural representations with multiple levels of detail (LODs). LODs can improve the rendering by using lower resolutions and smaller model sizes when appropriate. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 David Li , Brandon Y. Feng , Amitabh Varshney

Neural Radiance Fields (NeRF) are able to reconstruct scenes with unprecedented fidelity, and various recent works have extended NeRF to handle dynamic scenes. A common approach to reconstruct such non-rigid scenes is through the use of a…

Computer Vision and Pattern Recognition · Computer Science 2021-09-13 Keunhong Park , Utkarsh Sinha , Peter Hedman , Jonathan T. Barron , Sofien Bouaziz , Dan B Goldman , Ricardo Martin-Brualla , Steven M. Seitz

Faster rendering of synthetic images is a core problem in the field of computer graphics. Rendering algorithms, such as path-tracing is dependent on parameters like size of the image, number of light bounces, number of samples per pixel,…

Graphics · Computer Science 2023-06-29 Annada Prasad Behera , Subhankar Mishra

Humans effortlessly infer the 3D shape of objects. What computations underlie this ability? Although various computational models have been proposed, none of them capture the human ability to match object shape across viewpoints. Here, we…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Thomas P. O'Connell , Tyler Bonnen , Yoni Friedman , Ayush Tewari , Josh B. Tenenbaum , Vincent Sitzmann , Nancy Kanwisher

We propose a method for reconstructing a continuous light field of a target scene from a single observed image. Our method takes the best of two worlds: joint aperture-exposure coding for compressive light-field acquisition, and a neural…

Computer Vision and Pattern Recognition · Computer Science 2023-11-17 Yuya Ishikawa , Keita Takahashi , Chihiro Tsutake , Toshiaki Fujii

Online reconstructing and rendering of large-scale indoor scenes is a long-standing challenge. SLAM-based methods can reconstruct 3D scene geometry progressively in real time but can not render photorealistic results. While NeRF-based…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Yiming Gao , Yan-Pei Cao , Ying Shan

Light field imaging is limited in its computational processing demands of high sampling for both spatial and angular dimensions. Single-shot light field cameras sacrifice spatial resolution to sample angular viewpoints, typically by…

Computer Vision and Pattern Recognition · Computer Science 2018-02-07 Mayank Gupta , Arjun Jauhari , Kuldeep Kulkarni , Suren Jayasuriya , Alyosha Molnar , Pavan Turaga

Neural implicit surface representations have recently emerged as popular alternative to explicit 3D object encodings, such as polygonal meshes, tabulated points, or voxels. While significant work has improved the geometric fidelity of these…

Graphics · Computer Science 2023-06-27 Yanran Guan , Andrei Chubarau , Ruby Rao , Derek Nowrouzezahrai

We propose a new method for reconstructing controllable implicit 3D human models from sparse multi-view RGB videos. Our method defines the neural scene representation on the mesh surface points and signed distances from the surface of a…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Tianhan Xu , Yasuhiro Fujita , Eiichi Matsumoto

Reconstructing outdoor 3D scenes from temporal observations is a challenge that recent work on neural fields has offered a new avenue for. However, existing methods that recover scene properties, such as geometry, appearance, or radiance,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Andrea Ramazzina , Stefanie Walz , Pragyan Dahal , Mario Bijelic , Felix Heide

Novel view synthesis is a long-standing problem. In this work, we consider a variant of the problem where we are given only a few context views sparsely covering a scene or an object. The goal is to predict novel viewpoints in the scene,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Jonáš Kulhánek , Erik Derner , Torsten Sattler , Robert Babuška

Rendering 3D scenes requires access to arbitrary viewpoints from the scene. Storage of such a 3D scene can be done in two ways; (1) storing 2D images taken from the 3D scene that can reconstruct the scene back through interpolations, or (2)…

Computer Vision and Pattern Recognition · Computer Science 2021-05-10 Berivan Isik

Light field cameras capture the 3D information in a scene with a single exposure. This special feature makes light field cameras very appealing for a variety of applications: from post-capture refocus, to depth estimation and image-based…

Computer Vision and Pattern Recognition · Computer Science 2018-08-01 Mattia Rossi , Pascal Frossard

The widespread adoption of implicit neural representations, especially Neural Radiance Fields (NeRF), highlights a growing need for editing capabilities in implicit 3D models, essential for tasks like scene post-processing and 3D content…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Zhentao Huang , Yukun Shi , Neil Bruce , Minglun Gong

We present Panoptic Neural Fields (PNF), an object-aware neural scene representation that decomposes a scene into a set of objects (things) and background (stuff). Each object is represented by an oriented 3D bounding box and a multi-layer…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Abhijit Kundu , Kyle Genova , Xiaoqi Yin , Alireza Fathi , Caroline Pantofaru , Leonidas Guibas , Andrea Tagliasacchi , Frank Dellaert , Thomas Funkhouser

The recent research explosion around implicit neural representations, such as NeRF, shows that there is immense potential for implicitly storing high-quality scene and lighting information in compact neural networks. However, one major…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Thomas Neff , Pascal Stadlbauer , Mathias Parger , Andreas Kurz , Joerg H. Mueller , Chakravarty R. Alla Chaitanya , Anton Kaplanyan , Markus Steinberger

Neural fields have recently enjoyed great success in representing and rendering 3D scenes. However, most state-of-the-art implicit representations model static or dynamic scenes as a whole, with minor variations. Existing work on learning…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Akshay Krishnan , Amit Raj , Xianling Zhang , Alexandra Carlson , Nathan Tseng , Sandhya Sridhar , Nikita Jaipuria , James Hays

Neural fields have emerged as a powerful framework for representing continuous multidimensional signals such as images and videos, 3D and 4D objects and scenes, and radiance fields. While efficient, achieving high-quality representation…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Abdelaziz Bouzidi , Hamid Laga , Hazem Wannous , Ferdous Sohel

We introduce a novel depth estimation technique for multi-frame structured light setups using neural implicit representations of 3D space. Our approach employs a neural signed distance field (SDF), trained through self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Rukun Qiao , Hiroshi Kawasaki , Hongbin Zha

In this work we target a learnable output representation that allows continuous, high resolution outputs of arbitrary shape. Recent works represent 3D surfaces implicitly with a Neural Network, thereby breaking previous barriers in…

Computer Vision and Pattern Recognition · Computer Science 2020-10-28 Julian Chibane , Aymen Mir , Gerard Pons-Moll