English
Related papers

Related papers: Light Field Networks: Neural Scene Representations…

200 papers

Light Field (LF) offers unique advantages such as post-capture refocusing and depth estimation, but low-light conditions limit these capabilities. To restore low-light LFs we should harness the geometric cues present in different LF views,…

Image and Video Processing · Electrical Eng. & Systems 2020-12-29 Mohit Lamba , Kranthi Kumar , Kaushik Mitra

Neural rendering combines ideas from classical computer graphics and machine learning to synthesize images from real-world observations. NeRF, short for Neural Radiance Fields, is a recent innovation that uses AI algorithms to create 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 AKM Shahariar Azad Rabby , Chengcui Zhang

This paper studies how to flexibly integrate reconstructed 3D models into practical 3D modeling pipelines such as 3D scene creation and rendering. Due to the technical difficulty, one can only obtain rough 3D models (R3DMs) for most real…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Bowen Cai , Yujie Li , Yuqin Liang , Rongfei Jia , Binqiang Zhao , Mingming Gong , Huan Fu

Neural Radiance Fields (NeRF) give rise to learning-based 3D reconstruction methods widely used in industrial applications. Although prevalent methods achieve considerable improvements in small-scale scenes, accomplishing reconstruction in…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Bingnan Ni , Huanyu Wang , Dongfeng Bai , Minghe Weng , Dexin Qi , Weichao Qiu , Bingbing Liu

Light field is a type of image data that captures the 3D scene information by recording light rays emitted from a scene at various orientations. It offers a more immersive perception than classic 2D images but at the cost of huge data…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Jinglei Shi , Yihong Xu , Christine Guillemot

Neural Radiance Fields or NeRFs have become the representation of choice for problems in view synthesis or image-based rendering, as well as in many other applications across computer graphics and vision, and beyond. At their core, NeRFs…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Ravi Ramamoorthi

We propose a framework for learning neural scene representations directly from images, without 3D supervision. Our key insight is that 3D structure can be imposed by ensuring that the learned representation transforms like a real 3D scene.…

Computer Vision and Pattern Recognition · Computer Science 2020-12-22 Emilien Dupont , Miguel Angel Bautista , Alex Colburn , Aditya Sankar , Carlos Guestrin , Josh Susskind , Qi Shan

Neural radiance fields (NeRFs) are able to synthesize realistic novel views from multi-view images captured from distinct positions and perspectives. In NeRF's rendering pipeline, neural networks are used to represent a scene independently…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Kang Han , Wei Xiang , Lu Yu

A long-standing goal in scene understanding is to obtain interpretable and editable representations that can be directly constructed from a raw monocular RGB-D video, without requiring specialized hardware setup or priors. The problem is…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Yu-Shiang Wong , Niloy J. Mitra

We explore a new strategy for few-shot novel view synthesis based on a neural light field representation. Given a target camera pose, an implicit neural network maps each ray to its target pixel's color directly. The network is conditioned…

Computer Vision and Pattern Recognition · Computer Science 2022-08-10 Qian Li , Franck Multon , Adnane Boukhayma

In recent years, Neural Radiance Fields (NeRFs) have demonstrated significant potential in encoding highly-detailed 3D geometry and environmental appearance, positioning themselves as a promising alternative to traditional explicit…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Tianxiang Ye , Qi Wu , Junyuan Deng , Guoqing Liu , Liu Liu , Songpengcheng Xia , Liang Pang , Wenxian Yu , Ling Pei

We present a new pipeline for holistic 3D scene understanding from a single image, which could predict object shapes, object poses, and scene layout. As it is a highly ill-posed problem, existing methods usually suffer from inaccurate…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Cheng Zhang , Zhaopeng Cui , Yinda Zhang , Bing Zeng , Marc Pollefeys , Shuaicheng Liu

Neural Radiance Fields (NeRFs) have remodeled 3D scene representation since release. NeRFs can effectively reconstruct complex 3D scenes from 2D images, advancing different fields and applications such as scene understanding, 3D content…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Wenhui Xiao , Remi Chierchia , Rodrigo Santa Cruz , Xuesong Li , David Ahmedt-Aristizabal , Olivier Salvado , Clinton Fookes , Leo Lebrat

Several variants of Neural Radiance Fields (NeRFs) have significantly improved the accuracy of synthesized images and surface reconstruction of 3D scenes/objects. In all of these methods, a key characteristic is that none can train the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Gonçalo Dias Pais , Valter Piedade , Moitreya Chatterjee , Marcus Greiff , Pedro Miraldo

We present a unified and compact scene representation for robotics, where each object in the scene is depicted by a latent code capturing geometry and appearance. This representation can be decoded for various tasks such as novel view…

Deep neural networks (DNNs) are widely applied for nowadays 3D surface reconstruction tasks and such methods can be further divided into two categories, which respectively warp templates explicitly by moving vertices or represent 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Xianghui Yang , Guosheng Lin , Zhenghao Chen , Luping Zhou

Neural fields, coordinate-based neural networks, have recently gained popularity for implicitly representing a scene. In contrast to classical methods that are based on explicit representations such as point clouds, neural fields provide a…

Robotics · Computer Science 2024-02-16 Stephen Hausler , David Hall , Sutharsan Mahendren , Peyman Moghadam

Contemporary registration devices for 3D visual information, such as LIDARs and various depth cameras, capture data as 3D point clouds. In turn, such clouds are challenging to be processed due to their size and complexity. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Dominik Zimny , Joanna Waczyńska , Tomasz Trzciński , Przemysław Spurek

Although neural radiance fields (NeRF) have shown impressive advances for novel view synthesis, most methods typically require multiple input images of the same scene with accurate camera poses. In this work, we seek to substantially reduce…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Kai-En Lin , Lin Yen-Chen , Wei-Sheng Lai , Tsung-Yi Lin , Yi-Chang Shih , Ravi Ramamoorthi

Inspired by the recent advances in implicitly representing signals with trained neural networks, we aim to learn a continuous representation for narrow-baseline 4D light fields. We propose an implicit representation model for 4D light…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Paramanand Chandramouli , Hendrik Sommerhoff , Andreas Kolb