English
Related papers

Related papers: Learning Neural Transmittance for Efficient Render…

200 papers

This paper proposes a novel approach for rendering a pre-trained Neural Radiance Field (NeRF) in real-time on resource-constrained devices. We introduce Re-ReND, a method enabling Real-time Rendering of NeRFs across Devices. Re-ReND is…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Sara Rojas , Jesus Zarzar , Juan Camilo Perez , Artsiom Sanakoyeu , Ali Thabet , Albert Pumarola , Bernard Ghanem

Neural volumetric representations have become a widely adopted model for radiance fields in 3D scenes. These representations are fully implicit or hybrid function approximators of the instantaneous volumetric radiance in a scene, which are…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Yuval Bahat , Yuxuan Zhang , Hendrik Sommerhoff , Andreas Kolb , Felix Heide

Neural radiance fields (NeRFs) have emerged as an effective method for novel-view synthesis and 3D scene reconstruction. However, conventional training methods require access to all training views during scene optimization. This assumption…

Computer Vision and Pattern Recognition · Computer Science 2023-09-07 Ryan Po , Zhengyang Dong , Alexander W. Bergman , Gordon Wetzstein

Beyond novel view synthesis, Neural Radiance Fields are useful for applications that interact with the real world. In this paper, we use them as an implicit map of a given scene and propose a camera relocalization algorithm tailored for…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Arthur Moreau , Nathan Piasco , Moussab Bennehar , Dzmitry Tsishkou , Bogdan Stanciulescu , Arnaud de La Fortelle

Decomposing a scene into its shape, reflectance, and illumination is a challenging but important problem in computer vision and graphics. This problem is inherently more challenging when the illumination is not a single light source under…

Computer Vision and Pattern Recognition · Computer Science 2021-08-27 Mark Boss , Raphael Braun , Varun Jampani , Jonathan T. Barron , Ce Liu , Hendrik P. A. Lensch

We present a real-time neural radiance caching method for path-traced global illumination. Our system is designed to handle fully dynamic scenes, and makes no assumptions about the lighting, geometry, and materials. The data-driven nature…

Graphics · Computer Science 2021-06-28 Thomas Müller , Fabrice Rousselle , Jan Novák , Alexander Keller

Faster rendering of synthetic images is a core problem in the field of computer graphics. Rendering algorithms, such as path-tracing is dependent on parameters like size of the image, number of light bounces, number of samples per pixel,…

Graphics · Computer Science 2023-06-29 Annada Prasad Behera , Subhankar Mishra

Recently, Neural Radiance Fields (NeRF) has exhibited significant success in novel view synthesis, surface reconstruction, etc. However, since no physical reflection is considered in its rendering pipeline, NeRF mistakes the reflection in…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Junyi Zeng , Chong Bao , Rui Chen , Zilong Dong , Guofeng Zhang , Hujun Bao , Zhaopeng Cui

We propose a neural inverse rendering approach that jointly reconstructs geometry, spatially varying reflectance, and lighting conditions from multi-view images captured under varying directional lighting. Unlike prior multi-view…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Xu Cao , Takafumi Taketomi

We propose a novel Neural Radiance Field (NeRF) representation for non-opaque scenes that enables fast inference by utilizing textured polygons. Despite the high-quality novel view rendering that NeRF provides, a critical limitation is that…

Graphics · Computer Science 2024-07-11 Gopal Sharma , Daniel Rebain , Kwang Moo Yi , Andrea Tagliasacchi

In recent years, novel view synthesis has gained popularity in generating high-fidelity images. While demonstrating superior performance in the task of synthesizing novel views, the majority of these methods are still based on the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Xiaoyan Yang , Dingbo Lu , Yang Li , Chenhui Li , Changbo Wang

This paper presents a novel Learning from Demonstration (LfD) method that uses neural fields to learn new skills efficiently and accurately. It achieves this by utilizing a shared embedding to learn both scene and motion representations in…

Robotics · Computer Science 2023-08-16 Ahmet Tekden , Marc Peter Deisenroth , Yasemin Bekiroglu

Radiance fields have emerged as a predominant representation for modeling 3D scene appearance. Neural formulations such as Neural Radiance Fields provide high expressivity but require costly ray marching for rendering, whereas…

Dynamic imaging is essential for analyzing various biological systems and behaviors but faces two main challenges: data incompleteness and computational burden. For many imaging systems, high frame rates and short acquisition times require…

Image and Video Processing · Electrical Eng. & Systems 2024-06-12 Luke Lozenski , Mark A. Anastasio , Umberto Villa

Traditional inverse rendering techniques are based on textured meshes, which naturally adapts to modern graphics pipelines, but costly differentiable multi-bounce Monte Carlo (MC) ray tracing poses challenges for modeling global…

Graphics · Computer Science 2025-06-09 Jiakai Sun , Weijing Zhang , Zhanjie Zhang , Tianyi Chu , Guangyuan Li , Lei Zhao , Wei Xing

Creating high-quality controllable 3D human models from multi-view RGB videos poses a significant challenge. Neural radiance fields (NeRFs) have demonstrated remarkable quality in reconstructing and free-viewpoint rendering of static as…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Paul Knoll , Wieland Morgenstern , Anna Hilsmann , Peter Eisert

Neural rendering algorithms have revolutionized computer graphics, yet their impact on real-time rendering under arbitrary lighting conditions remains limited due to strict latency constraints in practical applications. The key challenge…

Graphics · Computer Science 2025-06-12 Yijie Deng , Lei Han , Lu Fang

We propose a simple yet effective neural network-based framework for global illumination rendering. Recently, rendering techniques that learn neural radiance caches by minimizing the difference (i.e., residual) between the left and right…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 In-Young Cho , Jaewoong Cho

Neural Radiance Fields (NeRF) is a popular view synthesis technique that represents a scene as a continuous volumetric function, parameterized by multilayer perceptrons that provide the volume density and view-dependent emitted radiance at…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Dor Verbin , Peter Hedman , Ben Mildenhall , Todd Zickler , Jonathan T. Barron , Pratul P. Srinivasan

Reconstructing neural radiance fields with explicit volumetric representations, demonstrated by Plenoxels, has shown remarkable advantages on training and rendering efficiency, while grid-based representations typically induce considerable…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Lingzhi Li , Zhongshu Wang , Zhen Shen , Li Shen , Ping Tan