English
Related papers

Related papers: LinPrim: Linear Primitives for Differentiable Volu…

200 papers

Neural Radiance Fields or NeRFs have become the representation of choice for problems in view synthesis or image-based rendering, as well as in many other applications across computer graphics and vision, and beyond. At their core, NeRFs…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Ravi Ramamoorthi

Recent work has demonstrated that volumetric scene representations combined with differentiable volume rendering can enable photo-realistic rendering for challenging scenes that mesh reconstruction fails on. However, these methods entangle…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Fanbo Xiang , Zexiang Xu , Miloš Hašan , Yannick Hold-Geoffroy , Kalyan Sunkavalli , Hao Su

We introduce a new approach for reconstruction and novel view synthesis of unbounded real-world scenes. In contrast to previous methods using either volumetric fields, grid-based models, or discrete point cloud proxies, we propose a hybrid…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Florian Hahlbohm , Linus Franke , Moritz Kappel , Susana Castillo , Martin Eisemann , Marc Stamminger , Marcus Magnor

NeRF provides unparalleled fidelity of novel view synthesis: rendering a 3D scene from an arbitrary viewpoint. NeRF requires training on a large number of views that fully cover a scene, which limits its applicability. While these issues…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Pol Moreno , Adam R. Kosiorek , Heiko Strathmann , Daniel Zoran , Rosalia G. Schneider , Björn Winckler , Larisa Markeeva , Théophane Weber , Danilo J. Rezende

While deep learning methods have achieved impressive success in many vision benchmarks, it remains difficult to understand and explain the representations and decisions of these models. Though vision models are typically trained on 2D…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Benjamin Beilharz , Thomas S. A. Wallis

We present a method for differentiable rendering of 3D surfaces that supports both explicit and implicit representations, provides derivatives at occlusion boundaries, and is fast and simple to implement. The method first samples the…

Graphics · Computer Science 2021-08-12 Forrester Cole , Kyle Genova , Avneesh Sud , Daniel Vlasic , Zhoutong Zhang

Volumetric modeling and neural radiance field representations have revolutionized 3D face capture and photorealistic novel view synthesis. However, these methods often require hundreds of multi-view input images and are thus inapplicable to…

We present a new approach for synthesizing novel views of people in new poses. Our novel differentiable renderer enables the synthesis of highly realistic images from any viewpoint. Rather than operating over mesh-based structures, our…

Computer Vision and Pattern Recognition · Computer Science 2022-02-22 Guillaume Rochette , Chris Russell , Richard Bowden

Volume rendering using neural fields has shown great promise in capturing and synthesizing novel views of 3D scenes. However, this type of approach requires querying the volume network at multiple points along each viewing ray in order to…

Computer Vision and Pattern Recognition · Computer Science 2021-11-08 Martin Piala , Ronald Clark

Novel view synthesis (NVS) of multi-human scenes imposes challenges due to the complex inter-human occlusions. Layered representations handle the complexities by dividing the scene into multi-layered radiance fields, however, they are…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Youssef Abdelkareem , Shady Shehata , Fakhri Karray

We present a method for generating high-quality watertight manifold meshes from multi-view input images. Existing volumetric rendering methods are robust in optimization but tend to generate noisy meshes with poor topology. Differentiable…

Computer Vision and Pattern Recognition · Computer Science 2025-01-20 Xinyue Wei , Fanbo Xiang , Sai Bi , Anpei Chen , Kalyan Sunkavalli , Zexiang Xu , Hao Su

With the emergence of neural radiance fields (NeRFs), view synthesis quality has reached an unprecedented level. Compared to traditional mesh-based assets, this volumetric representation is more powerful in expressing scene geometry but…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Yuan-Chen Guo , Yan-Pei Cao , Chen Wang , Yu He , Ying Shan , Xiaohu Qie , Song-Hai Zhang

We introduce DiffBMP, a scalable and efficient differentiable rendering engine for a collection of bitmap images. Our work addresses a limitation that traditional differentiable renderers are constrained to vector graphics, given that most…

Graphics · Computer Science 2026-03-25 Seongmin Hong , Junghun James Kim , Daehyeop Kim , Insoo Chung , Se Young Chun

Radiance fields have emerged as a predominant representation for modeling 3D scene appearance. Neural formulations such as Neural Radiance Fields provide high expressivity but require costly ray marching for rendering, whereas…

Field-guided parametrization methods have proven effective for quad meshing of surfaces; these methods compute smooth cross fields to guide the meshing process and then integrate the fields to construct a discrete mesh. A key challenge in…

Graphics · Computer Science 2020-04-29 David Palmer , David Bommes , Justin Solomon

Differentiable rendering with 3D Gaussian primitives has emerged as a powerful method for reconstructing high-fidelity 3D scenes from multi-view images. While it offers improvements over NeRF-based methods, this representation still…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Kaifeng Sheng , Zheng Zhou , Yingliang Peng , Qianwei Wang

Modeling and rendering of dynamic scenes is challenging, as natural scenes often contain complex phenomena such as thin structures, evolving topology, translucency, scattering, occlusion, and biological motion. Mesh-based reconstruction and…

Graphics · Computer Science 2019-08-14 Stephen Lombardi , Tomas Simon , Jason Saragih , Gabriel Schwartz , Andreas Lehrmann , Yaser Sheikh

We present the first systematic comparison of implicit and explicit Novel View Synthesis methods for space-based 3D object reconstruction, evaluating the role of appearance embeddings. While embeddings improve photometric fidelity by…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Elias De Smijter , Renaud Detry , Christophe De Vleeschouwer

Neural Radiance Fields (NeRF) have demonstrated superior novel view synthesis performance but are slow at rendering. To speed up the volume rendering process, many acceleration methods have been proposed at the cost of large memory…

Computer Vision and Pattern Recognition · Computer Science 2022-12-19 Sicheng Li , Hao Li , Yue Wang , Yiyi Liao , Lu Yu

Neural Radiance Fields (NeRFs) have demonstrated amazing ability to synthesize images of 3D scenes from novel views. However, they rely upon specialized volumetric rendering algorithms based on ray marching that are mismatched to the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Zhiqin Chen , Thomas Funkhouser , Peter Hedman , Andrea Tagliasacchi