English
Related papers

Related papers: A Simple Approach to Differentiable Rendering of S…

200 papers

Differentiable physics is a powerful tool in computer vision and robotics for scene understanding and reasoning about interactions. Existing approaches have frequently been limited to objects with simple shape or shapes that are known in…

Computer Vision and Pattern Recognition · Computer Science 2022-01-11 Michael Strecke , Joerg Stueckler

Given only a set of images, neural implicit surface representation has shown its capability in 3D surface reconstruction. However, as the nature of per-scene optimization is based on the volumetric rendering of color, previous neural…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Jing Li , Jinpeng Yu , Ruoyu Wang , Zhengxin Li , Zhengyu Zhang , Lina Cao , Shenghua Gao

Unsigned Distance Functions (UDFs) can be used to represent non-watertight surfaces in a deep learning framework. However, UDFs tend to be brittle and difficult to learn, in part because the surface is located exactly where the UDF is…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Hieu Le , Federico Stella , Benoit Guillard , Pascal Fua

There is rising interest in differentiable rendering, which allows explicitly modeling geometric priors and constraints in optimization pipelines using first-order methods such as backpropagation. Incorporating such domain knowledge can…

Image and Video Processing · Electrical Eng. & Systems 2023-08-09 Michael Wilmanski , Jonathan Tamir

We propose a neural inverse rendering pipeline called IRON that operates on photometric images and outputs high-quality 3D content in the format of triangle meshes and material textures readily deployable in existing graphics pipelines. Our…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Kai Zhang , Fujun Luan , Zhengqi Li , Noah Snavely

We propose a method to interpolate Signed Distance Function (SDF) data from a discrete set of samples. Unlike prior work, our approach ensures that the new SDF data values are fully consistent with the input and each other, such that the…

Graphics · Computer Science 2026-05-05 Letao Chen , Sanju Mupparaju , Christopher Batty , Silvia Sellán , Oded Stein

Signed Distance Fields (SDFs) for surface representation are commonly generated offline and subsequently loaded into interactive applications like games. Since they are not updated every frame, they only provide a rigid surface…

Graphics · Computer Science 2022-10-11 Yu Wei Tan , Nicholas Chua , Clarence Koh , Anand Bhojan

Neural 3D implicit representations learn priors that are useful for diverse applications, such as single- or multiple-view 3D reconstruction. A major downside of existing approaches while rendering an image is that they require evaluating…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Tarun Yenamandra , Ayush Tewari , Nan Yang , Florian Bernard , Christian Theobalt , Daniel Cremers

We introduce a novel approach for rendering static and dynamic 3D neural signed distance functions (SDF) in real-time. We rely on nested neighborhoods of zero-level sets of neural SDFs, and mappings between them. This framework supports…

Graphics · Computer Science 2022-12-08 Vinícius da Silva , Tiago Novello , Guilherme Schardong , Luiz Schirmer , Hélio Lopes , Luiz Velho

Existing methods in neural scene reconstruction utilize the Signed Distance Function (SDF) to model the density function. However, in indoor scenes, the density computed from the SDF for a sampled point may not consistently reflect its real…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Ruihong Yin , Yunlu Chen , Sezer Karaoglu , Theo Gevers

This paper presents a novel post-processing methodology for extracting high-quality geometries from density-based topology optimization results. Current post-processing approaches often struggle to simultaneously achieve smooth boundaries,…

Computational Engineering, Finance, and Science · Computer Science 2025-12-09 Ondřej Ježek , Ján Kopačka , Martin Isoz , Dušan Gabriel , Pavel Maršálek , Martin Šotola , Radim Halama

Signed distance fields (SDFs) are a form of surface representation widely used in computer graphics, having applications in rendering, collision detection and modelling. In interactive media such as games, high-resolution SDFs are commonly…

Graphics · Computer Science 2022-10-13 Yu Wei Tan , Nicholas Chua , Clarence Koh , Anand Bhojan

In this paper, we develop a new method, termed SDF-3DGAN, for 3D object generation and 3D-Aware image synthesis tasks, which introduce implicit Signed Distance Function (SDF) as the 3D object representation method in the generative field.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Lutao Jiang , Ruyi Ji , Libo Zhang

Neural signed distance functions (SDFs) have shown powerful ability in fitting the shape geometry. However, inferring continuous signed distance fields from discrete unoriented point clouds still remains a challenge. The neural network…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Shengtao Li , Ge Gao , Yudong Liu , Ming Gu , Yu-Shen Liu

Neural Signed Distance Fields (SDFs) provide a differentiable environment representation to readily obtain collision checks and well-defined gradients for robot navigation tasks. However, updating neural SDFs as the scene evolves entails…

Robotics · Computer Science 2025-03-07 S. Talha Bukhari , Daniel Lawson , Ahmed H. Qureshi

Accurate surface estimation is critical for downstream tasks in scientific simulation, and quantifying uncertainty in implicit neural 3D representations still remains a substantial challenge due to computational inefficiencies, scalability…

Computer Vision and Pattern Recognition · Computer Science 2025-09-08 Rushil Desai

3D Gaussian splatting (3DGS) has shown its detailed expressive ability and highly efficient rendering speed in the novel view synthesis (NVS) task. The application to inverse rendering still faces several challenges, as the discrete nature…

Graphics · Computer Science 2025-07-22 Zuo-Liang Zhu , Jian Yang , Beibei Wang

While Signed Distance Fields (SDF) are well-established for modeling watertight surfaces, Unsigned Distance Fields (UDF) broaden the scope to include open surfaces and models with complex inner structures. Despite their flexibility, UDFs…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Cheng Xu , Fei Hou , Wencheng Wang , Hong Qin , Zhebin Zhang , Ying He

In view synthesis, a neural radiance field approximates underlying density and radiance fields based on a sparse set of scene pictures. To generate a pixel of a novel view, it marches a ray through the pixel and computes a weighted sum of…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Nikita Morozov , Denis Rakitin , Oleg Desheulin , Dmitry Vetrov , Kirill Struminsky

Differentiable rendering has received increasing interest for image-based inverse problems. It can benefit traditional optimization-based solutions to inverse problems, but also allows for self-supervision of learning-based approaches for…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Linjie Lyu , Marc Habermann , Lingjie Liu , Mallikarjun B R , Ayush Tewari , Christian Theobalt