English
Related papers

Related papers: DIST: Rendering Deep Implicit Signed Distance Func…

200 papers

It is vital to recover 3D geometry from multi-view RGB images in many 3D computer vision tasks. The latest methods infer the geometry represented as a signed distance field by minimizing the rendering error on the field through volume…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Sijia Jiang , Tong Wu , Jing Hua , Zhizhong Han

Geometric Deep Learning has recently made striking progress with the advent of continuous Deep Implicit Fields. They allow for detailed modeling of watertight surfaces of arbitrary topology while not relying on a 3D Euclidean grid,…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Edoardo Remelli , Artem Lukoianov , Stephan R. Richter , Benoît Guillard , Timur Bagautdinov , Pierre Baque , Pascal Fua

Shape implicit neural representations (INRs) have recently shown to be effective in shape analysis and reconstruction tasks. Existing INRs require point coordinates to learn the implicit level sets of the shape. When a normal vector is…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Yizhak Ben-Shabat , Chamin Hewa Koneputugodage , Stephen Gould

We present a method for differentiable rendering of 3D surfaces that supports both explicit and implicit representations, provides derivatives at occlusion boundaries, and is fast and simple to implement. The method first samples the…

Graphics · Computer Science 2021-08-12 Forrester Cole , Kyle Genova , Avneesh Sud , Daniel Vlasic , Zhoutong Zhang

Neural implicit shape representations are an emerging paradigm that offers many potential benefits over conventional discrete representations, including memory efficiency at a high spatial resolution. Generalizing across shapes with such…

Computer Vision and Pattern Recognition · Computer Science 2020-06-18 Vincent Sitzmann , Eric R. Chan , Richard Tucker , Noah Snavely , Gordon Wetzstein

We propose a novel method for reconstructing explicit parameterized surfaces from Signed Distance Fields (SDFs), a widely used implicit neural representation (INR) for 3D surfaces. While traditional reconstruction methods like Marching…

Graphics · Computer Science 2024-10-07 Haotian Yin , Przemyslaw Musialski

Representing visual signals by implicit representation (e.g., a coordinate based deep network) has prevailed among many vision tasks. This work explores a new intriguing direction: training a stylized implicit representation, using a…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Zhiwen Fan , Yifan Jiang , Peihao Wang , Xinyu Gong , Dejia Xu , Zhangyang Wang

In modern computer vision, the optimal representation of 3D shape continues to be task-dependent. One fundamental operation applied to such representations is differentiable rendering, as it enables inverse graphics approaches in learning…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Tristan Aumentado-Armstrong , Stavros Tsogkas , Sven Dickinson , Allan Jepson

Many minimally invasive interventional procedures still rely on 2D fluoroscopic imaging. Generating a patient-specific 3D model from these X-ray projection data would allow to improve the procedural workflow, e.g. by providing assistance…

Image and Video Processing · Electrical Eng. & Systems 2021-02-08 Karthik Shetty , Annette Birkhold , Norbert Strobel , Bernhard Egger , Srikrishna Jaganathan , Markus Kowarschik , Andreas Maier

This paper proposes a deep-learning-based method for recovering a signed distance function (SDF) of a given hypersurface represented by an implicit level set function. Using the flexibility of constructing a neural network, we use an…

Numerical Analysis · Mathematics 2023-05-16 Yesom Park , Chang hoon Song , Jooyoung Hahn , Myungjoo Kang

Computer graphics, 3D computer vision and robotics communities have produced multiple approaches to representing 3D geometry for rendering and reconstruction. These provide trade-offs across fidelity, efficiency and compression…

Computer Vision and Pattern Recognition · Computer Science 2019-01-17 Jeong Joon Park , Peter Florence , Julian Straub , Richard Newcombe , Steven Lovegrove

Traditional computer graphics rendering pipeline is designed for procedurally generating 2D quality images from 3D shapes with high performance. The non-differentiability due to discrete operations such as visibility computation makes it…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Thu Nguyen-Phuoc , Chuan Li , Stephen Balaban , Yong-Liang Yang

Mathematically representing the shape of an object is a key ingredient for solving inverse rendering problems. Explicit representations like meshes are efficient to render in a differentiable fashion but have difficulties handling topology…

Graphics · Computer Science 2022-07-12 Guangyan Cai , Kai Yan , Zhao Dong , Ioannis Gkioulekas , Shuang Zhao

Recent works on implicit neural representations have shown promising results for multi-view surface reconstruction. However, most approaches are limited to relatively simple geometries and usually require clean object masks for…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Jingyang Zhang , Yao Yao , Long Quan

Neural signed distance functions (SDFs) have been a vital representation to represent 3D shapes or scenes with neural networks. An SDF is an implicit function that can query signed distances at specific coordinates for recovering a 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Qiang Bai , Bojian Wu , Xi Yang , Zhizhong Han

Neural signed distance functions (SDFs) have shown powerful ability in fitting the shape geometry. However, inferring continuous signed distance fields from discrete unoriented point clouds still remains a challenge. The neural network…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Shengtao Li , Ge Gao , Yudong Liu , Ming Gu , Yu-Shen Liu

Recent advances in differentiable rendering, which allow calculating the gradients of 2D pixel values with respect to 3D object models, can be applied to estimation of the model parameters by gradient-based optimization with only 2D…

Graphics · Computer Science 2022-12-07 Yiping Xie , Nils Bore , John Folkesson

There is rising interest in differentiable rendering, which allows explicitly modeling geometric priors and constraints in optimization pipelines using first-order methods such as backpropagation. Incorporating such domain knowledge can…

Image and Video Processing · Electrical Eng. & Systems 2023-08-09 Michael Wilmanski , Jonathan Tamir

We introduce a novel depth estimation technique for multi-frame structured light setups using neural implicit representations of 3D space. Our approach employs a neural signed distance field (SDF), trained through self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Rukun Qiao , Hiroshi Kawasaki , Hongbin Zha

Differentiable render is widely used in optimization-based 3D reconstruction which requires gradients from differentiable operations for gradient-based optimization. The existing differentiable renderers obtain the gradients of rendering…

Computer Vision and Pattern Recognition · Computer Science 2019-06-20 Zaiqiang Wu , Wei Jiang