English
Related papers

Related papers: FIRe: Fast Inverse Rendering using Directional and…

200 papers

Reconstructing hand-held objects from a single RGB image is an important and challenging problem. Existing works utilizing Signed Distance Fields (SDF) reveal limitations in comprehensively capturing the complex hand-object interactions,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Chenyangguang Zhang , Yan Di , Ruida Zhang , Guangyao Zhai , Fabian Manhardt , Federico Tombari , Xiangyang Ji

This paper proposes a deep-learning-based method for recovering a signed distance function (SDF) of a given hypersurface represented by an implicit level set function. Using the flexibility of constructing a neural network, we use an…

Numerical Analysis · Mathematics 2023-05-16 Yesom Park , Chang hoon Song , Jooyoung Hahn , Myungjoo Kang

SDF-based differential rendering frameworks have achieved state-of-the-art multiview 3D shape reconstruction. In this work, we re-examine this family of approaches by minimally reformulating its core appearance model in a way that…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Briac Toussaint , Diego Thomas , Jean-Sébastien Franco

State-of-the-art neural implicit surface representations have achieved impressive results in indoor scene reconstruction by incorporating monocular geometric priors as additional supervision. However, we have observed that multi-view…

Computer Vision and Pattern Recognition · Computer Science 2024-05-02 Ziyi Chen , Xiaolong Wu , Yu Zhang

Neural Radiance Fields (NeRF) coupled with GANs represent a promising direction in the area of 3D reconstruction from a single view, owing to their ability to efficiently model arbitrary topologies. Recent work in this area, however, has…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Dario Pavllo , David Joseph Tan , Marie-Julie Rakotosaona , Federico Tombari

Recently, it has shown that priors are vital for neural implicit functions to reconstruct high-quality surfaces from multi-view RGB images. However, current priors require large-scale pre-training, and merely provide geometric clues without…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Wenyuan Zhang , Emily Yue-ting Jia , Junsheng Zhou , Baorui Ma , Kanle Shi , Yu-Shen Liu , Zhizhong Han

Signed distance functions (SDFs) is an attractive framework that has recently shown promising results for 3D shape reconstruction from images. SDFs seamlessly generalize to different shape resolutions and topologies but lack explicit…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Zerui Chen , Shizhe Chen , Cordelia Schmid , Ivan Laptev

We present a novel approach for recovering 3D shape and view dependent appearance from a few colored images, enabling efficient 3D reconstruction and novel view synthesis. Our method learns an implicit neural representation in the form of a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Mae Younes , Amine Ouasfi , Adnane Boukhayma

Reconstructing detailed 3D scenes from single-view images remains a challenging task due to limitations in existing approaches, which primarily focus on geometric shape recovery, overlooking object appearances and fine shape details. To…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Yixin Chen , Junfeng Ni , Nan Jiang , Yaowei Zhang , Yixin Zhu , Siyuan Huang

Neural implicit representations have emerged as a powerful paradigm for 3D reconstruction. However, despite their success, existing methods fail to capture fine geometric details and thin structures, especially in scenarios where only…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Aarya Patel , Hamid Laga , Ojaswa Sharma

We present learning-based implicit shape representations designed for real-time avatar collision queries arising in the simulation of clothing. Signed distance functions (SDFs) have been used for such queries for many years due to their…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Osman Akar , Yushan Han , Yizhou Chen , Weixian Lan , Benn Gallagher , Ronald Fedkiw , Joseph Teran

Obtaining high-quality 3D reconstructions of room-scale scenes is of paramount importance for upcoming applications in AR or VR. These range from mixed reality applications for teleconferencing, virtual measuring, virtual room planing, to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Dejan Azinović , Ricardo Martin-Brualla , Dan B Goldman , Matthias Nießner , Justus Thies

Unsigned Distance Functions (UDFs) can be used to represent non-watertight surfaces in a deep learning framework. However, UDFs tend to be brittle and difficult to learn, in part because the surface is located exactly where the UDF is…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Hieu Le , Federico Stella , Benoit Guillard , Pascal Fua

It is vital to infer a signed distance function (SDF) in multi-view based surface reconstruction. 3D Gaussian splatting (3DGS) provides a novel perspective for volume rendering, and shows advantages in rendering efficiency and quality.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Wenyuan Zhang , Yu-Shen Liu , Zhizhong Han

Deep neural networks (DNNs) are widely applied for nowadays 3D surface reconstruction tasks and such methods can be further divided into two categories, which respectively warp templates explicitly by moving vertices or represent 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Xianghui Yang , Guosheng Lin , Zhenghao Chen , Luping Zhou

Neural rendering can be used to reconstruct implicit representations of shapes without 3D supervision. However, current neural surface reconstruction methods have difficulty learning high-frequency geometry details, so the reconstructed…

Computer Vision and Pattern Recognition · Computer Science 2022-09-23 Yiqun Wang , Ivan Skorokhodov , Peter Wonka

In this paper, we develop a new method, termed SDF-3DGAN, for 3D object generation and 3D-Aware image synthesis tasks, which introduce implicit Signed Distance Function (SDF) as the 3D object representation method in the generative field.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Lutao Jiang , Ruyi Ji , Libo Zhang

Neural distance fields (NDF) have emerged as a powerful tool for addressing challenges in 3D computer vision and graphics downstream problems. While significant progress has been made to learn NDF from various kind of sensor data, a crucial…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Akshit Singh , Karan Bhakuni , Rajendra Nagar

Neural implicit reconstruction via volume rendering has demonstrated its effectiveness in recovering dense 3D surfaces. However, it is non-trivial to simultaneously recover meticulous geometry and preserve smoothness across regions with…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Ziyu Tang , Weicai Ye , Yifan Wang , Di Huang , Hujun Bao , Tong He , Guofeng Zhang

We present a simple algorithm for differentiable rendering of surfaces represented by Signed Distance Fields (SDF), which makes it easy to integrate rendering into gradient-based optimization pipelines. To tackle visibility-related…

Graphics · Computer Science 2024-06-10 Zichen Wang , Xi Deng , Ziyi Zhang , Wenzel Jakob , Steve Marschner