English
Related papers

Related papers: GIFS: Neural Implicit Function for General Shape R…

200 papers

3D scene segmentation based on neural implicit representation has emerged recently with the advantage of training only on 2D supervision. However, existing approaches still requires expensive per-scene optimization that prohibits…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Hanlin Chen , Chen Li , Mengqi Guo , Zhiwen Yan , Gim Hee Lee

The neural implicit representation has shown its effectiveness in novel view synthesis and high-quality 3D reconstruction from multi-view images. However, most approaches focus on holistic scene representation yet ignore individual objects…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Qianyi Wu , Xian Liu , Yuedong Chen , Kejie Li , Chuanxia Zheng , Jianfei Cai , Jianmin Zheng

Unsigned Distance Functions (UDFs) can be used to represent non-watertight surfaces in a deep learning framework. However, UDFs tend to be brittle and difficult to learn, in part because the surface is located exactly where the UDF is…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Hieu Le , Federico Stella , Benoit Guillard , Pascal Fua

We present a novel neural surface reconstruction method, called NeuS, for reconstructing objects and scenes with high fidelity from 2D image inputs. Existing neural surface reconstruction approaches, such as DVR and IDR, require foreground…

Computer Vision and Pattern Recognition · Computer Science 2023-02-02 Peng Wang , Lingjie Liu , Yuan Liu , Christian Theobalt , Taku Komura , Wenping Wang

In recent years, neural implicit surface reconstruction has emerged as a popular paradigm for multi-view 3D reconstruction. Unlike traditional multi-view stereo approaches, the neural implicit surface-based methods leverage neural networks…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Qianyi Wu , Kaisiyuan Wang , Kejie Li , Jianmin Zheng , Jianfei Cai

Neural implicit 3D representations have emerged as a powerful paradigm for reconstructing surfaces from multi-view images and synthesizing novel views. Unfortunately, existing methods such as DVR or IDR require accurate per-pixel object…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Michael Oechsle , Songyou Peng , Andreas Geiger

Surface reconstruction is a fundamental problem in 3D graphics. In this paper, we propose a learning-based approach for implicit surface reconstruction from raw point clouds without normals. Our method is inspired by Gauss Lemma in…

Computer Vision and Pattern Recognition · Computer Science 2022-02-22 Dong Xiao , Siyou Lin , Zuoqiang Shi , Bin Wang

Generating high-quality 3D objects from textual descriptions remains a challenging problem due to computational cost, the scarcity of 3D data, and complex 3D representations. We introduce Geometry Image Diffusion (GIMDiffusion), a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Slava Elizarov , Ciara Rowles , Simon Donné

Recent advances in implicit neural representations have achieved impressive results by sampling and fusing individual points along sampling rays in the sampling space. However, due to the explosively growing sampling space, finely…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Yuhan Ding , Fukun Yin , Jiayuan Fan , Hui Li , Xin Chen , Wen Liu , Chongshan Lu , Gang YU , Tao Chen

Differentiable rendering is an essential operation in modern vision, allowing inverse graphics approaches to 3D understanding to be utilized in modern machine learning frameworks. Explicit shape representations (voxels, point clouds, or…

Computer Vision and Pattern Recognition · Computer Science 2021-12-13 Tristan Aumentado-Armstrong , Stavros Tsogkas , Sven Dickinson , Allan Jepson

Neural implicit representations, including Neural Distance Fields and Neural Radiance Fields, have demonstrated significant capabilities for reconstructing surfaces with complicated geometry and topology, and generating novel views of a…

Graphics · Computer Science 2024-02-08 Lin Gao , Jie Yang , Bo-Tao Zhang , Jia-Mu Sun , Yu-Jie Yuan , Hongbo Fu , Yu-Kun Lai

Representing surfaces as zero level sets of neural networks recently emerged as a powerful modeling paradigm, named Implicit Neural Representations (INRs), serving numerous downstream applications in geometric deep learning and 3D vision.…

Machine Learning · Computer Science 2021-06-16 Yaron Lipman

Deep implicit functions (DIFs) have emerged as a powerful paradigm for many computer vision tasks such as 3D shape reconstruction, generation, registration, completion, editing, and understanding. However, given a set of 3D shapes with…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Yining Jiao , Carlton Zdanski , Julia Kimbell , Andrew Prince , Cameron Worden , Samuel Kirse , Christopher Rutter , Benjamin Shields , William Dunn , Jisan Mahmud , Marc Niethammer

Neural implicit representations have become a popular choice for modeling surfaces due to their adaptability in resolution and support for complex topology. While previous works have achieved impressive reconstruction quality by training on…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Lu Sang , Abhishek Saroha , Maolin Gao , Daniel Cremers

Diffusion models have shown remarkable results for image generation, editing and inpainting. Recent works explore diffusion models for 3D shape generation with neural implicit functions, i.e., signed distance function and occupancy…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Junsheng Zhou , Weiqi Zhang , Baorui Ma , Kanle Shi , Yu-Shen Liu , Zhizhong Han

NeRF-based techniques fit wide and deep multi-layer perceptrons (MLPs) to a continuous radiance field that can be rendered from any unseen viewpoint. However, the lack of surface and normals definition and high rendering times limit their…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Stefano Esposito , Daniele Baieri , Stefan Zellmann , André Hinkenjann , Emanuele Rodolà

We present a novel method, called NeuralUDF, for reconstructing surfaces with arbitrary topologies from 2D images via volume rendering. Recent advances in neural rendering based reconstruction have achieved compelling results. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Xiaoxiao Long , Cheng Lin , Lingjie Liu , Yuan Liu , Peng Wang , Christian Theobalt , Taku Komura , Wenping Wang

Precise representations of 3D faces are beneficial to various computer vision and graphics applications. Due to the data discretization and model linearity, however, it remains challenging to capture accurate identity and expression clues…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Mingwu Zheng , Hongyu Yang , Di Huang , Liming Chen

Existing digital sensors capture images at fixed spatial and spectral resolutions (e.g., RGB, multispectral, and hyperspectral images), and each combination requires bespoke machine learning models. Neural Implicit Functions partially…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Gengchen Mai , Ni Lao , Weiwei Sun , Yuchi Ma , Jiaming Song , Chenlin Meng , Hongxu Ma , Jinmeng Rao , Ziyuan Li , Stefano Ermon

Template 3D shapes are useful for many tasks in graphics and vision, including fitting observation data, analyzing shape collections, and transferring shape attributes. Because of the variety of geometry and topology of real-world shapes,…

Computer Vision and Pattern Recognition · Computer Science 2019-04-16 Kyle Genova , Forrester Cole , Daniel Vlasic , Aaron Sarna , William T. Freeman , Thomas Funkhouser