English
Related papers

Related papers: Deep Level Sets: Implicit Surface Representations …

200 papers

In recent years, neural implicit representations gained popularity in 3D reconstruction due to their expressiveness and flexibility. However, the implicit nature of neural implicit representations results in slow inference time and requires…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Songyou Peng , Chiyu "Max" Jiang , Yiyi Liao , Michael Niemeyer , Marc Pollefeys , Andreas Geiger

Iterative refinement -- start with a random guess, then iteratively improve the guess -- is a useful paradigm for representation learning because it offers a way to break symmetries among equally plausible explanations for the data. This…

Machine Learning · Computer Science 2023-01-03 Michael Chang , Thomas L. Griffiths , Sergey Levine

The neural implicit representation has shown its effectiveness in novel view synthesis and high-quality 3D reconstruction from multi-view images. However, most approaches focus on holistic scene representation yet ignore individual objects…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Qianyi Wu , Xian Liu , Yuedong Chen , Kejie Li , Chuanxia Zheng , Jianfei Cai , Jianmin Zheng

Recently, methods for neural surface representation and rendering, for example NeuS, have shown that learning neural implicit surfaces through volume rendering is becoming increasingly popular and making good progress. However, these…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Hanqi Jiang , Cheng Zeng , Runnan Chen , Shuai Liang , Yinhe Han , Yichao Gao , Conglin Wang

Representing 3D surfaces as level sets of continuous functions over $\mathbb{R}^3$ is the common denominator of neural implicit representations, which recently enabled remarkable progress in geometric deep learning and computer vision…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Daniele Baieri , Stefano Esposito , Filippo Maggioli , Emanuele Rodolà

Generative reconstruction methods compute the 3D configuration (such as pose and/or geometry) of a shape by optimizing the overlap of the projected 3D shape model with images. Proper handling of occlusions is a big challenge, since the…

Computer Vision and Pattern Recognition · Computer Science 2016-02-12 Helge Rhodin , Nadia Robertini , Christian Richardt , Hans-Peter Seidel , Christian Theobalt

Recent years have seen the development of mature solutions for reconstructing deformable surfaces from a single image, provided that they are relatively well-textured. By contrast, recovering the 3D shape of texture-less surfaces remains an…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Jan Bednařík , Pascal Fua , Mathieu Salzmann

Recently, implicit neural representations have gained popularity for learning-based 3D reconstruction. While demonstrating promising results, most implicit approaches are limited to comparably simple geometry of single objects and do not…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Songyou Peng , Michael Niemeyer , Lars Mescheder , Marc Pollefeys , Andreas Geiger

Reconstructing detailed 3D scenes from single-view images remains a challenging task due to limitations in existing approaches, which primarily focus on geometric shape recovery, overlooking object appearances and fine shape details. To…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Yixin Chen , Junfeng Ni , Nan Jiang , Yaowei Zhang , Yixin Zhu , Siyuan Huang

We introduce Multiresolution Deep Implicit Functions (MDIF), a hierarchical representation that can recover fine geometry detail, while being able to perform global operations such as shape completion. Our model represents a complex 3D…

Computer Vision and Pattern Recognition · Computer Science 2021-09-17 Zhang Chen , Yinda Zhang , Kyle Genova , Sean Fanello , Sofien Bouaziz , Christian Haene , Ruofei Du , Cem Keskin , Thomas Funkhouser , Danhang Tang

We tackle the problem of automatically reconstructing a complete 3D model of a scene from a single RGB image. This challenging task requires inferring the shape of both visible and occluded surfaces. Our approach utilizes viewer-centered,…

Computer Vision and Pattern Recognition · Computer Science 2019-08-28 Daeyun Shin , Zhile Ren , Erik B. Sudderth , Charless C. Fowlkes

Surface reconstruction is a fundamental problem in 3D graphics. In this paper, we propose a learning-based approach for implicit surface reconstruction from raw point clouds without normals. Our method is inspired by Gauss Lemma in…

Computer Vision and Pattern Recognition · Computer Science 2022-02-22 Dong Xiao , Siyou Lin , Zuoqiang Shi , Bin Wang

Various SDF-based neural implicit surface reconstruction methods have been proposed recently, and have demonstrated remarkable modeling capabilities. However, due to the global nature and limited representation ability of a single network,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Leyuan Yang , Bailin Deng , Juyong Zhang

We present a topology-informed inverse rendering approach for reconstructing high-genus surface meshes from multi-view images. Compared to 3D representations like voxels and point clouds, mesh-based representations are preferred as they…

Conventional 3D object detection approaches concentrate on bounding boxes representation learning with several parameters, i.e., localization, dimension, and orientation. Despite its popularity and universality, such a straightforward…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Xuelin Qian , Li Wang , Yi Zhu , Li Zhang , Yanwei Fu , Xiangyang Xue

We propose a novel deep reinforcement learning-based approach for 3D object reconstruction from monocular images. Prior works that use mesh representations are template based. Thus, they are limited to the reconstruction of objects that…

Computer Vision and Pattern Recognition · Computer Science 2021-09-27 Tarek Ben Charrada , Hedi Tabia , Aladine Chetouani , Hamid Laga

We present Gradient-SDF, a novel representation for 3D geometry that combines the advantages of implict and explicit representations. By storing at every voxel both the signed distance field as well as its gradient vector field, we enhance…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Christiane Sommer , Lu Sang , David Schubert , Daniel Cremers

One challenge that remains open in 3D deep learning is how to efficiently represent 3D data to feed deep networks. Recent works have relied on volumetric or point cloud representations, but such approaches suffer from a number of issues…

Computer Vision and Pattern Recognition · Computer Science 2019-01-25 Jhony K. Pontes , Chen Kong , Sridha Sridharan , Simon Lucey , Anders Eriksson , Clinton Fookes

Real-world 3D data may contain intricate details defined by salient surface gaps. Automated reconstruction of these open surfaces (e.g., non-watertight meshes) is a challenging problem for environment synthesis in mixed reality…

Computer Vision and Pattern Recognition · Computer Science 2023-01-20 Mohammad Samiul Arshad , William J. Beksi

Collision detection is essential to virtually all robotics applications. However, traditional geometric collision detection methods generally require pre-existing workspace geometry representations; thus, they are unable to infer the…

Robotics · Computer Science 2023-09-15 Gabriel Guo , Judah Goldfeder , Aniv Ray , Tony Dear , Hod Lipson