English
Related papers

Related papers: Learning to Infer Implicit Surfaces without 3D Sup…

200 papers

3D shape matching is a long-standing problem in computer vision and computer graphics. While deep neural networks were shown to lead to state-of-the-art results in shape matching, existing learning-based approaches are limited in the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Dongliang Cao , Florian Bernard

Most deep learning approaches to comprehensive semantic modeling of 3D indoor spaces require costly dense annotations in the 3D domain. In this work, we explore a central 3D scene modeling task, namely, semantic scene reconstruction without…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Junwen Huang , Alexey Artemov , Yujin Chen , Shuaifeng Zhi , Kai Xu , Matthias Nießner

Representing shapes as level sets of neural networks has been recently proved to be useful for different shape analysis and reconstruction tasks. So far, such representations were computed using either: (i) pre-computed implicit shape…

Machine Learning · Computer Science 2020-07-10 Amos Gropp , Lior Yariv , Niv Haim , Matan Atzmon , Yaron Lipman

A key challenge of learning a visual representation for the 3D high fidelity geometry of dressed humans lies in the limited availability of the ground truth data (e.g., 3D scanned models), which results in the performance degradation of 3D…

Computer Vision and Pattern Recognition · Computer Science 2022-12-29 Yasamin Jafarian , Hyun Soo Park

The objective of this work is to infer the 3D shape of an object from a single image. We use sculptures as our training and test bed, as these have great variety in shape and appearance. To achieve this we build on the success of multiple…

Computer Vision and Pattern Recognition · Computer Science 2018-10-05 Olivia Wiles , Andrew Zisserman

Recovering detailed facial geometry from a set of calibrated multi-view images is valuable for its wide range of applications. Traditional multi-view stereo (MVS) methods adopt an optimization-based scheme to regularize the matching cost.…

Computer Vision and Pattern Recognition · Computer Science 2022-05-06 Yunze Xiao , Hao Zhu , Haotian Yang , Zhengyu Diao , Xiangju Lu , Xun Cao

We present a convolutional neural network for joint 3D shape prediction and viewpoint estimation from a single input image. During training, our network gets the learning signal from a silhouette of an object in the input image - a form of…

Robotics · Computer Science 2019-10-18 Oier Mees , Maxim Tatarchenko , Thomas Brox , Wolfram Burgard

We present a novel 3D shape reconstruction method which learns to predict an implicit 3D shape representation from a single RGB image. Our approach uses a set of single-view images of multiple object categories without viewpoint annotation,…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Zixuan Huang , Stefan Stojanov , Anh Thai , Varun Jampani , James M. Rehg

Implicit Neural Representations have gained prominence as a powerful framework for capturing complex data modalities, encompassing a wide range from 3D shapes to images and audio. Within the realm of 3D shape representation, Neural Signed…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Amine Ouasfi , Adnane Boukhayma

We propose a method for predicting the 3D shape of a deformable surface from a single view. By contrast with previous approaches, we do not need a pre-registered template of the surface, and our method is robust to the lack of texture and…

Computer Vision and Pattern Recognition · Computer Science 2018-09-28 Albert Pumarola , Antonio Agudo , Lorenzo Porzi , Alberto Sanfeliu , Vincent Lepetit , Francesc Moreno-Noguer

Neural reconstruction and rendering strategies have demonstrated state-of-the-art performances due, in part, to their ability to preserve high level shape details. Existing approaches, however, either represent objects as implicit surface…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Angtian Wang , Yuanlu Xu , Nikolaos Sarafianos , Robert Maier , Edmond Boyer , Alan Yuille , Tony Tung

Diffusion models have shown great promise for image generation, beating GANs in terms of generation diversity, with comparable image quality. However, their application to 3D shapes has been limited to point or voxel representations that…

Computer Vision and Pattern Recognition · Computer Science 2022-12-16 Gimin Nam , Mariem Khlifi , Andrew Rodriguez , Alberto Tono , Linqi Zhou , Paul Guerrero

Implicit representations have been widely applied in robotics for obstacle avoidance and path planning. In this paper, we explore the problem of constructing an implicit distance representation from a single image. Past methods for implicit…

Robotics · Computer Science 2026-03-13 Wei-Teng Chu , Tianyi Zhang , Matthew Johnson-Roberson , Weiming Zhi

In this paper, we study the problem of continuous 3D shape representations. The majority of existing successful methods are coordinate-based implicit neural representations. However, they are inefficient to render novel views or recover…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Zhuoman Liu , Bo Yang , Yan Luximon , Ajay Kumar , Jinxi Li

We introduce a deep appearance model for rendering the human face. Inspired by Active Appearance Models, we develop a data-driven rendering pipeline that learns a joint representation of facial geometry and appearance from a multiview…

Graphics · Computer Science 2018-08-02 Stephen Lombardi , Jason Saragih , Tomas Simon , Yaser Sheikh

Accurate representations of 3D faces are of paramount importance in various computer vision and graphics applications. However, the challenges persist due to the limitations imposed by data discretization and model linearity, which hinder…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Mingwu Zheng , Haiyu Zhang , Hongyu Yang , Liming Chen , Di Huang

Novel view synthesis and 3D modeling using implicit neural field representation are shown to be very effective for calibrated multi-view cameras. Such representations are known to benefit from additional geometric and semantic supervision.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Nikola Popovic , Danda Pani Paudel , Luc Van Gool

3D geometry is a very informative cue when interacting with and navigating an environment. This writing proposes a new approach to 3D reconstruction and scene understanding, which implicitly learns 3D geometry from depth maps pairing a deep…

Computer Vision and Pattern Recognition · Computer Science 2018-08-22 Dario Rethage , Federico Tombari , Felix Achilles , Nassir Navab

Triangulated meshes have become ubiquitous discrete-surface representations. In this paper we address the problem of how to maintain the manifold properties of a surface while it undergoes strong deformations that may cause topological…

Computer Vision and Pattern Recognition · Computer Science 2020-12-11 Andrei Zaharescu , Edmond Boyer , Radu Horaud

Conventional 3D object detection approaches concentrate on bounding boxes representation learning with several parameters, i.e., localization, dimension, and orientation. Despite its popularity and universality, such a straightforward…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Xuelin Qian , Li Wang , Yi Zhu , Li Zhang , Yanwei Fu , Xiangyang Xue