English
Related papers

Related papers: Topologically-Aware Deformation Fields for Single-…

200 papers

We propose a framework that can deform an object in a 2D image as it exists in 3D space. Most existing methods for 3D-aware image manipulation are limited to (1) only changing the global scene information or depth, or (2) manipulating an…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Jihyun Lee , Minhyuk Sung , Hyunjin Kim , Tae-Kyun Kim

Template 3D shapes are useful for many tasks in graphics and vision, including fitting observation data, analyzing shape collections, and transferring shape attributes. Because of the variety of geometry and topology of real-world shapes,…

Computer Vision and Pattern Recognition · Computer Science 2019-04-16 Kyle Genova , Forrester Cole , Daniel Vlasic , Aaron Sarna , William T. Freeman , Thomas Funkhouser

Learning deformable 3D object models from single-view in-the-wild images has enabled impressive 3D shape reconstruction without supervision. However, it remains unclear whether these models capture the semantic structure required for…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Sky Cen , Wufei Ma , Guofeng Zhang , Alan Yuille , Adam Kortylewski

Deep implicit functions (DIFs), as a kind of 3D shape representation, are becoming more and more popular in the 3D vision community due to their compactness and strong representation power. However, unlike polygon mesh-based templates, it…

Computer Vision and Pattern Recognition · Computer Science 2021-05-14 Zerong Zheng , Tao Yu , Qionghai Dai , Yebin Liu

Parametric 3D models have formed a fundamental role in modeling deformable objects, such as human bodies, faces, and hands; however, the construction of such parametric models requires significant manual intervention and domain expertise.…

Computer Vision and Pattern Recognition · Computer Science 2022-01-21 Pablo Palafox , Nikolaos Sarafianos , Tony Tung , Angela Dai

Neural implicit surface representations have emerged as a promising paradigm to capture 3D shapes in a continuous and resolution-independent manner. However, adapting them to articulated shapes is non-trivial. Existing approaches learn a…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Xu Chen , Yufeng Zheng , Michael J. Black , Otmar Hilliges , Andreas Geiger

While single-view 3D reconstruction has made significant progress benefiting from deep shape representations in recent years, garment reconstruction is still not solved well due to open surfaces, diverse topologies and complex geometric…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Fang Zhao , Wenhao Wang , Shengcai Liao , Ling Shao

Reconstructing the 3D geometry of an object from an image is a major challenge in computer vision. Recently introduced differentiable renderers can be leveraged to learn the 3D geometry of objects from 2D images, but those approaches…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Felix Petersen , Bastian Goldluecke , Oliver Deussen , Hilde Kuehne

Humans rely on their visual and tactile senses to develop a comprehensive 3D understanding of their physical environment. Recently, there has been a growing interest in exploring and manipulating objects using data-driven approaches that…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Mauro Comi , Yijiong Lin , Alex Church , Alessio Tonioni , Laurence Aitchison , Nathan F. Lepora

In this work, we present a new method for 3D face reconstruction from sparse-view RGB images. Unlike previous methods which are built upon 3D morphable models (3DMMs) with limited details, we leverage an implicit representation to encode…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Moran Li , Haibin Huang , Yi Zheng , Mengtian Li , Nong Sang , Chongyang Ma

Understanding 3D objects from images is fundamental to robotics and AR/VR applications. While recent work has made progress in category-level pose estimation, current representations fail to capture the fine-grained semantics needed for…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Leonhard Sommer , Artur Jesslen , Basavaraj Sunagad , Adam Kortylewski

Recent research has shown that controllable image generation based on pre-trained GANs can benefit a wide range of computer vision tasks. However, less attention has been devoted to 3D vision tasks. In light of this, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Feng Liu , Xiaoming Liu

Perceiving accurate 3D object shape is important for robots to interact with the physical world. Current research along this direction has been primarily relying on visual observations. Vision, however useful, has inherent limitations due…

Computer Vision and Pattern Recognition · Computer Science 2018-08-10 Shaoxiong Wang , Jiajun Wu , Xingyuan Sun , Wenzhen Yuan , William T. Freeman , Joshua B. Tenenbaum , Edward H. Adelson

3D geometry is a very informative cue when interacting with and navigating an environment. This writing proposes a new approach to 3D reconstruction and scene understanding, which implicitly learns 3D geometry from depth maps pairing a deep…

Computer Vision and Pattern Recognition · Computer Science 2018-08-22 Dario Rethage , Federico Tombari , Felix Achilles , Nassir Navab

Learning deformable 3D objects from 2D images is often an ill-posed problem. Existing methods rely on explicit supervision to establish multi-view correspondences, such as template shape models and keypoint annotations, which restricts…

Computer Vision and Pattern Recognition · Computer Science 2022-06-30 Shangzhe Wu , Tomas Jakab , Christian Rupprecht , Andrea Vedaldi

Much progress has been made in the supervised learning of 3D reconstruction of rigid objects from multi-view images or a video. However, it is more challenging to reconstruct severely deformed objects from a single-view RGB image in an…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Jie Mei , Jingxi Yu , Suzanne Romain , Craig Rose , Kelsey Magrane , Graeme LeeSon , Jenq-Neng Hwang

The impressive performance of deep convolutional neural networks in single-view 3D reconstruction suggests that these models perform non-trivial reasoning about the 3D structure of the output space. Recent work has challenged this belief,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-17 Mateusz Michalkiewicz , Stavros Tsogkas , Sarah Parisot , Mahsa Baktashmotlagh , Anders Eriksson , Eugene Belilovsky

We propose a method for predicting the 3D shape of a deformable surface from a single view. By contrast with previous approaches, we do not need a pre-registered template of the surface, and our method is robust to the lack of texture and…

Computer Vision and Pattern Recognition · Computer Science 2018-09-28 Albert Pumarola , Antonio Agudo , Lorenzo Porzi , Alberto Sanfeliu , Vincent Lepetit , Francesc Moreno-Noguer

We learn a self-supervised, single-view 3D reconstruction model that predicts the 3D mesh shape, texture and camera pose of a target object with a collection of 2D images and silhouettes. The proposed method does not necessitate 3D…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Xueting Li , Sifei Liu , Kihwan Kim , Shalini De Mello , Varun Jampani , Ming-Hsuan Yang , Jan Kautz

Differentiable rendering is an essential operation in modern vision, allowing inverse graphics approaches to 3D understanding to be utilized in modern machine learning frameworks. Explicit shape representations (voxels, point clouds, or…

Computer Vision and Pattern Recognition · Computer Science 2021-12-13 Tristan Aumentado-Armstrong , Stavros Tsogkas , Sven Dickinson , Allan Jepson