English
Related papers

Related papers: Photo-Geometric Autoencoding to Learn 3D Objects f…

200 papers

When interacting in a three dimensional world, humans must estimate 3D structure from visual inputs projected down to two dimensional retinal images. It has been shown that humans use the persistence of object shape over motion-induced…

Neurons and Cognition · Quantitative Biology 2023-04-03 Marissa Connor , Bruno Olshausen , Christopher Rozell

While 6D object pose estimation has wide applications across computer vision and robotics, it remains far from being solved due to the lack of annotations. The problem becomes even more challenging when moving to category-level 6D pose,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Kaifeng Zhang , Yang Fu , Shubhankar Borse , Hong Cai , Fatih Porikli , Xiaolong Wang

Object segmentation is a crucial problem that is usually solved by using supervised learning approaches over very large datasets composed of both images and corresponding object masks. Since the masks have to be provided at pixel level,…

Computer Vision and Pattern Recognition · Computer Science 2019-12-02 Mickaël Chen , Thierry Artières , Ludovic Denoyer

Perceiving accurate 3D object shape is important for robots to interact with the physical world. Current research along this direction has been primarily relying on visual observations. Vision, however useful, has inherent limitations due…

Computer Vision and Pattern Recognition · Computer Science 2018-08-10 Shaoxiong Wang , Jiajun Wu , Xingyuan Sun , Wenzhen Yuan , William T. Freeman , Joshua B. Tenenbaum , Edward H. Adelson

In this paper we set out to solve the task of 6-DOF 3D object detection from 2D images, where the only supervision is a geometric representation of the objects we aim to find. In doing so, we remove the need for 6-DOF labels (i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 David Griffiths , Jan Boehm , Tobias Ritschel

Novel view synthesis from a single image has recently achieved remarkable results, although the requirement of some form of 3D, pose, or multi-view supervision at training time limits the deployment in real scenarios. This work aims at…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 Pierluigi Zama Ramirez , Diego Martin Arroyo , Alessio Tonioni , Federico Tombari

Intraoperative shape reconstruction of organs from endoscopic camera images is a complex yet indispensable technique for image-guided surgery. To address the uncertainty in reconstructing entire shapes from single-viewpoint occluded images,…

Computer Vision and Pattern Recognition · Computer Science 2023-01-27 Tomoki Oya , Megumi Nakao , Tetsuya Matsuda

Is a geometric model required to synthesize novel views from a single image? Being bound to local convolutions, CNNs need explicit 3D biases to model geometric transformations. In contrast, we demonstrate that a transformer-based model can…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Robin Rombach , Patrick Esser , Björn Ommer

We study the problem of 3D object generation. We propose a novel framework, namely 3D Generative Adversarial Network (3D-GAN), which generates 3D objects from a probabilistic space by leveraging recent advances in volumetric convolutional…

Computer Vision and Pattern Recognition · Computer Science 2017-01-05 Jiajun Wu , Chengkai Zhang , Tianfan Xue , William T. Freeman , Joshua B. Tenenbaum

We present a novel approach to the generation of static and articulated 3D assets that has a 3D autodecoder at its core. The 3D autodecoder framework embeds properties learned from the target dataset in the latent space, which can then be…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Evangelos Ntavelis , Aliaksandr Siarohin , Kyle Olszewski , Chaoyang Wang , Luc Van Gool , Sergey Tulyakov

Digital humans and, especially, 3D facial avatars have raised a lot of attention in the past years, as they are the backbone of several applications like immersive telepresence in AR or VR. Despite the progress, facial avatars reconstructed…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Berna Kabadayi , Wojciech Zielonka , Bharat Lal Bhatnagar , Gerard Pons-Moll , Justus Thies

We propose the Canonical 3D Deformer Map, a new representation of the 3D shape of common object categories that can be learned from a collection of 2D images of independent objects. Our method builds in a novel way on concepts from…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 David Novotny , Roman Shapovalov , Andrea Vedaldi

This paper presents a novel framework to recover \emph{detailed} avatar from a single image. It is a challenging task due to factors such as variations in human shapes, body poses, texture, and viewpoints. Prior methods typically attempt to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-21 Hao Zhu , Xinxin Zuo , Haotian Yang , Sen Wang , Xun Cao , Ruigang Yang

With increasing focus on augmented and virtual reality applications (XR) comes the demand for algorithms that can lift objects from images and videos into representations that are suitable for a wide variety of related 3D tasks. Large-scale…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Felix Wimbauer , Shangzhe Wu , Christian Rupprecht

We present MoGe, a powerful model for recovering 3D geometry from monocular open-domain images. Given a single image, our model directly predicts a 3D point map of the captured scene with an affine-invariant representation, which is…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Ruicheng Wang , Sicheng Xu , Cassie Dai , Jianfeng Xiang , Yu Deng , Xin Tong , Jiaolong Yang

Recent advances in 3D deep learning have shown that it is possible to train highly effective deep models for 3D shape generation, directly from 2D images. This is particularly interesting since the availability of 3D models is still limited…

Computer Vision and Pattern Recognition · Computer Science 2019-11-05 Shichen Liu , Shunsuke Saito , Weikai Chen , Hao Li

The estimation of 3D human body pose and shape from a single image has been extensively studied in recent years. However, the texture generation problem has not been fully discussed. In this paper, we propose an end-to-end learning strategy…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Jian Wang , Yunshan Zhong , Yachun Li , Chi Zhang , Yichen Wei

We present a learning framework for abstracting complex shapes by learning to assemble objects using 3D volumetric primitives. In addition to generating simple and geometrically interpretable explanations of 3D objects, our framework also…

Computer Vision and Pattern Recognition · Computer Science 2018-08-06 Shubham Tulsiani , Hao Su , Leonidas J. Guibas , Alexei A. Efros , Jitendra Malik

Single-view 3D face reconstruction is a fundamental Computer Vision problem of extraordinary difficulty. Current systems often assume the input is unobstructed faces which makes their method not suitable for in-the-wild conditions. We…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Dapeng Zhao , Yue Qi

Unsupervised learning from visual data is one of the most difficult challenges in computer vision, being a fundamental task for understanding how visual recognition works. From a practical point of view, learning from unsupervised visual…

Computer Vision and Pattern Recognition · Computer Science 2017-04-03 Ioana Croitoru , Simion-Vlad Bogolin , Marius Leordeanu