English
Related papers

Related papers: Pixel2Mesh++: Multi-View 3D Mesh Generation via De…

200 papers

3D object reconstruction is important for semantic scene understanding. It is challenging to reconstruct detailed 3D shapes from monocular images directly due to a lack of depth information, occlusion and noise. Most current methods…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Ziwei Liao , Steven L. Waslander

Learning to predict future images from a video sequence involves the construction of an internal representation that models the image evolution accurately, and therefore, to some degree, its content and dynamics. This is why pixel-space…

Machine Learning · Computer Science 2016-03-01 Michael Mathieu , Camille Couprie , Yann LeCun

Generative models aim to learn the distribution of observed data by generating new instances. With the advent of neural networks, deep generative models, including variational autoencoders (VAEs), generative adversarial networks (GANs), and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Zifan Shi , Sida Peng , Yinghao Xu , Andreas Geiger , Yiyi Liao , Yujun Shen

Recent progress in image and video synthesis has inspired their use in advancing 3D scene generation. However, we observe that text-to-image and -video approaches struggle to maintain scene- and object-level consistency beyond a limited…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Manuel-Andreas Schneider , Angela Dai

We present ShapeFlow, a flow-based model for learning a deformation space for entire classes of 3D shapes with large intra-class variations. ShapeFlow allows learning a multi-template deformation space that is agnostic to shape topology,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-25 Chiyu "Max" Jiang , Jingwei Huang , Andrea Tagliasacchi , Leonidas Guibas

In recent years, 3D generation has made great strides in both academia and industry. However, generating 3D scenes from a single RGB image remains a significant challenge, as current approaches often struggle to ensure both object…

Graphics · Computer Science 2026-02-18 Xiang Tang , Ruotong Li , Xiaopeng Fan

For humans, visual understanding is inherently generative: given a 3D shape, we can postulate how it would look in the world; given a 2D image, we can infer the 3D structure that likely gave rise to it. We can thus translate between the 2D…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Tristan Aumentado-Armstrong , Alex Levinshtein , Stavros Tsogkas , Konstantinos G. Derpanis , Allan D. Jepson

3D shape representation and its processing have substantial effects on 3D shape recognition. The polygon mesh as a 3D shape representation has many advantages in computer graphics and geometry processing. However, there are still some…

Computer Vision and Pattern Recognition · Computer Science 2022-05-12 Mohsen Yavartanoo , Shih-Hsuan Hung , Reyhaneh Neshatavar , Yue Zhang , Kyoung Mu Lee

This paper introduces a generative model for 3D surfaces based on a representation of shapes with mean curvature and metric, which are invariant under rigid transformation. Hence, compared with existing 3D machine learning frameworks, our…

Graphics · Computer Science 2020-09-08 Zi Ye , Nobuyuki Umetani , Takeo Igarashi , Tim Hoffmann

Shape from texture refers to the extraction of 3D information from 2D images with irregular texture. This paper introduces a statistical framework to learn shape from texture where convex texture elements in a 2D image are represented…

The majority of descriptor-based methods for geometric processing of non-rigid shape rely on hand-crafted descriptors. Recently, learning-based techniques have been shown effective, achieving state-of-the-art results in a variety of tasks.…

Computer Vision and Pattern Recognition · Computer Science 2020-02-10 Zhangsihao Yang , Or Litany , Tolga Birdal , Srinath Sridhar , Leonidas Guibas

Aiming at inferring 3D shapes from 2D images, 3D shape reconstruction has drawn huge attention from researchers in computer vision and deep learning communities. However, it is not practical to assume that 2D input images and their…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Yi-Lun Liao , Yao-Cheng Yang , Yu-Chiang Frank Wang

Many surface cues support three-dimensional shape perception, but people can sometimes still see shape when these features are missing -- in extreme cases, even when an object is completely occluded, as when covered with a draped cloth. We…

Neurons and Cognition · Quantitative Biology 2023-01-11 Ilker Yildirim , Max H. Siegel , Amir A. Soltani , Shraman Ray Chaudhari , Joshua B. Tenenbaum

Recent advances in 3D perception have shown impressive progress in understanding geometric structures of 3Dshapes and even scenes. Inspired by these advances in geometric understanding, we aim to imbue image-based perception with…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Ji Hou , Saining Xie , Benjamin Graham , Angela Dai , Matthias Nießner

We propose a method for constructing generative models of 3D objects from a single 3D mesh and improving them through unsupervised low-shot learning from 2D images. Our method produces a 3D morphable model that represents shape and albedo…

Computer Vision and Pattern Recognition · Computer Science 2022-03-08 Skylar Sutherland , Bernhard Egger , Joshua Tenenbaum

3D reconstruction from a single view image is a long-standing prob-lem in computer vision. Various methods based on different shape representations(such as point cloud or volumetric representations) have been proposed. However,the 3D shape…

Graphics · Computer Science 2020-03-10 Aihua Mao , Canglan Dai , Lin Gao , Ying He , Yong-jin Liu

We cast multiview reconstruction from unknown pose as a generative modeling problem. From a collection of unannotated 2D images of a scene, our approach simultaneously learns both a network to predict camera pose from 2D image input, as…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Xin Yuan , Rana Hanocka , Michael Maire

In this work, we address the lack of 3D understanding of generative neural networks by introducing a persistent 3D feature embedding for view synthesis. To this end, we propose DeepVoxels, a learned representation that encodes the…

Computer Vision and Pattern Recognition · Computer Science 2019-04-12 Vincent Sitzmann , Justus Thies , Felix Heide , Matthias Nießner , Gordon Wetzstein , Michael Zollhöfer

We present a technique for zero-shot generation of a 3D model using only a target text prompt. Without any 3D supervision our method deforms the control shape of a limit subdivided surface along with its texture map and normal map to obtain…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Nasir Mohammad Khalid , Tianhao Xie , Eugene Belilovsky , Tiberiu Popa

With the support of Virtual Reality (VR) and Augmented Reality (AR) technologies, the 3D virtual eyeglasses try-on application is well on its way to becoming a new trending solution that offers a "try on" option to select the perfect pair…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Fan Zhang , Ziyue Ji , Weiguang Kang , Weiqing Li , Zhiyong Su