English
Related papers

Related papers: Creative Birds: Self-Supervised Single-View 3D Sty…

200 papers

We present Worldsheet, a method for novel view synthesis using just a single RGB image as input. The main insight is that simply shrink-wrapping a planar mesh sheet onto the input image, consistent with the learned intermediate depth,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Ronghang Hu , Nikhila Ravi , Alexander C. Berg , Deepak Pathak

Much progress has been made in the supervised learning of 3D reconstruction of rigid objects from multi-view images or a video. However, it is more challenging to reconstruct severely deformed objects from a single-view RGB image in an…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Jie Mei , Jingxi Yu , Suzanne Romain , Craig Rose , Kelsey Magrane , Graeme LeeSon , Jenq-Neng Hwang

This research aims to study a self-supervised 3D clothing reconstruction method, which recovers the geometry shape and texture of human clothing from a single image. Compared with existing methods, we observe that three primary challenges…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Zhedong Zheng , Jiayin Zhu , Wei Ji , Yi Yang , Tat-Seng Chua

We propose an approach to 3D reconstruction via inverse procedural modeling and investigate two variants of this approach. The first option consists in the fitting set of input parameters using a genetic algorithm. We demonstrate the…

Graphics · Computer Science 2023-10-23 Albert Garifullin , Nikolay Maiorov , Vladimir Frolov

Recently, multi-view diffusion-based 3D generation methods have gained significant attention. However, these methods often suffer from shape and texture misalignment across generated multi-view images, leading to low-quality 3D generation…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Zhuojiang Cai , Yiheng Zhang , Meitong Guo , Mingdao Wang , Yuwang Wang

Accurately predicting the 3D shape of any arbitrary object in any pose from a single image is a key goal of computer vision research. This is challenging as it requires a model to learn a representation that can infer both the visible and…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Anh Thai , Stefan Stojanov , Vijay Upadhya , James M. Rehg

Conventional methods of 3D object generative modeling learn volumetric predictions using deep networks with 3D convolutional operations, which are direct analogies to classical 2D ones. However, these methods are computationally wasteful in…

Computer Vision and Pattern Recognition · Computer Science 2017-06-22 Chen-Hsuan Lin , Chen Kong , Simon Lucey

We present TextureDreamer, a novel image-guided texture synthesis method to transfer relightable textures from a small number of input images (3 to 5) to target 3D shapes across arbitrary categories. Texture creation is a pivotal challenge…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Yu-Ying Yeh , Jia-Bin Huang , Changil Kim , Lei Xiao , Thu Nguyen-Phuoc , Numair Khan , Cheng Zhang , Manmohan Chandraker , Carl S Marshall , Zhao Dong , Zhengqin Li

While 2D diffusion models have achieved remarkable success in identity-preserving personalization, extending this capability to 3D assets remains a significant challenge due to the complexities of multi-view consistency and spatial control.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Jinxin Ai , Matthias Nießner , Ziya Erkoç

We introduce FabricDiffusion, a method for transferring fabric textures from a single clothing image to 3D garments of arbitrary shapes. Existing approaches typically synthesize textures on the garment surface through 2D-to-3D texture…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Cheng Zhang , Yuanhao Wang , Francisco Vicente Carrasco , Chenglei Wu , Jinlong Yang , Thabo Beeler , Fernando De la Torre

This paper introduces a deep neural network based method, i.e., DeepOrganNet, to generate and visualize high-fidelity 3D / 4D organ geometric models from single-view medical image in real time. Traditional 3D / 4D medical image…

Graphics · Computer Science 2019-07-23 Yifan Wang , Zichun Zhong , Jing Hua

Despite recent advances in geometric modeling, 3D mesh modeling still involves a considerable amount of manual labor by experts. In this paper, we introduce Mesh Draping: a neural method for transferring existing mesh structure from one…

Graphics · Computer Science 2021-10-12 Amir Hertz , Or Perel , Raja Giryes , Olga Sorkine-Hornung , Daniel Cohen-Or

Differentiable rendering is a very successful technique that applies to a Single-View 3D Reconstruction. Current renderers use losses based on pixels between a rendered image of some 3D reconstructed object and ground-truth images from…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Nikola Zubić , Pietro Liò

A key question in the problem of 3D reconstruction is how to train a machine or a robot to model 3D objects. Many tasks like navigation in real-time systems such as autonomous vehicles directly depend on this problem. These systems usually…

Computer Vision and Pattern Recognition · Computer Science 2022-09-22 AmirHossein Zamani , Amir G. Aghdam , Kamran Ghaffari T

Given a single image of a 3D object, this paper proposes a novel method (named ConsistNet) that is able to generate multiple images of the same object, as if seen they are captured from different viewpoints, while the 3D (multi-view)…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Jiayu Yang , Ziang Cheng , Yunfei Duan , Pan Ji , Hongdong Li

In this paper, we present a texture-independent approach to estimate and track 3D joint positions of multiple pigeons. For this purpose, we build upon the existing 3D-MuPPET framework, which estimates and tracks the 3D poses of up to 10…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Valentin Schmuker , Alex Hoi Hang Chan , Bastian Goldluecke , Urs Waldmann

We propose an end-to-end deep learning architecture that produces a 3D shape in triangular mesh from a single color image. Limited by the nature of deep neural network, previous methods usually represent a 3D shape in volume or point cloud,…

Computer Vision and Pattern Recognition · Computer Science 2018-08-06 Nanyang Wang , Yinda Zhang , Zhuwen Li , Yanwei Fu , Wei Liu , Yu-Gang Jiang

Recent approaches to drape garments quickly over arbitrary human bodies leverage self-supervision to eliminate the need for large training sets. However, they are designed to train one network per clothing item, which severely limits their…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Luca De Luigi , Ren Li , Benoît Guillard , Mathieu Salzmann , Pascal Fua

Existing works on single-image 3D reconstruction mainly focus on shape recovery. In this work, we study a new problem, that is, simultaneously recovering 3D shape and surface color from a single image, namely "colorful 3D reconstruction".…

Computer Vision and Pattern Recognition · Computer Science 2018-04-18 Yongbin Sun , Ziwei Liu , Yue Wang , Sanjay E. Sarma

In this paper the argument is made that for true novel view synthesis of objects, where the object can be synthesized from any viewpoint, an explicit 3D shape representation isdesired. Our method estimates point clouds to capture the…

Computer Vision and Pattern Recognition · Computer Science 2020-09-21 Hoang-An Le , Thomas Mensink , Partha Das , Theo Gevers