English
Related papers

Related papers: Cycle-Consistent Generative Rendering for 2D-3D Mo…

200 papers

Impressive progress in 3D shape extraction led to representations that can capture object geometries with high fidelity. In parallel, primitive-based methods seek to represent objects as semantically consistent part arrangements. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-19 Despoina Paschalidou , Angelos Katharopoulos , Andreas Geiger , Sanja Fidler

We present a method for creating 3D indoor scenes with a generative model learned from a collection of semantic-segmented depth images captured from different unknown scenes. Given a room with a specified size, our method automatically…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Ming-Jia Yang , Yu-Xiao Guo , Bin Zhou , Xin Tong

We introduce X-Ray, a novel 3D sequential representation inspired by the penetrability of x-ray scans. X-Ray transforms a 3D object into a series of surface frames at different layers, making it suitable for generating 3D models from…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Tao Hu , Wenhang Ge , Yuyang Zhao , Gim Hee Lee

Diffusion models currently achieve state-of-the-art performance for both conditional and unconditional image generation. However, so far, image diffusion models do not support tasks required for 3D understanding, such as view-consistent 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Titas Anciukevičius , Zexiang Xu , Matthew Fisher , Paul Henderson , Hakan Bilen , Niloy J. Mitra , Paul Guerrero

Recent advances in deep learning have significantly transformed the field of 3D shape generation, enabling the synthesis of complex, diverse, and semantically meaningful 3D objects. This survey provides a comprehensive overview of the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Nicolas Caytuiro , Ivan Sipiran

Recent deep learning based approaches have shown promising results for the challenging task of inpainting large missing regions in an image. These methods can generate visually plausible image structures and textures, but often create…

Computer Vision and Pattern Recognition · Computer Science 2018-03-23 Jiahui Yu , Zhe Lin , Jimei Yang , Xiaohui Shen , Xin Lu , Thomas S. Huang

We propose a probabilistic shape completion method extended to the continuous geometry of large-scale 3D scenes. Real-world scans of 3D scenes suffer from a considerable amount of missing data cluttered with unsegmented objects. The problem…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Dongsu Zhang , Changwoon Choi , Inbum Park , Young Min Kim

3D Morphable Model (3DMM) fitting has widely benefited face analysis due to its strong 3D priori. However, previous reconstructed 3D faces suffer from degraded visual verisimilitude due to the loss of fine-grained geometry, which is…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Xiangyu Zhu , Chang Yu , Di Huang , Zhen Lei , Hao Wang , Stan Z. Li

Tremendous progress in deep generative models has led to photorealistic image synthesis. While achieving compelling results, most approaches operate in the two-dimensional image domain, ignoring the three-dimensional nature of our world.…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Michael Niemeyer , Andreas Geiger

3D object reconstruction is important for semantic scene understanding. It is challenging to reconstruct detailed 3D shapes from monocular images directly due to a lack of depth information, occlusion and noise. Most current methods…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Ziwei Liao , Steven L. Waslander

Generative models have emerged as an essential building block for many image synthesis and editing tasks. Recent advances in this field have also enabled high-quality 3D or video content to be generated that exhibits either multi-view or…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Sherwin Bahmani , Jeong Joon Park , Despoina Paschalidou , Hao Tang , Gordon Wetzstein , Leonidas Guibas , Luc Van Gool , Radu Timofte

Multi-modal 3D object understanding has gained significant attention, yet current approaches often assume complete data availability and rigid alignment across all modalities. We present CrossOver, a novel framework for cross-modal 3D scene…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Sayan Deb Sarkar , Ondrej Miksik , Marc Pollefeys , Daniel Barath , Iro Armeni

We study the problem of shape generation in 3D mesh representation from a small number of color images with or without camera poses. While many previous works learn to hallucinate the shape directly from priors, we adopt to further improve…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Chao Wen , Yinda Zhang , Chenjie Cao , Zhuwen Li , Xiangyang Xue , Yanwei Fu

Image generation today can produce somewhat realistic images from text prompts. However, if one asks the generator to synthesize a specific camera setting such as creating different fields of view using a 24mm lens versus a 70mm lens, the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Yu Yuan , Xijun Wang , Yichen Sheng , Prateek Chennuri , Xingguang Zhang , Stanley Chan

We present a unified framework tackling two problems: class-specific 3D reconstruction from a single image, and generation of new 3D shape samples. These tasks have received considerable attention recently; however, most existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2019-08-28 Paul Henderson , Vittorio Ferrari

The rapid development of Large Multimodal Models (LMMs) has led to remarkable progress in 2D visual understanding; however, extending these capabilities to 3D scene understanding remains a significant challenge. Existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Hongpei Zheng , Lintao Xiang , Qijun Yang , Qian Lin , Hujun Yin

In this paper, we propose a generic neural-based hair rendering pipeline that can synthesize photo-realistic images from virtual 3D hair models. Unlike existing supervised translation methods that require model-level similarity to preserve…

Computer Vision and Pattern Recognition · Computer Science 2020-07-23 Menglei Chai , Jian Ren , Sergey Tulyakov

Recently, the impressive generative capabilities of diffusion models have been demonstrated, producing images with remarkable fidelity. Particularly, existing methods for the 3D object generation tasks, which is one of the fastest-growing…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Jaeseok Lee , Jaekoo Lee

Recently, multi-view diffusion-based 3D generation methods have gained significant attention. However, these methods often suffer from shape and texture misalignment across generated multi-view images, leading to low-quality 3D generation…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Zhuojiang Cai , Yiheng Zhang , Meitong Guo , Mingdao Wang , Yuwang Wang

Deep generative models of 3D shapes have received a great deal of research interest. Yet, almost all of them generate discrete shape representations, such as voxels, point clouds, and polygon meshes. We present the first 3D generative model…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Rundi Wu , Chang Xiao , Changxi Zheng