English
Related papers

Related papers: Scan2Mesh: From Unstructured Range Scans to 3D Mes…

200 papers

Face registration deforms a template mesh to closely fit a 3D face scan, the quality of which commonly degrades in non-skin regions (e.g., hair, beard, accessories), because the optimized template-to-scan distance pulls the template mesh…

Generative modeling of 3D shapes has become an important problem due to its relevance to many applications across Computer Vision, Graphics, and VR. In this paper we build upon recently introduced 3D mesh-convolutional Variational…

Machine Learning · Computer Science 2019-06-11 Jake Levinson , Avneesh Sud , Ameesh Makadia

In this paper, we present an approach for combining non-rigid structure-from-motion (NRSfM) with deep generative models,and propose an efficient framework for discovering trajectories in the latent space of 2D GANs corresponding to changes…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 René Haas , Stella Graßhof , Sami S. Brandt

We introduce 3inGAN, an unconditional 3D generative model trained from 2D images of a single self-similar 3D scene. Such a model can be used to produce 3D "remixes" of a given scene, by mapping spatial latent codes into a 3D volumetric…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Animesh Karnewar , Oliver Wang , Tobias Ritschel , Niloy Mitra

Limited by the computational efficiency and accuracy, generating complex 3D scenes remains a challenging problem for existing generation networks. In this work, we propose DepthGAN, a novel method of generating depth maps with only semantic…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Yidi Li , Yiqun Wang , Zhengda Lu , Jun Xiao

Deep generative models have shown success in generating 3D shapes with different representations. In this work, we propose Neural Volumetric Mesh Generator(NVMG) which can generate novel and high-quality volumetric meshes. Unlike the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Yan Zheng , Lemeng Wu , Xingchao Liu , Zhen Chen , Qiang Liu , Qixing Huang

We introduce GEM3D -- a new deep, topology-aware generative model of 3D shapes. The key ingredient of our method is a neural skeleton-based representation encoding information on both shape topology and geometry. Through a denoising…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Dmitry Petrov , Pradyumn Goyal , Vikas Thamizharasan , Vladimir G. Kim , Matheus Gadelha , Melinos Averkiou , Siddhartha Chaudhuri , Evangelos Kalogerakis

This paper describes a novel approach for generating accurate floor plans and 3D models of building interiors using scanned mesh data. Unlike previous methods, which begin with a high resolution point cloud from a laser range-finder, our…

Graphics · Computer Science 2023-12-29 Ritesh Sharma , Eric Bier , Lester Nelson , Mahabir Bhandari , Niraj Kunwar

Data-driven generative modeling has made remarkable progress by leveraging the power of deep neural networks. A reoccurring challenge is how to enable a model to generate a rich variety of samples from the entire target distribution, rather…

Graphics · Computer Science 2019-09-04 Nadav Schor , Oren Katzir , Hao Zhang , Daniel Cohen-Or

Rigged 3D assets are fundamental to 3D deformation and animation. However, existing 3D generation methods face challenges in generating animatable geometry, while rigging techniques lack fine-grained structural control over skeleton…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Ruisi Zhao , Haoren Zheng , Zongxin Yang , Hehe Fan , Yi Yang

We present Text2Tex, a novel method for generating high-quality textures for 3D meshes from the given text prompts. Our method incorporates inpainting into a pre-trained depth-aware image diffusion model to progressively synthesize high…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Dave Zhenyu Chen , Yawar Siddiqui , Hsin-Ying Lee , Sergey Tulyakov , Matthias Nießner

Recent conditional image generation methods produce images of remarkable diversity, fidelity and realism. However, the majority of these methods allow conditioning only on labels or text prompts, which limits their level of control over the…

Computer Vision and Pattern Recognition · Computer Science 2023-02-14 Dina Bashkirova , Jose Lezama , Kihyuk Sohn , Kate Saenko , Irfan Essa

We investigate the problem of generating 3D meshes from single free-hand sketches, aiming at fast 3D modeling for novice users. It can be regarded as a single-view reconstruction problem, but with unique challenges, brought by the variation…

Computer Vision and Pattern Recognition · Computer Science 2021-05-17 Song-Hai Zhang , Yuan-Chen Guo , Qing-Wen Gu

Statistical shape modeling is the computational process of discovering significant shape parameters from segmented anatomies captured by medical images (such as MRI and CT scans), which can fully describe subject-specific anatomy in the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Krithika Iyer , Shireen Elhabian

Generative models aim to learn the distribution of observed data by generating new instances. With the advent of neural networks, deep generative models, including variational autoencoders (VAEs), generative adversarial networks (GANs), and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Zifan Shi , Sida Peng , Yinghao Xu , Andreas Geiger , Yiyi Liao , Yujun Shen

Learning-based methods for 3D scene reconstruction and object completion require large datasets containing partial scans paired with complete ground-truth geometry. However, acquiring such datasets using real-world scanning systems is…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Jelle Vermandere , Maarten Bassier , Maarten Vergauwen

Generative AI has made rapid progress in text, image, and video synthesis, yet text-to-3D modeling for scientific design remains particularly challenging due to limited controllability and high computational cost. Most existing 3D…

Graphics · Computer Science 2026-04-01 Rachel K. Luu , Markus J. Buehler

In this work, we develop intuitive controls for editing the style of 3D objects. Our framework, Text2Mesh, stylizes a 3D mesh by predicting color and local geometric details which conform to a target text prompt. We consider a disentangled…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Oscar Michel , Roi Bar-On , Richard Liu , Sagie Benaim , Rana Hanocka

In this paper, we propose Img2CAD, the first approach to our knowledge that uses 2D image inputs to generate CAD models with editable parameters. Unlike existing AI methods for 3D model generation using text or image inputs often rely on…

Computer Vision and Pattern Recognition · Computer Science 2024-10-07 Tianrun Chen , Chunan Yu , Yuanqi Hu , Jing Li , Tao Xu , Runlong Cao , Lanyun Zhu , Ying Zang , Yong Zhang , Zejian Li , Linyun Sun

Deep learning based 3D shape generation methods generally utilize latent features extracted from color images to encode the semantics of objects and guide the shape generation process. These color image semantics only implicitly encode 3D…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Rakesh Shrestha , Zhiwen Fan , Qingkun Su , Zuozhuo Dai , Siyu Zhu , Ping Tan