English
Related papers

Related papers: PolyGen: An Autoregressive Generative Model of 3D …

200 papers

Latent diffusion models for image generation have crossed a quality threshold which enabled them to achieve mass adoption. Recently, a series of works have made advancements towards replicating this success in the 3D domain, introducing…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Anchit Gupta , Wenhan Xiong , Yixin Nie , Ian Jones , Barlas Oğuz

This paper presents a method to reconstruct high-quality textured 3D models from both multi-view and single-view images. The reconstruction is posed as an adaptation problem and is done progressively where in the first stage, we focus on…

Computer Vision and Pattern Recognition · Computer Science 2022-03-18 Aysegul Dundar , Jun Gao , Andrew Tao , Bryan Catanzaro

Recent advances in differentiable rendering have sparked an interest in learning generative models of textured 3D meshes from image collections. These models natively disentangle pose and appearance, enable downstream applications in…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Dario Pavllo , Jonas Kohler , Thomas Hofmann , Aurelien Lucchi

We introduce LaviGen, a framework that repurposes 3D generative models for 3D layout generation. Unlike previous methods that infer object layouts from textual descriptions, LaviGen operates directly in the native 3D space, formulating…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Haoran Feng , Yifan Niu , Zehuan Huang , Yang-Tian Sun , Chunchao Guo , Yuxin Peng , Lu Sheng

Existing 3D surface representation approaches are unable to accurately classify pixels and their orientation lying on the boundary of an object. Thus resulting in coarse representations which usually require post-processing steps to extract…

Computer Vision and Pattern Recognition · Computer Science 2019-01-23 Mateusz Michalkiewicz , Jhony K. Pontes , Dominic Jack , Mahsa Baktashmotlagh , Anders Eriksson

Triangle meshes play a crucial role in 3D applications for efficient manipulation and rendering. While auto-regressive methods generate structured meshes by predicting discrete vertex tokens, they are often constrained by limited face…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Ruowen Zhao , Junliang Ye , Zhengyi Wang , Guangce Liu , Yiwen Chen , Yikai Wang , Jun Zhu

Diffusion models have shown great promise for image generation, beating GANs in terms of generation diversity, with comparable image quality. However, their application to 3D shapes has been limited to point or voxel representations that…

Computer Vision and Pattern Recognition · Computer Science 2022-12-16 Gimin Nam , Mariem Khlifi , Andrew Rodriguez , Alberto Tono , Linqi Zhou , Paul Guerrero

The generation of triangle meshes from point clouds, i.e. meshing, is a core task in computer graphics and computer vision. Traditional techniques directly construct a surface mesh using local decision heuristics, while some recent methods…

Computer Vision and Pattern Recognition · Computer Science 2022-10-06 Mathias Vetsch , Sandro Lombardi , Marc Pollefeys , Martin R. Oswald

We present a unified framework tackling two problems: class-specific 3D reconstruction from a single image, and generation of new 3D shape samples. These tasks have received considerable attention recently; however, existing approaches rely…

Computer Vision and Pattern Recognition · Computer Science 2018-11-16 Paul Henderson , Vittorio Ferrari

We investigate the problem of learning to generate 3D parametric surface representations for novel object instances, as seen from one or more views. Previous work on learning shape reconstruction from multiple views uses discrete…

Computer Vision and Pattern Recognition · Computer Science 2020-08-19 Jiahui Lei , Srinath Sridhar , Paul Guerrero , Minhyuk Sung , Niloy Mitra , Leonidas J. Guibas

Generating accurate 3D models is a challenging problem that traditionally requires explicit learning from 3D datasets using supervised learning. Although recent advances have shown promise in learning 3D models from 2D images, these methods…

Computer Vision and Pattern Recognition · Computer Science 2024-02-05 Qijia Shen , Guangrun Wang

We introduce PolyDiff, the first diffusion-based approach capable of directly generating realistic and diverse 3D polygonal meshes. In contrast to methods that use alternate 3D shape representations (e.g. implicit representations), our…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Antonio Alliegro , Yawar Siddiqui , Tatiana Tommasi , Matthias Nießner

3D data that contains rich geometry information of objects and scenes is valuable for understanding 3D physical world. With the recent emergence of large-scale 3D datasets, it becomes increasingly crucial to have a powerful 3D generative…

Computer Vision and Pattern Recognition · Computer Science 2020-12-29 Jianwen Xie , Zilong Zheng , Ruiqi Gao , Wenguan Wang , Song-Chun Zhu , Ying Nian Wu

High-quality quadrilateral mesh generation is a fundamental challenge in computer graphics. Traditional optimization-based methods are often constrained by the topological quality of input meshes and suffer from severe efficiency…

Graphics · Computer Science 2026-03-12 Yuguang Chen , Xinhai Liu , Xiangyu Zhu , Yiling Zhu , Zhuo Chen , Dongyu Zhang , Chunchao Guo

Meshes serve as a primary representation for 3D assets. Autoregressive mesh generators serialize faces into sequences and train on truncated segments with sliding-window inference to cope with memory limits. However, this mismatch breaks…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Junkai Lin , Hang Long , Huipeng Guo , Jielei Zhang , JiaYi Yang , Tianle Guo , Yang Yang , Jianwen Li , Wenxiao Zhang , Matthias Nießner , Wei Yang

While high-quality texture maps are essential for realistic 3D asset rendering, few studies have explored learning directly in the texture space, especially on large-scale datasets. In this work, we depart from the conventional approach of…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Xin Yu , Ze Yuan , Yuan-Chen Guo , Ying-Tian Liu , JianHui Liu , Yangguang Li , Yan-Pei Cao , Ding Liang , Xiaojuan Qi

Recent advances in 3D deep learning have shown that it is possible to train highly effective deep models for 3D shape generation, directly from 2D images. This is particularly interesting since the availability of 3D models is still limited…

Computer Vision and Pattern Recognition · Computer Science 2019-11-05 Shichen Liu , Shunsuke Saito , Weikai Chen , Hao Li

We introduce ProcGen3D, a new approach for 3D content creation by generating procedural graph abstractions of 3D objects, which can then be decoded into rich, complex 3D assets. Inspired by the prevalent use of procedural generators in…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Xinyi Zhang , Daoyi Gao , Naiqi Li , Angela Dai

During the last years, many advances have been made in tasks like3D model retrieval, 3D model classification, and 3D model segmentation.The typical 3D representations such as point clouds, voxels, and poly-gon meshes are mostly suitable for…

Computer Vision and Pattern Recognition · Computer Science 2021-03-08 Arniel Labrada , Benjamin Bustos , Ivan Sipiran

In this work, we address the lack of 3D understanding of generative neural networks by introducing a persistent 3D feature embedding for view synthesis. To this end, we propose DeepVoxels, a learned representation that encodes the…

Computer Vision and Pattern Recognition · Computer Science 2019-04-12 Vincent Sitzmann , Justus Thies , Felix Heide , Matthias Nießner , Gordon Wetzstein , Michael Zollhöfer