English
Related papers

Related papers: Pushing the Limits of 3D Shape Generation at Scale

200 papers

Significant progress has recently been made in creative applications of large pre-trained models for downstream tasks in 3D vision, such as text-to-shape generation. This motivates our investigation of how these pre-trained models can be…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Aditya Sanghi , Pradeep Kumar Jayaraman , Arianna Rampini , Joseph Lambourne , Hooman Shayani , Evan Atherton , Saeid Asgari Taghanaki

3D shape generation is a challenging problem due to the high-dimensional output space and complex part configurations of real-world objects. As a result, existing algorithms experience difficulties in accurate generative modeling of 3D…

Computer Vision and Pattern Recognition · Computer Science 2019-06-11 Salman H. Khan , Yulan Guo , Munawar Hayat , Nick Barnes

Diffusion models have shown great promise for image generation, beating GANs in terms of generation diversity, with comparable image quality. However, their application to 3D shapes has been limited to point or voxel representations that…

Computer Vision and Pattern Recognition · Computer Science 2022-12-16 Gimin Nam , Mariem Khlifi , Andrew Rodriguez , Alberto Tono , Linqi Zhou , Paul Guerrero

Generative models can be used to synthesize 3D objects of high quality and diversity. However, there is typically no control over the properties of the generated object.This paper proposes a novel generative adversarial network (GAN) setup…

Computer Vision and Pattern Recognition · Computer Science 2022-09-12 Larissa T. Triess , Andre Bühler , David Peter , Fabian B. Flohr , J. Marius Zöllner

Recent advances in 3D shape generation have achieved impressive results, but most existing methods rely on clean, unoccluded, and well-segmented inputs. Such conditions are rarely met in real-world scenarios. We present ShapeR, a novel…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 Yawar Siddiqui , Duncan Frost , Samir Aroudj , Armen Avetisyan , Henry Howard-Jenkins , Daniel DeTone , Pierre Moulon , Qirui Wu , Zhengqin Li , Julian Straub , Richard Newcombe , Jakob Engel

3D data that contains rich geometry information of objects and scenes is valuable for understanding 3D physical world. With the recent emergence of large-scale 3D datasets, it becomes increasingly crucial to have a powerful 3D generative…

Computer Vision and Pattern Recognition · Computer Science 2020-12-29 Jianwen Xie , Zilong Zheng , Ruiqi Gao , Wenguan Wang , Song-Chun Zhu , Ying Nian Wu

Foundation models for 3D shape generation have recently shown a remarkable capacity to encode rich geometric priors across both global and local dimensions. However, leveraging these priors for downstream tasks can be challenging as…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Maximilian Plattner , Arturs Berzins , Johannes Brandstetter

We introduce a new generative model that combines latent diffusion with persistent homology to create 3D shapes with high diversity, with a special emphasis on their topological characteristics. Our method involves representing 3D shapes as…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Jiangbei Hu , Ben Fei , Baixin Xu , Fei Hou , Weidong Yang , Shengfa Wang , Na Lei , Chen Qian , Ying He

Semantic-driven 3D shape generation aims to generate 3D objects conditioned on text. Previous works face problems with single-category generation, low-frequency 3D details, and requiring a large number of paired datasets for training. To…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Bo Han , Yitong Fu , Yixuan Shen

Recent advancements in implicit 3D representations and generative models have markedly propelled the field of 3D object generation forward. However, it remains a significant challenge to accurately model geometries with defined sharp…

Graphics · Computer Science 2024-01-17 Zeqing Yuan , Haoxuan Lan , Qiang Zou , Junbo Zhao

Text-to-3D generation represents an exciting field that has seen rapid advancements, facilitating the transformation of textual descriptions into detailed 3D models. However, current progress often neglects the intricate high-order…

Computer Vision and Pattern Recognition · Computer Science 2025-01-10 Donglin Di , Jiahui Yang , Chaofan Luo , Zhou Xue , Wei Chen , Xun Yang , Yue Gao

Generative models for 2D images has recently seen tremendous progress in quality, resolution and speed as a result of the efficiency of 2D convolutional architectures. However it is difficult to extend this progress into the 3D domain since…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Hassan Abu Alhaija , Alara Dirik , André Knörig , Sanja Fidler , Maria Shugrina

We present a novel 3D shape completion framework that unifies multimodal conditioning, leveraging both 2D images and 3D partial scans through a latent diffusion model. Shapes are represented as Truncated Signed Distance Functions (TSDFs)…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Simon Schaefer , Juan D. Galvis , Xingxing Zuo , Stefan Leutengger

Deep generative models of 3D shapes have received a great deal of research interest. Yet, almost all of them generate discrete shape representations, such as voxels, point clouds, and polygon meshes. We present the first 3D generative model…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Rundi Wu , Chang Xiao , Changxi Zheng

A main challenge in mechanical design is to efficiently explore the design space while satisfying engineering constraints. This work explores the use of 3D generative models to explore the design space in the context of vehicle development,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Hayata Morita , Kohei Shintani , Chenyang Yuan , Frank Permenter

Modern 3D generation methods can rapidly create shapes from sparse or single views, but their outputs often lack geometric detail due to computational constraints. We present DetailGen3D, a generative approach specifically designed to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Ken Deng , Yuan-Chen Guo , Jingxiang Sun , Zi-Xin Zou , Yangguang Li , Xin Cai , Yan-Pei Cao , Yebin Liu , Ding Liang

We present ShapeCrafter, a neural network for recursive text-conditioned 3D shape generation. Existing methods to generate text-conditioned 3D shapes consume an entire text prompt to generate a 3D shape in a single step. However, humans…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Rao Fu , Xiao Zhan , Yiwen Chen , Daniel Ritchie , Srinath Sridhar

Autoregressive models have achieved remarkable success across various domains, yet their performance in 3D shape generation lags significantly behind that of diffusion models. In this paper, we introduce OctGPT, a novel multiscale…

Graphics · Computer Science 2025-04-16 Si-Tong Wei , Rui-Huan Wang , Chuan-Zhi Zhou , Baoquan Chen , Peng-Shuai Wang

Realistic and diverse 3D shape generation is helpful for a wide variety of applications such as virtual reality, gaming, and animation. Modern generative models, such as GANs and diffusion models, learn from large-scale datasets and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Jingyuan Zhu , Huimin Ma , Jiansheng Chen , Jian Yuan

Existing generative models for 3D shapes can synthesize high-fidelity and visually plausible shapes. For certain classes of shapes that have undergone an engineering design process, the realism of the shape is tightly coupled with the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Yingxuan You , Chen Zhao , Hantao Zhang , Ming Xu , Pascal Fua