English
Related papers

Related papers: Pushing the Limits of 3D Shape Generation at Scale

200 papers

Recent generative AI models have achieved remarkable breakthroughs in language and visual understanding. However, although these models can generate realistic visual content, their spatial scale remains confined to bounded environments,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Jinqi Cao , Zhiping Yu , Baihong Lin , Chenyang Liu , Zhenwei Shi , Zhengxia Zou

Generative AI has made rapid progress in text, image, and video synthesis, yet text-to-3D modeling for scientific design remains particularly challenging due to limited controllability and high computational cost. Most existing 3D…

Graphics · Computer Science 2026-04-01 Rachel K. Luu , Markus J. Buehler

3D structure modeling is essential across scales, enabling applications from fluid simulation and 3D reconstruction to protein folding and molecular docking. Yet, despite shared 3D spatial patterns, current approaches remain fragmented,…

Machine Learning · Computer Science 2025-10-10 Shuqi Lu , Haowei Lin , Lin Yao , Zhifeng Gao , Xiaohong Ji , Yitao Liang , Weinan E , Linfeng Zhang , Guolin Ke

While recent generative models for 2D images achieve impressive visual results, they clearly lack the ability to perform 3D reasoning. This heavily restricts the degree of control over generated objects as well as the possible applications…

Computer Vision and Pattern Recognition · Computer Science 2020-10-26 Dario Pavllo , Graham Spinks , Thomas Hofmann , Marie-Francine Moens , Aurelien Lucchi

In recent years, 3D models have been utilized in many applications, such as auto-driver, 3D reconstruction, VR, and AR. However, the scarcity of 3D model data does not meet its practical demands. Thus, generating high-quality 3D models…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Weizhi Nie , Ruidong Chen , Weijie Wang , Bruno Lepri , Nicu Sebe

We propose a method for constructing generative models of 3D objects from a single 3D mesh and improving them through unsupervised low-shot learning from 2D images. Our method produces a 3D morphable model that represents shape and albedo…

Computer Vision and Pattern Recognition · Computer Science 2022-03-08 Skylar Sutherland , Bernhard Egger , Joshua Tenenbaum

This paper introduces a generative model for 3D surfaces based on a representation of shapes with mean curvature and metric, which are invariant under rigid transformation. Hence, compared with existing 3D machine learning frameworks, our…

Graphics · Computer Science 2020-09-08 Zi Ye , Nobuyuki Umetani , Takeo Igarashi , Tim Hoffmann

We present XCube (abbreviated as $\mathcal{X}^3$), a novel generative model for high-resolution sparse 3D voxel grids with arbitrary attributes. Our model can generate millions of voxels with a finest effective resolution of up to $1024^3$…

Computer Vision and Pattern Recognition · Computer Science 2024-06-26 Xuanchi Ren , Jiahui Huang , Xiaohui Zeng , Ken Museth , Sanja Fidler , Francis Williams

While text-conditional 3D object generation and manipulation have seen rapid progress, the evaluation of coherence between generated 3D shapes and input textual descriptions lacks a clear benchmark. The reason is twofold: a) the low quality…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Andrea Amaduzzi , Giuseppe Lisanti , Samuele Salti , Luigi Di Stefano

The generation of high-quality 3D environments is crucial for industries such as gaming, virtual reality, and cinema, yet remains resource-intensive due to the reliance on manual processes. This study performs a systematic review of…

Graphics · Computer Science 2025-06-09 Miguel Silva , Alexandre Valle de Carvalho

Generative AI models have made significant progress in automating the creation of 3D shapes, which has the potential to transform car design. In engineering design and optimization, evaluating engineering metrics is crucial. To make…

Machine Learning · Computer Science 2023-06-13 Binyang Song , Chenyang Yuan , Frank Permenter , Nikos Arechiga , Faez Ahmed

Sequential assembly with geometric primitives has drawn attention in robotics and 3D vision since it yields a practical blueprint to construct a target shape. However, due to its combinatorial property, a greedy method falls short of…

Computer Vision and Pattern Recognition · Computer Science 2020-11-26 Jungtaek Kim , Hyunsoo Chung , Jinhwi Lee , Minsu Cho , Jaesik Park

The ability to generate diverse 3D articulated head avatars is vital to a plethora of applications, including augmented reality, cinematography, and education. Recent work on text-guided 3D object generation has shown great promise in…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Alexander W. Bergman , Wang Yifan , Gordon Wetzstein

While 3D content generation has advanced significantly, existing methods still face challenges with input formats, latent space design, and output representations. This paper introduces a novel 3D generation framework that addresses these…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Yushi Lan , Shangchen Zhou , Zhaoyang Lyu , Fangzhou Hong , Shuai Yang , Bo Dai , Xingang Pan , Chen Change Loy

Accurate machine-learning models for aerodynamic prediction are essential for accelerating shape optimization, yet remain challenging to develop for complex three-dimensional configurations due to the high cost of generating training data.…

Machine Learning · Computer Science 2026-04-21 Yunjia Yang , Babak Gholami , Caglar Gurbuz , Mohammad Rashed , Nils Thuerey

Recent advances in deep generative models have led to immense progress in 3D shape synthesis. While existing models are able to synthesize shapes represented as voxels, point-clouds, or implicit functions, these methods only indirectly…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Andrew Luo , Tianqin Li , Wen-Hao Zhang , Tai Sing Lee

In contemporary architectural design, the growing complexity and diversity of design demands have made generative plugin tools essential for quickly producing initial concepts and exploring novel 3D forms. However, objectively analyzing the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Jun Yin , Jing Zhong , Pengyu Zeng , Peilin Li , Zixuan Dai , Miao Zhang , Shuai Lu

3D content inherently encompasses multi-modal characteristics and can be projected into different modalities (e.g., RGB images, RGBD, and point clouds). Each modality exhibits distinct advantages in 3D asset modeling: RGB images contain…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Ziang Cao , Zhaoxi Chen , Liang Pan , Ziwei Liu

In 3D modeling, designers often use an existing 3D model as a reference to create new ones. This practice has inspired the development of Phidias, a novel generative model that uses diffusion for reference-augmented 3D generation. Given an…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Zhenwei Wang , Tengfei Wang , Zexin He , Gerhard Hancke , Ziwei Liu , Rynson W. H. Lau

World modeling has become a cornerstone in AI research, enabling agents to understand, represent, and predict the dynamic environments they inhabit. While prior work largely emphasizes generative methods for 2D image and video data, they…