English
Related papers

Related papers: ArchComplete: Autoregressive 3D Architectural Desi…

200 papers

3D structure modeling is essential across scales, enabling applications from fluid simulation and 3D reconstruction to protein folding and molecular docking. Yet, despite shared 3D spatial patterns, current approaches remain fragmented,…

Machine Learning · Computer Science 2025-10-10 Shuqi Lu , Haowei Lin , Lin Yao , Zhifeng Gao , Xiaohong Ji , Yitao Liang , Weinan E , Linfeng Zhang , Guolin Ke

Most recent advances in 3D generative modeling rely on diffusion or flow-matching formulations. We instead explore a fully autoregressive alternative and introduce GaussianGPT, a transformer-based model that directly generates 3D Gaussians…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Nicolas von Lützow , Barbara Rössle , Katharina Schmid , Matthias Nießner

Generating high-quality 3D content from text, single images, or sparse view images remains a challenging task with broad applications. Existing methods typically employ multi-view diffusion models to synthesize multi-view images, followed…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Junlin Han , Jianyuan Wang , Andrea Vedaldi , Philip Torr , Filippos Kokkinos

Autoregressive multimodal large language models (MLLMs) enable 3D generation but struggle to scale to high-resolution shapes due to inadequate 3D tokenizations. Compact set-based representations discard deterministic spatial ordering,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Yuan Li , Congyi Zhang , Xifeng Gao , Xiaohu Guo

We use hierarchical procedural rules for the generation of control maps within the stable diffusion framework to produce photo-realistic architectural facade images. Starting from a single input image and its segmentation, we apply an…

Graphics · Computer Science 2026-05-15 Aleksander Plocharski , Jan Swidzinski , Przemyslaw Musialski

Recent mesh generation approaches typically tokenize triangle meshes into sequences of tokens and train autoregressive models to generate these tokens sequentially. Despite substantial progress, such token sequences inevitably reuse…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Jeonghwan Kim , Yushi Lan , Armando Fortes , Yongwei Chen , Xingang Pan

We introduce AutoPartGen, a model that generates objects composed of 3D parts in an autoregressive manner. This model can take as input an image of an object, 2D masks of the object's parts, or an existing 3D object, and generate a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Minghao Chen , Jianyuan Wang , Roman Shapovalov , Tom Monnier , Hyunyoung Jung , Dilin Wang , Rakesh Ranjan , Iro Laina , Andrea Vedaldi

Auto-Regressive (AR) models have achieved impressive results in 2D image generation by modeling joint distributions in the grid space. While this approach has been extended to the 3D domain for powerful shape generation, it still has two…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Simian Luo , Xuelin Qian , Yanwei Fu , Yinda Zhang , Ying Tai , Zhenyu Zhang , Chengjie Wang , Xiangyang Xue

Generating desirable molecular structures in 3D is a fundamental problem for drug discovery. Despite the considerable progress we have achieved, existing methods usually generate molecules in atom resolution and ignore intrinsic local…

Biomolecules · Quantitative Biology 2023-05-29 Bo Qiang , Yuxuan Song , Minkai Xu , Jingjing Gong , Bowen Gao , Hao Zhou , Weiying Ma , Yanyan Lan

Discrete Element Method (DEM) simulations of granular media are computationally intensive, particularly during initialization phases dominated by large displacements and kinetic energy. This paper presents a novel generative pipeline based…

Machine Learning · Computer Science 2026-03-23 Muhammad Moeeze Hassan , Régis Cottereau , Filippo Gatti , Patryk Dec

Inverse design of high-resolution and fine-detailed 3D lightweight mechanical structures is notoriously expensive due to the need for vast computational resources and the use of very fine-scaled complex meshes. Furthermore, in designing for…

The creation of manufacturable and editable 3D shapes through Computer-Aided Design (CAD) remains a highly manual and time-consuming task, hampered by the complex topology of boundary representations of 3D solids and unintuitive design…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Md Ferdous Alam , Faez Ahmed

Inspired by generative paradigms in image and video, 3D shape generation has made notable progress, enabling the rapid synthesis of high-fidelity 3D assets from a single image. However, current methods still face challenges, including the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Yangguang Li , Xianglong He , Zi-Xin Zou , Zexiang Liu , Wanli Ouyang , Ding Liang , Yan-Pei Cao

Sparse-view 3D modeling represents a fundamental tension between reconstruction fidelity and generative plausibility. While feed-forward reconstruction excels in efficiency and input alignment, it often lacks the global priors needed for…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Zhisheng Huang , Jiahao Chen , Cheng Lin , Chenyu Hu , Hanzhuo Huang , Zhengming Yu , Mengfei Li , Yuheng Liu , Zekai Gu , Zibo Zhao , Yuan Liu , Xin Li , Wenping Wang

Probabilistic denoising diffusion models (DDMs) have set a new standard for 2D image generation. Extending DDMs for 3D content creation is an active field of research. Here, we propose TetraDiffusion, a diffusion model that operates on a…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Nikolai Kalischek , Torben Peters , Jan D. Wegner , Konrad Schindler

3D shape completion from partial scans remains challenging for unseen categories and noisy real-world observations, where geometry alone is often insufficient for inferring missing structure. We present DinoComplete, a deterministic and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Furkan Mert Algan , Eckehard Steinbach

We present a detail-driven deep neural network for point set upsampling. A high-resolution point set is essential for point-based rendering and surface reconstruction. Inspired by the recent success of neural image super-resolution…

Computer Vision and Pattern Recognition · Computer Science 2019-03-22 Wang Yifan , Shihao Wu , Hui Huang , Daniel Cohen-Or , Olga Sorkine-Hornung

We present a new approach for generating 3D house wireframes with semantic enrichment using an autoregressive model. Unlike conventional generative models that independently process vertices, edges, and faces, our approach employs a unified…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Xueqi Ma , Yilin Liu , Wenjun Zhou , Ruowei Wang , Hui Huang

Recent advancements in 3D generative modeling have significantly improved the generation realism, yet the field is still hampered by existing representations, which struggle to capture assets with complex topologies and detailed appearance.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Jianfeng Xiang , Xiaoxue Chen , Sicheng Xu , Ruicheng Wang , Zelong Lv , Yu Deng , Hongyuan Zhu , Yue Dong , Hao Zhao , Nicholas Jing Yuan , Jiaolong Yang

Deep generative models of 3D shapes have received a great deal of research interest. Yet, almost all of them generate discrete shape representations, such as voxels, point clouds, and polygon meshes. We present the first 3D generative model…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Rundi Wu , Chang Xiao , Changxi Zheng