English
Related papers

Related papers: Pushing the Limits of 3D Shape Generation at Scale

200 papers

In this work, we present a novel framework built to simplify 3D asset generation for amateur users. To enable interactive generation, our method supports a variety of input modalities that can be easily provided by a human, including…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Yen-Chi Cheng , Hsin-Ying Lee , Sergey Tulyakov , Alexander Schwing , Liangyan Gui

We present a generative model to synthesize 3D shapes as sets of handles -- lightweight proxies that approximate the original 3D shape -- for applications in interactive editing, shape parsing, and building compact 3D representations. Our…

Computer Vision and Pattern Recognition · Computer Science 2020-04-08 Matheus Gadelha , Giorgio Gori , Duygu Ceylan , Radomir Mech , Nathan Carr , Tamy Boubekeur , Rui Wang , Subhransu Maji

Explorable 3D world generation from a single image or text prompt forms a cornerstone of spatial intelligence. Recent works utilize video model to achieve wide-scope and generalizable 3D world generation. However, existing approaches often…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Zhongqi Yang , Wenhang Ge , Yuqi Li , Jiaqi Chen , Haoyuan Li , Mengyin An , Fei Kang , Hua Xue , Baixin Xu , Yuyang Yin , Eric Li , Yang Liu , Yikai Wang , Hao-Xiang Guo , Yahui Zhou

Existing diffusion-based text-to-3D generation methods primarily focus on producing visually realistic shapes and appearances, often neglecting the physical constraints necessary for downstream tasks. Generated models frequently fail to…

Machine Learning · Computer Science 2024-11-19 Yunuo Chen , Tianyi Xie , Zeshun Zong , Xuan Li , Feng Gao , Yin Yang , Ying Nian Wu , Chenfanfu Jiang

We introduce a deep generative network for 3D shape detailization, akin to stylization with the style being geometric details. We address the challenge of creating large varieties of high-resolution and detailed 3D geometry from a small set…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Zhiqin Chen , Vladimir G. Kim , Matthew Fisher , Noam Aigerman , Hao Zhang , Siddhartha Chaudhuri

Recent multimodal large language models have achieved strong performance in unified text and image understanding and generation, yet extending such native capability to 3D remains challenging due to limited data. Compared to abundant 2D…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Chongjie Ye , Cheng Cao , Chuanyu Pan , Yiming Hao , Yihao Zhi , Yuanming Hu , Xiaoguang Han

Deep generative architectures provide a way to model not only images but also complex, 3-dimensional objects, such as point clouds. In this work, we present a novel method to obtain meaningful representations of 3D shapes that can be used…

Machine Learning · Computer Science 2019-05-03 Maciej Zamorski , Maciej Zięba , Piotr Klukowski , Rafał Nowak , Karol Kurach , Wojciech Stokowiec , Tomasz Trzciński

We study the problem of shape generation in 3D mesh representation from a small number of color images with or without camera poses. While many previous works learn to hallucinate the shape directly from priors, we adopt to further improve…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Chao Wen , Yinda Zhang , Chenjie Cao , Zhuwen Li , Xiangyang Xue , Yanwei Fu

In this paper, we propose Extend3D, a training-free pipeline for 3D scene generation from a single image, built upon an object-centric 3D generative model. To overcome the limitations of fixed-size latent spaces in object-centric models for…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Seungwoo Yoon , Jinmo Kim , Jaesik Park

The recent advancements in image-text diffusion models have stimulated research interest in large-scale 3D generative models. Nevertheless, the limited availability of diverse 3D resources presents significant challenges to learning. In…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Chi Zhang , Yiwen Chen , Yijun Fu , Zhenglin Zhou , Gang YU , Billzb Wang , Bin Fu , Tao Chen , Guosheng Lin , Chunhua Shen

Structural representation is crucial for reconstructing and generating editable 3D shapes with part semantics. Recent 3D shape generation works employ complicated networks and structure definitions relying on hierarchical annotations and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Changfeng Ma , Pengxiao Guo , Shuangyu Yang , Yinuo Chen , Jie Guo , Chongjun Wang , Yanwen Guo , Wenping Wang

Generating high-resolution 3D shapes using volumetric representations such as Signed Distance Functions (SDFs) presents substantial computational and memory challenges. We introduce Direct3D-S2, a scalable 3D generation framework based on…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Shuang Wu , Youtian Lin , Feihu Zhang , Yifei Zeng , Yikang Yang , Yajie Bao , Jiachen Qian , Siyu Zhu , Xun Cao , Philip Torr , Yao Yao

In recent years, there has been significant progress in 2D generative face models fueled by applications such as animation, synthetic data generation, and digital avatars. However, due to the absence of 3D information, these 2D models often…

Computer Vision and Pattern Recognition · Computer Science 2023-10-30 Aashish Rai , Hiresh Gupta , Ayush Pandey , Francisco Vicente Carrasco , Shingo Jason Takagi , Amaury Aubel , Daeil Kim , Aayush Prakash , Fernando de la Torre

3D scene generation has long been dominated by 2D multi-view or video diffusion models. This is due not only to the lack of scene-level 3D latent representation, but also to the fact that most scene-level 3D visual data exists in the form…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Dongxu Wei , Qi Xu , Zhiqi Li , Hangning Zhou , Cong Qiu , Hailong Qin , Mu Yang , Zhaopeng Cui , Peidong Liu

Generating 3D scenes from human motion sequences supports numerous applications, including virtual reality and architectural design. However, previous auto-regression-based human-aware 3D scene generation methods have struggled to…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Xiaolin Hong , Hongwei Yi , Fazhi He , Qiong Cao

We study the problem of 3D object generation. We propose a novel framework, namely 3D Generative Adversarial Network (3D-GAN), which generates 3D objects from a probabilistic space by leveraging recent advances in volumetric convolutional…

Computer Vision and Pattern Recognition · Computer Science 2017-01-05 Jiajun Wu , Chengkai Zhang , Tianfan Xue , William T. Freeman , Joshua B. Tenenbaum

Probabilistic denoising diffusion models (DDMs) have set a new standard for 2D image generation. Extending DDMs for 3D content creation is an active field of research. Here, we propose TetraDiffusion, a diffusion model that operates on a…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Nikolai Kalischek , Torben Peters , Jan D. Wegner , Konrad Schindler

Although the recent rapid evolution of 3D generative neural networks greatly improves 3D shape generation, it is still not convenient for ordinary users to create 3D shapes and control the local geometry of generated shapes. To address…

Computer Vision and Pattern Recognition · Computer Science 2023-05-10 Xin-Yang Zheng , Hao Pan , Peng-Shuai Wang , Xin Tong , Yang Liu , Heung-Yeung Shum

Generative models for 3D object synthesis have seen significant advancements with the incorporation of prior knowledge distilled from 2D diffusion models. Nevertheless, challenges persist in the form of multi-view geometric inconsistencies…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Lincong Feng , Muyu Wang , Maoyu Wang , Kuo Xu , Xiaoli Liu

In recent years, generative 3D face models (e.g., EG3D) have been developed to tackle the problem of synthesizing photo-realistic faces. However, these models are often unable to capture facial features unique to each individual,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Luchao Qi , Jiaye Wu , Annie N. Wang , Shengze Wang , Roni Sengupta