English
Related papers

Related papers: Precise-Physics Driven Text-to-3D Generation

200 papers

Due to the lack of large-scale text-3D correspondence data, recent text-to-3D generation works mainly rely on utilizing 2D diffusion models for synthesizing 3D data. Since diffusion-based methods typically require significant optimization…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Bin-Shih Wu , Hong-En Chen , Sheng-Yu Huang , Yu-Chiang Frank Wang

The ability to map descriptions of scenes to 3D geometric representations has many applications in areas such as art, education, and robotics. However, prior work on the text to 3D scene generation task has used manually specified object…

Computation and Language · Computer Science 2015-06-08 Angel Chang , Will Monroe , Manolis Savva , Christopher Potts , Christopher D. Manning

Recent strides in Text-to-3D techniques have been propelled by distilling knowledge from powerful large text-to-image diffusion models (LDMs). Nonetheless, existing Text-to-3D approaches often grapple with challenges such as…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Yiwen Chen , Chi Zhang , Xiaofeng Yang , Zhongang Cai , Gang Yu , Lei Yang , Guosheng Lin

The ability to generate highly realistic 2D images from mere text prompts has recently made huge progress in terms of speed and quality, thanks to the advent of image diffusion models. Naturally, the question arises if this can be also…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Christina Tsalicoglou , Fabian Manhardt , Alessio Tonioni , Michael Niemeyer , Federico Tombari

With the growing demand for high-fidelity 3D models from 2D images, existing methods still face significant challenges in accurately reproducing fine-grained geometric details due to limitations in domain gaps and inherent ambiguities in…

Graphics · Computer Science 2025-04-01 Chongjie Ye , Yushuang Wu , Ziteng Lu , Jiahao Chang , Xiaoyang Guo , Jiaqing Zhou , Hao Zhao , Xiaoguang Han

Generative AI has made significant progress in recent years, with text-guided content generation being the most practical as it facilitates interaction between human instructions and AI-generated content (AIGC). Thanks to advancements in…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Chenghao Li , Chaoning Zhang , Joseph Cho , Atish Waghwase , Lik-Hang Lee , Francois Rameau , Yang Yang , Sung-Ho Bae , Choong Seon Hong

The generative modeling landscape has experienced tremendous growth in recent years, particularly in generating natural images and art. Recent techniques have shown impressive potential in creating complex visual compositions while…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Juan A Rodriguez , David Vazquez , Issam Laradji , Marco Pedersoli , Pau Rodriguez

In this paper, we present TEXTure, a novel method for text-guided generation, editing, and transfer of textures for 3D shapes. Leveraging a pretrained depth-to-image diffusion model, TEXTure applies an iterative scheme that paints a 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-02-06 Elad Richardson , Gal Metzer , Yuval Alaluf , Raja Giryes , Daniel Cohen-Or

We introduce PAT3D, the first physics-augmented text-to-3D scene generation framework that integrates vision-language models with physics-based simulation to produce physically plausible, simulation-ready, and intersection-free 3D scenes.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Guying Lin , Kemeng Huang , Michael Liu , Ruihan Gao , Hanke Chen , Lyuhao Chen , Beijia Lu , Taku Komura , Yuan Liu , Jun-Yan Zhu , Minchen Li

Recent remarkable advances in large-scale text-to-image diffusion models have inspired a significant breakthrough in text-to-3D generation, pursuing 3D content creation solely from a given text prompt. However, existing text-to-3D…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Yang Chen , Yingwei Pan , Yehao Li , Ting Yao , Tao Mei

Generative models for 2D images has recently seen tremendous progress in quality, resolution and speed as a result of the efficiency of 2D convolutional architectures. However it is difficult to extend this progress into the 3D domain since…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Hassan Abu Alhaija , Alara Dirik , André Knörig , Sanja Fidler , Maria Shugrina

The recent advances in text and image synthesis show a great promise for the future of generative models in creative fields. However, a less explored area is the one of 3D model generation, with a lot of potential applications to game…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Antoine Schnepf , Flavian Vasile , Ugo Tanielian

Automatic text-to-3D generation that combines Score Distillation Sampling (SDS) with the optimization of volume rendering has achieved remarkable progress in synthesizing realistic 3D objects. Yet most existing text-to-3D methods by SDS and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Zilong Chen , Feng Wang , Yikai Wang , Huaping Liu

3D asset generation is getting massive amounts of attention, inspired by the recent success of text-guided 2D content creation. Existing text-to-3D methods use pretrained text-to-image diffusion models in an optimization problem or…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Lukas Höllein , Aljaž Božič , Norman Müller , David Novotny , Hung-Yu Tseng , Christian Richardt , Michael Zollhöfer , Matthias Nießner

In recent years, 3D models have been utilized in many applications, such as auto-driver, 3D reconstruction, VR, and AR. However, the scarcity of 3D model data does not meet its practical demands. Thus, generating high-quality 3D models…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Weizhi Nie , Ruidong Chen , Weijie Wang , Bruno Lepri , Nicu Sebe

The entertainment industry relies on 3D visual content to create immersive experiences, but traditional methods for creating textured 3D models can be time-consuming and subjective. Generative networks such as StyleGAN have advanced image…

Computer Vision and Pattern Recognition · Computer Science 2024-02-09 Yi-Ting Pan , Chai-Rong Lee , Shu-Ho Fan , Jheng-Wei Su , Jia-Bin Huang , Yung-Yu Chuang , Hung-Kuo Chu

3D modeling is moving from virtual to physical. Existing 3D generation primarily emphasizes geometries and textures while neglecting physical-grounded modeling. Consequently, despite the rapid development of 3D generative models, the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Ziang Cao , Zhaoxi Chen , Liang Pan , Ziwei Liu

In recent years, 3D Gaussian splatting has emerged as a powerful technique for 3D reconstruction and generation, known for its fast and high-quality rendering capabilities. To address these shortcomings, this paper introduces a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Xianglong He , Junyi Chen , Sida Peng , Di Huang , Yangguang Li , Xiaoshui Huang , Chun Yuan , Wanli Ouyang , Tong He

We introduce Meta 3D Gen (3DGen), a new state-of-the-art, fast pipeline for text-to-3D asset generation. 3DGen offers 3D asset creation with high prompt fidelity and high-quality 3D shapes and textures in under a minute. It supports…

Generative models for 3D object synthesis have seen significant advancements with the incorporation of prior knowledge distilled from 2D diffusion models. Nevertheless, challenges persist in the form of multi-view geometric inconsistencies…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Lincong Feng , Muyu Wang , Maoyu Wang , Kuo Xu , Xiaoli Liu