English
Related papers

Related papers: Text-to-3D by Stitching a Multi-view Reconstructio…

200 papers

We propose a high-quality 3D-to-3D conversion method, Instruct 3D-to-3D. Our method is designed for a novel task, which is to convert a given 3D scene to another scene according to text instructions. Instruct 3D-to-3D applies pretrained…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Hiromichi Kamata , Yuiko Sakuma , Akio Hayakawa , Masato Ishii , Takuya Narihira

We present Dual3D, a novel text-to-3D generation framework that generates high-quality 3D assets from texts in only $1$ minute.The key component is a dual-mode multi-view latent diffusion model. Given the noisy multi-view latents, the 2D…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Xinyang Li , Zhangyu Lai , Linning Xu , Jianfei Guo , Liujuan Cao , Shengchuan Zhang , Bo Dai , Rongrong Ji

Score Distillation Sampling (SDS) enables high-quality text-to-3D generation by supervising 3D models through the denoising of multi-view 2D renderings, using a pretrained text-to-image diffusion model to align with the input prompt and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Weimin Bai , Yubo Li , Weijian Luo , Wenzheng Chen , He Sun

Large-scale diffusion generative models are greatly simplifying image, video and 3D asset creation from user-provided text prompts and images. However, the challenging problem of text-to-4D dynamic 3D scene generation with diffusion…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Yufeng Zheng , Xueting Li , Koki Nagano , Sifei Liu , Karsten Kreis , Otmar Hilliges , Shalini De Mello

As several industries are moving towards modeling massive 3D virtual worlds, the need for content creation tools that can scale in terms of the quantity, quality, and diversity of 3D content is becoming evident. In our work, we aim to train…

Computer Vision and Pattern Recognition · Computer Science 2022-09-23 Jun Gao , Tianchang Shen , Zian Wang , Wenzheng Chen , Kangxue Yin , Daiqing Li , Or Litany , Zan Gojcic , Sanja Fidler

The ability to map descriptions of scenes to 3D geometric representations has many applications in areas such as art, education, and robotics. However, prior work on the text to 3D scene generation task has used manually specified object…

Computation and Language · Computer Science 2015-06-08 Angel Chang , Will Monroe , Manolis Savva , Christopher Potts , Christopher D. Manning

Text-to-3D generation is to craft a 3D object according to a natural language description. This can significantly reduce the workload for manually designing 3D models and provide a more natural way of interaction for users. However, this…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Han Yi , Zhedong Zheng , Xiangyu Xu , Tat-seng Chua

Text-to-3D generation is a valuable technology in virtual reality and digital content creation. While recent works have pushed the boundaries of text-to-3D generation, producing high-fidelity 3D objects with inefficient prompts and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Wenqing Wang , Yun Fu

In this paper, we present TEXTure, a novel method for text-guided generation, editing, and transfer of textures for 3D shapes. Leveraging a pretrained depth-to-image diffusion model, TEXTure applies an iterative scheme that paints a 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-02-06 Elad Richardson , Gal Metzer , Yuval Alaluf , Raja Giryes , Daniel Cohen-Or

Text-to-video generation is an emerging field in generative AI, enabling the creation of realistic, semantically accurate videos from text prompts. While current models achieve impressive visual quality and alignment with input text, they…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Luca Zanchetta , Lorenzo Papa , Luca Maiano , Irene Amerini

While large-scale datasets have driven significant progress in Text-to-Video (T2V) generative models, these models remain highly sensitive to input prompts, demonstrating that prompt design is critical to generation quality. Current methods…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Zillur Rahman , Alex Sheng , Cristian Meo

Text-guided 3D face synthesis has achieved remarkable results by leveraging text-to-image (T2I) diffusion models. However, most existing works focus solely on the direct generation, ignoring the editing, restricting them from synthesizing…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Yunjie Wu , Yapeng Meng , Zhipeng Hu , Lincheng Li , Haoqian Wu , Kun Zhou , Weiwei Xu , Xin Yu

Recent advances in large models have significantly advanced image-to-3D reconstruction. However, the generated models are often fused into a single piece, limiting their applicability in downstream tasks. This paper focuses on 3D garment…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Xuan Li , Chang Yu , Wenxin Du , Ying Jiang , Tianyi Xie , Yunuo Chen , Yin Yang , Chenfanfu Jiang

In this paper, we rethink text-to-avatar generative models by proposing TeRA, a more efficient and effective framework than the previous SDS-based models and general large 3D generative models. Our approach employs a two-stage training…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Yanwen Wang , Yiyu Zhuang , Jiawei Zhang , Li Wang , Yifei Zeng , Xun Cao , Xinxin Zuo , Hao Zhu

By lifting the pre-trained 2D diffusion models into Neural Radiance Fields (NeRFs), text-to-3D generation methods have made great progress. Many state-of-the-art approaches usually apply score distillation sampling (SDS) to optimize the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Yuze He , Yushi Bai , Matthieu Lin , Jenny Sheng , Yubin Hu , Qi Wang , Yu-Hui Wen , Yong-Jin Liu

The rising popularity of immersive visual experiences has increased interest in stereoscopic 3D video generation. Despite significant advances in video synthesis, creating 3D videos remains challenging due to the relative scarcity of 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-05-02 Michal Geyer , Omer Tov , Linyi Jin , Richard Tucker , Inbar Mosseri , Tali Dekel , Noah Snavely

Designing high-quality indoor 3D scenes is important in many practical applications, such as room planning or game development. Conventionally, this has been a time-consuming process which requires both artistic skill and familiarity with…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Başak Melis Öcal , Maxim Tatarchenko , Sezer Karaoglu , Theo Gevers

Recent advances in 3D generation have improved the fidelity and geometric details of synthesized 3D assets. However, due to the inherent ambiguity of single-view observations and the lack of robust global structural priors caused by limited…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Wenyue Chen , Wenjue Chen , Peng Li , Qinghe Wang , Xu Jia , Heliang Zheng , Rongfei Jia , Yuan Liu , Ronggang Wang

Generating high-quality 3D assets from text and images has long been challenging, primarily due to the absence of scalable 3D representations capable of capturing intricate geometry distributions. In this work, we introduce Direct3D, a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Shuang Wu , Youtian Lin , Feihu Zhang , Yifei Zeng , Jingxi Xu , Philip Torr , Xun Cao , Yao Yao

3D vector graphics play a crucial role in various applications including 3D shape retrieval, conceptual design, and virtual reality interactions due to their ability to capture essential structural information with minimal representation.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Chuang Wang , Haitao Zhou , Ling Luo , Qian Yu