English
Related papers

Related papers: Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D S…

200 papers

We introduce ShowRoom3D, a three-stage approach for generating high-quality 3D room-scale scenes from texts. Previous methods using 2D diffusion priors to optimize neural radiance fields for generating room-scale scenes have shown…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Weijia Mao , Yan-Pei Cao , Jia-Wei Liu , Zhongcong Xu , Mike Zheng Shou

Recent strides in Text-to-3D techniques have been propelled by distilling knowledge from powerful large text-to-image diffusion models (LDMs). Nonetheless, existing Text-to-3D approaches often grapple with challenges such as…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Yiwen Chen , Chi Zhang , Xiaofeng Yang , Zhongang Cai , Gang Yu , Lei Yang , Guosheng Lin

Recent years have seen an explosion of work and interest in text-to-3D shape generation. Much of the progress is driven by advances in 3D representations, large-scale pretraining and representation learning for text and image data enabling…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Han-Hung Lee , Manolis Savva , Angel X. Chang

Current state-of-the-art methods for text-to-shape generation either require supervised training using a labeled dataset of pre-defined 3D shapes, or perform expensive inference-time optimization of implicit neural representations. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Kelly O. Marshall , Minh Pham , Ameya Joshi , Anushrut Jignasu , Aditya Balu , Adarsh Krishnamurthy , Chinmay Hegde

Large-scale diffusion generative models are greatly simplifying image, video and 3D asset creation from user-provided text prompts and images. However, the challenging problem of text-to-4D dynamic 3D scene generation with diffusion…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Yufeng Zheng , Xueting Li , Koki Nagano , Sifei Liu , Karsten Kreis , Otmar Hilliges , Shalini De Mello

The emergence of virtual reality has necessitated the generation of detailed and customizable 3D hand models for interaction in the virtual world. However, the current methods for 3D hand model generation are both expensive and cumbersome,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Green Rosh , Prateek Kukreja , Vishakha SR , Pawan Prasad B H

We introduce DreamDrone, a novel zero-shot and training-free pipeline for generating unbounded flythrough scenes from textual prompts. Different from other methods that focus on warping images frame by frame, we advocate explicitly warping…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Hanyang Kong , Dongze Lian , Michael Bi Mi , Xinchao Wang

By lifting the pre-trained 2D diffusion models into Neural Radiance Fields (NeRFs), text-to-3D generation methods have made great progress. Many state-of-the-art approaches usually apply score distillation sampling (SDS) to optimize the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Yuze He , Yushi Bai , Matthieu Lin , Jenny Sheng , Yubin Hu , Qi Wang , Yu-Hui Wen , Yong-Jin Liu

The advancements in automatic text-to-3D generation have been remarkable. Most existing methods use pre-trained text-to-image diffusion models to optimize 3D representations like Neural Radiance Fields (NeRFs) via latent-space denoising…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Junzhe Zhu , Peiye Zhuang , Sanmi Koyejo

Recently, 3D content creation from text prompts has demonstrated remarkable progress by utilizing 2D and 3D diffusion models. While 3D diffusion models ensure great multi-view consistency, their ability to generate high-quality and diverse…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Fangfu Liu , Diankun Wu , Yi Wei , Yongming Rao , Yueqi Duan

Recent breakthroughs in text-to-4D generation rely on pre-trained text-to-image and text-to-video models to generate dynamic 3D scenes. However, current text-to-4D methods face a three-way tradeoff between the quality of scene appearance,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Sherwin Bahmani , Ivan Skorokhodov , Victor Rong , Gordon Wetzstein , Leonidas Guibas , Peter Wonka , Sergey Tulyakov , Jeong Joon Park , Andrea Tagliasacchi , David B. Lindell

We present DreamBooth3D, an approach to personalize text-to-3D generative models from as few as 3-6 casually captured images of a subject. Our approach combines recent advances in personalizing text-to-image models (DreamBooth) with…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Amit Raj , Srinivas Kaza , Ben Poole , Michael Niemeyer , Nataniel Ruiz , Ben Mildenhall , Shiran Zada , Kfir Aberman , Michael Rubinstein , Jonathan Barron , Yuanzhen Li , Varun Jampani

Text-guided image generation has progressed rapidly in recent years, inspiring major breakthroughs in text-guided shape generation. Recently, it has been shown that using score distillation, one can successfully text-guide a NeRF model to…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Gal Metzer , Elad Richardson , Or Patashnik , Raja Giryes , Daniel Cohen-Or

Text-guided diffusion models have shown superior performance in image/video generation and editing. While few explorations have been performed in 3D scenarios. In this paper, we discuss three fundamental and interesting problems on this…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Gang Li , Heliang Zheng , Chaoyue Wang , Chang Li , Changwen Zheng , Dacheng Tao

Text-driven 3D scene generation is widely applicable to video gaming, film industry, and metaverse applications that have a large demand for 3D scenes. However, existing text-to-3D generation methods are limited to producing 3D objects with…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Jingbo Zhang , Xiaoyu Li , Ziyu Wan , Can Wang , Jing Liao

Generating shapes using natural language can enable new ways of imagining and creating the things around us. While significant recent progress has been made in text-to-image generation, text-to-shape generation remains a challenging problem…

Computer Vision and Pattern Recognition · Computer Science 2022-05-02 Aditya Sanghi , Hang Chu , Joseph G. Lambourne , Ye Wang , Chin-Yi Cheng , Marco Fumero , Kamal Rahimi Malekshan

Recent works on text-to-3d generation show that using only 2D diffusion supervision for 3D generation tends to produce results with inconsistent appearances (e.g., faces on the back view) and inaccurate shapes (e.g., animals with extra…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Cheng Chen , Xiaofeng Yang , Fan Yang , Chengzeng Feng , Zhoujie Fu , Chuan-Sheng Foo , Guosheng Lin , Fayao Liu

In this paper, we study Text-to-3D content generation leveraging 2D diffusion priors to enhance the quality and detail of the generated 3D models. Recent progress (Magic3D) in text-to-3D has shown that employing high-resolution (e.g., 512 x…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Jinbo Wu , Xiaobo Gao , Xing Liu , Zhengyang Shen , Chen Zhao , Haocheng Feng , Jingtuo Liu , Errui Ding

In this paper, we tackle a new task of 3D object synthesis, where a 3D model is composited with another object category to create a novel 3D model. However, most existing text/image/3D-to-3D methods struggle to effectively integrate…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Zeren Xiong , Zikun Chen , Zedong Zhang , Xiang Li , Ying Tai , Jian Yang , Jun Li

Recent advancements in text-to-image generation have enabled significant progress in zero-shot 3D shape generation. This is achieved by score distillation, a methodology that uses pre-trained text-to-image diffusion models to optimize the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-29 Zhenzhen Weng , Zeyu Wang , Serena Yeung