English
Related papers

Related papers: Text-to-3D Generation by 2D Editing

200 papers

Witnessing the evolution of text-to-image diffusion models, significant strides have been made in text-to-3D generation. Currently, two primary paradigms dominate the field of text-to-3D: the feed-forward generation solutions, capable of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Yonghao Yu , Shunan Zhu , Huai Qin , Haorui Li

We present Dual3D, a novel text-to-3D generation framework that generates high-quality 3D assets from texts in only $1$ minute.The key component is a dual-mode multi-view latent diffusion model. Given the noisy multi-view latents, the 2D…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Xinyang Li , Zhangyu Lai , Linning Xu , Jianfei Guo , Liujuan Cao , Shengchuan Zhang , Bo Dai , Rongrong Ji

Recent advancements in Text-to-3D generation have yielded remarkable progress, particularly through methods that rely on Score Distillation Sampling (SDS). While SDS exhibits the capability to create impressive 3D assets, it is hindered by…

Machine Learning · Computer Science 2024-07-30 Runjie Yan , Kailu Wu , Kaisheng Ma

Distilling pre-trained 2D diffusion models into 3D assets has driven remarkable advances in text-to-3D synthesis. However, existing methods typically rely on Score Distillation Sampling (SDS) loss, which involves asymmetric KL divergence--a…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Weimin Bai , Yubo Li , Wenzheng Chen , Weijian Luo , He Sun

Text-to-3D generation has made remarkable progress recently, particularly with methods based on Score Distillation Sampling (SDS) that leverages pre-trained 2D diffusion models. While the usage of classifier-free guidance is well…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Xin Yu , Yuan-Chen Guo , Yangguang Li , Ding Liang , Song-Hai Zhang , Xiaojuan Qi

Recent 3D large reconstruction models typically employ a two-stage process, including first generate multi-view images by a multi-view diffusion model, and then utilize a feed-forward model to reconstruct images to 3D content.However,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Zhenyu Tang , Junwu Zhang , Xinhua Cheng , Wangbo Yu , Chaoran Feng , Yatian Pang , Bin Lin , Li Yuan

To address the data scarcity associated with 3D assets, 2D-lifting techniques such as Score Distillation Sampling (SDS) have become a widely adopted practice in text-to-3D generation pipelines. However, the diffusion models used in these…

Computer Vision and Pattern Recognition · Computer Science 2025-01-23 Utkarsh Nath , Rajeev Goel , Eun Som Jeon , Changhoon Kim , Kyle Min , Yezhou Yang , Yingzhen Yang , Pavan Turaga

Text-to-3D generation has shown rapid progress in recent days with the advent of score distillation, a methodology of using pretrained text-to-2D diffusion models to optimize neural radiance field (NeRF) in the zero-shot setting. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Junyoung Seo , Wooseok Jang , Min-Seop Kwak , Hyeonsu Kim , Jaehoon Ko , Junho Kim , Jin-Hwa Kim , Jiyoung Lee , Seungryong Kim

Traditional 3D content creation tools empower users to bring their imagination to life by giving them direct control over a scene's geometry, appearance, motion, and camera path. Creating computer-generated videos, however, is a tedious…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Shengqu Cai , Duygu Ceylan , Matheus Gadelha , Chun-Hao Paul Huang , Tuanfeng Yang Wang , Gordon Wetzstein

Existing text-based 3D generation methods generate attractive results but lack detailed geometry control. Sketches, known for their conciseness and expressiveness, have contributed to intuitive 3D modeling but are confined to producing…

Graphics · Computer Science 2024-05-15 Feng-Lin Liu , Hongbo Fu , Yu-Kun Lai , Lin Gao

Recent innovations on text-to-3D generation have featured Score Distillation Sampling (SDS), which enables the zero-shot learning of implicit 3D models (NeRF) by directly distilling prior knowledge from 2D diffusion models. However, current…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Yang Chen , Yingwei Pan , Haibo Yang , Ting Yao , Tao Mei

Large-scale text-guided image diffusion models have shown astonishing results in text-to-image (T2I) generation. However, applying these models to synthesize textures for 3D geometries remains challenging due to the domain gap between 2D…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Jiawei Lu , Yingpeng Zhang , Zengjun Zhao , He Wang , Kun Zhou , Tianjia Shao

Recently, there has been a significant advancement in text-to-image diffusion models, leading to groundbreaking performance in 2D image generation. These advancements have been extended to 3D models, enabling the generation of novel 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Jangho Park , Gihyun Kwon , Jong Chul Ye

Automatic text-to-3D generation that combines Score Distillation Sampling (SDS) with the optimization of volume rendering has achieved remarkable progress in synthesizing realistic 3D objects. Yet most existing text-to-3D methods by SDS and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Zilong Chen , Feng Wang , Yikai Wang , Huaping Liu

We propose a simple and novel method for generating 3D human motion from complex natural language sentences, which describe different velocity, direction and composition of all kinds of actions. Different from existing methods that use…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Zhiyuan Ren , Zhihong Pan , Xin Zhou , Le Kang

Recent remarkable advances in large-scale text-to-image diffusion models have inspired a significant breakthrough in text-to-3D generation, pursuing 3D content creation solely from a given text prompt. However, existing text-to-3D…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Yang Chen , Yingwei Pan , Yehao Li , Ting Yao , Tao Mei

The advancement of text-driven 3D content editing has been blessed by the progress from 2D generative diffusion models. However, a major obstacle hindering the widespread adoption of 3D content editing is its time-intensive processing. This…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Liangchen Song , Liangliang Cao , Jiatao Gu , Yifan Jiang , Junsong Yuan , Hao Tang

Recent advancements in 3D generation have leveraged synthetic datasets with ground truth 3D assets and predefined cameras. However, the potential of adopting real-world datasets, which can produce significantly more realistic 3D scenes,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-26 Xinyang Li , Zhangyu Lai , Linning Xu , Yansong Qu , Liujuan Cao , Shengchuan Zhang , Bo Dai , Rongrong Ji

Score Distillation Sampling (SDS) has emerged as a prevalent technique for text-to-3D generation, enabling 3D content creation by distilling view-dependent information from text-to-2D guidance. However, they frequently exhibit shortcomings…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Zeyu Cai , Duotun Wang , Yixun Liang , Zhijing Shao , Ying-Cong Chen , Xiaohang Zhan , Zeyu Wang

Creating realistic 3D objects and clothed avatars from a single RGB image is an attractive yet challenging problem. Due to its ill-posed nature, recent works leverage powerful prior from 2D diffusion models pretrained on large datasets.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Yuxuan Xue , Xianghui Xie , Riccardo Marin , Gerard Pons-Moll