English
Related papers

Related papers: FlowDreamer: Exploring High Fidelity Text-to-3D Ge…

200 papers

Text-to-3D generation has shown rapid progress in recent days with the advent of score distillation, a methodology of using pretrained text-to-2D diffusion models to optimize neural radiance field (NeRF) in the zero-shot setting. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Junyoung Seo , Wooseok Jang , Min-Seop Kwak , Hyeonsu Kim , Jaehoon Ko , Junho Kim , Jin-Hwa Kim , Jiyoung Lee , Seungryong Kim

Score Distillation Sampling (SDS) and its variants have been widely used for text-to-3D generation by distilling 2D image diffusion priors. However, the standard SDS objective is prone to severe mode collapse, frequently yielding…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Rohith Ramanan , A. N. Rajagopalan

Generating high-quality 3D assets from textual descriptions remains a pivotal challenge in computer graphics and vision research. Due to the scarcity of 3D data, state-of-the-art approaches utilize pre-trained 2D diffusion priors, optimized…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Ling Yang , Zixiang Zhang , Junlin Han , Bohan Zeng , Runjia Li , Philip Torr , Wentao Zhang

While 2D diffusion models generate realistic, high-detail images, 3D shape generation methods like Score Distillation Sampling (SDS) built on these 2D diffusion models produce cartoon-like, over-smoothed shapes. To help explain this…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Artem Lukoianov , Haitz Sáez de Ocáriz Borde , Kristjan Greenewald , Vitor Campagnolo Guizilini , Timur Bagautdinov , Vincent Sitzmann , Justin Solomon

Recent breakthroughs in text-to-4D generation rely on pre-trained text-to-image and text-to-video models to generate dynamic 3D scenes. However, current text-to-4D methods face a three-way tradeoff between the quality of scene appearance,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Sherwin Bahmani , Ivan Skorokhodov , Victor Rong , Gordon Wetzstein , Leonidas Guibas , Peter Wonka , Sergey Tulyakov , Jeong Joon Park , Andrea Tagliasacchi , David B. Lindell

3D Gaussian Splatting (3DGS) has achieved excellent rendering quality with fast training and rendering speed. However, its optimization process lacks explicit geometric constraints, leading to suboptimal geometric reconstruction in regions…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Lin-Zhuo Chen , Kangjie Liu , Youtian Lin , Siyu Zhu , Zhihao Li , Xun Cao , Yao Yao

Text-to-3D content creation is a rapidly evolving research area. Given the scarcity of 3D data, current approaches often adapt pre-trained 2D diffusion models for 3D synthesis. Among these approaches, Score Distillation Sampling (SDS) has…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Yumin Zhang , Xingyu Miao , Haoran Duan , Bo Wei , Tejal Shah , Yang Long , Rajiv Ranjan

Score Distillation Sampling (SDS) has emerged as a prominent method for text-to-3D generation by leveraging the strengths of 2D diffusion models. However, SDS is limited to generation tasks and lacks the capability to edit existing 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Xingyu Miao , Haoran Duan , Yang Long , Jungong Han

Diffusion models achieve high-quality image generation but are limited by slow iterative sampling. Distillation methods alleviate this by enabling one- or few-step generation. Flow matching, originally introduced as a distinct framework,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Mingyuan Zhou , Yi Gu , Huangjie Zheng , Liangchen Song , Guande He , Yizhe Zhang , Wenze Hu , Yinfei Yang

Recent advances in diffusion and flow-based generative models have demonstrated remarkable success in image restoration tasks, achieving superior perceptual quality compared to traditional deep learning approaches. However, these methods…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Yuanzhi Zhu , Ruiqing Wang , Shilin Lu , Junnan Li , Hanshu Yan , Kai Zhang

Large-scale diffusion models have achieved remarkable performance in generative tasks. Beyond their initial training applications, these models have proven their ability to function as versatile plug-and-play priors. For instance, 2D…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Xiaofeng Yang , Cheng Chen , Xulei Yang , Fayao Liu , Guosheng Lin

Score Distillation Sampling (SDS) has emerged as an effective technique for leveraging 2D diffusion priors for tasks such as text-to-3D generation. While powerful, SDS struggles with achieving fine-grained alignment to user intent. To…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Itay Chachy , Guy Yariv , Sagie Benaim

Discrete diffusion models (DDMs) have shown powerful generation ability for discrete data modalities like text and molecules. However, their practical application is hindered by inefficient sampling, requiring a large number of sampling…

Machine Learning · Computer Science 2025-09-25 Feiyang Fu , Tongxian Guo , Zhaoqiang Liu

The diffusion models including Denoising Diffusion Probabilistic Models (DDPM) and score-based generative models have demonstrated excellent performance in speech synthesis tasks. However, its effectiveness comes at the cost of numerous…

Sound · Computer Science 2024-02-01 Wenhao Guan , Qi Su , Haodong Zhou , Shiyu Miao , Xingjia Xie , Lin Li , Qingyang Hong

Score Distillation Sampling (SDS) has achieved remarkable success in text-to-3D content generation. However, SDS-based methods struggle to maintain semantic fidelity for user prompts, particularly when involving multiple objects with…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Chenhan Jiang , Yihan Zeng , Dit-Yan Yeung

Recently, text-to-3D generation has attracted significant attention, resulting in notable performance enhancements. Previous methods utilize end-to-end 3D generation models to initialize 3D Gaussians, multi-view diffusion models to enforce…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Shuo Huang , Shikun Sun , Zixuan Wang , Xiaoyu Qin , Yanmin Xiong , Yuan Zhang , Pengfei Wan , Di Zhang , Jia Jia

Diffusion models (DMs) have demonstrated remarkable success in real-world image super-resolution (SR), yet their reliance on time-consuming multi-step sampling largely hinders their practical applications. While recent efforts have…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Jiaqi Xu , Wenbo Li , Haoze Sun , Fan Li , Zhixin Wang , Long Peng , Jingjing Ren , Haoran Yang , Xiaowei Hu , Renjing Pei , Pheng-Ann Heng

In the evolving landscape of text-to-3D technology, Dreamfusion has showcased its proficiency by utilizing Score Distillation Sampling (SDS) to optimize implicit representations such as NeRF. This process is achieved through the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Yuzhong Huang , Zhong Li , Zhang Chen , Zhiyuan Ren , Guosheng Lin , Fred Morstatter , Yi Xu

Although Score Distillation Sampling (SDS) has exhibited remarkable performance in conditional 3D content generation, a comprehensive understanding of its formulation is still lacking, hindering the development of 3D generation. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Boshi Tang , Jianan Wang , Zhiyong Wu , Lei Zhang

This paper presents a novel method to generate textures for 3D models given text prompts and 3D meshes. Additional depth information is taken into account to perform the Score Distillation Sampling (SDS) process with depth conditional…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Cindy Le , Congrui Hetang , Chendi Lin , Ang Cao , Yihui He