中文
相关论文

相关论文: Taming Mode Collapse in Score Distillation for Tex…

200 篇论文

Recently, text-to-3D generation has attracted significant attention, resulting in notable performance enhancements. Previous methods utilize end-to-end 3D generation models to initialize 3D Gaussians, multi-view diffusion models to enforce…

计算机视觉与模式识别 · 计算机科学 2024-07-22 Shuo Huang , Shikun Sun , Zixuan Wang , Xiaoyu Qin , Yanmin Xiong , Yuan Zhang , Pengfei Wan , Di Zhang , Jia Jia

Score distillation sampling (SDS) demonstrates a powerful capability for text-conditioned 2D image and 3D object generation by distilling the knowledge from learned score functions. However, SDS often suffers from blurriness caused by noisy…

计算机视觉与模式识别 · 计算机科学 2025-03-26 SeonHwa Kim , Jiwon Kim , Soobin Park , Donghoon Ahn , Jiwon Kang , Seungryong Kim , Kyong Hwan Jin , Eunju Cha

While diffusion models show promising results in image editing given a target prompt, achieving both prompt fidelity and background preservation remains difficult. Recent works have introduced score distillation techniques that leverage the…

3D Gaussian Splatting has recently enabled fast and photorealistic reconstruction of static 3D scenes. However, dynamic editing of such scenes remains a significant challenge. We introduce a novel framework, Physics-Guided Score…

图形学 · 计算机科学 2026-03-26 Gal Fiebelman , Hadar Averbuch-Elor , Sagie Benaim

Score Distillation Sampling (SDS) is a recent but already widely popular method that relies on an image diffusion model to control optimization problems using text prompts. In this paper, we conduct an in-depth analysis of the SDS loss…

计算机视觉与模式识别 · 计算机科学 2024-07-08 Thiemo Alldieck , Nikos Kolotouros , Cristian Sminchisescu

3D Gaussian Splatting (3DGS) has recently gained great attention in the 3D scene representation for its high-quality real-time rendering capabilities. However, when the input comprises sparse training views, 3DGS is prone to overfitting,…

计算机视觉与模式识别 · 计算机科学 2025-11-17 Ruocheng Wu , Haolan He , Yufei Wang , Zhihao Li , Bihan Wen

Text-guided image and 3D editing have advanced with diffusion-based models, yet methods like Delta Denoising Score often struggle with stability, spatial control, and editing strength. These limitations stem from reliance on complex…

计算机视觉与模式识别 · 计算机科学 2025-07-15 Haiming Zhu , Yangyang Xu , Chenshu Xu , Tingrui Shen , Wenxi Liu , Yong Du , Jun Yu , Shengfeng He

Recent one image to 3D generation methods commonly adopt Score Distillation Sampling (SDS). Despite the impressive results, there are multiple deficiencies including multi-view inconsistency, over-saturated and over-smoothed textures, as…

计算机视觉与模式识别 · 计算机科学 2023-12-29 Junwu Zhang , Zhenyu Tang , Yatian Pang , Xinhua Cheng , Peng Jin , Yida Wei , Munan Ning , Li Yuan

While diffusion models have demonstrated remarkable progress in 2D image generation and editing, extending these capabilities to 3D editing remains challenging, particularly in maintaining multi-view consistency. Classical approaches…

计算机视觉与模式识别 · 计算机科学 2025-08-05 Yufeng Chi , Huimin Ma , Kafeng Wang , Jianmin Li

Learning generative models directly from corrupted observations is a long standing challenge across natural and scientific domains. We introduce Restoration Score Distillation (RSD), a unified framework for learning high fidelity, one step…

机器学习 · 计算机科学 2026-03-19 Yasi Zhang , Tianyu Chen , Zhendong Wang , Ying Nian Wu , Mingyuan Zhou , Oscar Leong

Diffusion-based text-to-image generation models trained on extensive text-image pairs have demonstrated the ability to produce photorealistic images aligned with textual descriptions. However, a significant limitation of these models is…

计算机视觉与模式识别 · 计算机科学 2025-02-11 Mingyuan Zhou , Zhendong Wang , Huangjie Zheng , Hai Huang

Human preference alignment presents a critical yet underexplored challenge for diffusion models in text-to-3D generation. Existing solutions typically require task-specific fine-tuning, posing significant hurdles in data-scarce 3D domains.…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Jiaqi Leng , Shuyuan Tu , Haidong Cao , Sicheng Xie , Daoguo Dong , Zuxuan Wu , Yu-Gang Jiang

Recent progress in text-to-3D object generation enables the synthesis of detailed geometry from text input by leveraging 2D diffusion models and differentiable 3D representations. However, the approaches often suffer from limited…

计算机视觉与模式识别 · 计算机科学 2026-04-13 Ming He , Zhixiang Chen , Steve Maddock

Score Distillation Sampling (SDS) has been pivotal for leveraging pre-trained diffusion models in downstream tasks such as inverse problems, but it faces two major challenges: $(i)$ mode collapse and $(ii)$ latent space inversion, which…

机器学习 · 计算机科学 2024-10-15 Nicolas Zilberstein , Morteza Mardani , Santiago Segarra

In recent years, advancements in generative models have significantly expanded the capabilities of text-to-3D generation. Many approaches rely on Score Distillation Sampling (SDS) technology. However, SDS struggles to accommodate…

计算机视觉与模式识别 · 计算机科学 2024-11-01 Jiahui Yang , Donglin Di , Baorui Ma , Xun Yang , Yongjia Ma , Wenzhang Sun , Wei Chen , Jianxun Cui , Zhou Xue , Meng Wang , Yebin Liu

We present Acc3D to tackle the challenge of accelerating the diffusion process to generate 3D models from single images. To derive high-quality reconstructions through few-step inferences, we emphasize the critical issue of regularizing the…

计算机视觉与模式识别 · 计算机科学 2025-03-21 Kendong Liu , Zhiyu Zhu , Hui Liu , Junhui Hou

Score Distillation Sampling (SDS) has emerged as the de facto approach for text-to-content generation in non-image domains. In this paper, we reexamine the SDS process and introduce a straightforward interpretation that demystifies the…

计算机视觉与模式识别 · 计算机科学 2023-10-27 Oren Katzir , Or Patashnik , Daniel Cohen-Or , Dani Lischinski

Recently, 3D Gaussian Splatting (3D-GS) has achieved impressive results in novel view synthesis, demonstrating high fidelity and efficiency. However, it easily exhibits needle-like artifacts, especially when increasing the sampling rate.…

计算机视觉与模式识别 · 计算机科学 2024-10-16 Letian Huang , Jie Guo , Jialin Dan , Ruoyu Fu , Shujie Wang , Yuanqi Li , Yanwen Guo

Text-to-3D generation has recently garnered significant attention, fueled by 2D diffusion models trained on billions of image-text pairs. Existing methods primarily rely on score distillation to leverage the 2D diffusion priors to supervise…

计算机视觉与模式识别 · 计算机科学 2023-07-27 Chaohui Yu , Qiang Zhou , Jingliang Li , Zhe Zhang , Zhibin Wang , Fan Wang

Recent advances in text-to-3D generation have made significant progress. In particular, with the pretrained diffusion models, existing methods predominantly use Score Distillation Sampling (SDS) to train 3D models such as Neural RaRecent…

计算机视觉与模式识别 · 计算机科学 2024-10-10 Hangyu Li , Xiangxiang Chu , Dingyuan Shi , Wang Lin