中文
相关论文

相关论文: StableDreamer: Taming Noisy Score Distillation Sam…

200 篇论文

Recent advances in diffusion models have significantly improved 3D generation, enabling the use of assets generated from an image for embodied AI simulations. However, the one-to-many nature of the image-to-3D problem limits their use due…

计算机视觉与模式识别 · 计算机科学 2025-02-26 Onat Şahin , Mohammad Altillawi , George Eskandar , Carlos Carbone , Ziyuan Liu

Witnessing the evolution of text-to-image diffusion models, significant strides have been made in text-to-3D generation. Currently, two primary paradigms dominate the field of text-to-3D: the feed-forward generation solutions, capable of…

计算机视觉与模式识别 · 计算机科学 2026-05-05 Yonghao Yu , Shunan Zhu , Huai Qin , Haorui Li

We present a novel method for 3D surface reconstruction from multiple images where only a part of the object of interest is captured. Our approach builds on two recent developments: surface reconstruction using neural radiance fields for…

计算机视觉与模式识别 · 计算机科学 2023-12-11 Savva Ignatyev , Daniil Selikhanovych , Oleg Voynov , Yiqun Wang , Peter Wonka , Stamatios Lefkimmiatis , Evgeny Burnaev

Generating high-quality 3D assets from textual descriptions remains a pivotal challenge in computer graphics and vision research. Due to the scarcity of 3D data, state-of-the-art approaches utilize pre-trained 2D diffusion priors, optimized…

计算机视觉与模式识别 · 计算机科学 2024-10-14 Ling Yang , Zixiang Zhang , Junlin Han , Bohan Zeng , Runjia Li , Philip Torr , Wentao Zhang

By lifting the pre-trained 2D diffusion models into Neural Radiance Fields (NeRFs), text-to-3D generation methods have made great progress. Many state-of-the-art approaches usually apply score distillation sampling (SDS) to optimize the…

计算机视觉与模式识别 · 计算机科学 2023-12-20 Yuze He , Yushi Bai , Matthieu Lin , Jenny Sheng , Yubin Hu , Qi Wang , Yu-Hui Wen , Yong-Jin Liu

Text-guided image and 3D editing have advanced with diffusion-based models, yet methods like Delta Denoising Score often struggle with stability, spatial control, and editing strength. These limitations stem from reliance on complex…

计算机视觉与模式识别 · 计算机科学 2025-07-15 Haiming Zhu , Yangyang Xu , Chenshu Xu , Tingrui Shen , Wenxi Liu , Yong Du , Jun Yu , Shengfeng He

Score Distillation Sampling (SDS) has emerged as a prevalent technique for text-to-3D generation, enabling 3D content creation by distilling view-dependent information from text-to-2D guidance. However, they frequently exhibit shortcomings…

计算机视觉与模式识别 · 计算机科学 2024-09-20 Zeyu Cai , Duotun Wang , Yixun Liang , Zhijing Shao , Ying-Cong Chen , Xiaohang Zhan , Zeyu Wang

This paper proposes ConsistDreamer - a novel framework that lifts 2D diffusion models with 3D awareness and 3D consistency, thus enabling high-fidelity instruction-guided scene editing. To overcome the fundamental limitation of missing 3D…

计算机视觉与模式识别 · 计算机科学 2024-06-14 Jun-Kun Chen , Samuel Rota Bulò , Norman Müller , Lorenzo Porzi , Peter Kontschieder , Yu-Xiong Wang

Recently, text-to-3D generation has attracted significant attention, resulting in notable performance enhancements. Previous methods utilize end-to-end 3D generation models to initialize 3D Gaussians, multi-view diffusion models to enforce…

计算机视觉与模式识别 · 计算机科学 2024-07-22 Shuo Huang , Shikun Sun , Zixuan Wang , Xiaoyu Qin , Yanmin Xiong , Yuan Zhang , Pengfei Wan , Di Zhang , Jia Jia

Score Distillation Sampling (SDS) has achieved remarkable success in text-to-3D content generation. However, SDS-based methods struggle to maintain semantic fidelity for user prompts, particularly when involving multiple objects with…

计算机视觉与模式识别 · 计算机科学 2025-08-14 Chenhan Jiang , Yihan Zeng , Dit-Yan Yeung

Reconstructing 3D objects from extremely sparse views is a long-standing and challenging problem. While recent techniques employ image diffusion models for generating plausible images at novel viewpoints or for distilling pre-trained…

计算机视觉与模式识别 · 计算机科学 2023-12-21 Zi-Xin Zou , Weihao Cheng , Yan-Pei Cao , Shi-Sheng Huang , Ying Shan , Song-Hai Zhang

3D Gaussian Splatting (3DGS) has recently gained great attention in the 3D scene representation for its high-quality real-time rendering capabilities. However, when the input comprises sparse training views, 3DGS is prone to overfitting,…

计算机视觉与模式识别 · 计算机科学 2025-11-17 Ruocheng Wu , Haolan He , Yufei Wang , Zhihao Li , Bihan Wen

Score distillation of 2D diffusion models has proven to be a powerful mechanism to guide 3D optimization, for example enabling text-based 3D generation or single-view reconstruction. A common limitation of existing score distillation…

计算机视觉与模式识别 · 计算机科学 2025-04-17 Yanbo Xu , Jayanth Srinivasa , Gaowen Liu , Shubham Tulsiani

Score Distillation Sampling (SDS) has emerged as the de facto approach for text-to-content generation in non-image domains. In this paper, we reexamine the SDS process and introduce a straightforward interpretation that demystifies the…

计算机视觉与模式识别 · 计算机科学 2023-10-27 Oren Katzir , Or Patashnik , Daniel Cohen-Or , Dani Lischinski

Score Distillation Sampling (SDS) has made significant strides in distilling image-generative models for 3D generation. However, its maximum-likelihood-seeking behavior often leads to degraded visual quality and diversity, limiting its…

计算机视觉与模式识别 · 计算机科学 2025-01-10 Runjie Yan , Yinbo Chen , Xiaolong Wang

Text-to-3D is an emerging task that allows users to create 3D content with infinite possibilities. Existing works tackle the problem by optimizing a 3D representation with guidance from pre-trained diffusion models. An apparent drawback is…

计算机视觉与模式识别 · 计算机科学 2023-06-06 Yiji Cheng , Fei Yin , Xiaoke Huang , Xintong Yu , Jiaxiang Liu , Shikun Feng , Yujiu Yang , Yansong Tang

Diffusion models, such as Stable Diffusion, have shown incredible performance on text-to-image generation. Since text-to-image generation often requires models to generate visual concepts with fine-grained details and attributes specified…

计算机视觉与模式识别 · 计算机科学 2024-04-26 Xuehai He , Weixi Feng , Tsu-Jui Fu , Varun Jampani , Arjun Akula , Pradyumna Narayana , Sugato Basu , William Yang Wang , Xin Eric Wang

In the evolving landscape of text-to-3D technology, Dreamfusion has showcased its proficiency by utilizing Score Distillation Sampling (SDS) to optimize implicit representations such as NeRF. This process is achieved through the…

计算机视觉与模式识别 · 计算机科学 2024-06-17 Yuzhong Huang , Zhong Li , Zhang Chen , Zhiyuan Ren , Guosheng Lin , Fred Morstatter , Yi Xu

Diffusion models have achieved remarkable success in generating high-resolution, realistic images across diverse natural distributions. However, their performance heavily relies on high-quality training data, making it challenging to learn…

机器学习 · 计算机科学 2025-05-22 Tianyu Chen , Yasi Zhang , Zhendong Wang , Ying Nian Wu , Oscar Leong , Mingyuan Zhou

Recent breakthroughs in text-to-4D generation rely on pre-trained text-to-image and text-to-video models to generate dynamic 3D scenes. However, current text-to-4D methods face a three-way tradeoff between the quality of scene appearance,…