English
Related papers

Related papers: Geometry-Aware Score Distillation via 3D Consisten…

200 papers

Recent advances in text-to-3D generation have made significant progress. In particular, with the pretrained diffusion models, existing methods predominantly use Score Distillation Sampling (SDS) to train 3D models such as Neural RaRecent…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Hangyu Li , Xiangxiang Chu , Dingyuan Shi , Wang Lin

Distilling pre-trained 2D diffusion models into 3D assets has driven remarkable advances in text-to-3D synthesis. However, existing methods typically rely on Score Distillation Sampling (SDS) loss, which involves asymmetric KL divergence--a…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Weimin Bai , Yubo Li , Wenzheng Chen , Weijian Luo , He Sun

Text-to-3D is an emerging task that allows users to create 3D content with infinite possibilities. Existing works tackle the problem by optimizing a 3D representation with guidance from pre-trained diffusion models. An apparent drawback is…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Yiji Cheng , Fei Yin , Xiaoke Huang , Xintong Yu , Jiaxiang Liu , Shikun Feng , Yujiu Yang , Yansong Tang

Text-guided image and 3D editing have advanced with diffusion-based models, yet methods like Delta Denoising Score often struggle with stability, spatial control, and editing strength. These limitations stem from reliance on complex…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Haiming Zhu , Yangyang Xu , Chenshu Xu , Tingrui Shen , Wenxi Liu , Yong Du , Jun Yu , Shengfeng He

Score distillation sampling (SDS) demonstrates a powerful capability for text-conditioned 2D image and 3D object generation by distilling the knowledge from learned score functions. However, SDS often suffers from blurriness caused by noisy…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 SeonHwa Kim , Jiwon Kim , Soobin Park , Donghoon Ahn , Jiwon Kang , Seungryong Kim , Kyong Hwan Jin , Eunju Cha

Text-to-3D generation based on score distillation of pre-trained 2D diffusion models has gained increasing interest, with variational score distillation (VSD) as a remarkable example. VSD proves that vanilla score distillation can be…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Yu Lei , Bingde Liu , Qingsong Xie , Haonan Lu , Zhijie Deng

Recent breakthroughs in text-to-4D generation rely on pre-trained text-to-image and text-to-video models to generate dynamic 3D scenes. However, current text-to-4D methods face a three-way tradeoff between the quality of scene appearance,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Sherwin Bahmani , Ivan Skorokhodov , Victor Rong , Gordon Wetzstein , Leonidas Guibas , Peter Wonka , Sergey Tulyakov , Jeong Joon Park , Andrea Tagliasacchi , David B. Lindell

Existing score distillation methods are sensitive to classifier-free guidance (CFG) scale: manifested as over-smoothness or instability at small CFG scales, while over-saturation at large ones. To explain and analyze these issues, we…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Min Wei , Jingkai Zhou , Junyao Sun , Xuesong Zhang

Recent one image to 3D generation methods commonly adopt Score Distillation Sampling (SDS). Despite the impressive results, there are multiple deficiencies including multi-view inconsistency, over-saturated and over-smoothed textures, as…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Junwu Zhang , Zhenyu Tang , Yatian Pang , Xinhua Cheng , Peng Jin , Yida Wei , Munan Ning , Li Yuan

Human preference alignment presents a critical yet underexplored challenge for diffusion models in text-to-3D generation. Existing solutions typically require task-specific fine-tuning, posing significant hurdles in data-scarce 3D domains.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Jiaqi Leng , Shuyuan Tu , Haidong Cao , Sicheng Xie , Daoguo Dong , Zuxuan Wu , Yu-Gang Jiang

Score Distillation Sampling (SDS) and its variants have been widely used for text-to-3D generation by distilling 2D image diffusion priors. However, the standard SDS objective is prone to severe mode collapse, frequently yielding…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Rohith Ramanan , A. N. Rajagopalan

The increased demand for 3D data in AR/VR, robotics and gaming applications, gave rise to powerful generative pipelines capable of synthesizing high-quality 3D objects. Most of these models rely on the Score Distillation Sampling (SDS)…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Ziyu Wan , Despoina Paschalidou , Ian Huang , Hongyu Liu , Bokui Shen , Xiaoyu Xiang , Jing Liao , Leonidas Guibas

3D semantic scene understanding is essential for digital twins, autonomous driving, smart agriculture, and embodied perception, yet dense point-wise annotation for point clouds remains expensive and difficult to scale. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Yijing Wang , Ruonan Li , Qilin Wang , Rongqiang Zhao , Jie Liu

Generating realistic 3D objects from single-view images requires natural appearance, 3D consistency, and the ability to capture multiple plausible interpretations of unseen regions. Existing approaches often rely on fine-tuning pretrained…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Pufan Li , Bi'an Du , Wei Hu

Text-based 2D diffusion models have demonstrated impressive capabilities in image generation and editing. Meanwhile, the 2D diffusion models also exhibit substantial potentials for 3D editing tasks. However, how to achieve consistent edits…

Computer Vision and Pattern Recognition · Computer Science 2024-06-26 Ruihuang Li , Liyi Chen , Zhengqiang Zhang , Varun Jampani , Vishal M. Patel , Lei Zhang

Recent progress in text-to-3D object generation enables the synthesis of detailed geometry from text input by leveraging 2D diffusion models and differentiable 3D representations. However, the approaches often suffer from limited…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Ming He , Zhixiang Chen , Steve Maddock

Creating 3D content from single-view images is a challenging problem that has attracted considerable attention in recent years. Current approaches typically utilize score distillation sampling (SDS) from pre-trained 2D diffusion models to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Junbang Liu , Enpei Huang , Dongxing Mao , Hui Zhang , Xinyuan Song , Yongxin Ni

Recent text-guided generation of individual 3D object has achieved great success using diffusion priors. However, these methods are not suitable for object insertion and replacement tasks as they do not consider the background, leading to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Hanyuan Xiao , Yingshu Chen , Huajian Huang , Haolin Xiong , Jing Yang , Pratusha Prasad , Yajie Zhao

Knowledge distillation is the process of transferring knowledge from a more powerful large model (teacher) to a simpler counterpart (student). Numerous current approaches involve the student imitating the knowledge of the teacher directly.…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Zhaoge Liu , Xiaohao Xu , Yunkang Cao , Weiming Shen

Current text-to-3D generation methods based on score distillation often suffer from geometric inconsistencies, leading to repeated patterns across different poses of 3D assets. This issue, known as the Multi-Face Janus problem, arises…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Chenxi Zheng , Yihong Lin , Bangzhen Liu , Xuemiao Xu , Yongwei Nie , Shengfeng He