中文
相关论文

相关论文: RecDreamer: Consistent Text-to-3D Generation via U…

200 篇论文

Recent strides in Text-to-3D techniques have been propelled by distilling knowledge from powerful large text-to-image diffusion models (LDMs). Nonetheless, existing Text-to-3D approaches often grapple with challenges such as…

计算机视觉与模式识别 · 计算机科学 2023-08-23 Yiwen Chen , Chi Zhang , Xiaofeng Yang , Zhongang Cai , Gang Yu , Lei Yang , Guosheng Lin

We present DreamCraft3D, a hierarchical 3D content generation method that produces high-fidelity and coherent 3D objects. We tackle the problem by leveraging a 2D reference image to guide the stages of geometry sculpting and texture…

计算机视觉与模式识别 · 计算机科学 2023-10-27 Jingxiang Sun , Bo Zhang , Ruizhi Shao , Lizhen Wang , Wen Liu , Zhenda Xie , Yebin Liu

The field of text-to-3D content generation has made significant progress in generating realistic 3D objects, with existing methodologies like Score Distillation Sampling (SDS) offering promising guidance. However, these methods often…

计算机视觉与模式识别 · 计算机科学 2024-09-11 Phu Pham , Aradhya N. Mathur , Ojaswa Sharma , Aniket Bera

Due to the fascinating generative performance of text-to-image diffusion models, growing text-to-3D generation works explore distilling the 2D generative priors into 3D, using the score distillation sampling (SDS) loss, to bypass the data…

计算机视觉与模式识别 · 计算机科学 2024-07-18 Yu-Jie Yuan , Leif Kobbelt , Jiwen Liu , Yuan Zhang , Pengfei Wan , Yu-Kun Lai , Lin Gao

We present Acc3D to tackle the challenge of accelerating the diffusion process to generate 3D models from single images. To derive high-quality reconstructions through few-step inferences, we emphasize the critical issue of regularizing the…

计算机视觉与模式识别 · 计算机科学 2025-03-21 Kendong Liu , Zhiyu Zhu , Hui Liu , Junhui Hou

Recent methods such as Score Distillation Sampling (SDS) and Variational Score Distillation (VSD) using 2D diffusion models for text-to-3D generation have demonstrated impressive generation quality. However, the long generation time of such…

计算机视觉与模式识别 · 计算机科学 2024-05-21 Linqi Zhou , Andy Shih , Chenlin Meng , Stefano Ermon

Generating multi-view images from a single input view using image-conditioned diffusion models is a recent advancement and has shown considerable potential. However, issues such as the lack of consistency in synthesized views and…

计算机视觉与模式识别 · 计算机科学 2025-05-14 Youjia Zhang , Zikai Song , Junqing Yu , Yawei Luo , Wei Yang

Text-to-3D generation based on diffusion models often suffers from the Janus problem, leading to inconsistent geometry across viewpoints. This work identifies viewpoint bias in 2D diffusion priors as the main cause and proposes Structural…

计算机视觉与模式识别 · 计算机科学 2026-05-20 Qing Zhang , Jinguang Tong , Jing Zhang , Jie Hong , Xuesong Li

While 2D diffusion models generate realistic, high-detail images, 3D shape generation methods like Score Distillation Sampling (SDS) built on these 2D diffusion models produce cartoon-like, over-smoothed shapes. To help explain this…

There is a rapidly growing interest in controlling consistency across multiple generated images using diffusion models. Among various methods, recent works have found that simply manipulating attention modules by concatenating features from…

计算机视觉与模式识别 · 计算机科学 2024-05-29 Jiaojiao Fan , Haotian Xue , Qinsheng Zhang , Yongxin Chen

Reverse sampling and score-distillation have emerged as main workhorses in recent years for image manipulation using latent diffusion models (LDMs). While reverse diffusion sampling often requires adjustments of LDM architecture or feature…

计算机视觉与模式识别 · 计算机科学 2024-09-24 Jeongsol Kim , Geon Yeong Park , Jong Chul Ye

Advances in 3D generation have facilitated sequential 3D model generation (a.k.a 4D generation), yet its application for animatable objects with large motion remains scarce. Our work proposes AnimatableDreamer, a text-to-4D generation…

计算机视觉与模式识别 · 计算机科学 2024-03-29 Xinzhou Wang , Yikai Wang , Junliang Ye , Zhengyi Wang , Fuchun Sun , Pengkun Liu , Ling Wang , Kai Sun , Xintong Wang , Bin He

Text-guided diffusion models have shown superior performance in image/video generation and editing. While few explorations have been performed in 3D scenarios. In this paper, we discuss three fundamental and interesting problems on this…

计算机视觉与模式识别 · 计算机科学 2023-10-13 Gang Li , Heliang Zheng , Chaoyue Wang , Chang Li , Changwen Zheng , Dacheng Tao

We introduce DreamPolish, a text-to-3D generation model that excels in producing refined geometry and high-quality textures. In the geometry construction phase, our approach leverages multiple neural representations to enhance the stability…

计算机视觉与模式识别 · 计算机科学 2024-11-05 Yean Cheng , Ziqi Cai , Ming Ding , Wendi Zheng , Shiyu Huang , Yuxiao Dong , Jie Tang , Boxin Shi

Existing neural rendering-based text-to-3D-portrait generation methods typically make use of human geometry prior and diffusion models to obtain guidance. However, relying solely on geometry information introduces issues such as the Janus…

计算机视觉与模式识别 · 计算机科学 2024-04-17 Yiqian Wu , Hao Xu , Xiangjun Tang , Xien Chen , Siyu Tang , Zhebin Zhang , Chen Li , Xiaogang Jin

Score distillation sampling (SDS) and its variants have greatly boosted the development of text-to-3D generation, but are vulnerable to geometry collapse and poor textures yet. To solve this issue, we first deeply analyze the SDS and find…

计算机视觉与模式识别 · 计算机科学 2024-06-14 Zike Wu , Pan Zhou , Xuanyu Yi , Xiaoding Yuan , Hanwang Zhang

3D generation has rapidly accelerated in the past decade owing to the progress in the field of generative modeling. Score Distillation Sampling (SDS) based rendering has improved 3D asset generation to a great extent. Further, the recent…

计算机视觉与模式识别 · 计算机科学 2023-12-11 Aradhya N. Mathur , Phu Pham , Aniket Bera , Ojaswa Sharma

Recent progress in text-to-3D generation has been achieved through the utilization of score distillation methods: they make use of the pre-trained text-to-image (T2I) diffusion models by distilling via the diffusion model training…

计算机视觉与模式识别 · 计算机科学 2024-03-25 Kyungmin Lee , Kihyuk Sohn , Jinwoo Shin

Acquiring labeled datasets for 3D human mesh estimation is challenging due to depth ambiguities and the inherent difficulty of annotating 3D geometry from monocular images. Existing datasets are either real, with manually annotated 3D…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Lorenza Prospero , Orest Kupyn , Ostap Viniavskyi , João F. Henriques , Christian Rupprecht

Generative models, particularly diffusion models, have made significant success in data synthesis across various modalities, including images, videos, and 3D assets. However, current diffusion models are computationally intensive, often…

计算机视觉与模式识别 · 计算机科学 2024-12-10 Yuanzhi Zhu , Hanshu Yan , Huan Yang , Kai Zhang , Junnan Li