中文
相关论文

相关论文: Let 2D Diffusion Model Know 3D-Consistency for Rob…

200 篇论文

Text-to-3D generation has achieved significant success by incorporating powerful 2D diffusion models, but insufficient 3D prior knowledge also leads to the inconsistency of 3D geometry. Recently, since large-scale multi-view datasets have…

计算机视觉与模式识别 · 计算机科学 2024-05-03 Junyoung Seo , Susung Hong , Wooseok Jang , Inès Hyeonsu Kim , Minseop Kwak , Doyup Lee , Seungryong Kim

Text-to-3D generation has recently garnered significant attention, fueled by 2D diffusion models trained on billions of image-text pairs. Existing methods primarily rely on score distillation to leverage the 2D diffusion priors to supervise…

计算机视觉与模式识别 · 计算机科学 2023-07-27 Chaohui Yu , Qiang Zhou , Jingliang Li , Zhe Zhang , Zhibin Wang , Fan Wang

Recent breakthroughs in text-to-image synthesis have been driven by diffusion models trained on billions of image-text pairs. Adapting this approach to 3D synthesis would require large-scale datasets of labeled 3D data and efficient…

计算机视觉与模式识别 · 计算机科学 2022-09-30 Ben Poole , Ajay Jain , Jonathan T. Barron , Ben Mildenhall

By lifting the pre-trained 2D diffusion models into Neural Radiance Fields (NeRFs), text-to-3D generation methods have made great progress. Many state-of-the-art approaches usually apply score distillation sampling (SDS) to optimize the…

计算机视觉与模式识别 · 计算机科学 2023-12-20 Yuze He , Yushi Bai , Matthieu Lin , Jenny Sheng , Yubin Hu , Qi Wang , Yu-Hui Wen , Yong-Jin Liu

Current 4D generation methods have achieved noteworthy efficacy with the aid of advanced diffusion generative models. However, these methods lack multi-view spatial-temporal modeling and encounter challenges in integrating diverse prior…

计算机视觉与模式识别 · 计算机科学 2024-10-23 Haiyu Zhang , Xinyuan Chen , Yaohui Wang , Xihui Liu , Yunhong Wang , Yu Qiao

Score distillation of 2D diffusion models has proven to be a powerful mechanism to guide 3D optimization, for example enabling text-based 3D generation or single-view reconstruction. A common limitation of existing score distillation…

计算机视觉与模式识别 · 计算机科学 2025-04-17 Yanbo Xu , Jayanth Srinivasa , Gaowen Liu , Shubham Tulsiani

Text-guided image generation has progressed rapidly in recent years, inspiring major breakthroughs in text-guided shape generation. Recently, it has been shown that using score distillation, one can successfully text-guide a NeRF model to…

计算机视觉与模式识别 · 计算机科学 2022-11-15 Gal Metzer , Elad Richardson , Or Patashnik , Raja Giryes , Daniel Cohen-Or

Recent advances in text-to-3D generation have made significant progress. In particular, with the pretrained diffusion models, existing methods predominantly use Score Distillation Sampling (SDS) to train 3D models such as Neural RaRecent…

计算机视觉与模式识别 · 计算机科学 2024-10-10 Hangyu Li , Xiangxiang Chu , Dingyuan Shi , Wang Lin

Recent advancements in 3D generation are predominantly propelled by improvements in 3D-aware image diffusion models. These models are pretrained on Internet-scale image data and fine-tuned on massive 3D data, offering the capability of…

计算机视觉与模式识别 · 计算机科学 2024-10-03 Zeyu Yang , Zijie Pan , Chun Gu , Li Zhang

We propose a unified framework aimed at enhancing the diffusion priors for 3D generation tasks. Despite the critical importance of these tasks, existing methodologies often struggle to generate high-caliber results. We begin by examining…

计算机视觉与模式识别 · 计算机科学 2023-12-11 Xiaofeng Yang , Yiwen Chen , Cheng Chen , Chi Zhang , Yi Xu , Xulei Yang , Fayao Liu , Guosheng Lin

We present Acc3D to tackle the challenge of accelerating the diffusion process to generate 3D models from single images. To derive high-quality reconstructions through few-step inferences, we emphasize the critical issue of regularizing the…

计算机视觉与模式识别 · 计算机科学 2025-03-21 Kendong Liu , Zhiyu Zhu , Hui Liu , Junhui Hou

In the realm of text-to-3D generation, utilizing 2D diffusion models through score distillation sampling (SDS) frequently leads to issues such as blurred appearances and multi-faced geometry, primarily due to the intrinsically noisy nature…

计算机视觉与模式识别 · 计算机科学 2023-12-06 Pengsheng Guo , Hans Hao , Adam Caccavale , Zhongzheng Ren , Edward Zhang , Qi Shan , Aditya Sankar , Alexander G. Schwing , Alex Colburn , Fangchang Ma

Score Distillation Sampling (SDS) has made significant strides in distilling image-generative models for 3D generation. However, its maximum-likelihood-seeking behavior often leads to degraded visual quality and diversity, limiting its…

计算机视觉与模式识别 · 计算机科学 2025-01-10 Runjie Yan , Yinbo Chen , Xiaolong Wang

Score Distillation Sampling (SDS) by well-trained 2D diffusion models has shown great promise in text-to-3D generation. However, this paradigm distills view-agnostic 2D image distributions into the rendering distribution of 3D…

计算机视觉与模式识别 · 计算机科学 2024-10-15 Chenhan Jiang , Yihan Zeng , Tianyang Hu , Songcun Xu , Wei Zhang , Hang Xu , Dit-Yan Yeung

Distilling pre-trained 2D diffusion models into 3D assets has driven remarkable advances in text-to-3D synthesis. However, existing methods typically rely on Score Distillation Sampling (SDS) loss, which involves asymmetric KL divergence--a…

计算机视觉与模式识别 · 计算机科学 2025-06-17 Weimin Bai , Yubo Li , Wenzheng Chen , Weijian Luo , He Sun

We present DreamCraft3D, a hierarchical 3D content generation method that produces high-fidelity and coherent 3D objects. We tackle the problem by leveraging a 2D reference image to guide the stages of geometry sculpting and texture…

计算机视觉与模式识别 · 计算机科学 2023-10-27 Jingxiang Sun , Bo Zhang , Ruizhi Shao , Lizhen Wang , Wen Liu , Zhenda Xie , Yebin Liu

While diffusion models have demonstrated remarkable progress in 2D image generation and editing, extending these capabilities to 3D editing remains challenging, particularly in maintaining multi-view consistency. Classical approaches…

计算机视觉与模式识别 · 计算机科学 2025-08-05 Yufeng Chi , Huimin Ma , Kafeng Wang , Jianmin Li

Most 3D generation research focuses on up-projecting 2D foundation models into the 3D space, either by minimizing 2D Score Distillation Sampling (SDS) loss or fine-tuning on multi-view datasets. Without explicit 3D priors, these methods…

计算机视觉与模式识别 · 计算机科学 2023-12-11 Lihe Ding , Shaocong Dong , Zhanpeng Huang , Zibin Wang , Yiyuan Zhang , Kaixiong Gong , Dan Xu , Tianfan Xue

Reconstructing 3D objects from extremely sparse views is a long-standing and challenging problem. While recent techniques employ image diffusion models for generating plausible images at novel viewpoints or for distilling pre-trained…

计算机视觉与模式识别 · 计算机科学 2023-12-21 Zi-Xin Zou , Weihao Cheng , Yan-Pei Cao , Shi-Sheng Huang , Ying Shan , Song-Hai Zhang

Diffusion models achieve high-quality image generation but are limited by slow iterative sampling. Distillation methods alleviate this by enabling one- or few-step generation. Flow matching, originally introduced as a distinct framework,…

计算机视觉与模式识别 · 计算机科学 2025-12-04 Mingyuan Zhou , Yi Gu , Huangjie Zheng , Liangchen Song , Guande He , Yizhe Zhang , Wenze Hu , Yinfei Yang
‹ 上一页 1 2 3 10 下一页 ›