中文
相关论文

相关论文: Efficient Text-Guided 3D-Aware Portrait Generation…

200 篇论文

By leveraging the text-to-image diffusion priors, score distillation can synthesize 3D contents without paired text-3D training data. Instead of spending hours of online optimization per text prompt, recent studies have been focused on…

计算机视觉与模式识别 · 计算机科学 2024-07-03 Zhiyuan Ma , Yuxiang Wei , Yabin Zhang , Xiangyu Zhu , Zhen Lei , Lei Zhang

Most text-to-3D generators build upon off-the-shelf text-to-image models trained on billions of images. They use variants of Score Distillation Sampling (SDS), which is slow, somewhat unstable, and prone to artifacts. A mitigation is to…

计算机视觉与模式识别 · 计算机科学 2024-02-14 Luke Melas-Kyriazi , Iro Laina , Christian Rupprecht , Natalia Neverova , Andrea Vedaldi , Oran Gafni , Filippos Kokkinos

Efficiently generating a freestyle 3D portrait with high quality and 3D-consistency is a promising yet challenging task. The portrait styles generated by most existing methods are usually restricted by their 3D generators, which are learned…

计算机视觉与模式识别 · 计算机科学 2023-12-27 Tianxiang Ma , Kang Zhao , Jianxin Sun , Yingya Zhang , Jing Dong

In the evolving landscape of text-to-3D technology, Dreamfusion has showcased its proficiency by utilizing Score Distillation Sampling (SDS) to optimize implicit representations such as NeRF. This process is achieved through the…

计算机视觉与模式识别 · 计算机科学 2024-06-17 Yuzhong Huang , Zhong Li , Zhang Chen , Zhiyuan Ren , Guosheng Lin , Fred Morstatter , Yi Xu

Recently, text-to-image generation has exhibited remarkable advancements, with the ability to produce visually impressive results. In contrast, text-to-3D generation has not yet reached a comparable level of quality. Existing methods…

计算机视觉与模式识别 · 计算机科学 2023-08-21 Yukang Cao , Yan-Pei Cao , Kai Han , Ying Shan , Kwan-Yee K. Wong

Text-to-3D generation has made remarkable progress recently, particularly with methods based on Score Distillation Sampling (SDS) that leverages pre-trained 2D diffusion models. While the usage of classifier-free guidance is well…

计算机视觉与模式识别 · 计算机科学 2023-11-01 Xin Yu , Yuan-Chen Guo , Yangguang Li , Ding Liang , Song-Hai Zhang , Xiaojuan Qi

Score Distillation Sampling (SDS) by well-trained 2D diffusion models has shown great promise in text-to-3D generation. However, this paradigm distills view-agnostic 2D image distributions into the rendering distribution of 3D…

计算机视觉与模式识别 · 计算机科学 2024-10-15 Chenhan Jiang , Yihan Zeng , Tianyang Hu , Songcun Xu , Wei Zhang , Hang Xu , Dit-Yan Yeung

Text-guided domain adaptation and generation of 3D-aware portraits find many applications in various fields. However, due to the lack of training data and the challenges in handling the high variety of geometry and appearance, the existing…

计算机视觉与模式识别 · 计算机科学 2024-04-15 Biwen Lei , Kai Yu , Mengyang Feng , Miaomiao Cui , Xuansong Xie

We present Acc3D to tackle the challenge of accelerating the diffusion process to generate 3D models from single images. To derive high-quality reconstructions through few-step inferences, we emphasize the critical issue of regularizing the…

计算机视觉与模式识别 · 计算机科学 2025-03-21 Kendong Liu , Zhiyu Zhu , Hui Liu , Junhui Hou

Recently, the impressive generative capabilities of diffusion models have been demonstrated, producing images with remarkable fidelity. Particularly, existing methods for the 3D object generation tasks, which is one of the fastest-growing…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Jaeseok Lee , Jaekoo Lee

Score Distillation Sampling (SDS) is a recent but already widely popular method that relies on an image diffusion model to control optimization problems using text prompts. In this paper, we conduct an in-depth analysis of the SDS loss…

计算机视觉与模式识别 · 计算机科学 2024-07-08 Thiemo Alldieck , Nikos Kolotouros , Cristian Sminchisescu

Recent innovations on text-to-3D generation have featured Score Distillation Sampling (SDS), which enables the zero-shot learning of implicit 3D models (NeRF) by directly distilling prior knowledge from 2D diffusion models. However, current…

计算机视觉与模式识别 · 计算机科学 2024-03-26 Yang Chen , Yingwei Pan , Haibo Yang , Ting Yao , Tao Mei

Text-to-3D synthesis has recently emerged as a new approach to sampling 3D models by adopting pretrained text-to-image models as guiding visual priors. An intriguing but underexplored problem with existing text-to-3D methods is that 3D…

计算机视觉与模式识别 · 计算机科学 2024-07-18 Uy Dieu Tran , Minh Luu , Phong Ha Nguyen , Khoi Nguyen , Binh-Son Hua

The extensive amounts of data required for training deep neural networks pose significant challenges on storage and transmission fronts. Dataset distillation has emerged as a promising technique to condense the information of massive…

计算机视觉与模式识别 · 计算机科学 2024-03-13 Ali Abbasi , Ashkan Shahbazi , Hamed Pirsiavash , Soheil Kolouri

Witnessing the evolution of text-to-image diffusion models, significant strides have been made in text-to-3D generation. Currently, two primary paradigms dominate the field of text-to-3D: the feed-forward generation solutions, capable of…

计算机视觉与模式识别 · 计算机科学 2026-05-05 Yonghao Yu , Shunan Zhu , Huai Qin , Haorui Li

Score distillation sampling is an effective technique to generate 3D models from text prompts, utilizing pre-trained large-scale text-to-image diffusion models as guidance. However, the produced 3D assets tend to be over-saturating,…

计算机视觉与模式识别 · 计算机科学 2025-08-25 Khoi Do , Binh-Son Hua

Text-guided diffusion models have shown superior performance in image/video generation and editing. While few explorations have been performed in 3D scenarios. In this paper, we discuss three fundamental and interesting problems on this…

计算机视觉与模式识别 · 计算机科学 2023-10-13 Gang Li , Heliang Zheng , Chaoyue Wang , Chang Li , Changwen Zheng , Dacheng Tao

In this paper, we propose an effective two-stage approach named Grounded-Dreamer to generate 3D assets that can accurately follow complex, compositional text prompts while achieving high fidelity by using a pre-trained multi-view diffusion…

计算机视觉与模式识别 · 计算机科学 2024-04-30 Xiaolong Li , Jiawei Mo , Ying Wang , Chethan Parameshwara , Xiaohan Fei , Ashwin Swaminathan , CJ Taylor , Zhuowen Tu , Paolo Favaro , Stefano Soatto

Although recent advancements in text-to-3D generation have significantly improved generation quality, issues like limited level of detail and low fidelity still persist, which requires further improvement. To understand the essence of those…

计算机视觉与模式识别 · 计算机科学 2024-07-23 Zongrui Li , Minghui Hu , Qian Zheng , Xudong Jiang

Score distillation sampling (SDS) has emerged as an effective framework in text-driven 3D editing tasks, leveraging diffusion models for 3D-consistent editing. However, existing SDS-based 3D editing methods suffer from long training times…

计算机视觉与模式识别 · 计算机科学 2025-02-12 Jiwook Kim , Seonho Lee , Jaeyo Shin , Jiho Choi , Hyunjung Shim