中文
相关论文

相关论文: DiverseDream: Diverse Text-to-3D Synthesis with Au…

200 篇论文

Recent methods in text-to-3D leverage powerful pretrained diffusion models to optimize NeRF. Notably, these methods are able to produce high-quality 3D scenes without training on 3D data. Due to the open-ended nature of the task, most…

计算机视觉与模式识别 · 计算机科学 2024-04-18 Yuze He , Yushi Bai , Matthieu Lin , Wang Zhao , Yubin Hu , Jenny Sheng , Ran Yi , Juanzi Li , Yong-Jin Liu

In recent years, advancements in generative models have significantly expanded the capabilities of text-to-3D generation. Many approaches rely on Score Distillation Sampling (SDS) technology. However, SDS struggles to accommodate…

计算机视觉与模式识别 · 计算机科学 2024-11-01 Jiahui Yang , Donglin Di , Baorui Ma , Xun Yang , Yongjia Ma , Wenzhang Sun , Wei Chen , Jianxun Cui , Zhou Xue , Meng Wang , Yebin Liu

Witnessing the evolution of text-to-image diffusion models, significant strides have been made in text-to-3D generation. Currently, two primary paradigms dominate the field of text-to-3D: the feed-forward generation solutions, capable of…

计算机视觉与模式识别 · 计算机科学 2026-05-05 Yonghao Yu , Shunan Zhu , Huai Qin , Haorui Li

Recently, diffusion-based deep generative models (e.g., Stable Diffusion) have shown impressive results in text-to-image synthesis. However, current text-to-image models often require multiple passes of prompt engineering by humans in order…

计算与语言 · 计算机科学 2023-11-14 Tingfeng Cao , Chengyu Wang , Bingyan Liu , Ziheng Wu , Jinhui Zhu , Jun Huang

Recently, the text-to-3D task has developed rapidly due to the appearance of the SDS method. However, the SDS method always generates 3D objects with poor quality due to the over-smooth issue. This issue is attributed to two factors: 1) the…

计算机视觉与模式识别 · 计算机科学 2025-01-07 Yiming Zhong , Xiaolin Zhang , Yao Zhao , Yunchao Wei

Score distillation sampling (SDS) has shown great promise in text-to-3D generation by distilling pretrained large-scale text-to-image diffusion models, but suffers from over-saturation, over-smoothing, and low-diversity problems. In this…

机器学习 · 计算机科学 2023-11-23 Zhengyi Wang , Cheng Lu , Yikai Wang , Fan Bao , Chongxuan Li , Hang Su , Jun Zhu

Recent advances in text-to-3D generation have made significant progress. In particular, with the pretrained diffusion models, existing methods predominantly use Score Distillation Sampling (SDS) to train 3D models such as Neural RaRecent…

计算机视觉与模式识别 · 计算机科学 2024-10-10 Hangyu Li , Xiangxiang Chu , Dingyuan Shi , Wang Lin

The emergence of virtual reality has necessitated the generation of detailed and customizable 3D hand models for interaction in the virtual world. However, the current methods for 3D hand model generation are both expensive and cumbersome,…

计算机视觉与模式识别 · 计算机科学 2026-04-07 Green Rosh , Prateek Kukreja , Vishakha SR , Pawan Prasad B H

Score distillation sampling (SDS) and its variants have greatly boosted the development of text-to-3D generation, but are vulnerable to geometry collapse and poor textures yet. To solve this issue, we first deeply analyze the SDS and find…

计算机视觉与模式识别 · 计算机科学 2024-06-14 Zike Wu , Pan Zhou , Xuanyu Yi , Xiaoding Yuan , Hanwang Zhang

Large-scale text-to-image diffusion models have achieved great success in synthesizing high-quality and diverse images given target text prompts. Despite the revolutionary image generation ability, current state-of-the-art models still…

计算机视觉与模式识别 · 计算机科学 2025-01-20 Jingyuan Zhu , Huimin Ma , Jiansheng Chen , Jian Yuan

Scene text synthesis involves rendering specified texts onto arbitrary images. Current methods typically formulate this task in an end-to-end manner but lack effective character-level guidance during training. Besides, their text encoders,…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Yibin Wang , Weizhong Zhang , Honghui Xu , Cheng Jin

In this paper, we study Text-to-3D content generation leveraging 2D diffusion priors to enhance the quality and detail of the generated 3D models. Recent progress (Magic3D) in text-to-3D has shown that employing high-resolution (e.g., 512 x…

计算机视觉与模式识别 · 计算机科学 2023-08-01 Jinbo Wu , Xiaobo Gao , Xing Liu , Zhengyang Shen , Chen Zhao , Haocheng Feng , Jingtuo Liu , Errui Ding

Text-to-3D generation aims to create 3D assets from text-to-image diffusion models. However, existing methods face an inherent bottleneck in generation quality because the widely-used objectives such as Score Distillation Sampling (SDS)…

计算机视觉与模式识别 · 计算机科学 2024-06-24 Zixuan Chen , Ruijie Su , Jiahao Zhu , Lingxiao Yang , Jian-Huang Lai , Xiaohua Xie

3D content creation plays a vital role in various applications, such as gaming, robotics simulation, and virtual reality. However, the process is labor-intensive and time-consuming, requiring skilled designers to invest considerable effort…

计算机视觉与模式识别 · 计算机科学 2024-05-16 Chenhan Jiang

Text-to-3D generation by distilling pretrained large-scale text-to-image diffusion models has shown great promise but still suffers from inconsistent 3D geometric structures (Janus problems) and severe artifacts. The aforementioned problems…

计算机视觉与模式识别 · 计算机科学 2023-12-05 Baorui Ma , Haoge Deng , Junsheng Zhou , Yu-Shen Liu , Tiejun Huang , Xinlong Wang

The popularization of Text-to-Image (T2I) diffusion models enables the generation of high-quality images from text descriptions. However, generating diverse customized images with reference visual attributes remains challenging. This work…

计算机视觉与模式识别 · 计算机科学 2025-04-22 Brian Nlong Zhao , Yuhang Xiao , Jiashu Xu , Xinyang Jiang , Yifan Yang , Dongsheng Li , Laurent Itti , Vibhav Vineet , Yunhao Ge

Score Distillation Sampling (SDS) by well-trained 2D diffusion models has shown great promise in text-to-3D generation. However, this paradigm distills view-agnostic 2D image distributions into the rendering distribution of 3D…

计算机视觉与模式识别 · 计算机科学 2024-10-15 Chenhan Jiang , Yihan Zeng , Tianyang Hu , Songcun Xu , Wei Zhang , Hang Xu , Dit-Yan Yeung

Text-to-image generation models have seen considerable advancement, catering to the increasing interest in personalized image creation. Current customization techniques often necessitate users to provide multiple images (typically 3-5) for…

计算机视觉与模式识别 · 计算机科学 2024-05-28 Linhao Zhong , Yan Hong , Wentao Chen , Binglin Zhou , Yiyi Zhang , Jianfu Zhang , Liqing Zhang

Text-to-3D synthesis has recently seen intriguing advances by combining the text-to-image priors with 3D representation methods, e.g., 3D Gaussian Splatting (3D GS), via Score Distillation Sampling (SDS). However, a hurdle of existing…

计算机视觉与模式识别 · 计算机科学 2024-11-19 Lutao Jiang , Xu Zheng , Yuanhuiyi Lyu , Jiazhou Zhou , Lin Wang

Recent breakthroughs in text-to-image generation has shown encouraging results via large generative models. Due to the scarcity of 3D assets, it is hardly to transfer the success of text-to-image generation to that of text-to-3D generation.…

计算机视觉与模式识别 · 计算机科学 2023-11-28 Yiming Chen , Zhiqi Li , Peidong Liu