中文
相关论文

相关论文: VP3D: Unleashing 2D Visual Prompt for Text-to-3D G…

200 篇论文

Novel view synthesis under sparse views has been a long-term important challenge in 3D reconstruction. Existing works mainly rely on introducing external semantic or depth priors to supervise the optimization of 3D representations. However,…

计算机视觉与模式识别 · 计算机科学 2024-12-04 Qisen Wang , Yifan Zhao , Jiawei Ma , Jia Li

Recent advances in generative AI have unveiled significant potential for the creation of 3D content. However, current methods either apply a pre-trained 2D diffusion model with the time-consuming score distillation sampling (SDS), or a…

计算机视觉与模式识别 · 计算机科学 2024-03-22 Yuanxun Lu , Jingyang Zhang , Shiwei Li , Tian Fang , David McKinnon , Yanghai Tsin , Long Quan , Xun Cao , Yao Yao

We introduce ShowRoom3D, a three-stage approach for generating high-quality 3D room-scale scenes from texts. Previous methods using 2D diffusion priors to optimize neural radiance fields for generating room-scale scenes have shown…

计算机视觉与模式识别 · 计算机科学 2023-12-22 Weijia Mao , Yan-Pei Cao , Jia-Wei Liu , Zhongcong Xu , Mike Zheng Shou

Recent advances in zero-shot text-to-3D human generation, which employ the human model prior (eg, SMPL) or Score Distillation Sampling (SDS) with pre-trained text-to-image diffusion models, have been groundbreaking. However, SDS may provide…

计算机视觉与模式识别 · 计算机科学 2023-10-17 Jianhui Yu , Hao Zhu , Liming Jiang , Chen Change Loy , Weidong Cai , Wayne Wu

Generative models are increasingly integrated into creative workflows. While text-to-image generation excels in visual quality and diversity, color accessibility for users with Color Vision Deficiencies (CVD) remains largely unexplored. Our…

图形学 · 计算机科学 2026-03-11 Xinyao Zhuang , Jose Echevarria , Kaan Akşit

Recent methods such as Score Distillation Sampling (SDS) and Variational Score Distillation (VSD) using 2D diffusion models for text-to-3D generation have demonstrated impressive generation quality. However, the long generation time of such…

计算机视觉与模式识别 · 计算机科学 2024-05-21 Linqi Zhou , Andy Shih , Chenlin Meng , Stefano Ermon

Score Distillation Sampling (SDS) has achieved remarkable success in text-to-3D content generation. However, SDS-based methods struggle to maintain semantic fidelity for user prompts, particularly when involving multiple objects with…

计算机视觉与模式识别 · 计算机科学 2025-08-14 Chenhan Jiang , Yihan Zeng , Dit-Yan Yeung

Recent years have witnessed remarkable progress in multi-view diffusion models for 3D content creation. However, there remains a significant gap in image quality and prompt-following ability compared to 2D diffusion models. A critical…

计算机视觉与模式识别 · 计算机科学 2024-10-04 Zeyi Sun , Tong Wu , Pan Zhang , Yuhang Zang , Xiaoyi Dong , Yuanjun Xiong , Dahua Lin , Jiaqi Wang

Most 3D generation research focuses on up-projecting 2D foundation models into the 3D space, either by minimizing 2D Score Distillation Sampling (SDS) loss or fine-tuning on multi-view datasets. Without explicit 3D priors, these methods…

计算机视觉与模式识别 · 计算机科学 2023-12-11 Lihe Ding , Shaocong Dong , Zhanpeng Huang , Zibin Wang , Yiyuan Zhang , Kaixiong Gong , Dan Xu , Tianfan Xue

Diffusion-based 2D virtual try-on (VTON) techniques have recently demonstrated strong performance, while the development of 3D VTON has largely lagged behind. Despite recent advances in text-guided 3D scene editing, integrating 2D VTON into…

计算机视觉与模式识别 · 计算机科学 2024-10-08 Yukang Cao , Masoud Hadi , Liang Pan , Ziwei Liu

Diffusion models, such as Stable Diffusion, have shown incredible performance on text-to-image generation. Since text-to-image generation often requires models to generate visual concepts with fine-grained details and attributes specified…

计算机视觉与模式识别 · 计算机科学 2024-04-26 Xuehai He , Weixi Feng , Tsu-Jui Fu , Varun Jampani , Arjun Akula , Pradyumna Narayana , Sugato Basu , William Yang Wang , Xin Eric Wang

Recent works on text-to-3d generation show that using only 2D diffusion supervision for 3D generation tends to produce results with inconsistent appearances (e.g., faces on the back view) and inaccurate shapes (e.g., animals with extra…

计算机视觉与模式识别 · 计算机科学 2024-03-15 Cheng Chen , Xiaofeng Yang , Fan Yang , Chengzeng Feng , Zhoujie Fu , Chuan-Sheng Foo , Guosheng Lin , Fayao Liu

Optimization-based text-to-3D methods distill guidance from 2D generative models via Score Distillation Sampling (SDS), but implicitly treat this guidance as static. This work shows that ignoring source dynamics yields inconsistent…

机器学习 · 计算机科学 2025-11-18 Jiayin Zhu , Linlin Yang , Yicong Li , Angela Yao

We propose VideoRFSplat, a direct text-to-3D model leveraging a video generation model to generate realistic 3D Gaussian Splatting (3DGS) for unbounded real-world scenes. To generate diverse camera poses and unbounded spatial extent of…

计算机视觉与模式识别 · 计算机科学 2025-03-21 Hyojun Go , Byeongjun Park , Hyelin Nam , Byung-Hoon Kim , Hyungjin Chung , Changick Kim

The extensive amounts of data required for training deep neural networks pose significant challenges on storage and transmission fronts. Dataset distillation has emerged as a promising technique to condense the information of massive…

计算机视觉与模式识别 · 计算机科学 2024-03-13 Ali Abbasi , Ashkan Shahbazi , Hamed Pirsiavash , Soheil Kolouri

To address the data scarcity associated with 3D assets, 2D-lifting techniques such as Score Distillation Sampling (SDS) have become a widely adopted practice in text-to-3D generation pipelines. However, the diffusion models used in these…

计算机视觉与模式识别 · 计算机科学 2025-01-23 Utkarsh Nath , Rajeev Goel , Eun Som Jeon , Changhoon Kim , Kyle Min , Yezhou Yang , Yingzhen Yang , Pavan Turaga

While text-to-3D and image-to-3D generation tasks have received considerable attention, one important but under-explored field between them is controllable text-to-3D generation, which we mainly focus on in this work. To address this task,…

计算机视觉与模式识别 · 计算机科学 2025-02-11 Zhiqi Li , Yiming Chen , Lingzhe Zhao , Peidong Liu

Score Distillation Sampling (SDS) has emerged as a prominent method for text-to-3D generation by leveraging the strengths of 2D diffusion models. However, SDS is limited to generation tasks and lacks the capability to edit existing 3D…

计算机视觉与模式识别 · 计算机科学 2025-05-06 Xingyu Miao , Haoran Duan , Yang Long , Jungong Han

Recent breakthroughs in text-to-image generation has shown encouraging results via large generative models. Due to the scarcity of 3D assets, it is hardly to transfer the success of text-to-image generation to that of text-to-3D generation.…

计算机视觉与模式识别 · 计算机科学 2023-11-28 Yiming Chen , Zhiqi Li , Peidong Liu

Text-to-3D generation has attracted much attention from the computer vision community. Existing methods mainly optimize a neural field from scratch for each text prompt, relying on heavy and repetitive training cost which impedes their…

计算机视觉与模式识别 · 计算机科学 2024-04-30 Ming Li , Pan Zhou , Jia-Wei Liu , Jussi Keppo , Min Lin , Shuicheng Yan , Xiangyu Xu