中文
相关论文

相关论文: DreamBooth3D: Subject-Driven Text-to-3D Generation

200 篇论文

3D generation guided by text-to-image diffusion models enables the creation of visually compelling assets. However previous methods explore generation based on image or text. The boundaries of creativity are limited by what can be expressed…

计算机视觉与模式识别 · 计算机科学 2024-06-25 Sandeep Mishra , Oindrila Saha , Alan C. Bovik

3D shape generation aims to produce innovative 3D content adhering to specific conditions and constraints. Existing methods often decompose 3D shapes into a sequence of localized components, treating each element in isolation without…

计算机视觉与模式识别 · 计算机科学 2024-07-15 Ruikai Cui , Weizhe Liu , Weixuan Sun , Senbo Wang , Taizhang Shang , Yang Li , Xibin Song , Han Yan , Zhennan Wu , Shenzhou Chen , Hongdong Li , Pan Ji

Text-to-3D generation is to craft a 3D object according to a natural language description. This can significantly reduce the workload for manually designing 3D models and provide a more natural way of interaction for users. However, this…

计算机视觉与模式识别 · 计算机科学 2023-09-27 Han Yi , Zhedong Zheng , Xiangyu Xu , Tat-seng Chua

Text-guided domain adaptation and generation of 3D-aware portraits find many applications in various fields. However, due to the lack of training data and the challenges in handling the high variety of geometry and appearance, the existing…

计算机视觉与模式识别 · 计算机科学 2024-04-15 Biwen Lei , Kai Yu , Mengyang Feng , Miaomiao Cui , Xuansong Xie

Subject-driven text-to-image generation models create novel renditions of an input subject based on text prompts. Existing models suffer from lengthy fine-tuning and difficulties preserving the subject fidelity. To overcome these…

计算机视觉与模式识别 · 计算机科学 2023-06-23 Dongxu Li , Junnan Li , Steven C. H. Hoi

This paper introduces Motion Personalization, a new task that generates personalized motions aligned with text descriptions using several basic motions containing Persona. To support this novel task, we introduce a new large-scale motion…

计算机视觉与模式识别 · 计算机科学 2025-03-24 Boeun Kim , Hea In Jeong , JungHoon Sung , Yihua Cheng , Jeongmin Lee , Ju Yong Chang , Sang-Il Choi , Younggeun Choi , Saim Shin , Jungho Kim , Hyung Jin Chang

Emerging Metaverse applications demand accessible, accurate, and easy-to-use tools for 3D digital human creations in order to depict different cultures and societies as if in the physical world. Recent large-scale vision-language advances…

图形学 · 计算机科学 2023-04-07 Longwen Zhang , Qiwei Qiu , Hongyang Lin , Qixuan Zhang , Cheng Shi , Wei Yang , Ye Shi , Sibei Yang , Lan Xu , Jingyi Yu

We present DreamCraft3D, a hierarchical 3D content generation method that produces high-fidelity and coherent 3D objects. We tackle the problem by leveraging a 2D reference image to guide the stages of geometry sculpting and texture…

计算机视觉与模式识别 · 计算机科学 2023-10-27 Jingxiang Sun , Bo Zhang , Ruizhi Shao , Lizhen Wang , Wen Liu , Zhenda Xie , Yebin Liu

Diffusion-based models, widely used in text-to-image generation, have proven effective in 2D representation learning. Recently, this framework has been extended to 3D self-supervised learning by constructing a conditional point generator…

计算机视觉与模式识别 · 计算机科学 2025-07-15 Yiyang Chen , Shanshan Zhao , Lunhao Duan , Changxing Ding , Dacheng Tao

This paper presents a novel method for building scalable 3D generative models utilizing pre-trained video diffusion models. The primary obstacle in developing foundation 3D generative models is the limited availability of 3D data. Unlike…

计算机视觉与模式识别 · 计算机科学 2024-07-22 Junlin Han , Filippos Kokkinos , Philip Torr

Recent multimodal large language models have achieved strong performance in unified text and image understanding and generation, yet extending such native capability to 3D remains challenging due to limited data. Compared to abundant 2D…

计算机视觉与模式识别 · 计算机科学 2026-04-03 Chongjie Ye , Cheng Cao , Chuanyu Pan , Yiming Hao , Yihao Zhi , Yuanming Hu , Xiaoguang Han

Recently unified generation and editing models have achieved remarkable success with their impressive performance. These models rely mainly on text prompts for instruction-based editing and generation, but language often fails to capture…

计算机视觉与模式识别 · 计算机科学 2025-12-30 Bin Xia , Bohao Peng , Jiyang Liu , Sitong Wu , Jingyao Li , Junjia Huang , Xu Zhao , Yitong Wang , Ruihang Chu , Bei Yu , Jiaya Jia

Text-to-3D generation has shown great promise in generating novel 3D content based on given text prompts. However, existing generative methods mostly focus on geometric or visual plausibility while ignoring precise physics perception for…

计算机视觉与模式识别 · 计算机科学 2024-03-20 Qingshan Xu , Jiao Liu , Melvin Wong , Caishun Chen , Yew-Soon Ong

We present Text2Room, a method for generating room-scale textured 3D meshes from a given text prompt as input. To this end, we leverage pre-trained 2D text-to-image models to synthesize a sequence of images from different poses. In order to…

计算机视觉与模式识别 · 计算机科学 2023-09-12 Lukas Höllein , Ang Cao , Andrew Owens , Justin Johnson , Matthias Nießner

We present DreamPolisher, a novel Gaussian Splatting based method with geometric guidance, tailored to learn cross-view consistency and intricate detail from textual descriptions. While recent progress on text-to-3D generation methods have…

计算机视觉与模式识别 · 计算机科学 2024-03-27 Yuanze Lin , Ronald Clark , Philip Torr

Recent advances in text-to-image diffusion models have substantially improved the quality of image customization, enabling the synthesis of highly realistic images. Despite this progress, achieving fast and efficient personalization remains…

计算机视觉与模式识别 · 计算机科学 2026-03-25 Aniket Roy , Maitreya Suin , Rama Chellappa

Recent advancements in instruction-based image editing and subject-driven generation have garnered significant attention, yet both tasks still face limitations in meeting practical user needs. Instruction-based editing relies solely on…

计算机视觉与模式识别 · 计算机科学 2025-10-09 Bin Xia , Bohao Peng , Yuechen Zhang , Junjia Huang , Jiyang Liu , Jingyao Li , Haoru Tan , Sitong Wu , Chengyao Wang , Yitong Wang , Xinglong Wu , Bei Yu , Jiaya Jia

The de novo generation of molecules with targeted properties is crucial in biology, chemistry, and drug discovery. Current generative models are limited to using single property values as conditions, struggling with complex customizations…

机器学习 · 计算机科学 2024-10-08 Yanchen Luo , Junfeng Fang , Sihang Li , Zhiyuan Liu , Jiancan Wu , An Zhang , Wenjie Du , Xiang Wang

Recent research in subject-driven generation increasingly emphasizes the importance of selective subject features. Nevertheless, accurately selecting the content in a given reference image still poses challenges, especially when selecting…

计算机视觉与模式识别 · 计算机科学 2025-01-07 Junjie Hu , Shuyong Gao , Lingyi Hong , Qishan Wang , Yuzhou Zhao , Yan Wang , Wenqiang Zhang

Real-world applications often require a large gallery of 3D assets that share a consistent theme. While remarkable advances have been made in general 3D content creation from text or image, synthesizing customized 3D assets following the…

计算机视觉与模式识别 · 计算机科学 2024-05-16 Zhenwei Wang , Tengfei Wang , Gerhard Hancke , Ziwei Liu , Rynson W. H. Lau