English
Related papers

Related papers: Dream-in-Style: Text-to-3D Generation Using Styliz…

200 papers

Score distillation has emerged as one of the most prevalent approaches for text-to-3D asset synthesis. Essentially, score distillation updates 3D parameters by lifting and back-propagating scores averaged over different views. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Peihao Wang , Zhiwen Fan , Dejia Xu , Dilin Wang , Sreyas Mohan , Forrest Iandola , Rakesh Ranjan , Yilei Li , Qiang Liu , Zhangyang Wang , Vikas Chandra

Recent advances in zero-shot text-to-3D human generation, which employ the human model prior (eg, SMPL) or Score Distillation Sampling (SDS) with pre-trained text-to-image diffusion models, have been groundbreaking. However, SDS may provide…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Jianhui Yu , Hao Zhu , Liming Jiang , Chen Change Loy , Weidong Cai , Wayne Wu

Recently, text-to-3D generation has attracted significant attention, resulting in notable performance enhancements. Previous methods utilize end-to-end 3D generation models to initialize 3D Gaussians, multi-view diffusion models to enforce…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Shuo Huang , Shikun Sun , Zixuan Wang , Xiaoyu Qin , Yanmin Xiong , Yuan Zhang , Pengfei Wan , Di Zhang , Jia Jia

Score Distillation Sampling (SDS) has achieved remarkable success in text-to-3D content generation. However, SDS-based methods struggle to maintain semantic fidelity for user prompts, particularly when involving multiple objects with…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Chenhan Jiang , Yihan Zeng , Dit-Yan Yeung

We present TextureDreamer, a novel image-guided texture synthesis method to transfer relightable textures from a small number of input images (3 to 5) to target 3D shapes across arbitrary categories. Texture creation is a pivotal challenge…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Yu-Ying Yeh , Jia-Bin Huang , Changil Kim , Lei Xiao , Thu Nguyen-Phuoc , Numair Khan , Cheng Zhang , Manmohan Chandraker , Carl S Marshall , Zhao Dong , Zhengqin Li

In this paper, we study Text-to-3D content generation leveraging 2D diffusion priors to enhance the quality and detail of the generated 3D models. Recent progress (Magic3D) in text-to-3D has shown that employing high-resolution (e.g., 512 x…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Jinbo Wu , Xiaobo Gao , Xing Liu , Zhengyang Shen , Chen Zhao , Haocheng Feng , Jingtuo Liu , Errui Ding

Generative priors of large-scale text-to-image diffusion models enable a wide range of new generation and editing applications on diverse visual modalities. However, when adapting these priors to complex visual modalities, often represented…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Subin Kim , Kyungmin Lee , June Suk Choi , Jongheon Jeong , Kihyuk Sohn , Jinwoo Shin

Optimization-based text-to-3D methods distill guidance from 2D generative models via Score Distillation Sampling (SDS), but implicitly treat this guidance as static. This work shows that ignoring source dynamics yields inconsistent…

Machine Learning · Computer Science 2025-11-18 Jiayin Zhu , Linlin Yang , Yicong Li , Angela Yao

Text-driven diffusion-based video editing presents a unique challenge not encountered in image editing literature: establishing real-world motion. Unlike existing video editing approaches, here we focus on score distillation sampling to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Hyeonho Jeong , Jinho Chang , Geon Yeong Park , Jong Chul Ye

We present Animus3D, a text-driven 3D animation framework that generates motion field given a static 3D asset and text prompt. Previous methods mostly leverage the vanilla Score Distillation Sampling (SDS) objective to distill motion from…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Qi Sun , Can Wang , Jiaxiang Shang , Wensen Feng , Jing Liao

In this paper, we present TEXTure, a novel method for text-guided generation, editing, and transfer of textures for 3D shapes. Leveraging a pretrained depth-to-image diffusion model, TEXTure applies an iterative scheme that paints a 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-02-06 Elad Richardson , Gal Metzer , Yuval Alaluf , Raja Giryes , Daniel Cohen-Or

Human preference alignment presents a critical yet underexplored challenge for diffusion models in text-to-3D generation. Existing solutions typically require task-specific fine-tuning, posing significant hurdles in data-scarce 3D domains.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Jiaqi Leng , Shuyuan Tu , Haidong Cao , Sicheng Xie , Daoguo Dong , Zuxuan Wu , Yu-Gang Jiang

Recent innovations on text-to-3D generation have featured Score Distillation Sampling (SDS), which enables the zero-shot learning of implicit 3D models (NeRF) by directly distilling prior knowledge from 2D diffusion models. However, current…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Yang Chen , Yingwei Pan , Haibo Yang , Ting Yao , Tao Mei

Stylized text-to-image generation focuses on creating images from textual descriptions while adhering to a style specified by a few reference images. However, subtle style variations within different reference images can hinder the model…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Xing Cui , Zekun Li , Pei Pei Li , Huaibo Huang , Xuannan Liu , Zhaofeng He

Designing complex 3D scenes has been a tedious, manual process requiring domain expertise. Emerging text-to-3D generative models show great promise for making this task more intuitive, but existing approaches are limited to object-level…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Ryan Po , Gordon Wetzstein

Pre-trained text-to-image diffusion models are increasingly applied to real-world image super-resolution (Real-ISR) task. Given the iterative refinement nature of diffusion models, most existing approaches are computationally expensive.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Linwei Dong , Qingnan Fan , Yihong Guo , Zhonghao Wang , Qi Zhang , Jinwei Chen , Yawei Luo , Changqing Zou

Text-to-image diffusion models produce impressive results but are frustrating tools for artists who desire fine-grained control. For example, a common use case is to create images of a specific instance in novel contexts, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Shengqu Cai , Eric Chan , Yunzhi Zhang , Leonidas Guibas , Jiajun Wu , Gordon Wetzstein

The success of 3DGS in generative and editing applications has sparked growing interest in 3DGS-based style transfer. However, current methods still face two major challenges: (1) multi-view inconsistency often leads to style conflicts,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Yitong Yang , Yinglin Wang , Changshuo Wang , Huajie Wang , Shuting He

Text-to-3D generation has achieved remarkable success via large-scale text-to-image diffusion models. Nevertheless, there is no paradigm for scaling up the methodology to urban scale. Urban scenes, characterized by numerous elements,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Fan Lu , Kwan-Yee Lin , Yan Xu , Hongsheng Li , Guang Chen , Changjun Jiang

Text-to-3D generation has recently garnered significant attention, fueled by 2D diffusion models trained on billions of image-text pairs. Existing methods primarily rely on score distillation to leverage the 2D diffusion priors to supervise…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Chaohui Yu , Qiang Zhou , Jingliang Li , Zhe Zhang , Zhibin Wang , Fan Wang