English
Related papers

Related papers: DiverseDream: Diverse Text-to-3D Synthesis with Au…

200 papers

Latent diffusion models excel at producing high-quality images from text. Yet, concerns appear about the lack of diversity in the generated imagery. To tackle this, we introduce Diverse Diffusion, a method for boosting image diversity…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Mariia Zameshina , Olivier Teytaud , Laurent Najman

Recent large-scale text-driven synthesis models have attracted much attention thanks to their remarkable capabilities of generating highly diverse images that follow given text prompts. Such text-based synthesis methods are particularly…

Computer Vision and Pattern Recognition · Computer Science 2022-08-03 Amir Hertz , Ron Mokady , Jay Tenenbaum , Kfir Aberman , Yael Pritch , Daniel Cohen-Or

In recent times, automatic text-to-3D content creation has made significant progress, driven by the development of pretrained 2D diffusion models. Existing text-to-3D methods typically optimize the 3D representation to ensure that the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Yiwei Ma , Yijun Fan , Jiayi Ji , Haowei Wang , Xiaoshuai Sun , Guannan Jiang , Annan Shu , Rongrong Ji

Generating 3D human motions from text is a challenging yet valuable task. The key aspects of this task are ensuring text-motion consistency and achieving generation diversity. Although recent advancements have enabled the generation of…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Zheng Qin , Yabing Wang , Minghui Yang , Sanping Zhou , Ming Yang , Le Wang

We present Text2Room, a method for generating room-scale textured 3D meshes from a given text prompt as input. To this end, we leverage pre-trained 2D text-to-image models to synthesize a sequence of images from different poses. In order to…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Lukas Höllein , Ang Cao , Andrew Owens , Justin Johnson , Matthias Nießner

Despite their growing capabilities, language models still frequently reproduce content from their training data, generate repetitive text, and favor common grammatical patterns and vocabulary. A possible cause is the decoding strategy: the…

Computation and Language · Computer Science 2026-01-15 Giorgio Franceschelli , Mirco Musolesi

Recent remarkable advances in large-scale text-to-image diffusion models have inspired a significant breakthrough in text-to-3D generation, pursuing 3D content creation solely from a given text prompt. However, existing text-to-3D…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Yang Chen , Yingwei Pan , Yehao Li , Ting Yao , Tao Mei

Recent advances in 3D generation have been remarkable, with methods such as DreamFusion leveraging large-scale text-to-image diffusion-based models to guide 3D object generation. These methods enable the synthesis of detailed and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Bohan Zeng , Shanglin Li , Yutang Feng , Ling Yang , Hong Li , Sicheng Gao , Jiaming Liu , Conghui He , Wentao Zhang , Jianzhuang Liu , Baochang Zhang , Shuicheng Yan

Large-scale diffusion-based generative models have led to breakthroughs in text-conditioned high-resolution image synthesis. Starting from random noise, such text-to-image diffusion models gradually synthesize images in an iterative fashion…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Yogesh Balaji , Seungjun Nah , Xun Huang , Arash Vahdat , Jiaming Song , Qinsheng Zhang , Karsten Kreis , Miika Aittala , Timo Aila , Samuli Laine , Bryan Catanzaro , Tero Karras , Ming-Yu Liu

Recently, text-to-3D generation has attracted significant attention, resulting in notable performance enhancements. Previous methods utilize end-to-end 3D generation models to initialize 3D Gaussians, multi-view diffusion models to enforce…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Shuo Huang , Shikun Sun , Zixuan Wang , Xiaoyu Qin , Yanmin Xiong , Yuan Zhang , Pengfei Wan , Di Zhang , Jia Jia

Recent progresses in large-scale text-to-image models have yielded remarkable accomplishments, finding various applications in art domain. However, expressing unique characteristics of an artwork (e.g. brushwork, colortone, or composition)…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Namhyuk Ahn , Junsoo Lee , Chunggi Lee , Kunhee Kim , Daesik Kim , Seung-Hun Nam , Kibeom Hong

Recent progress in text-to-image (T2I) generative models has led to significant improvements in generating high-quality images aligned with text prompts. However, these models still struggle with prompts involving multiple objects, often…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Dongnam Byun , Jungwon Park , Jungmin Ko , Changin Choi , Wonjong Rhee

Text-to-3D generation is to craft a 3D object according to a natural language description. This can significantly reduce the workload for manually designing 3D models and provide a more natural way of interaction for users. However, this…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Han Yi , Zhedong Zheng , Xiangyu Xu , Tat-seng Chua

Given a 3D mesh, we aim to synthesize 3D textures that correspond to arbitrary textual descriptions. Current methods for generating and assembling textures from sampled views often result in prominent seams or excessive smoothing. To tackle…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Dong Huo , Zixin Guo , Xinxin Zuo , Zhihao Shi , Juwei Lu , Peng Dai , Songcen Xu , Li Cheng , Yee-Hong Yang

Customization of text-to-image models enables users to insert new concepts or objects and generate them in unseen settings. Existing methods either rely on comparatively expensive test-time optimization or train encoders on single-image…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Nupur Kumari , Xi Yin , Jun-Yan Zhu , Ishan Misra , Samaneh Azadi

Recent advancements in text-to-3D generation improve the visual quality of Score Distillation Sampling (SDS) and its variants by directly connecting Consistency Distillation (CD) to score distillation. However, due to the imbalance between…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Jiahao Zhu , Zixuan Chen , Guangcong Wang , Xiaohua Xie , Yi Zhou

Despite the latest remarkable advances in generative modeling, efficient generation of high-quality 3D assets from textual prompts remains a difficult task. A key challenge lies in data scarcity: the most extensive 3D datasets encompass…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Antoine Mercier , Ramin Nakhli , Mahesh Reddy , Rajeev Yasarla , Hong Cai , Fatih Porikli , Guillaume Berger

Traditional 3D garment creation is labor-intensive, involving sketching, modeling, UV mapping, and texturing, which are time-consuming and costly. Recent advances in diffusion-based generative models have enabled new possibilities for 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Boqian Li , Xuan Li , Ying Jiang , Tianyi Xie , Feng Gao , Huamin Wang , Yin Yang , Chenfanfu Jiang

By lifting the pre-trained 2D diffusion models into Neural Radiance Fields (NeRFs), text-to-3D generation methods have made great progress. Many state-of-the-art approaches usually apply score distillation sampling (SDS) to optimize the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Yuze He , Yushi Bai , Matthieu Lin , Jenny Sheng , Yubin Hu , Qi Wang , Yu-Hui Wen , Yong-Jin Liu

The field of advanced text-to-image generation is witnessing the emergence of unified frameworks that integrate powerful text encoders, such as CLIP and T5, with Diffusion Transformer backbones. Although there have been efforts to control…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Liang Chen , Shuai Bai , Wenhao Chai , Weichu Xie , Haozhe Zhao , Leon Vinci , Junyang Lin , Baobao Chang