English
Related papers

Related papers: Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D S…

200 papers

Animation techniques bring digital 3D worlds and characters to life. However, manual animation is tedious and automated techniques are often specialized to narrow shape classes. In our work, we propose a technique for automatic re-animation…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Lukas Uzolas , Elmar Eisemann , Petr Kellnhofer

Score distillation sampling (SDS) has emerged as an effective framework in text-driven 3D editing tasks, leveraging diffusion models for 3D-consistent editing. However, existing SDS-based 3D editing methods suffer from long training times…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Jiwook Kim , Seonho Lee , Jaeyo Shin , Jiho Choi , Hyunjung Shim

Existing neural rendering-based text-to-3D-portrait generation methods typically make use of human geometry prior and diffusion models to obtain guidance. However, relying solely on geometry information introduces issues such as the Janus…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Yiqian Wu , Hao Xu , Xiangjun Tang , Xien Chen , Siyu Tang , Zhebin Zhang , Chen Li , Xiaogang Jin

Large-scale diffusion-based generative models have led to breakthroughs in text-conditioned high-resolution image synthesis. Starting from random noise, such text-to-image diffusion models gradually synthesize images in an iterative fashion…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Yogesh Balaji , Seungjun Nah , Xun Huang , Arash Vahdat , Jiaming Song , Qinsheng Zhang , Karsten Kreis , Miika Aittala , Timo Aila , Samuli Laine , Bryan Catanzaro , Tero Karras , Ming-Yu Liu

There has been a significant progress in text conditional image generation models. Recent advancements in this field depend not only on improvements in model structures, but also vast quantities of text-image paired datasets. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Seungdae Han , Joohee Kim

We present DreamAvatar, a text-and-shape guided framework for generating high-quality 3D human avatars with controllable poses. While encouraging results have been reported by recent methods on text-guided 3D common object generation,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Yukang Cao , Yan-Pei Cao , Kai Han , Ying Shan , Kwan-Yee K. Wong

Based on recent advanced diffusion models, Text-to-image (T2I) generation models have demonstrated their capabilities to generate diverse and high-quality images. However, leveraging their potential for real-world content creation,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Sandra Zhang Ding , Jiafeng Mao , Kiyoharu Aizawa

Large-scale text-to-image generative models have been a revolutionary breakthrough in the evolution of generative AI, allowing us to synthesize diverse images that convey highly complex visual concepts. However, a pivotal challenge in…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Narek Tumanyan , Michal Geyer , Shai Bagon , Tali Dekel

Recent CLIP-guided 3D generation methods have achieved promising results but struggle with generating faithful 3D shapes that conform with input text due to the gap between text and image embeddings. To this end, this paper proposes HOTS3D…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Zezeng Li , Weimin Wang , Yuming Zhao , Wenhai Li , Na Lei , Xianfeng Gu

We present TextureDreamer, a novel image-guided texture synthesis method to transfer relightable textures from a small number of input images (3 to 5) to target 3D shapes across arbitrary categories. Texture creation is a pivotal challenge…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Yu-Ying Yeh , Jia-Bin Huang , Changil Kim , Lei Xiao , Thu Nguyen-Phuoc , Numair Khan , Cheng Zhang , Manmohan Chandraker , Carl S Marshall , Zhao Dong , Zhengqin Li

Recently, the text-to-3D task has developed rapidly due to the appearance of the SDS method. However, the SDS method always generates 3D objects with poor quality due to the over-smooth issue. This issue is attributed to two factors: 1) the…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Yiming Zhong , Xiaolin Zhang , Yao Zhao , Yunchao Wei

In this work, we propose a method that leverages CLIP feature distillation, achieving efficient 3D segmentation through language guidance. Unlike previous methods that rely on multi-scale CLIP features and are limited by processing speed…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Xingyu Miao , Haoran Duan , Yang Bai , Tejal Shah , Jun Song , Yang Long , Rajiv Ranjan , Ling Shao

With the rise of large, publicly-available text-to-image diffusion models, text-guided real image editing has garnered much research attention recently. Existing methods tend to either rely on some form of per-instance or per-task…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Adham Elarabawy , Harish Kamath , Samuel Denton

In recent years, 3D generation has made great strides in both academia and industry. However, generating 3D scenes from a single RGB image remains a significant challenge, as current approaches often struggle to ensure both object…

Graphics · Computer Science 2026-02-18 Xiang Tang , Ruotong Li , Xiaopeng Fan

Generating 3D CT volumes from descriptive free-text inputs presents a transformative opportunity in diagnostics and research. In this paper, we introduce Text2CT, a novel approach for synthesizing 3D CT volumes from textual descriptions…

Image and Video Processing · Electrical Eng. & Systems 2025-05-09 Pengfei Guo , Can Zhao , Dong Yang , Yufan He , Vishwesh Nath , Ziyue Xu , Pedro R. A. S. Bassi , Zongwei Zhou , Benjamin D. Simon , Stephanie Anne Harmon , Baris Turkbey , Daguang Xu

We propose a new view synthesis method via synthesizing a 3D neural field from both single or few-view input images. To address the ill-posed nature of the image-to-3D generation problem, we devise a two-stage method that involves a…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Tung Do , Thuan Hoang Nguyen , Anh Tuan Tran , Rang Nguyen , Binh-Son Hua

The increasing demand for virtual reality applications has highlighted the significance of crafting immersive 3D assets. We present a text-to-3D 360$^{\circ}$ scene generation pipeline that facilitates the creation of comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Shijie Zhou , Zhiwen Fan , Dejia Xu , Haoran Chang , Pradyumna Chari , Tejas Bharadwaj , Suya You , Zhangyang Wang , Achuta Kadambi

Recent text-to-image generation methods provide a simple yet exciting conversion capability between text and image domains. While these methods have incrementally improved the generated image fidelity and text relevancy, several pivotal…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Oran Gafni , Adam Polyak , Oron Ashual , Shelly Sheynin , Devi Parikh , Yaniv Taigman

3D scene generation is in high demand across various domains, including virtual reality, gaming, and the film industry. Owing to the powerful generative capabilities of text-to-image diffusion models that provide reliable priors, the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Haiyang Zhou , Xinhua Cheng , Wangbo Yu , Yonghong Tian , Li Yuan

Recent text-to-image diffusion models have demonstrated an astonishing capacity to generate high-quality images. However, researchers mainly studied the way of synthesizing images with only text prompts. While some works have explored using…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Jinheng Xie , Yuexiang Li , Yawen Huang , Haozhe Liu , Wentian Zhang , Yefeng Zheng , Mike Zheng Shou
‹ Prev 1 8 9 10 Next ›