中文
相关论文

相关论文: HD-Fusion: Detailed Text-to-3D Generation Leveragi…

200 篇论文

In the realm of text-to-3D generation, utilizing 2D diffusion models through score distillation sampling (SDS) frequently leads to issues such as blurred appearances and multi-faced geometry, primarily due to the intrinsically noisy nature…

计算机视觉与模式识别 · 计算机科学 2023-12-06 Pengsheng Guo , Hans Hao , Adam Caccavale , Zhongzheng Ren , Edward Zhang , Qi Shan , Aditya Sankar , Alexander G. Schwing , Alex Colburn , Fangchang Ma

Despite the latest remarkable advances in generative modeling, efficient generation of high-quality 3D assets from textual prompts remains a difficult task. A key challenge lies in data scarcity: the most extensive 3D datasets encompass…

计算机视觉与模式识别 · 计算机科学 2024-01-17 Antoine Mercier , Ramin Nakhli , Mahesh Reddy , Rajeev Yasarla , Hong Cai , Fatih Porikli , Guillaume Berger

3D object generation from a single image involves estimating the full 3D geometry and texture of unseen views from an unposed RGB image captured in the wild. Accurately reconstructing an object's complete 3D structure and texture has…

计算机视觉与模式识别 · 计算机科学 2024-11-21 Hritam Basak , Hadi Tabatabaee , Shreekant Gayaka , Ming-Feng Li , Xin Yang , Cheng-Hao Kuo , Arnie Sen , Min Sun , Zhaozheng Yin

Score Distillation Sampling (SDS) has emerged as a prevalent technique for text-to-3D generation, enabling 3D content creation by distilling view-dependent information from text-to-2D guidance. However, they frequently exhibit shortcomings…

计算机视觉与模式识别 · 计算机科学 2024-09-20 Zeyu Cai , Duotun Wang , Yixun Liang , Zhijing Shao , Ying-Cong Chen , Xiaohang Zhan , Zeyu Wang

Recent advances in text-to-3D generation have made significant progress. In particular, with the pretrained diffusion models, existing methods predominantly use Score Distillation Sampling (SDS) to train 3D models such as Neural RaRecent…

计算机视觉与模式识别 · 计算机科学 2024-10-10 Hangyu Li , Xiangxiang Chu , Dingyuan Shi , Wang Lin

This paper introduces a pioneering 3D volumetric encoder designed for text-to-3D generation. To scale up the training data for the diffusion model, a lightweight network is developed to efficiently acquire feature volumes from multi-view…

计算机视觉与模式识别 · 计算机科学 2024-08-14 Zhicong Tang , Shuyang Gu , Chunyu Wang , Ting Zhang , Jianmin Bao , Dong Chen , Baining Guo

Text-to-3D, known for its efficient generation methods and expansive creative potential, has garnered significant attention in the AIGC domain. However, the pixel-wise rendering of NeRF and its ray marching light sampling constrain the…

计算机视觉与模式识别 · 计算机科学 2024-11-27 Xinhai Li , Huaibin Wang , Kuo-Kun Tseng

Diffusion-based image generators can now produce high-quality and diverse samples, but their success has yet to fully translate to 3D generation: existing diffusion methods can either generate low-resolution but 3D consistent outputs, or…

计算机视觉与模式识别 · 计算机科学 2023-08-29 Animesh Karnewar , Niloy J. Mitra , Andrea Vedaldi , David Novotny

We train a feed-forward text-to-3D diffusion generator for human characters using only single-view 2D data for supervision. Existing 3D generative models cannot yet match the fidelity of image or video generative models. State-of-the-art 3D…

计算机视觉与模式识别 · 计算机科学 2024-12-24 Souhaib Attaiki , Paul Guerrero , Duygu Ceylan , Niloy J. Mitra , Maks Ovsjanikov

Automatic text-to-3D generation that combines Score Distillation Sampling (SDS) with the optimization of volume rendering has achieved remarkable progress in synthesizing realistic 3D objects. Yet most existing text-to-3D methods by SDS and…

计算机视觉与模式识别 · 计算机科学 2024-04-03 Zilong Chen , Feng Wang , Yikai Wang , Huaping Liu

Large scale text-guided diffusion models have garnered significant attention due to their ability to synthesize diverse images that convey complex visual concepts. This generative power has more recently been leveraged to perform text-to-3D…

计算机视觉与模式识别 · 计算机科学 2023-09-20 Etai Sella , Gal Fiebelman , Peter Hedman , Hadar Averbuch-Elor

Text-to-image diffusion models pre-trained on billions of image-text pairs have recently enabled 3D content creation by optimizing a randomly initialized differentiable 3D representation with score distillation. However, the optimization…

计算机视觉与模式识别 · 计算机科学 2024-05-07 Yukun Huang , Jianan Wang , Yukai Shi , Boshi Tang , Xianbiao Qi , Lei Zhang

This paper explores the burgeoning field of 3D content generation within the landscape of Artificial Intelligence Generated Content (AIGC) and large-scale models. It investigates innovative methods like Text-to-3D and Image-to-3D, which…

图形学 · 计算机科学 2024-05-27 Ke Zhao , Andreas Larsen

Score Distillation Sampling (SDS) leverages pretrained 2D diffusion models to advance text-to-3D generation but neglects multi-view correlations, being prone to geometric inconsistencies and multi-face artifacts in the generated 3D content.…

计算机视觉与模式识别 · 计算机科学 2025-12-23 Feng Yang , Wenliang Qian , Wangmeng Zuo , Hui Li

This research paper proposes a Latent Diffusion Model for 3D (LDM3D) that generates both image and depth map data from a given text prompt, allowing users to generate RGBD images from text prompts. The LDM3D model is fine-tuned on a dataset…

Significant progress has been made in text-to-video generation through the use of powerful generative models and large-scale internet data. However, substantial challenges remain in precisely controlling individual concepts within the…

计算机视觉与模式识别 · 计算机科学 2024-09-30 Hanxin Zhu , Tianyu He , Anni Tang , Junliang Guo , Zhibo Chen , Jiang Bian

Inspired by the remarkable success of Latent Diffusion Models (LDMs) for image synthesis, we study LDM for text-to-video generation, which is a formidable challenge due to the computational and memory constraints during both model training…

计算机视觉与模式识别 · 计算机科学 2023-09-08 Jiaxi Gu , Shicong Wang , Haoyu Zhao , Tianyi Lu , Xing Zhang , Zuxuan Wu , Songcen Xu , Wei Zhang , Yu-Gang Jiang , Hang Xu

Large-scale diffusion models have achieved remarkable performance in generative tasks. Beyond their initial training applications, these models have proven their ability to function as versatile plug-and-play priors. For instance, 2D…

计算机视觉与模式识别 · 计算机科学 2025-02-21 Xiaofeng Yang , Cheng Chen , Xulei Yang , Fayao Liu , Guosheng Lin

Diffusion models have shown great promise for image generation, beating GANs in terms of generation diversity, with comparable image quality. However, their application to 3D shapes has been limited to point or voxel representations that…

计算机视觉与模式识别 · 计算机科学 2022-12-16 Gimin Nam , Mariem Khlifi , Andrew Rodriguez , Alberto Tono , Linqi Zhou , Paul Guerrero

Large-scale text-guided image diffusion models have shown astonishing results in text-to-image (T2I) generation. However, applying these models to synthesize textures for 3D geometries remains challenging due to the domain gap between 2D…

计算机视觉与模式识别 · 计算机科学 2024-09-30 Jiawei Lu , Yingpeng Zhang , Zengjun Zhao , He Wang , Kun Zhou , Tianjia Shao