中文
相关论文

相关论文: Magic3D: High-Resolution Text-to-3D Content Creati…

200 篇论文

This paper proposes a Diffusion Model-Optimized Neural Radiance Field (DT-NeRF) method, aimed at enhancing detail recovery and multi-view consistency in 3D scene reconstruction. By combining diffusion models with Transformers, DT-NeRF…

计算机视觉与模式识别 · 计算机科学 2025-09-23 Bo Liu , Runlong Li , Li Zhou , Yan Zhou

We present Neural Feature Fusion Fields (N3F), a method that improves dense 2D image feature extractors when the latter are applied to the analysis of multiple images reconstructible as a 3D scene. Given an image feature extractor, for…

计算机视觉与模式识别 · 计算机科学 2022-09-09 Vadim Tschernezki , Iro Laina , Diane Larlus , Andrea Vedaldi

Recent advances in diffusion models such as ControlNet have enabled geometrically controllable, high-fidelity text-to-image generation. However, none of them addresses the question of adding such controllability to text-to-3D generation. In…

计算机视觉与模式识别 · 计算机科学 2023-09-08 Sungwon Hwang , Junha Hyung , Jaegul Choo

Large-scale text-guided image diffusion models have shown astonishing results in text-to-image (T2I) generation. However, applying these models to synthesize textures for 3D geometries remains challenging due to the domain gap between 2D…

计算机视觉与模式识别 · 计算机科学 2024-09-30 Jiawei Lu , Yingpeng Zhang , Zengjun Zhao , He Wang , Kun Zhou , Tianjia Shao

We present an approach to generate a 360-degree view of a person with a consistent, high-resolution appearance from a single input image. NeRF and its variants typically require videos or images from different viewpoints. Most existing…

计算机视觉与模式识别 · 计算机科学 2023-11-16 Badour AlBahar , Shunsuke Saito , Hung-Yu Tseng , Changil Kim , Johannes Kopf , Jia-Bin Huang

A fundamental problem in the texturing of 3D meshes using pre-trained text-to-image models is to ensure multi-view consistency. State-of-the-art approaches typically use diffusion models to aggregate multi-view inputs, where common issues…

计算机视觉与模式识别 · 计算机科学 2024-08-05 Zhengyi Zhao , Chen Song , Xiaodong Gu , Yuan Dong , Qi Zuo , Weihao Yuan , Liefeng Bo , Zilong Dong , Qixing Huang

Recent remarkable advances in large-scale text-to-image diffusion models have inspired a significant breakthrough in text-to-3D generation, pursuing 3D content creation solely from a given text prompt. However, existing text-to-3D…

计算机视觉与模式识别 · 计算机科学 2023-11-10 Yang Chen , Yingwei Pan , Yehao Li , Ting Yao , Tao Mei

Neural radiance fields (NeRF) bring a new wave for 3D interactive experiences. However, as an important part of the immersive experiences, the defocus effects have not been fully explored within NeRF. Some recent NeRF-based methods generate…

计算机视觉与模式识别 · 计算机科学 2022-08-11 Yinhuai Wang , Shuzhou Yang , Yujie Hu , Jian Zhang

Recent advancements in open-world 3D object generation have been remarkable, with image-to-3D methods offering superior fine-grained control over their text-to-3D counterparts. However, most existing models fall short in simultaneously…

计算机视觉与模式识别 · 计算机科学 2023-11-15 Minghua Liu , Ruoxi Shi , Linghao Chen , Zhuoyang Zhang , Chao Xu , Xinyue Wei , Hansheng Chen , Chong Zeng , Jiayuan Gu , Hao Su

While generative models produce high-quality images of concepts learned from a large-scale database, a user often wishes to synthesize instantiations of their own concepts (for example, their family, pets, or items). Can we teach a model to…

计算机视觉与模式识别 · 计算机科学 2023-06-21 Nupur Kumari , Bingliang Zhang , Richard Zhang , Eli Shechtman , Jun-Yan Zhu

We present DreamBooth3D, an approach to personalize text-to-3D generative models from as few as 3-6 casually captured images of a subject. Our approach combines recent advances in personalizing text-to-image models (DreamBooth) with…

Novel view synthesis from a single image requires inferring occluded regions of objects and scenes whilst simultaneously maintaining semantic and physical consistency with the input. Existing approaches condition neural radiance fields…

计算机视觉与模式识别 · 计算机科学 2023-02-21 Jiatao Gu , Alex Trevithick , Kai-En Lin , Josh Susskind , Christian Theobalt , Lingjie Liu , Ravi Ramamoorthi

Recent advancements in text-to-3D generation technology have significantly advanced the conversion of textual descriptions into imaginative well-geometrical and finely textured 3D objects. Despite these developments, a prevalent limitation…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Zexiang Liu , Yangguang Li , Youtian Lin , Xin Yu , Sida Peng , Yan-Pei Cao , Xiaojuan Qi , Xiaoshui Huang , Ding Liang , Wanli Ouyang

We present a novel method for diffusion-guided frameworks for view-consistent super-resolution (SR) in neural rendering. Our approach leverages existing 2D SR models in conjunction with advanced techniques such as Variational Score…

计算机视觉与模式识别 · 计算机科学 2025-01-07 Shrey Vishen , Jatin Sarabu , Saurav Kumar , Chinmay Bharathulwar , Rithwick Lakshmanan , Vishnu Srinivas

Text-to-3D generation has achieved significant success by incorporating powerful 2D diffusion models, but insufficient 3D prior knowledge also leads to the inconsistency of 3D geometry. Recently, since large-scale multi-view datasets have…

计算机视觉与模式识别 · 计算机科学 2024-05-03 Junyoung Seo , Susung Hong , Wooseok Jang , Inès Hyeonsu Kim , Minseop Kwak , Doyup Lee , Seungryong Kim

There has been tremendous progress in large-scale text-to-image synthesis driven by diffusion models enabling versatile downstream applications such as 3D object synthesis from texts, image editing, and customized generation. We present a…

计算机视觉与模式识别 · 计算机科学 2023-04-05 Ting-Hsuan Liao , Songwei Ge , Yiran Xu , Yao-Chih Lee , Badour AlBahar , Jia-Bin Huang

While image diffusion models have made significant progress in text-driven 3D content creation, they often fail to accurately capture the intended meaning of text prompts, especially for view information. This limitation leads to the Janus…

计算机视觉与模式识别 · 计算机科学 2024-03-22 Zhipeng Hu , Minda Zhao , Chaoyi Zhao , Xinyue Liang , Lincheng Li , Zeng Zhao , Changjie Fan , Xiaowei Zhou , Xin Yu

Text-embedded image generation plays a critical role in industries such as graphic design, advertising, and digital content creation. Text-to-Image generation methods leveraging diffusion models, such as TextDiffuser-2, have demonstrated…

计算机视觉与模式识别 · 计算机科学 2025-11-11 Kazi Mahathir Rahman , Showrin Rahman , Sharmin Sultana Srishty

We propose a simple yet effective pipeline for stylizing a 3D scene, harnessing the power of 2D image diffusion models. Given a NeRF model reconstructed from a set of multi-view images, we perform 3D style transfer by refining the source…

计算机视觉与模式识别 · 计算机科学 2024-09-05 Haruo Fujiwara , Yusuke Mukuta , Tatsuya Harada

In recent times, automatic text-to-3D content creation has made significant progress, driven by the development of pretrained 2D diffusion models. Existing text-to-3D methods typically optimize the 3D representation to ensure that the…

计算机视觉与模式识别 · 计算机科学 2024-07-31 Yiwei Ma , Yijun Fan , Jiayi Ji , Haowei Wang , Xiaoshuai Sun , Guannan Jiang , Annan Shu , Rongrong Ji