中文
相关论文

相关论文: DITTO-NeRF: Diffusion-based Iterative Text To Omni…

200 篇论文

Diffusion models have emerged as the leading approach for text-to-image generation. However, their iterative sampling process, which gradually morphs random noise into coherent images, introduces significant latency that limits their…

计算机视觉与模式识别 · 计算机科学 2026-02-16 Peijie Qiu , Hariharan Ramshankar , Arnau Ramisa , René Vidal , Amit Kumar K C , Vamsi Salaka , Rahul Bhagat

Neural Radiance Field (NeRF) has shown remarkable performance in novel view synthesis but requires numerous multi-view images, limiting its practicality in few-shot scenarios. Ray augmentation has been proposed to alleviate overfitting…

计算机视觉与模式识别 · 计算机科学 2025-08-07 Ingyun Lee , Jae Won Jang , Seunghyeon Seo , Nojun Kwak

As a powerful representation of 3D scenes, the neural radiance field (NeRF) enables high-quality novel view synthesis from multi-view images. Stylizing NeRF, however, remains challenging, especially on simulating a text-guided style with…

计算机视觉与模式识别 · 计算机科学 2022-12-16 Can Wang , Ruixiang Jiang , Menglei Chai , Mingming He , Dongdong Chen , Jing Liao

We propose \textbf{DMV3D}, a novel 3D generation approach that uses a transformer-based 3D large reconstruction model to denoise multi-view diffusion. Our reconstruction model incorporates a triplane NeRF representation and can denoise…

计算机视觉与模式识别 · 计算机科学 2023-11-16 Yinghao Xu , Hao Tan , Fujun Luan , Sai Bi , Peng Wang , Jiahao Li , Zifan Shi , Kalyan Sunkavalli , Gordon Wetzstein , Zexiang Xu , Kai Zhang

Recent works on generalizable NeRFs have shown promising results on novel view synthesis from single or few images. However, such models have rarely been applied on other downstream tasks beyond synthesis such as semantic understanding and…

计算机视觉与模式识别 · 计算机科学 2024-04-10 Jianglong Ye , Naiyan Wang , Xiaolong Wang

Recently, the impressive generative capabilities of diffusion models have been demonstrated, producing images with remarkable fidelity. Particularly, existing methods for the 3D object generation tasks, which is one of the fastest-growing…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Jaeseok Lee , Jaekoo Lee

Aliasing artifacts in renderings produced by Neural Radiance Field (NeRF) is a long-standing but complex issue in the field of 3D implicit representation, which arises from a multitude of intricate causes and was mitigated by designing more…

计算机视觉与模式识别 · 计算机科学 2024-07-11 Ganlin Yang , Kaidong Zhang , Jingjing Fu , Dong Liu

Text-driven 3D scene generation techniques have made rapid progress in recent years. Their success is mainly attributed to using existing generative models to iteratively perform image warping and inpainting to generate 3D scenes. However,…

计算机视觉与模式识别 · 计算机科学 2024-03-15 Frank Zhang , Yibo Zhang , Quan Zheng , Rui Ma , Wei Hua , Hujun Bao , Weiwei Xu , Changqing Zou

Neural Radiance Field (NeRF) is a representation for 3D reconstruction from multi-view images. Despite some recent work showing preliminary success in editing a reconstructed NeRF with diffusion prior, they remain struggling to synthesize…

计算机视觉与模式识别 · 计算机科学 2024-11-14 Chieh Hubert Lin , Changil Kim , Jia-Bin Huang , Qinbo Li , Chih-Yao Ma , Johannes Kopf , Ming-Hsuan Yang , Hung-Yu Tseng

We present DreamAvatar, a text-and-shape guided framework for generating high-quality 3D human avatars with controllable poses. While encouraging results have been reported by recent methods on text-guided 3D common object generation,…

计算机视觉与模式识别 · 计算机科学 2023-12-01 Yukang Cao , Yan-Pei Cao , Kai Han , Ying Shan , Kwan-Yee K. Wong

Virtual reality and augmented reality (XR) bring increasing demand for 3D content. However, creating high-quality 3D content requires tedious work that a human expert must do. In this work, we study the challenging task of lifting a single…

计算机视觉与模式识别 · 计算机科学 2023-04-04 Dejia Xu , Yifan Jiang , Peihao Wang , Zhiwen Fan , Yi Wang , Zhangyang Wang

Volumetric neural rendering methods like NeRF generate high-quality view synthesis results but are optimized per-scene leading to prohibitive reconstruction time. On the other hand, deep multi-view stereo methods can quickly reconstruct…

计算机视觉与模式识别 · 计算机科学 2023-03-17 Qiangeng Xu , Zexiang Xu , Julien Philip , Sai Bi , Zhixin Shu , Kalyan Sunkavalli , Ulrich Neumann

Generating high-quality 3D objects from textual descriptions remains a challenging problem due to computational cost, the scarcity of 3D data, and complex 3D representations. We introduce Geometry Image Diffusion (GIMDiffusion), a novel…

计算机视觉与模式识别 · 计算机科学 2024-09-06 Slava Elizarov , Ciara Rowles , Simon Donné

Recent CLIP-guided 3D optimization methods, such as DreamFields and PureCLIPNeRF, have achieved impressive results in zero-shot text-to-3D synthesis. However, due to scratch training and random initialization without prior knowledge, these…

计算机视觉与模式识别 · 计算机科学 2023-04-04 Jiale Xu , Xintao Wang , Weihao Cheng , Yan-Pei Cao , Ying Shan , Xiaohu Qie , Shenghua Gao

3D reconstruction from images has wide applications in Virtual Reality and Automatic Driving, where the precision requirement is very high. Ground-breaking research in the neural radiance field (NeRF) by utilizing Multi-Layer Perceptions…

计算机视觉与模式识别 · 计算机科学 2022-09-28 Jiaming Shen , Bolin Song , Zirui Wu , Yi Xu

Numerous diffusion models have recently been applied to image synthesis and editing. However, editing 3D scenes is still in its early stages. It poses various challenges, such as the requirement to design specific methods for different…

计算机视觉与模式识别 · 计算机科学 2023-12-01 Shuangkang Fang , Yufeng Wang , Yi Yang , Yi-Hsuan Tsai , Wenrui Ding , Shuchang Zhou , Ming-Hsuan Yang

In NeRF-aided editing tasks, object movement presents difficulties in supervision generation due to the introduction of variability in object positions. Moreover, the removal operations of certain scene objects often lead to empty regions,…

计算机视觉与模式识别 · 计算机科学 2024-05-24 Zhenyang Li , Zilong Chen , Feifan Qu , Mingqing Wang , Yizhou Zhao , Kai Zhang , Yifan Peng

Neural Radiance Field (NeRF) has exhibited outstanding three-dimensional (3D) reconstruction quality via the novel view synthesis from multi-view images and paired calibrated camera parameters. However, previous NeRF-based systems have been…

计算机视觉与模式识别 · 计算机科学 2023-03-10 Dogyoon Lee , Minhyeok Lee , Chajin Shin , Sangyoun Lee

We proposed a novel test-time optimisation (TTO) approach framed by a NeRF-based architecture for long-term 3D point tracking. Most current methods in point tracking struggle to obtain consistent motion or are limited to 2D motion. TTO…

计算机视觉与模式识别 · 计算机科学 2025-08-14 Gerardo Loza , Junlei Hu , Dominic Jones , Sharib Ali , Pietro Valdastri

Existing single image-to-3D creation methods typically involve a two-stage process, first generating multi-view images, and then using these images for 3D reconstruction. However, training these two stages separately leads to significant…

计算机视觉与模式识别 · 计算机科学 2025-05-02 Hao Wen , Zehuan Huang , Yaohui Wang , Xinyuan Chen , Lu Sheng