中文
相关论文

相关论文: ED-NeRF: Efficient Text-Guided Editing of 3D Scene…

200 篇论文

Text-driven localized editing of 3D objects is particularly difficult as locally mixing the original 3D object with the intended new object and style effects without distorting the object's form is not a straightforward process. To address…

计算机视觉与模式识别 · 计算机科学 2023-09-12 Hyeonseop Song , Seokhun Choi , Hoseok Do , Chul Lee , Taehyeong Kim

With the popularity of implicit neural representations, or neural radiance fields (NeRF), there is a pressing need for editing methods to interact with the implicit 3D models for tasks like post-processing reconstructed scenes and 3D…

计算机视觉与模式识别 · 计算机科学 2023-08-29 Xiangyu Wang , Jingsen Zhu , Qi Ye , Yuchi Huo , Yunlong Ran , Zhihua Zhong , Jiming Chen

We propose NeRF-Insert, a NeRF editing framework that allows users to make high-quality local edits with a flexible level of control. Unlike previous work that relied on image-to-image models, we cast scene editing as an in-painting…

计算机视觉与模式识别 · 计算机科学 2024-05-01 Benet Oriol Sabat , Alessandro Achille , Matthew Trager , Stefano Soatto

Despite advancements in Neural Implicit models for 3D surface reconstruction, handling dynamic environments with interactions between arbitrary rigid, non-rigid, or deformable entities remains challenging. The generic reconstruction methods…

计算机视觉与模式识别 · 计算机科学 2024-12-05 Sandika Biswas , Qianyi Wu , Biplab Banerjee , Hamid Rezatofighi

In the evolving landscape of text-to-3D technology, Dreamfusion has showcased its proficiency by utilizing Score Distillation Sampling (SDS) to optimize implicit representations such as NeRF. This process is achieved through the…

计算机视觉与模式识别 · 计算机科学 2024-06-17 Yuzhong Huang , Zhong Li , Zhang Chen , Zhiyuan Ren , Guosheng Lin , Fred Morstatter , Yi Xu

Compared to frame-based methods, computational neuromorphic imaging using event cameras offers significant advantages, such as minimal motion blur, enhanced temporal resolution, and high dynamic range. The multi-view consistency of Neural…

计算机视觉与模式识别 · 计算机科学 2025-01-08 Chaoran Feng , Wangbo Yu , Xinhua Cheng , Zhenyu Tang , Junwu Zhang , Li Yuan , Yonghong Tian

Editing a local region or a specific object in a 3D scene represented by a NeRF or consistently blending a new realistic object into the scene is challenging, mainly due to the implicit nature of the scene representation. We present…

计算机视觉与模式识别 · 计算机科学 2024-07-17 Ori Gordon , Omri Avrahami , Dani Lischinski

The tremendous progress in neural image generation, coupled with the emergence of seemingly omnipotent vision-language models has finally enabled text-based interfaces for creating and editing images. Handling generic images requires a…

计算机视觉与模式识别 · 计算机科学 2023-07-27 Omri Avrahami , Ohad Fried , Dani Lischinski

Radiance fields have gradually become a main representation of media. Although its appearance editing has been studied, how to achieve view-consistent recoloring in an efficient manner is still under explored. We present RecolorNeRF, a…

计算机视觉与模式识别 · 计算机科学 2023-09-19 Bingchen Gong , Yuehao Wang , Xiaoguang Han , Qi Dou

Neural Radiance Fields (NeRFs) have recently emerged as a popular option for photo-realistic object capture due to their ability to faithfully capture high-fidelity volumetric content even from handheld video input. Although much research…

计算机视觉与模式识别 · 计算机科学 2024-04-24 Binglun Wang , Niladri Shekhar Dutt , Niloy J. Mitra

Neural rendering techniques combining machine learning with geometric reasoning have arisen as one of the most promising approaches for synthesizing novel views of a scene from a sparse set of images. Among these, stands out the Neural…

计算机视觉与模式识别 · 计算机科学 2020-12-01 Albert Pumarola , Enric Corona , Gerard Pons-Moll , Francesc Moreno-Noguer

Neural fields (NeRF) have emerged as a promising approach for representing continuous 3D scenes. Nevertheless, the lack of semantic encoding in NeRFs poses a significant challenge for scene decomposition. To address this challenge, we…

计算机视觉与模式识别 · 计算机科学 2024-05-09 Ning Wang , Lefei Zhang , Angel X Chang

We present DiSR-NeRF, a diffusion-guided framework for view-consistent super-resolution (SR) NeRF. Unlike prior works, we circumvent the requirement for high-resolution (HR) reference images by leveraging existing powerful 2D…

计算机视觉与模式识别 · 计算机科学 2024-04-02 Jie Long Lee , Chen Li , Gim Hee Lee

Diffusion models have opened the path to a wide range of text-based image editing frameworks. However, these typically build on the multi-step nature of the diffusion backwards process, and adapting them to distilled, fast-sampling methods…

计算机视觉与模式识别 · 计算机科学 2024-08-02 Gilad Deutch , Rinon Gal , Daniel Garibi , Or Patashnik , Daniel Cohen-Or

We propose a simple yet effective pipeline for stylizing a 3D scene, harnessing the power of 2D image diffusion models. Given a NeRF model reconstructed from a set of multi-view images, we perform 3D style transfer by refining the source…

计算机视觉与模式识别 · 计算机科学 2024-09-05 Haruo Fujiwara , Yusuke Mukuta , Tatsuya Harada

As a powerful representation of 3D scenes, the neural radiance field (NeRF) enables high-quality novel view synthesis from multi-view images. Stylizing NeRF, however, remains challenging, especially on simulating a text-guided style with…

计算机视觉与模式识别 · 计算机科学 2022-12-16 Can Wang , Ruixiang Jiang , Menglei Chai , Mingming He , Dongdong Chen , Jing Liao

Large scale text-guided diffusion models have garnered significant attention due to their ability to synthesize diverse images that convey complex visual concepts. This generative power has more recently been leveraged to perform text-to-3D…

计算机视觉与模式识别 · 计算机科学 2023-09-20 Etai Sella , Gal Fiebelman , Peter Hedman , Hadar Averbuch-Elor

Neural radiance fields (NeRF) bring a new wave for 3D interactive experiences. However, as an important part of the immersive experiences, the defocus effects have not been fully explored within NeRF. Some recent NeRF-based methods generate…

计算机视觉与模式识别 · 计算机科学 2022-08-11 Yinhuai Wang , Shuzhou Yang , Yujie Hu , Jian Zhang

We present DietNeRF, a 3D neural scene representation estimated from a few images. Neural Radiance Fields (NeRF) learn a continuous volumetric representation of a scene through multi-view consistency, and can be rendered from novel…

计算机视觉与模式识别 · 计算机科学 2021-04-02 Ajay Jain , Matthew Tancik , Pieter Abbeel

Recent advances in NeRF inpainting have leveraged pretrained diffusion models to enhance performance. However, these methods often yield suboptimal results due to their ineffective utilization of 2D diffusion priors. The limitations…

计算机视觉与模式识别 · 计算机科学 2024-11-26 Menglin Zhang , Xin Luo , Yunwei Lan , Chang Liu , Rui Li , Kaidong Zhang , Ganlin Yang , Dong Liu