中文
相关论文

相关论文: SealD-NeRF: Interactive Pixel-Level Editing for Dy…

200 篇论文

We propose a method for editing NeRF scenes with text-instructions. Given a NeRF of a scene and the collection of images used to reconstruct it, our method uses an image-conditioned diffusion model (InstructPix2Pix) to iteratively edit the…

计算机视觉与模式识别 · 计算机科学 2023-06-02 Ayaan Haque , Matthew Tancik , Alexei A. Efros , Aleksander Holynski , Angjoo Kanazawa

Extensions of Neural Radiance Fields (NeRFs) to model dynamic scenes have enabled their near photo-realistic, free-viewpoint rendering. Although these methods have shown some potential in creating immersive experiences, two drawbacks limit…

计算机视觉与模式识别 · 计算机科学 2024-06-07 Xinhang Liu , Yu-Wing Tai , Chi-Keung Tang , Pedro Miraldo , Suhas Lohit , Moitreya Chatterjee

We propose a novel visual re-localization method based on direct matching between the implicit 3D descriptors and the 2D image with transformer. A conditional neural radiance field(NeRF) is chosen as the 3D scene representation in our…

计算机视觉与模式识别 · 计算机科学 2023-04-18 Jianlin Liu , Qiang Nie , Yong Liu , Chengjie Wang

Neural Radiance Fields (NeRF) is a novel implicit 3D reconstruction method that shows immense potential and has been gaining increasing attention. It enables the reconstruction of 3D scenes solely from a set of photographs. However, its…

计算机视觉与模式识别 · 计算机科学 2023-10-23 Jiaming Gu , Minchao Jiang , Hongsheng Li , Xiaoyuan Lu , Guangming Zhu , Syed Afaq Ali Shah , Liang Zhang , Mohammed Bennamoun

Neural Radiance Fields (NeRFs) have remodeled 3D scene representation since release. NeRFs can effectively reconstruct complex 3D scenes from 2D images, advancing different fields and applications such as scene understanding, 3D content…

计算机视觉与模式识别 · 计算机科学 2025-12-10 Wenhui Xiao , Remi Chierchia , Rodrigo Santa Cruz , Xuesong Li , David Ahmedt-Aristizabal , Olivier Salvado , Clinton Fookes , Leo Lebrat

Advances in image diffusion models have recently led to notable improvements in the generation of high-quality images. In combination with Neural Radiance Fields (NeRFs), they enabled new opportunities in 3D generation. However, most…

计算机视觉与模式识别 · 计算机科学 2024-03-28 Jan-Niklas Dihlmann , Andreas Engelhardt , Hendrik Lensch

In recent years, Neural Radiance Fields (NeRF) has made remarkable progress in the field of computer vision and graphics, providing strong technical support for solving key tasks including 3D scene understanding, new perspective synthesis,…

计算机视觉与模式识别 · 计算机科学 2024-04-02 Mingyuan Yao , Yukang Huo , Yang Ran , Qingbin Tian , Ruifeng Wang , Haihua Wang

Neural Radiance Fields (NeRF) have significantly advanced the generation of highly realistic and expressive 3D scenes. However, the task of editing NeRF, particularly in terms of geometry modification, poses a significant challenge. This…

图形学 · 计算机科学 2023-10-10 Ruiyang Liu , Jinxu Xiang , Bowen Zhao , Ran Zhang , Jingyi Yu , Changxi Zheng

We present a novel method for performing flexible, 3D-aware image content manipulation while enabling high-quality novel view synthesis. While NeRF-based approaches are effective for novel view synthesis, such models memorize the radiance…

计算机视觉与模式识别 · 计算机科学 2022-04-25 Verica Lazova , Vladimir Guzov , Kyle Olszewski , Sergey Tulyakov , Gerard Pons-Moll

Neural Radiance Field(NeRF) is an novel implicit method to achieve the 3D reconstruction and representation with a high resolution. After the first research of NeRF is proposed, NeRF has gained a robust developing power and is booming in…

计算机视觉与模式识别 · 计算机科学 2024-05-15 Jinwei Lin

Text-driven localized editing of 3D objects is particularly difficult as locally mixing the original 3D object with the intended new object and style effects without distorting the object's form is not a straightforward process. To address…

计算机视觉与模式识别 · 计算机科学 2023-09-12 Hyeonseop Song , Seokhun Choi , Hoseok Do , Chul Lee , Taehyeong Kim

The emergence of Neural Radiance Fields (NeRF) for novel view synthesis has increased interest in 3D scene editing. An essential task in editing is removing objects from a scene while ensuring visual reasonability and multiview consistency.…

计算机视觉与模式识别 · 计算机科学 2023-10-02 Youtan Yin , Zhoujie Fu , Fan Yang , Guosheng Lin

While Neural Radiance Fields (NeRFs) had achieved unprecedented novel view synthesis results, they have been struggling in dealing with large-scale cluttered scenes with sparse input views and highly view-dependent appearances.…

计算机视觉与模式识别 · 计算机科学 2023-03-28 Xinhang Liu , Yu-Wing Tai , Chi-Keung Tang

This paper introduces a novel continual learning framework for synthesising novel views of multiple scenes, learning multiple 3D scenes incrementally, and updating the network parameters only with the training data of the upcoming new…

计算机视觉与模式识别 · 计算机科学 2024-09-10 Yuze Wang , Junyi Wang , Chen Wang , Wantong Duan , Yongtang Bao , Yue Qi

Though neural radiance fields (NeRF) have demonstrated impressive view synthesis results on objects and small bounded regions of space, they struggle on "unbounded" scenes, where the camera may point in any direction and content may exist…

计算机视觉与模式识别 · 计算机科学 2022-03-29 Jonathan T. Barron , Ben Mildenhall , Dor Verbin , Pratul P. Srinivasan , Peter Hedman

Neural scene representations, such as Neural Radiance Fields (NeRF), are based on training a multilayer perceptron (MLP) using a set of color images with known poses. An increasing number of devices now produce RGB-D(color + depth)…

计算机视觉与模式识别 · 计算机科学 2022-11-08 Arnab Dey , Yassine Ahmine , Andrew I. Comport

Though Neural Radiance Field (NeRF) demonstrates compelling novel view synthesis results, it is still unintuitive to edit a pre-trained NeRF because the neural network's parameters and the scene geometry/appearance are often not explicitly…

计算机视觉与模式识别 · 计算机科学 2022-06-13 Hao-Kang Liu , I-Chao Shen , Bing-Yu Chen

Despite the great success in 2D editing using user-friendly tools, such as Photoshop, semantic strokes, or even text prompts, similar capabilities in 3D areas are still limited, either relying on 3D modeling skills or allowing editing…

计算机视觉与模式识别 · 计算机科学 2023-03-28 Chong Bao , Yinda Zhang , Bangbang Yang , Tianxing Fan , Zesong Yang , Hujun Bao , Guofeng Zhang , Zhaopeng Cui

Neural radiance field (NeRF) attracts attention as a promising approach to reconstructing the 3D scene. As NeRF emerges, subsequent studies have been conducted to model dynamic scenes, which include motions or topological changes. However,…

计算机视觉与模式识别 · 计算机科学 2022-12-07 Hankyu Jang , Daeyoung Kim

Although there has been significant progress in neural radiance fields, an issue on dynamic illumination changes still remains unsolved. Different from relevant works that parameterize time-variant/-invariant components in scenes, subjects'…

计算机视觉与模式识别 · 计算机科学 2026-04-03 Changyeon Won , Hyunjun Jung , Jungu Cho , Seonmi Park , Chi-Hoon Lee , Hae-Gon Jeon