中文
相关论文

相关论文: 3D-aware Blending with Generative NeRFs

200 篇论文

We use neural radiance fields (NeRFs) to build interactive 3D environments from large-scale visual captures spanning buildings or even multiple city blocks collected primarily from drones. In contrast to single object scenes (on which NeRFs…

计算机视觉与模式识别 · 计算机科学 2022-03-30 Haithem Turki , Deva Ramanan , Mahadev Satyanarayanan

In this work, we focus on synthesizing high-fidelity novel view images for arbitrary human performers, given a set of sparse multi-view images. It is a challenging task due to the large variation among articulated body poses and heavy…

计算机视觉与模式识别 · 计算机科学 2023-03-27 Jianchuan Chen , Wentao Yi , Liqian Ma , Xu Jia , Huchuan Lu

Since it is usually difficult to capture an all-in-focus image of a 3D scene directly, various multi-focus image fusion methods are employed to generate it from several images focusing at different depths. However, the performance of…

计算机视觉与模式识别 · 计算机科学 2019-11-05 Haoyu Ma , Juncheng Zhang , Shaojun Liu , Qingmin Liao

We address efficient and structure-aware 3D scene representation from images. Nerflets are our key contribution -- a set of local neural radiance fields that together represent a scene. Each nerflet maintains its own spatial position,…

计算机视觉与模式识别 · 计算机科学 2023-03-13 Xiaoshuai Zhang , Abhijit Kundu , Thomas Funkhouser , Leonidas Guibas , Hao Su , Kyle Genova

In advanced mission concepts with high levels of autonomy, spacecraft need to internally model the pose and shape of nearby orbiting objects. Recent works in neural scene representations show promising results for inferring generic…

计算机视觉与模式识别 · 计算机科学 2021-05-14 Anne Mergy , Gurvan Lecuyer , Dawa Derksen , Dario Izzo

We present iNeRF, a framework that performs mesh-free pose estimation by "inverting" a Neural RadianceField (NeRF). NeRFs have been shown to be remarkably effective for the task of view synthesis - synthesizing photorealistic novel views of…

计算机视觉与模式识别 · 计算机科学 2021-08-11 Lin Yen-Chen , Pete Florence , Jonathan T. Barron , Alberto Rodriguez , Phillip Isola , Tsung-Yi Lin

This paper introduces a novel continual learning framework for synthesising novel views of multiple scenes, learning multiple 3D scenes incrementally, and updating the network parameters only with the training data of the upcoming new…

计算机视觉与模式识别 · 计算机科学 2024-09-10 Yuze Wang , Junyi Wang , Chen Wang , Wantong Duan , Yongtang Bao , Yue Qi

We introduce InseRF, a novel method for generative object insertion in the NeRF reconstructions of 3D scenes. Based on a user-provided textual description and a 2D bounding box in a reference viewpoint, InseRF generates new objects in 3D…

计算机视觉与模式识别 · 计算机科学 2024-01-11 Mohamad Shahbazi , Liesbeth Claessens , Michael Niemeyer , Edo Collins , Alessio Tonioni , Luc Van Gool , Federico Tombari

Neural radiance fields (NeRFs) are a widely accepted standard for synthesizing new 3D object views from a small number of base images. However, NeRFs have limited generalization properties, which means that we need to use significant…

计算机视觉与模式识别 · 计算机科学 2024-02-05 Paweł Batorski , Dawid Malarz , Marcin Przewięźlikowski , Marcin Mazur , Sławomir Tadeja , Przemysław Spurek

Text-driven localized editing of 3D objects is particularly difficult as locally mixing the original 3D object with the intended new object and style effects without distorting the object's form is not a straightforward process. To address…

计算机视觉与模式识别 · 计算机科学 2023-09-12 Hyeonseop Song , Seokhun Choi , Hoseok Do , Chul Lee , Taehyeong Kim

Neural Radiances Fields (NeRF) and their extensions have shown great success in representing 3D scenes and synthesizing novel-view images. However, most NeRF methods take in low-dynamic-range (LDR) images, which may lose details, especially…

计算机视觉与模式识别 · 计算机科学 2024-01-12 Guanjun Wu , Taoran Yi , Jiemin Fang , Wenyu Liu , Xinggang Wang

While Neural Radiance Fields (NeRFs) had achieved unprecedented novel view synthesis results, they have been struggling in dealing with large-scale cluttered scenes with sparse input views and highly view-dependent appearances.…

计算机视觉与模式识别 · 计算机科学 2023-03-28 Xinhang Liu , Yu-Wing Tai , Chi-Keung Tang

In this work, we propose the use of Neural Radiance Fields (NeRF) as a scene representation for visual localization. Recently, NeRF has been employed to enhance pose regression and scene coordinate regression models by augmenting the…

计算机视觉与模式识别 · 计算机科学 2024-08-22 Qunjie Zhou , Maxim Maximov , Or Litany , Laura Leal-Taixé

Recent advances in Neural Radiance Fields (NeRF) boast impressive performances for generative tasks such as novel view synthesis and 3D reconstruction. Methods based on neural radiance fields are able to represent the 3D world implicitly by…

计算机视觉与模式识别 · 计算机科学 2022-11-23 Jesus Zarzar , Sara Rojas , Silvio Giancola , Bernard Ghanem

We propose a pipeline to generate Neural Radiance Fields~(NeRF) of an object or a scene of a specific class, conditioned on a single input image. This is a challenging task, as training NeRF requires multiple views of the same scene,…

计算机视觉与模式识别 · 计算机科学 2022-03-01 Shengqu Cai , Anton Obukhov , Dengxin Dai , Luc Van Gool

Generative Adversarial Networks (GANs) have emerged as powerful tools for high-quality image generation and real image editing by manipulating their latent spaces. Recent advancements in GANs include 3D-aware models such as EG3D, which…

计算机视觉与模式识别 · 计算机科学 2025-04-16 Bahri Batuhan Bilecen , Yigit Yalin , Ning Yu , Aysegul Dundar

Neural radiance fields (NeRF) have revolutionized the field of image-based view synthesis. However, NeRF uses straight rays and fails to deal with complicated light path changes caused by refraction and reflection. This prevents NeRF from…

计算机视觉与模式识别 · 计算机科学 2023-09-25 Xiaoxue Chen , Junchen Liu , Hao Zhao , Guyue Zhou , Ya-Qin Zhang

This paper presents a novel approach for sparse 3D reconstruction by leveraging the expressive power of Neural Radiance Fields (NeRFs) and fast transfer of their features to learn accurate occupancy fields. Existing 3D reconstruction…

计算机视觉与模式识别 · 计算机科学 2024-10-01 Shubhendu Jena , Franck Multon , Adnane Boukhayma

With the advent of Neural Radiance Field (NeRF), representing 3D scenes through multiple observations has shown remarkable improvements in performance. Since this cutting-edge technique is able to obtain high-resolution renderings by…

机器人学 · 计算机科学 2023-09-18 Minjae Lee , Kyeongsu Kang , Hyeonwoo Yu

The neural radiance field (NeRF) achieved remarkable success in modeling 3D scenes and synthesizing high-fidelity novel views. However, existing NeRF-based methods focus more on the make full use of the image resolution to generate novel…

计算机视觉与模式识别 · 计算机科学 2023-04-27 Yuqi Han , Tao Yu , Xiaohang Yu , Yuwang Wang , Qionghai Dai