English
Related papers

Related papers: 3D-aware Blending with Generative NeRFs

200 papers

Due to the limited model capacity, leveraging distributed Neural Radiance Fields (NeRFs) for modeling extensive urban environments has become a necessity. However, current distributed NeRF registration approaches encounter aliasing…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Baijun Ye , Caiyun Liu , Xiaoyu Ye , Yuantao Chen , Yuhai Wang , Zike Yan , Yongliang Shi , Hao Zhao , Guyue Zhou

We propose a Transformer-based NeRF (TransNeRF) to learn a generic neural radiance field conditioned on observed-view images for the novel view synthesis task. By contrast, existing MLP-based NeRFs are not able to directly receive observed…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Dan Wang , Xinrui Cui , Septimiu Salcudean , Z. Jane Wang

Neural Radiance Fields (NeRF) have emerged as a powerful tool for creating highly detailed and photorealistic scenes. Existing methods for NeRF-based 3D style transfer need extensive per-scene optimization for single or multiple styles,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Adil Meric , Umut Kocasari , Matthias Nießner , Barbara Roessle

Unsupervised learning of 3D-aware generative adversarial networks (GANs) using only collections of single-view 2D photographs has very recently made much progress. These 3D GANs, however, have not been demonstrated for human bodies and the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Alexander W. Bergman , Petr Kellnhofer , Wang Yifan , Eric R. Chan , David B. Lindell , Gordon Wetzstein

Neural Radiance Fields (NeRF) coupled with GANs represent a promising direction in the area of 3D reconstruction from a single view, owing to their ability to efficiently model arbitrary topologies. Recent work in this area, however, has…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Dario Pavllo , David Joseph Tan , Marie-Julie Rakotosaona , Federico Tombari

Neural radiance fields (NeRF) bring a new wave for 3D interactive experiences. However, as an important part of the immersive experiences, the defocus effects have not been fully explored within NeRF. Some recent NeRF-based methods generate…

Computer Vision and Pattern Recognition · Computer Science 2022-08-11 Yinhuai Wang , Shuzhou Yang , Yujie Hu , Jian Zhang

Generative Neural Radiance Fields (GNeRF)-based 3D-aware GANs have showcased remarkable prowess in crafting high-fidelity images while upholding robust 3D consistency, particularly face generation. However, specific existing models…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Jichao Zhang , Aliaksandr Siarohin , Yahui Liu , Hao Tang , Nicu Sebe , Wei Wang

3D scene stylization aims at generating stylized images of the scene from arbitrary novel views following a given set of style examples, while ensuring consistency when rendered from different views. Directly applying methods for image or…

Graphics · Computer Science 2022-05-26 Yi-Hua Huang , Yue He , Yu-Jie Yuan , Yu-Kun Lai , Lin Gao

Neural radiance fields (NeRFs) produce state-of-the-art view synthesis results. However, they are slow to render, requiring hundreds of network evaluations per pixel to approximate a volume rendering integral. Baking NeRFs into explicit…

Computer Vision and Pattern Recognition · Computer Science 2022-05-11 Benjamin Attal , Jia-Bin Huang , Michael Zollhoefer , Johannes Kopf , Changil Kim

Editing a local region or a specific object in a 3D scene represented by a NeRF or consistently blending a new realistic object into the scene is challenging, mainly due to the implicit nature of the scene representation. We present…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Ori Gordon , Omri Avrahami , Dani Lischinski

We present a learning-based method for synthesizing novel views of complex scenes using only unstructured collections of in-the-wild photographs. We build on Neural Radiance Fields (NeRF), which uses the weights of a multilayer perceptron…

Computer Vision and Pattern Recognition · Computer Science 2021-01-07 Ricardo Martin-Brualla , Noha Radwan , Mehdi S. M. Sajjadi , Jonathan T. Barron , Alexey Dosovitskiy , Daniel Duckworth

3D reconstruction methods such as Neural Radiance Fields (NeRFs) excel at rendering photorealistic novel views of complex scenes. However, recovering a high-quality NeRF typically requires tens to hundreds of input images, resulting in a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Rundi Wu , Ben Mildenhall , Philipp Henzler , Keunhong Park , Ruiqi Gao , Daniel Watson , Pratul P. Srinivasan , Dor Verbin , Jonathan T. Barron , Ben Poole , Aleksander Holynski

Recent advances in Neural Radiance Fields (NeRF) have demonstrated promising results in 3D scene representations, including 3D human representations. However, these representations often lack crucial information on the underlying human pose…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Arnab Dey , Di Yang , Rohith Agaram , Antitza Dantcheva , Andrew I. Comport , Srinath Sridhar , Jean Martinet

Neural Radiance Field (NeRF) is a framework that represents a 3D scene in the weights of a fully connected neural network, known as the Multi-Layer Perception(MLP). The method was introduced for the task of novel view synthesis and is able…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Mohamed Debbagh

Neural Radiance Fields (NeRF) has been wildly applied to various tasks for its high-quality representation of 3D scenes. It takes long per-scene training time and per-image testing time. In this paper, we present EfficientNeRF as an…

Computer Vision and Pattern Recognition · Computer Science 2022-06-03 Tao Hu , Shu Liu , Yilun Chen , Tiancheng Shen , Jiaya Jia

Neural Radiance Fields (NeRF) have emerged as a powerful paradigm for 3D scene representation, offering high-fidelity renderings and reconstructions from a set of sparse and unstructured sensor data. In the context of autonomous robotics,…

Robotics · Computer Science 2024-12-09 Yuhang Ming , Xingrui Yang , Weihan Wang , Zheng Chen , Jinglun Feng , Yifan Xing , Guofeng Zhang

Neural Radiance Field (NeRF) has exhibited outstanding three-dimensional (3D) reconstruction quality via the novel view synthesis from multi-view images and paired calibrated camera parameters. However, previous NeRF-based systems have been…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Dogyoon Lee , Minhyeok Lee , Chajin Shin , Sangyoun Lee

We present a pipeline for integrating NeRFs into traditional compositing VFX pipelines using Nerfstudio, an open-source framework for training and rendering NeRFs. Our approach involves using Blender, a widely used open-source 3D creation…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Cyrus Vachha

Reconstruction of deformable scenes from endoscopic videos is important for many applications such as intraoperative navigation, surgical visual perception, and robotic surgery. It is a foundational requirement for realizing autonomous…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Shreya Saha , Zekai Liang , Shan Lin , Jingpei Lu , Michael Yip , Sainan Liu

Neural Radiation Field (NeRF) technology can learn a 3D implicit model of a scene from 2D images and synthesize realistic novel view images. This technology has received widespread attention from the industry and has good application…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Shun Fang , Ming Cui , Xing Feng , Yanna Lv