中文
相关论文

相关论文: CoNFies: Controllable Neural Face Avatars

200 篇论文

This paper presents BioNeRF, a biologically plausible architecture that models scenes in a 3D representation and synthesizes new views through radiance fields. Since NeRF relies on the network weights to store the scene's 3-dimensional…

计算机视觉与模式识别 · 计算机科学 2024-11-27 Leandro A. Passos , Douglas Rodrigues , Danilo Jodas , Kelton A. P. Costa , Ahsan Adeel , João Paulo Papa

Neural radiance field (NeRF) enables the synthesis of cutting-edge realistic novel view images of a 3D scene. It includes density and color fields to model the shape and radiance of a scene, respectively. Supervised by the photometric loss…

计算机视觉与模式识别 · 计算机科学 2023-12-21 Qihang Fang , Yafei Song , Keqiang Li , Liefeng Bo

Neural Radiance Fields (NeRF) recently emerged as a new paradigm for object representation from multi-view (MV) images. Yet, it cannot handle multi-scale (MS) images and camera pose estimation errors, which generally is the case with…

计算机视觉与模式识别 · 计算机科学 2022-10-11 Nishant Jain , Suryansh Kumar , Luc Van Gool

Dynamic Neural Radiance Field (NeRF) is a powerful algorithm capable of rendering photo-realistic novel view images from a monocular RGB video of a dynamic scene. Although it warps moving points across frames from the observation spaces to…

计算机视觉与模式识别 · 计算机科学 2023-03-28 Zhiwen Yan , Chen Li , Gim Hee Lee

Neural Radiance Fields (NeRF) have emerged as a potent paradigm for representing scenes and synthesizing photo-realistic images. A main limitation of conventional NeRFs is that they often fail to produce high-quality renderings under novel…

计算机视觉与模式识别 · 计算机科学 2022-05-13 Jian Zhang , Yuanqing Zhang , Huan Fu , Xiaowei Zhou , Bowen Cai , Jinchi Huang , Rongfei Jia , Binqiang Zhao , Xing Tang

In this work, we aim to detect the changes caused by object variations in a scene represented by the neural radiance fields (NeRFs). Given an arbitrary view and two sets of scene images captured at different timestamps, we can predict the…

计算机视觉与模式识别 · 计算机科学 2023-12-27 Rui Huang , Binbin Jiang , Qingyi Zhao , William Wang , Yuxiang Zhang , Qing Guo

We present Non-Rigid Neural Radiance Fields (NR-NeRF), a reconstruction and novel view synthesis approach for general non-rigid dynamic scenes. Our approach takes RGB images of a dynamic scene as input (e.g., from a monocular video…

计算机视觉与模式识别 · 计算机科学 2021-08-24 Edgar Tretschk , Ayush Tewari , Vladislav Golyanik , Michael Zollhöfer , Christoph Lassner , Christian Theobalt

We introduce a technique for pairwise registration of neural fields that extends classical optimization-based local registration (i.e. ICP) to operate on Neural Radiance Fields (NeRF) -- neural 3D scene representations trained from…

计算机视觉与模式识别 · 计算机科学 2022-11-04 Lily Goli , Daniel Rebain , Sara Sabour , Animesh Garg , Andrea Tagliasacchi

As a powerful representation of 3D scenes, the neural radiance field (NeRF) enables high-quality novel view synthesis from multi-view images. Stylizing NeRF, however, remains challenging, especially on simulating a text-guided style with…

计算机视觉与模式识别 · 计算机科学 2022-12-16 Can Wang , Ruixiang Jiang , Menglei Chai , Mingming He , Dongdong Chen , Jing Liao

Fully unsupervised 3D representation learning has gained attention owing to its advantages in data collection. A successful approach involves a viewpoint-aware approach that learns an image distribution based on generative models (e.g.,…

计算机视觉与模式识别 · 计算机科学 2022-06-14 Takuhiro Kaneko

We address efficient and structure-aware 3D scene representation from images. Nerflets are our key contribution -- a set of local neural radiance fields that together represent a scene. Each nerflet maintains its own spatial position,…

计算机视觉与模式识别 · 计算机科学 2023-03-13 Xiaoshuai Zhang , Abhijit Kundu , Thomas Funkhouser , Leonidas Guibas , Hao Su , Kyle Genova

We propose a Transformer-based NeRF (TransNeRF) to learn a generic neural radiance field conditioned on observed-view images for the novel view synthesis task. By contrast, existing MLP-based NeRFs are not able to directly receive observed…

计算机视觉与模式识别 · 计算机科学 2022-06-14 Dan Wang , Xinrui Cui , Septimiu Salcudean , Z. Jane Wang

We present a learning-based method for synthesizing novel views of complex scenes using only unstructured collections of in-the-wild photographs. We build on Neural Radiance Fields (NeRF), which uses the weights of a multilayer perceptron…

计算机视觉与模式识别 · 计算机科学 2021-01-07 Ricardo Martin-Brualla , Noha Radwan , Mehdi S. M. Sajjadi , Jonathan T. Barron , Alexey Dosovitskiy , Daniel Duckworth

We propose a new method for reconstructing controllable implicit 3D human models from sparse multi-view RGB videos. Our method defines the neural scene representation on the mesh surface points and signed distances from the surface of a…

计算机视觉与模式识别 · 计算机科学 2022-04-05 Tianhan Xu , Yasuhiro Fujita , Eiichi Matsumoto

For reconstructing high-fidelity human 3D models from monocular videos, it is crucial to maintain consistent large-scale body shapes along with finely matched subtle wrinkles. This paper explores the observation that the per-frame rendering…

计算机视觉与模式识别 · 计算机科学 2024-06-04 Chunjin Song , Zhijie Wu , Bastian Wandt , Leonid Sigal , Helge Rhodin

A practical benefit of implicit visual representations like Neural Radiance Fields (NeRFs) is their memory efficiency: large scenes can be efficiently stored and shared as small neural nets instead of collections of images. However,…

计算机视觉与模式识别 · 计算机科学 2023-05-23 Jiading Fang , Shengjie Lin , Igor Vasiljevic , Vitor Guizilini , Rares Ambrus , Adrien Gaidon , Gregory Shakhnarovich , Matthew R. Walter

Neural Radiance Fields (NeRFs) have emerged as a popular approach for novel view synthesis. While NeRFs are quickly being adapted for a wider set of applications, intuitively editing NeRF scenes is still an open challenge. One important…

Neural volumetric representations such as Neural Radiance Fields (NeRF) have emerged as a compelling technique for learning to represent 3D scenes from images with the goal of rendering photorealistic images of the scene from unobserved…

计算机视觉与模式识别 · 计算机科学 2021-03-29 Peter Hedman , Pratul P. Srinivasan , Ben Mildenhall , Jonathan T. Barron , Paul Debevec

Neural Radiance Fields (NeRF) use multi-view images for 3D scene representation, demonstrating remarkable performance. As one of the primary sources of multi-view images, multi-camera systems encounter challenges such as varying intrinsic…

计算机视觉与模式识别 · 计算机科学 2024-12-09 Yu Gao , Lutong Su , Hao Liang , Yufeng Yue , Yi Yang , Mengyin Fu

In recent years, Neural Radiance Fields (NeRF) has made remarkable progress in the field of computer vision and graphics, providing strong technical support for solving key tasks including 3D scene understanding, new perspective synthesis,…

计算机视觉与模式识别 · 计算机科学 2024-04-02 Mingyuan Yao , Yukang Huo , Yang Ran , Qingbin Tian , Ruifeng Wang , Haihua Wang