English
Related papers

Related papers: Learning Compositional Radiance Fields of Dynamic …

200 papers

Neural Radiance Fields (NeRF) is a technique for high quality novel view synthesis from a collection of posed input images. Like most view synthesis methods, NeRF uses tonemapped low dynamic range (LDR) as input; these images have been…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Ben Mildenhall , Peter Hedman , Ricardo Martin-Brualla , Pratul Srinivasan , Jonathan T. Barron

Neural Radiance Fields employ simple volume rendering as a way to overcome the challenges of differentiating through ray-triangle intersections by leveraging a probabilistic notion of visibility. This is achieved by assuming the scene is…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Andrea Tagliasacchi , Ben Mildenhall

Neural Radiance Fields (NeRF) have demonstrated superior novel view synthesis performance but are slow at rendering. To speed up the volume rendering process, many acceleration methods have been proposed at the cost of large memory…

Computer Vision and Pattern Recognition · Computer Science 2022-12-19 Sicheng Li , Hao Li , Yue Wang , Yiyi Liao , Lu Yu

Volumetric videos, benefiting from immersive 3D realism and interactivity, hold vast potential for various applications, while the tremendous data volume poses significant challenges for compression. Recently, NeRF has demonstrated…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Zhiyu Zhang , Guo Lu , Huanxiong Liang , Anni Tang , Qiang Hu , Li Song

We present Dynamic Neural Portraits, a novel approach to the problem of full-head reenactment. Our method generates photo-realistic video portraits by explicitly controlling head pose, facial expressions and eye gaze. Our proposed…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Michail Christos Doukas , Stylianos Ploumpis , Stefanos Zafeiriou

Modeling dynamic scenes is important for many applications such as virtual reality and telepresence. Despite achieving unprecedented fidelity for novel view synthesis in dynamic scenes, existing methods based on Neural Radiance Fields…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Jia-Wei Liu , Yan-Pei Cao , Weijia Mao , Wenqiao Zhang , David Junhao Zhang , Jussi Keppo , Ying Shan , Xiaohu Qie , Mike Zheng Shou

Existing inverse rendering combined with neural rendering methods can only perform editable novel view synthesis on object-specific scenes, while we present intrinsic neural radiance fields, dubbed IntrinsicNeRF, which introduce intrinsic…

Computer Vision and Pattern Recognition · Computer Science 2023-08-30 Weicai Ye , Shuo Chen , Chong Bao , Hujun Bao , Marc Pollefeys , Zhaopeng Cui , Guofeng Zhang

We present Non-Rigid Neural Radiance Fields (NR-NeRF), a reconstruction and novel view synthesis approach for general non-rigid dynamic scenes. Our approach takes RGB images of a dynamic scene as input (e.g., from a monocular video…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Edgar Tretschk , Ayush Tewari , Vladislav Golyanik , Michael Zollhöfer , Christoph Lassner , Christian Theobalt

In recent years, Neural Radiance Fields (NeRF) have achieved remarkable progress in dynamic human reconstruction and rendering. Part-based rendering paradigms, guided by human segmentation, allow for flexible parameter allocation based on…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Yao Lu , Jiawei Li , Ming Jiang

Neural scene representations, both continuous and discrete, have recently emerged as a powerful new paradigm for 3D scene understanding. Recent efforts have tackled unsupervised discovery of object-centric neural scene representations.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Cameron Smith , Hong-Xing Yu , Sergey Zakharov , Fredo Durand , Joshua B. Tenenbaum , Jiajun Wu , Vincent Sitzmann

Neural radiance fields achieve unprecedented quality for novel view synthesis, but their volumetric formulation remains expensive, requiring a huge number of samples to render high-resolution images. Volumetric encodings are essential to…

Computer Vision and Pattern Recognition · Computer Science 2023-11-17 Zian Wang , Tianchang Shen , Merlin Nimier-David , Nicholas Sharp , Jun Gao , Alexander Keller , Sanja Fidler , Thomas Müller , Zan Gojcic

We study the problem of novel view synthesis from sparse source observations of a scene comprised of 3D objects. We propose a simple yet effective approach that is neither continuous nor implicit, challenging recent trends on view…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Pengsheng Guo , Miguel Angel Bautista , Alex Colburn , Liang Yang , Daniel Ulbricht , Joshua M. Susskind , Qi Shan

We present animatable neural radiance fields (animatable NeRF) for detailed human avatar creation from monocular videos. Our approach extends neural radiance fields (NeRF) to the dynamic scenes with human movements via introducing explicit…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Jianchuan Chen , Ying Zhang , Di Kang , Xuefei Zhe , Linchao Bao , Xu Jia , Huchuan Lu

Neural Radiance Field (NeRF) is a framework that represents a 3D scene in the weights of a fully connected neural network, known as the Multi-Layer Perception(MLP). The method was introduced for the task of novel view synthesis and is able…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Mohamed Debbagh

Neural reconstruction models for autonomous driving simulation have made significant strides in recent years, with dynamic models becoming increasingly prevalent. However, these models are typically limited to handling in-domain objects…

Neural Radiance Fields (NeRF) have been proposed for photorealistic novel view rendering. However, it requires many different views of one scene for training. Moreover, it has poor generalizations to new scenes and requires retraining or…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Yurui Chen , Chun Gu , Feihu Zhang , Li Zhang

Volumetric neural rendering methods, such as neural radiance fields (NeRFs), have enabled photo-realistic novel view synthesis. However, in their standard form, NeRFs do not support the editing of objects, such as a human head, within a…

Computer Vision and Pattern Recognition · Computer Science 2022-06-15 ShahRukh Athar , Zexiang Xu , Kalyan Sunkavalli , Eli Shechtman , Zhixin Shu

Efficient and accurate 3D reconstruction is essential for applications in cultural heritage. This study addresses the challenge of visualizing objects within large-scale scenes at a high level of detail (LOD) using Neural Radiance Fields…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Quoc-Anh Bui , Gilles Rougeron , Géraldine Morin , Simone Gasparini

The goal of this work is to perform 3D reconstruction and novel view synthesis from data captured by scanning platforms commonly deployed for world mapping in urban outdoor environments (e.g., Street View). Given a sequence of posed RGB…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Konstantinos Rematas , Andrew Liu , Pratul P. Srinivasan , Jonathan T. Barron , Andrea Tagliasacchi , Thomas Funkhouser , Vittorio Ferrari

Humans have a strong intuitive understanding of the 3D environment around us. The mental model of the physics in our brain applies to objects of different materials and enables us to perform a wide range of manipulation tasks that are far…

Robotics · Computer Science 2021-11-15 Yunzhu Li , Shuang Li , Vincent Sitzmann , Pulkit Agrawal , Antonio Torralba