English
Related papers

Related papers: Animating NeRFs from Texture Space: A Framework fo…

200 papers

Neural radiance fields (NeRF) appeared recently as a powerful tool to generate realistic views of objects and confined areas. Still, they face serious challenges with open scenes, where the camera has unrestricted movement and content can…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Ahmad AlMughrabi , Umair Haroon , Ricardo Marques , Petia Radeva

Recent advances in Neural Radiance Fields (NeRFs) have made it possible to reconstruct and reanimate dynamic portrait scenes with control over head-pose, facial expressions and viewing direction. However, training such models assumes…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 ShahRukh Athar , Zhixin Shu , Zexiang Xu , Fujun Luan , Sai Bi , Kalyan Sunkavalli , Dimitris Samaras

Recent advances in neural radiance fields have enabled the high-fidelity 3D reconstruction of complex scenes for novel view synthesis. However, it remains underexplored how the appearance of such representations can be efficiently edited…

Computer Vision and Pattern Recognition · Computer Science 2023-01-25 Zhengfei Kuang , Fujun Luan , Sai Bi , Zhixin Shu , Gordon Wetzstein , Kalyan Sunkavalli

Unlike opaque object, novel view synthesis of transparent object is a challenging task, because transparent object refracts light of background causing visual distortions on the transparent object surface along the viewpoint change.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Heechan Yoon , Seungkyu Lee

This work targets at using a general deep learning framework to synthesize free-viewpoint images of arbitrary human performers, only requiring a sparse number of camera views as inputs and skirting per-case fine-tuning. The large variation…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Wei Cheng , Su Xu , Jingtan Piao , Chen Qian , Wayne Wu , Kwan-Yee Lin , Hongsheng Li

Generating high-fidelity garment animations through traditional workflows, from modeling to rendering, is both tedious and expensive. These workflows often require repetitive steps in response to updates in character motion, rendering…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Renke Wang , Meng Zhang , Jun Li , Jian Yan

Obtaining high-quality 3D reconstructions of room-scale scenes is of paramount importance for upcoming applications in AR or VR. These range from mixed reality applications for teleconferencing, virtual measuring, virtual room planing, to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Dejan Azinović , Ricardo Martin-Brualla , Dan B Goldman , Matthias Nießner , Justus Thies

Neural Radiance Field (NeRF) has emerged as a compelling method to represent 3D objects and scenes for photo-realistic rendering. However, its implicit representation causes difficulty in manipulating the models like the explicit mesh…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Jiaxiang Tang , Xiaokang Chen , Jingbo Wang , Gang Zeng

Neural radiance fields (NeRF) are a groundbreaking computer vision technology that enables the generation of high-quality, immersive visual content from multiple viewpoints. This capability has significant advantages for applications such…

Multimedia · Computer Science 2024-09-30 Pedro Martin , Antonio Rodrigues , Joao Ascenso , Maria Paula Queluz

Animating virtual avatars with free-view control is crucial for various applications like virtual reality and digital entertainment. Previous studies have attempted to utilize the representation power of the neural radiance field (NeRF) to…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Zhengming Yu , Wei Cheng , Xian Liu , Wayne Wu , Kwan-Yee Lin

While Neural Radiance Fields (NeRFs) had achieved unprecedented novel view synthesis results, they have been struggling in dealing with large-scale cluttered scenes with sparse input views and highly view-dependent appearances.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Xinhang Liu , Yu-Wing Tai , Chi-Keung Tang

Modeling hand-object interactions is a fundamentally challenging task in 3D computer vision. Despite remarkable progress that has been achieved in this field, existing methods still fail to synthesize the hand-object interaction…

Computer Vision and Pattern Recognition · Computer Science 2024-02-12 Zhongqun Zhang , Jifei Song , Eduardo Pérez-Pellitero , Yiren Zhou , Hyung Jin Chang , Aleš Leonardis

We present DietNeRF, a 3D neural scene representation estimated from a few images. Neural Radiance Fields (NeRF) learn a continuous volumetric representation of a scene through multi-view consistency, and can be rendered from novel…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Ajay Jain , Matthew Tancik , Pieter Abbeel

Neural Radiance Fields (NeRF) have recently demonstrated photo-realistic results for the task of novel view synthesis. In this paper, we propose to apply novel view synthesis to the robot relocalization problem: we demonstrate improvement…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Arthur Moreau , Nathan Piasco , Dzmitry Tsishkou , Bogdan Stanciulescu , Arnaud de La Fortelle

We present dynamic neural radiance fields for modeling the appearance and dynamics of a human face. Digitally modeling and reconstructing a talking human is a key building-block for a variety of applications. Especially, for telepresence…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Guy Gafni , Justus Thies , Michael Zollhöfer , Matthias Nießner

Neural radiance fields (NeRF) rely on volume rendering to synthesize novel views. Volume rendering requires evaluating an integral along each ray, which is numerically approximated with a finite sum that corresponds to the exact integral…

Computer Vision and Pattern Recognition · Computer Science 2024-01-22 Mikaela Angelina Uy , Kiyohiro Nakayama , Guandao Yang , Rahul Krishna Thomas , Leonidas Guibas , Ke Li

We introduce a method to render Neural Radiance Fields (NeRFs) in real time using PlenOctrees, an octree-based 3D representation which supports view-dependent effects. Our method can render 800x800 images at more than 150 FPS, which is over…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Alex Yu , Ruilong Li , Matthew Tancik , Hao Li , Ren Ng , Angjoo Kanazawa

We present a framework, called MVG-NeRF, that combines classical Multi-View Geometry algorithms and Neural Radiance Fields (NeRF) for image-based 3D reconstruction. NeRF has revolutionized the field of implicit 3D representations, mainly…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Marco Orsingher , Paolo Zani , Paolo Medici , Massimo Bertozzi

We introduce HOSNeRF, a novel 360{\deg} free-viewpoint rendering method that reconstructs neural radiance fields for dynamic human-object-scene from a single monocular in-the-wild video. Our method enables pausing the video at any frame and…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Jia-Wei Liu , Yan-Pei Cao , Tianyuan Yang , Eric Zhongcong Xu , Jussi Keppo , Ying Shan , Xiaohu Qie , Mike Zheng Shou

The neural radiance field (NeRF) for realistic novel view synthesis requires camera poses to be pre-acquired by a structure-from-motion (SfM) approach. This two-stage strategy is not convenient to use and degrades the performance because…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Shu Chen , Yang Zhang , Yaxin Xu , Beiji Zou