English
Related papers

Related papers: FaceCLIPNeRF: Text-driven 3D Face Manipulation usi…

200 papers

We present Neural Articulated Radiance Field (NARF), a novel deformable 3D representation for articulated objects learned from images. While recent advances in 3D implicit representation have made it possible to learn models of complex…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Atsuhiro Noguchi , Xiao Sun , Stephen Lin , Tatsuya Harada

We present a unified and compact scene representation for robotics, where each object in the scene is depicted by a latent code capturing geometry and appearance. This representation can be decoded for various tasks such as novel view…

Neural Radiance Fields (NeRF) are able to reconstruct scenes with unprecedented fidelity, and various recent works have extended NeRF to handle dynamic scenes. A common approach to reconstruct such non-rigid scenes is through the use of a…

Computer Vision and Pattern Recognition · Computer Science 2021-09-13 Keunhong Park , Utkarsh Sinha , Peter Hedman , Jonathan T. Barron , Sofien Bouaziz , Dan B Goldman , Ricardo Martin-Brualla , Steven M. Seitz

Neural Radiance Fields (NeRF) have achieved huge success in effectively capturing and representing 3D objects and scenes. However, to establish a ubiquitous presence in everyday media formats, such as images and videos, we need to fulfill…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Gyeongjin Kang , Younggeun Lee , Seungjun Oh , Eunbyung Park

Text-driven localized editing of 3D objects is particularly difficult as locally mixing the original 3D object with the intended new object and style effects without distorting the object's form is not a straightforward process. To address…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Hyeonseop Song , Seokhun Choi , Hoseok Do , Chul Lee , Taehyeong Kim

Neural fields (NeRF) have emerged as a promising approach for representing continuous 3D scenes. Nevertheless, the lack of semantic encoding in NeRFs poses a significant challenge for scene decomposition. To address this challenge, we…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Ning Wang , Lefei Zhang , Angel X Chang

Text-driven 3D scene generation is widely applicable to video gaming, film industry, and metaverse applications that have a large demand for 3D scenes. However, existing text-to-3D generation methods are limited to producing 3D objects with…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Jingbo Zhang , Xiaoyu Li , Ziyu Wan , Can Wang , Jing Liao

High-fidelity facial avatar reconstruction from a monocular video is a significant research problem in computer graphics and computer vision. Recently, Neural Radiance Field (NeRF) has shown impressive novel view rendering results and has…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Yunpeng Bai , Yanbo Fan , Xuan Wang , Yong Zhang , Jingxiang Sun , Chun Yuan , Ying Shan

Recently, Neural Radiance Fields (NeRF) is revolutionizing the task of novel view synthesis (NVS) for its superior performance. In this paper, we propose to synthesize dynamic scenes. Extending the methods for static scenes to dynamic…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Xiang Guo , Guanying Chen , Yuchao Dai , Xiaoqing Ye , Jiadai Sun , Xiao Tan , Errui Ding

Humans describe the physical world using natural language to refer to specific 3D locations based on a vast range of properties: visual appearance, semantics, abstract associations, or actionable affordances. In this work we propose…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Justin Kerr , Chung Min Kim , Ken Goldberg , Angjoo Kanazawa , Matthew Tancik

Neural Radiance Fields (NeRFs) have revolutionized scene novel view synthesis, offering visually realistic, precise, and robust implicit reconstructions. While recent approaches enable NeRF editing, such as object removal, 3D shape…

Computer Vision and Pattern Recognition · Computer Science 2023-09-11 Robin Courant , Xi Wang , Marc Christie , Vicky Kalogeiton

Neural Radiance Fields (NeRF) are compelling techniques for modeling dynamic 3D scenes from 2D image collections. These volumetric representations would be well suited for synthesizing novel facial expressions but for two problems. First,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Heng Yu , Koichiro Niinuma , Laszlo A. Jeni

We propose PAV, Personalized Head Avatar for the synthesis of human faces under arbitrary viewpoints and facial expressions. PAV introduces a method that learns a dynamic deformable neural radiance field (NeRF), in particular from a…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Akin Caliskan , Berkay Kicanaoglu , Hyeongwoo Kim

3D facial avatar reconstruction has been a significant research topic in computer graphics and computer vision, where photo-realistic rendering and flexible controls over poses and expressions are necessary for many related applications.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-10 Wangbo Yu , Yanbo Fan , Yong Zhang , Xuan Wang , Fei Yin , Yunpeng Bai , Yan-Pei Cao , Ying Shan , Yang Wu , Zhongqian Sun , Baoyuan Wu

Dynamic Neural Radiance Fields (NeRFs) achieve remarkable visual quality when synthesizing novel views of time-evolving 3D scenes. However, the common reliance on backward deformation fields makes reanimation of the captured object poses…

Computer Vision and Pattern Recognition · Computer Science 2024-02-12 Lukas Uzolas , Elmar Eisemann , Petr Kellnhofer

While deep learning reshaped the classical motion capture pipeline with feed-forward networks, generative models are required to recover fine alignment via iterative refinement. Unfortunately, the existing models are usually hand-crafted or…

Computer Vision and Pattern Recognition · Computer Science 2021-11-01 Shih-Yang Su , Frank Yu , Michael Zollhoefer , Helge Rhodin

Neural Radiance Fields (NeRFs) are a powerful representation for modeling a 3D scene as a continuous function. Though NeRF is able to render complex 3D scenes with view-dependent effects, few efforts have been devoted to exploring its…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Yifan Jiang , Peter Hedman , Ben Mildenhall , Dejia Xu , Jonathan T. Barron , Zhangyang Wang , Tianfan Xue

We present a novel method for performing flexible, 3D-aware image content manipulation while enabling high-quality novel view synthesis. While NeRF-based approaches are effective for novel view synthesis, such models memorize the radiance…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Verica Lazova , Vladimir Guzov , Kyle Olszewski , Sergey Tulyakov , Gerard Pons-Moll

Reasoning the 3D structure of a non-rigid dynamic scene from a single moving camera is an under-constrained problem. Inspired by the remarkable progress of neural radiance fields (NeRFs) in photo-realistic novel view synthesis of static…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Sameera Ramasinghe , Violetta Shevchenko , Gil Avraham , Anton Van Den Hengel

Neural Radiance Fields (NeRFs) have shown great potential in modeling 3D scenes. Dynamic NeRFs extend this model by capturing time-varying elements, typically using deformation fields. The existing dynamic NeRFs employ a similar Eulerian…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Ancheng Lin , Yusheng Xiang , Jun Li , Mukesh Prasad