English
Related papers

Related papers: NDF: Neural Deformable Fields for Dynamic Human Mo…

200 papers

We propose Medial Atom Ray Fields (MARFs), a novel neural object representation that enables accurate differentiable surface rendering with a single network evaluation per camera ray. Existing neural ray fields struggle with multi-view…

Graphics · Computer Science 2023-07-04 Peder Bergebakken Sundt , Theoharis Theoharis

In visual computing, 3D geometry is represented in many different forms including meshes, point clouds, voxel grids, level sets, and depth images. Each representation is suited for different tasks thus making the transformation of one…

Computer Vision and Pattern Recognition · Computer Science 2022-09-02 Trevor Houchens , Cheng-You Lu , Shivam Duggal , Rao Fu , Srinath Sridhar

In this work, we present a new method for 3D face reconstruction from sparse-view RGB images. Unlike previous methods which are built upon 3D morphable models (3DMMs) with limited details, we leverage an implicit representation to encode…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Moran Li , Haibin Huang , Yi Zheng , Mengtian Li , Nong Sang , Chongyang Ma

In recent years, Neural Radiance Fields (NeRF) has made remarkable progress in the field of computer vision and graphics, providing strong technical support for solving key tasks including 3D scene understanding, new perspective synthesis,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Mingyuan Yao , Yukang Huo , Yang Ran , Qingbin Tian , Ruifeng Wang , Haihua Wang

We propose a Transformer-based NeRF (TransNeRF) to learn a generic neural radiance field conditioned on observed-view images for the novel view synthesis task. By contrast, existing MLP-based NeRFs are not able to directly receive observed…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Dan Wang , Xinrui Cui , Septimiu Salcudean , Z. Jane Wang

Rendering scenes with a high-quality human face from arbitrary viewpoints is a practical and useful technique for many real-world applications. Recently, Neural Radiance Fields (NeRF), a rendering technique that uses neural networks to…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Satoshi Tsutsui , Weijia Mao , Sijing Lin , Yunyi Zhu , Murong Ma , Mike Zheng Shou

For reconstructing high-fidelity human 3D models from monocular videos, it is crucial to maintain consistent large-scale body shapes along with finely matched subtle wrinkles. This paper explores the observation that the per-frame rendering…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Chunjin Song , Zhijie Wu , Bastian Wandt , Leonid Sigal , Helge Rhodin

Novel view synthesis (NVS) is a challenging task in computer vision that involves synthesizing new views of a scene from a limited set of input images. Neural Radiance Fields (NeRF) have emerged as a powerful approach to address this…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Shuja Khalid , Frank Rudzicz

We present an implicit neural representation to learn the spatio-temporal space of kinematic motions. Unlike previous work that represents motion as discrete sequential samples, we propose to express the vast motion space as a continuous…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Chengan He , Jun Saito , James Zachary , Holly Rushmeier , Yi Zhou

High-quality reconstruction of controllable 3D head avatars from 2D videos is highly desirable for virtual human applications in movies, games, and telepresence. Neural implicit fields provide a powerful representation to model 3D head…

Computer Vision and Pattern Recognition · Computer Science 2023-04-24 Chuhan Chen , Matthew O'Toole , Gaurav Bharaj , Pablo Garrido

Neural fields, which represent signals as a function parameterized by a neural network, are a promising alternative to traditional discrete vector or grid-based representations. Compared to discrete representations, neural representations…

Machine Learning · Computer Science 2023-09-14 Jeffrey Gu , Kuan-Chieh Wang , Serena Yeung

Neural representations are popular for representing shapes, as they can be learned form sensor data and used for data cleanup, model completion, shape editing, and shape synthesis. Current neural representations can be categorized as either…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Connor Z. Lin , Niloy J. Mitra , Gordon Wetzstein , Leonidas Guibas , Paul Guerrero

State-of-the-art neural implicit surface representations have achieved impressive results in indoor scene reconstruction by incorporating monocular geometric priors as additional supervision. However, we have observed that multi-view…

Computer Vision and Pattern Recognition · Computer Science 2024-05-02 Ziyi Chen , Xiaolong Wu , Yu Zhang

Neural Radiance Field (NeRF) and its variants have exhibited great success on representing 3D scenes and synthesizing photo-realistic novel views. However, they are generally based on the pinhole camera model and assume all-in-focus inputs.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Zijin Wu , Xingyi Li , Juewen Peng , Hao Lu , Zhiguo Cao , Weicai Zhong

Neural radiance fields (NeRF) achieve highly photo-realistic novel-view synthesis, but it's a challenging problem to edit the scenes modeled by NeRF-based methods, especially for dynamic scenes. We propose editable neural radiance fields…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Chengwei Zheng , Wenbin Lin , Feng Xu

We present DietNeRF, a 3D neural scene representation estimated from a few images. Neural Radiance Fields (NeRF) learn a continuous volumetric representation of a scene through multi-view consistency, and can be rendered from novel…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Ajay Jain , Matthew Tancik , Pieter Abbeel

Knowing the 3D motions in a dynamic scene is essential to many vision applications. Recent progress is mainly focused on estimating the activity of some specific elements like humans. In this paper, we leverage a neural motion field for…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Liangchen Song , Xuan Gong , Benjamin Planche , Meng Zheng , David Doermann , Junsong Yuan , Terrence Chen , Ziyan Wu

We propose an end-to-end deep-learning approach for automatic rigging and retargeting of 3D models of human faces in the wild. Our approach, called Neural Face Rigging (NFR), holds three key properties: (i) NFR's expression space maintains…

Graphics · Computer Science 2023-05-16 Dafei Qin , Jun Saito , Noam Aigerman , Thibault Groueix , Taku Komura

Neural Radiance Fields (NeRFs) provide a high fidelity, continuous scene representation that can realistically represent complex behaviour of light. Despite works like Ref-NeRF improving geometry through physics-inspired models, the ability…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Jack Naylor , Viorela Ila , Donald G. Dansereau

Neural Radiance Fields (NeRF) recently emerged as a new paradigm for object representation from multi-view (MV) images. Yet, it cannot handle multi-scale (MS) images and camera pose estimation errors, which generally is the case with…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Nishant Jain , Suryansh Kumar , Luc Van Gool