English
Related papers

Related papers: Neural Human Performer: Learning Generalizable Rad…

200 papers

In this paper, we propose HeadNeRF, a novel NeRF-based parametric head model that integrates the neural radiance field to the parametric representation of the human head. It can render high fidelity head images in real-time on modern GPUs,…

Computer Vision and Pattern Recognition · Computer Science 2022-05-03 Yang Hong , Bo Peng , Haiyao Xiao , Ligang Liu , Juyong Zhang

This paper addresses the challenge of Neural Field (NeF) generalization, where models must efficiently adapt to new signals given only a few observations. To tackle this, we propose Geometric Neural Process Fields (G-NPF), a probabilistic…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Wenzhe Yin , Zehao Xiao , Jiayi Shen , Yunlu Chen , Cees G. M. Snoek , Jan-Jakob Sonke , Efstratios Gavves

We propose a novel framework to reconstruct accurate appearance and geometry with neural radiance fields (NeRF) for interacting hands, enabling the rendering of photo-realistic images and videos for gesture animation from arbitrary views.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Zhiyang Guo , Wengang Zhou , Min Wang , Li Li , Houqiang Li

Existing Human NeRF methods for reconstructing 3D humans typically rely on multiple 2D images from multi-view cameras or monocular videos captured from fixed camera views. However, in real-world scenarios, human images are often captured…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Shoukang Hu , Fangzhou Hong , Liang Pan , Haiyi Mei , Lei Yang , Ziwei Liu

We present HumanNeRF-SE, a simple yet effective method that synthesizes diverse novel pose images with simple input. Previous HumanNeRF works require a large number of optimizable parameters to fit the human images. Instead, we reload these…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Caoyuan Ma , Yu-Lun Liu , Zhixiang Wang , Wu Liu , Xinchen Liu , Zheng Wang

Animating virtual avatars with free-view control is crucial for various applications like virtual reality and digital entertainment. Previous studies have attempted to utilize the representation power of the neural radiance field (NeRF) to…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Zhengming Yu , Wei Cheng , Xian Liu , Wayne Wu , Kwan-Yee Lin

Neural radiance fields (NeRFs) are able to synthesize realistic novel views from multi-view images captured from distinct positions and perspectives. In NeRF's rendering pipeline, neural networks are used to represent a scene independently…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Kang Han , Wei Xiang , Lu Yu

Neural Radiance Fields (NeRF) have demonstrated impressive performance in novel view synthesis. However, NeRF and most of its variants still rely on traditional complex pipelines to provide extrinsic and intrinsic camera parameters, such as…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Qingsong Yan , Qiang Wang , Kaiyong Zhao , Jie Chen , Bo Li , Xiaowen Chu , Fei Deng

We present a novel semantic model for human head defined with neural radiance field. The 3D-consistent head model consist of a set of disentangled and interpretable bases, and can be driven by low-dimensional expression coefficients. Thanks…

Graphics · Computer Science 2022-10-13 Xuan Gao , Chenglai Zhong , Jun Xiang , Yang Hong , Yudong Guo , Juyong Zhang

It is now possible to reconstruct dynamic human motion and shape from a sparse set of cameras using Neural Radiance Fields (NeRF) driven by an underlying skeleton. However, a challenge remains to model the deformation of cloth and skin in…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Chunjin Song , Bastian Wandt , Helge Rhodin

The goal of our work is to generate high-quality novel views from monocular videos of complex and dynamic scenes. Prior methods, such as DynamicNeRF, have shown impressive performance by leveraging time-varying dynamic radiation fields.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Xingyu Miao , Yang Bai , Haoran Duan , Yawen Huang , Fan Wan , Yang Long , Yefeng Zheng

Neural Radiance Field (NeRF) has recently emerged as a powerful representation to synthesize photorealistic novel views. While showing impressive performance, it relies on the availability of dense input views with highly accurate camera…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Prune Truong , Marie-Julie Rakotosaona , Fabian Manhardt , Federico Tombari

We present a simple yet powerful neural network that implicitly represents and renders 3D objects and scenes only from 2D observations. The network models 3D geometries as a general radiance field, which takes a set of 2D images with camera…

Computer Vision and Pattern Recognition · Computer Science 2021-08-12 Alex Trevithick , Bo Yang

Faithful human performance capture and free-view rendering from sparse RGB observations is a long-standing problem in Vision and Graphics. The main challenges are the lack of observations and the inherent ambiguities of the setting, e.g.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Guoxing Sun , Rishabh Dabral , Pascal Fua , Christian Theobalt , Marc Habermann

Considering the problem of novel view synthesis (NVS) from only a set of 2D images, we simplify the training process of Neural Radiance Field (NeRF) on forward-facing scenes by removing the requirement of known or pre-computed camera…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Zirui Wang , Shangzhe Wu , Weidi Xie , Min Chen , Victor Adrian Prisacariu

Neural radiance fields (NeRFs) are a widely accepted standard for synthesizing new 3D object views from a small number of base images. However, NeRFs have limited generalization properties, which means that we need to use significant…

Computer Vision and Pattern Recognition · Computer Science 2024-02-05 Paweł Batorski , Dawid Malarz , Marcin Przewięźlikowski , Marcin Mazur , Sławomir Tadeja , Przemysław Spurek

Recently, many works have been proposed to utilize the neural radiance field for novel view synthesis of human performers. However, most of these methods require hours of training, making them difficult for practical use. To address this…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Bo Peng , Jun Hu , Jingtao Zhou , Xuan Gao , Juyong Zhang

Recent neural rendering approaches for human activities achieve remarkable view synthesis results, but still rely on dense input views or dense training with all the capture frames, leading to deployment difficulty and inefficient training…

Computer Vision and Pattern Recognition · Computer Science 2021-10-04 Anqi Pang , Xin Chen , Haimin Luo , Minye Wu , Jingyi Yu , Lan Xu

In recent years, Neural Radiance Fields (NeRF) has made remarkable progress in the field of computer vision and graphics, providing strong technical support for solving key tasks including 3D scene understanding, new perspective synthesis,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Mingyuan Yao , Yukang Huo , Yang Ran , Qingbin Tian , Ruifeng Wang , Haihua Wang

Creating controllable, photorealistic, and geometrically detailed digital doubles of real humans solely from video data is a key challenge in Computer Graphics and Vision, especially when real-time performance is required. Recent methods…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Heming Zhu , Fangneng Zhan , Christian Theobalt , Marc Habermann