English
Related papers

Related papers: GHuNeRF: Generalizable Human NeRF from a Monocular…

200 papers

Recent neural human representations can produce high-quality multi-view rendering but require using dense multi-view inputs and costly training. They are hence largely limited to static models as training each frame is infeasible. We…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Fuqiang Zhao , Wei Yang , Jiakai Zhang , Pei Lin , Yingliang Zhang , Jingyi Yu , Lan Xu

Capturing the dynamically deforming 3D shape of clothed human is essential for numerous applications, including VR/AR, autonomous driving, and human-computer interaction. Existing methods either require a highly specialized capturing setup,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Chen Guo , Xu Chen , Jie Song , Otmar Hilliges

In this work we develop a generalizable and efficient Neural Radiance Field (NeRF) pipeline for high-fidelity free-viewpoint human body synthesis under settings with sparse camera views. Though existing NeRF-based methods can synthesize…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Mingfei Chen , Jianfeng Zhang , Xiangyu Xu , Lijuan Liu , Yujun Cai , Jiashi Feng , Shuicheng Yan

The goal of our work is to generate high-quality novel views from monocular videos of complex and dynamic scenes. Prior methods, such as DynamicNeRF, have shown impressive performance by leveraging time-varying dynamic radiation fields.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Xingyu Miao , Yang Bai , Haoran Duan , Yawen Huang , Fan Wan , Yang Long , Yefeng Zheng

We present FlexNeRF, a method for photorealistic freeviewpoint rendering of humans in motion from monocular videos. Our approach works well with sparse views, which is a challenging scenario when the subject is exhibiting fast/complex…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Vinoj Jayasundara , Amit Agrawal , Nicolas Heron , Abhinav Shrivastava , Larry S. Davis

Human performance capture is a highly important computer vision problem with many applications in movie production and virtual/augmented reality. Many previous performance capture approaches either required expensive multi-view setups or…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Marc Habermann , Weipeng Xu , Michael Zollhoefer , Gerard Pons-Moll , Christian Theobalt

While NeRF-based human representations have shown impressive novel view synthesis results, most methods still rely on a large number of images / views for training. In this work, we propose a novel animatable NeRF called ActorsNeRF. It is…

Computer Vision and Pattern Recognition · Computer Science 2023-04-28 Jiteng Mu , Shen Sang , Nuno Vasconcelos , Xiaolong Wang

This paper addresses the challenge of quickly reconstructing free-viewpoint videos of dynamic humans from sparse multi-view videos. Some recent works represent the dynamic human as a canonical neural radiance field (NeRF) and a motion…

Computer Vision and Pattern Recognition · Computer Science 2023-02-27 Chen Geng , Sida Peng , Zhen Xu , Hujun Bao , Xiaowei Zhou

The neural rendering of humans is a topic of great research significance. However, previous works mostly focus on achieving photorealistic details, neglecting the exploration of human parsing. Additionally, classical semantic work are all…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Jie Zhang , Pengcheng Shi , Zaiwang Gu , Yiyang Zhou , Zhi Wang

We introduce HOSNeRF, a novel 360{\deg} free-viewpoint rendering method that reconstructs neural radiance fields for dynamic human-object-scene from a single monocular in-the-wild video. Our method enables pausing the video at any frame and…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Jia-Wei Liu , Yan-Pei Cao , Tianyuan Yang , Eric Zhongcong Xu , Jussi Keppo , Ying Shan , Xiaohu Qie , Mike Zheng Shou

Monocular 3D human performance capture is indispensable for many applications in computer graphics and vision for enabling immersive experiences. However, detailed capture of humans requires tracking of multiple aspects, including the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Yue Jiang , Marc Habermann , Vladislav Golyanik , Christian Theobalt

In recent advancements in novel view synthesis, generalizable Neural Radiance Fields (NeRF) based methods applied to human subjects have shown remarkable results in generating novel views from few images. However, this generalization…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Arnab Dey , Di Yang , Antitza Dantcheva , Jean Martinet

We present a novel method to learn temporally consistent 3D reconstruction of clothed people from a monocular video. Recent methods for 3D human reconstruction from monocular video using volumetric, implicit or parametric human shape…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Akin Caliskan , Armin Mustafa , Adrian Hilton

Recently, implicit neural representation has been widely used to generate animatable human avatars. However, the materials and geometry of those representations are coupled in the neural network and hard to edit, which hinders their…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Qifeng Chen , Rengan Xie , Kai Huang , Qi Wang , Wenting Zheng , Rong Li , Yuchi Huo

This paper introduces a novel paradigm for the generalizable neural radiance field (NeRF). Previous generic NeRF methods combine multiview stereo techniques with image-based neural rendering for generalization, yielding impressive results,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-26 Jiaxu Wang , Ziyi Zhang , Renjing Xu

We present neural radiance fields for rendering and temporal (4D) reconstruction of humans in motion (H-NeRF), as captured by a sparse set of cameras or even from a monocular video. Our approach combines ideas from neural scene…

Computer Vision and Pattern Recognition · Computer Science 2021-11-03 Hongyi Xu , Thiemo Alldieck , Cristian Sminchisescu

Photorealistic rendering and reposing of humans is important for enabling augmented reality experiences. We propose a novel framework to reconstruct the human and the scene that can be rendered with novel human poses and views from just a…

Computer Vision and Pattern Recognition · Computer Science 2022-09-23 Wei Jiang , Kwang Moo Yi , Golnoosh Samei , Oncel Tuzel , Anurag Ranjan

In this work, we introduce a method that learns a single dynamic neural radiance field (NeRF) from monocular talking face videos of multiple identities. NeRFs have shown remarkable results in modeling the 4D dynamics and appearance of human…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Aggelina Chatziagapi , Grigorios G. Chrysos , Dimitris Samaras

We present animatable neural radiance fields (animatable NeRF) for detailed human avatar creation from monocular videos. Our approach extends neural radiance fields (NeRF) to the dynamic scenes with human movements via introducing explicit…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Jianchuan Chen , Ying Zhang , Di Kang , Xuefei Zhe , Linchao Bao , Xu Jia , Huchuan Lu

This work targets at using a general deep learning framework to synthesize free-viewpoint images of arbitrary human performers, only requiring a sparse number of camera views as inputs and skirting per-case fine-tuning. The large variation…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Wei Cheng , Su Xu , Jingtan Piao , Chen Qian , Wayne Wu , Kwan-Yee Lin , Hongsheng Li