中文
相关论文

相关论文: Representing Animatable Avatar via Factorized Neur…

200 篇论文

Video-driven 3D facial animation transfer aims to drive avatars to reproduce the expressions of actors. Existing methods have achieved remarkable results by constraining both geometric and perceptual consistency. However, geometric…

图形学 · 计算机科学 2024-10-10 Feng Qiu , Wei Zhang , Chen Liu , Rudong An , Lincheng Li , Yu Ding , Changjie Fan , Zhipeng Hu , Xin Yu

Visually exploring in a real-world 4D spatiotemporal space freely in VR has been a long-term quest. The task is especially appealing when only a few or even single RGB cameras are used for capturing the dynamic scene. To this end, we…

计算机视觉与模式识别 · 计算机科学 2023-02-21 Liangchen Song , Anpei Chen , Zhong Li , Zhang Chen , Lele Chen , Junsong Yuan , Yi Xu , Andreas Geiger

Neural Radiance Fields (NeRFs) typically struggle to reconstruct and render highly specular objects, whose appearance varies quickly with changes in viewpoint. Recent works have improved NeRF's ability to render detailed specular appearance…

计算机视觉与模式识别 · 计算机科学 2024-05-24 Dor Verbin , Pratul P. Srinivasan , Peter Hedman , Ben Mildenhall , Benjamin Attal , Richard Szeliski , Jonathan T. Barron

This paper addresses the challenge of reconstructing an animatable human model from a multi-view video. Some recent works have proposed to decompose a non-rigidly deforming scene into a canonical neural radiance field and a set of…

计算机视觉与模式识别 · 计算机科学 2021-10-08 Sida Peng , Junting Dong , Qianqian Wang , Shangzhan Zhang , Qing Shuai , Xiaowei Zhou , Hujun Bao

We propose a new method for learning a generalized animatable neural human representation from a sparse set of multi-view imagery of multiple persons. The learned representation can be used to synthesize novel view images of an arbitrary…

计算机视觉与模式识别 · 计算机科学 2023-05-24 Yiming Wang , Qingzhe Gao , Libin Liu , Lingjie Liu , Christian Theobalt , Baoquan Chen

With the success of Neural Radiance Field (NeRF) in 3D-aware portrait editing, a variety of works have achieved promising results regarding both quality and 3D consistency. However, these methods heavily rely on per-prompt optimization when…

计算机视觉与模式识别 · 计算机科学 2024-02-05 Jianhui Li , Shilong Liu , Zidong Liu , Yikai Wang , Kaiwen Zheng , Jinghui Xu , Jianmin Li , Jun Zhu

In this paper, we propose HeadNeRF, a novel NeRF-based parametric head model that integrates the neural radiance field to the parametric representation of the human head. It can render high fidelity head images in real-time on modern GPUs,…

计算机视觉与模式识别 · 计算机科学 2022-05-03 Yang Hong , Bo Peng , Haiyao Xiao , Ligang Liu , Juyong Zhang

Neural Radiance Fields (NeRFs) are a powerful representation for modeling a 3D scene as a continuous function. Though NeRF is able to render complex 3D scenes with view-dependent effects, few efforts have been devoted to exploring its…

计算机视觉与模式识别 · 计算机科学 2022-11-18 Yifan Jiang , Peter Hedman , Ben Mildenhall , Dejia Xu , Jonathan T. Barron , Zhangyang Wang , Tianfan Xue

In this paper, we present a novel double diffusion based neural radiance field, dubbed DD-NeRF, to reconstruct human body geometry and render the human body appearance in novel views from a sparse set of images. We first propose a double…

计算机视觉与模式识别 · 计算机科学 2022-01-19 Guangming Yao , Hongzhi Wu , Yi Yuan , Lincheng Li , Kun Zhou , Xin Yu

Obtaining personalized 3D animatable avatars from a monocular camera has several real world applications in gaming, virtual try-on, animation, and VR/XR, etc. However, it is very challenging to model dynamic and fine-grained clothing…

计算机视觉与模式识别 · 计算机科学 2023-10-31 Yuxuan Xue , Bharat Lal Bhatnagar , Riccardo Marin , Nikolaos Sarafianos , Yuanlu Xu , Gerard Pons-Moll , Tony Tung

There has been rapid progress recently on 3D human rendering, including novel view synthesis and pose animation, based on the advances of neural radiance fields (NeRF). However, most existing methods focus on person-specific training and…

计算机视觉与模式识别 · 计算机科学 2022-07-28 Xiangjun Gao , Jiaolong Yang , Jongyoo Kim , Sida Peng , Zicheng Liu , Xin Tong

We present an approach to generate a 360-degree view of a person with a consistent, high-resolution appearance from a single input image. NeRF and its variants typically require videos or images from different viewpoints. Most existing…

计算机视觉与模式识别 · 计算机科学 2023-11-16 Badour AlBahar , Shunsuke Saito , Hung-Yu Tseng , Changil Kim , Johannes Kopf , Jia-Bin Huang

Neural Radiance Fields (NeRF) have demonstrated exceptional capabilities in reconstructing complex scenes with high fidelity. However, NeRF's view dependency can only handle low-frequency reflections. It falls short when handling complex…

计算机视觉与模式识别 · 计算机科学 2024-11-08 Chen Gao , Yipeng Wang , Changil Kim , Jia-Bin Huang , Johannes Kopf

The quality of three-dimensional reconstruction is a key factor affecting the effectiveness of its application in areas such as virtual reality (VR) and augmented reality (AR) technologies. Neural Radiance Fields (NeRF) can generate…

计算机视觉与模式识别 · 计算机科学 2023-06-09 Qianqiu Tan , Tao Liu , Yinling Xie , Shuwan Yu , Baohua Zhang

Recently, text-guided digital portrait editing has attracted more and more attentions. However, existing methods still struggle to maintain consistency across time, expression, and view or require specific data prerequisites. To solve these…

计算机视觉与模式识别 · 计算机科学 2023-12-01 Haiyao Xiao , Chenglai Zhong , Xuan Gao , Yudong Guo , Juyong Zhang

Neural Radiance Fields (NeRF) is a popular view synthesis technique that represents a scene as a continuous volumetric function, parameterized by multilayer perceptrons that provide the volume density and view-dependent emitted radiance at…

计算机视觉与模式识别 · 计算机科学 2021-12-08 Dor Verbin , Peter Hedman , Ben Mildenhall , Todd Zickler , Jonathan T. Barron , Pratul P. Srinivasan

Pose transfer of human videos aims to generate a high fidelity video of a target person imitating actions of a source person. A few studies have made great progress either through image translation with deep latent features or neural…

计算机视觉与模式识别 · 计算机科学 2023-05-09 Yang-tian Sun , Hao-zhi Huang , Xuan Wang , Yu-kun Lai , Wei Liu , Lin Gao

Recent advances in Neural Radiance Fields (NeRF) have demonstrated significant potential for representing 3D scene appearances as implicit neural networks, enabling the synthesis of high-fidelity novel views. However, the lengthy training…

计算机视觉与模式识别 · 计算机科学 2023-10-04 Tong Wang , Shuichi Kurabayashi

Recent neural human representations can produce high-quality multi-view rendering but require using dense multi-view inputs and costly training. They are hence largely limited to static models as training each frame is infeasible. We…

计算机视觉与模式识别 · 计算机科学 2022-03-28 Fuqiang Zhao , Wei Yang , Jiakai Zhang , Pei Lin , Yingliang Zhang , Jingyi Yu , Lan Xu

While recent work has shown progress on extracting clothed 3D human avatars from a single image, video, or a set of 3D scans, several limitations remain. Most methods use a holistic representation to jointly model the body and clothing,…

计算机视觉与模式识别 · 计算机科学 2022-10-06 Yao Feng , Jinlong Yang , Marc Pollefeys , Michael J. Black , Timo Bolkart