中文
相关论文

相关论文: Relightable and Animatable Neural Avatar from Spar…

200 篇论文

This work addresses the problem of real-time rendering of photorealistic human body avatars learned from multi-view videos. While the classical approaches to model and render virtual humans generally use a textured mesh, recent research has…

计算机视觉与模式识别 · 计算机科学 2024-03-29 Arthur Moreau , Jifei Song , Helisa Dhamo , Richard Shaw , Yiren Zhou , Eduardo Pérez-Pellitero

We present neural radiance fields for rendering and temporal (4D) reconstruction of humans in motion (H-NeRF), as captured by a sparse set of cameras or even from a monocular video. Our approach combines ideas from neural scene…

计算机视觉与模式识别 · 计算机科学 2021-11-03 Hongyi Xu , Thiemo Alldieck , Cristian Sminchisescu

High-fidelity reconstruction of 3D human avatars has a wild application in visual reality. In this paper, we introduce FAGhead, a method that enables fully controllable human portraits from monocular videos. We explicit the traditional 3D…

计算机视觉与模式识别 · 计算机科学 2024-07-01 Yixin Xuan , Xinyang Li , Gongxin Yao , Shiwei Zhou , Donghui Sun , Xiaoxin Chen , Yu Pan

We have recently seen tremendous progress in the neural advances for photo-real human modeling and rendering. However, it's still challenging to integrate them into an existing mesh-based pipeline for downstream applications. In this paper,…

Reconstructing an avatar from a portrait image has many applications in multimedia, but remains a challenging research problem. Extracting reflectance maps and geometry from one image is ill-posed: recovering geometry is a one-to-many…

计算机视觉与模式识别 · 计算机科学 2023-12-25 Abdallah Dib , Luiz Gustavo Hafemann , Emeline Got , Trevor Anderson , Amin Fadaeinejad , Rafael M. O. Cruz , Marc-Andre Carbonneau

This paper presents a unified surface reconstruction and rendering framework for LiDAR-visual systems, integrating Neural Radiance Fields (NeRF) and Neural Distance Fields (NDF) to recover both appearance and structural information from…

机器人学 · 计算机科学 2024-09-10 Jianheng Liu , Chunran Zheng , Yunfei Wan , Bowen Wang , Yixi Cai , Fu Zhang

We address the problem of photorealistic 3D face avatar synthesis from sparse images. Existing Parametric models for face avatar reconstruction struggle to generate details that originate from inputs. Meanwhile, although current NeRF-based…

计算机视觉与模式识别 · 计算机科学 2023-06-27 Weichen Zhang , Xiang Zhou , Yukang Cao , Wensen Feng , Chun Yuan

We introduce SparseNeuS, a novel neural rendering based method for the task of surface reconstruction from multi-view images. This task becomes more difficult when only sparse images are provided as input, a scenario where existing neural…

计算机视觉与模式识别 · 计算机科学 2022-08-03 Xiaoxiao Long , Cheng Lin , Peng Wang , Taku Komura , Wenping Wang

The appearance of a human in clothing is driven not only by the pose but also by its temporal context, i.e., motion. However, such context has been largely neglected by existing monocular human modeling methods whose neural networks often…

计算机视觉与模式识别 · 计算机科学 2023-12-29 Hansol Lee , Junuk Cha , Yunhoe Ku , Jae Shin Yoon , Seungryul Baek

We present a novel method for reconstructing personalized 3D human avatars with realistic animation from only a few images. Due to the large variations in body shapes, poses, and cloth types, existing methods mostly require hours of…

This paper presents a Surface-Aligned Gaussian representation for creating animatable human avatars from monocular videos,aiming at improving the novel view and pose synthesis performance while ensuring fast training and real-time…

计算机视觉与模式识别 · 计算机科学 2024-12-03 Ronghan Chen , Yang Cong , Jiayue Liu

We introduce HOSNeRF, a novel 360{\deg} free-viewpoint rendering method that reconstructs neural radiance fields for dynamic human-object-scene from a single monocular in-the-wild video. Our method enables pausing the video at any frame and…

计算机视觉与模式识别 · 计算机科学 2023-04-25 Jia-Wei Liu , Yan-Pei Cao , Tianyuan Yang , Eric Zhongcong Xu , Jussi Keppo , Ying Shan , Xiaohu Qie , Mike Zheng Shou

We present a method that enables synthesizing novel views and novel poses of arbitrary human performers from sparse multi-view images. A key ingredient of our method is a hybrid appearance blending module that combines the advantages of the…

计算机视觉与模式识别 · 计算机科学 2023-04-12 Youngjoong Kwon , Dahun Kim , Duygu Ceylan , Henry Fuchs

Traditional 3D morphable face models (3DMMs) provide fine-grained control over expression but cannot easily capture geometric and appearance details. Neural volumetric representations approach photorealism but are hard to animate and do not…

计算机视觉与模式识别 · 计算机科学 2022-11-07 Yufeng Zheng , Victoria Fernández Abrevaya , Marcel C. Bühler , Xu Chen , Michael J. Black , Otmar Hilliges

Recently, the reconstruction of high-fidelity 3D head models from static portrait image has made great progress. However, most methods require multi-view or multi-illumination information, which therefore put forward high requirements for…

计算机视觉与模式识别 · 计算机科学 2023-12-15 Xueying Wang , Juyong Zhang

We present ARCH++, an image-based method to reconstruct 3D avatars with arbitrary clothing styles. Our reconstructed avatars are animation-ready and highly realistic, in both the visible regions from input views and the unseen regions.…

计算机视觉与模式识别 · 计算机科学 2022-03-01 Tong He , Yuanlu Xu , Shunsuke Saito , Stefano Soatto , Tony Tung

High-fidelity reconstruction of fluids from sparse multiview RGB videos remains a formidable challenge due to the complexity of the underlying physics as well as complex occlusion and lighting in captures. Existing solutions either assume…

We present HRM$^2$Avatar, a framework for creating high-fidelity avatars from monocular phone scans, which can be rendered and animated in real time on mobile devices. Monocular capture with smartphones provides a low-cost alternative to…

图形学 · 计算机科学 2025-10-30 Chao Shi , Shenghao Jia , Jinhui Liu , Yong Zhang , Liangchao Zhu , Zhonglei Yang , Jinze Ma , Chaoyue Niu , Chengfei Lv

We present MatDecompSDF, a novel framework for recovering high-fidelity 3D shapes and decomposing their physically-based material properties from multi-view images. The core challenge of inverse rendering lies in the ill-posed…

计算机视觉与模式识别 · 计算机科学 2025-12-30 Chengyu Wang , Isabella Bennett , Henry Scott , Liang Zhang , Mei Chen , Hao Li , Rui Zhao

Generating controllable and photorealistic digital human avatars is a long-standing and important problem in Vision and Graphics. Recent methods have shown great progress in terms of either photorealism or inference speed while the…

计算机视觉与模式识别 · 计算机科学 2023-10-18 Youngjoong Kwon , Lingjie Liu , Henry Fuchs , Marc Habermann , Christian Theobalt