中文
相关论文

相关论文: Relightable and Animatable Neural Avatars from Vid…

200 篇论文

Recent works have shown that neural radiance fields (NeRFs) on top of parametric models have reached SOTA quality to build photorealistic head avatars from a monocular video. However, one major limitation of the NeRF-based avatars is the…

计算机视觉与模式识别 · 计算机科学 2024-11-08 Huan Wang , Feitong Tan , Ziqian Bai , Yinda Zhang , Shichen Liu , Qiangeng Xu , Menglei Chai , Anish Prabhu , Rohit Pandey , Sean Fanello , Zeng Huang , Yun Fu

Reconstructing realistic 3D human avatars from monocular videos is a challenging task due to the limited geometric information and complex non-rigid motion involved. We present MonoCloth, a new method for reconstructing and animating…

计算机视觉与模式识别 · 计算机科学 2025-11-18 Daisheng Jin , Ying He

Recent advancements in 3D avatar generation excel with multi-view supervision for photorealistic models. However, monocular counterparts lag in quality despite broader applicability. We propose ReCaLaB to close this gap. ReCaLaB is a…

计算机视觉与模式识别 · 计算机科学 2024-03-26 Yuchen Rao , Eduardo Perez Pellitero , Benjamin Busam , Yiren Zhou , Jifei Song

We present a unified framework for reconstructing animatable 3D human avatars from a single portrait across head, half-body, and full-body inputs. Our method tackles three bottlenecks: pose- and framing-sensitive feature representations,…

计算机视觉与模式识别 · 计算机科学 2026-04-07 Jiawei Zhang , Lei Chu , Jiahao Li , Zhenyu Zang , Chong Li , Xiao Li , Xun Cao , Hao Zhu , Yan Lu

In this paper, we propose a novel approach to reconstruct 3D human body shapes based on a sparse set of RGBD frames using a single RGBD camera. We specifically focus on the realistic settings where human subjects move freely during the…

计算机视觉与模式识别 · 计算机科学 2020-06-16 Xinxin Zuo , Sen Wang , Jiangbin Zheng , Weiwei Yu , Minglun Gong , Ruigang Yang , Li Cheng

Acquisition and rendering of photo-realistic human heads is a highly challenging research problem of particular importance for virtual telepresence. Currently, the highest quality is achieved by volumetric approaches trained in a person…

计算机视觉与模式识别 · 计算机科学 2021-01-08 Amit Raj , Michael Zollhoefer , Tomas Simon , Jason Saragih , Shunsuke Saito , James Hays , Stephen Lombardi

We introduce a novel framework for 3D human avatar generation and personalization, leveraging text prompts to enhance user engagement and customization. Central to our approach are key innovations aimed at overcoming the challenges in…

Reconstructing a dynamic human with loose clothing is an important but difficult task. To address this challenge, we propose a method named DLCA-Recon to create human avatars from monocular videos. The distance from loose clothing to the…

计算机视觉与模式识别 · 计算机科学 2023-12-21 Chunjie Luo , Fei Luo , Yusen Wang , Enxu Zhao , Chunxia Xiao

We propose a new method for reconstructing controllable implicit 3D human models from sparse multi-view RGB videos. Our method defines the neural scene representation on the mesh surface points and signed distances from the surface of a…

计算机视觉与模式识别 · 计算机科学 2022-04-05 Tianhan Xu , Yasuhiro Fujita , Eiichi Matsumoto

Efficiently modeling relightable human avatars from sparse-view videos is crucial for AR/VR applications. Current methods use neural implicit representations to capture dynamic geometry and reflectance, which incur high costs due to the…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Jiacheng Wu , Ruiqi Zhang , Jie Chen , Hui Zhang

We propose a neural rendering-based system that creates head avatars from a single photograph. Our approach models a person's appearance by decomposing it into two layers. The first layer is a pose-dependent coarse image that is synthesized…

计算机视觉与模式识别 · 计算机科学 2020-08-25 Egor Zakharov , Aleksei Ivakhnenko , Aliaksandra Shysheya , Victor Lempitsky

We present a novel method for reconstructing personalized 3D human avatars with realistic animation from only a few images. Due to the large variations in body shapes, poses, and cloth types, existing methods mostly require hours of…

Recent advancements in text-to-image generation have enabled significant progress in zero-shot 3D shape generation. This is achieved by score distillation, a methodology that uses pre-trained text-to-image diffusion models to optimize the…

计算机视觉与模式识别 · 计算机科学 2023-05-29 Zhenzhen Weng , Zeyu Wang , Serena Yeung

We study the problem of creating high-fidelity and animatable 3D avatars from only textual descriptions. Existing text-to-avatar methods are either limited to static avatars which cannot be animated or struggle to generate animatable…

图形学 · 计算机科学 2023-11-30 Jianfeng Zhang , Xuanmeng Zhang , Huichao Zhang , Jun Hao Liew , Chenxu Zhang , Yi Yang , Jiashi Feng

A human 3D avatar is one of the important elements in the metaverse, and the modeling effect directly affects people's visual experience. However, the human body has a complex topology and diverse details, so it is often expensive,…

计算机视觉与模式识别 · 计算机科学 2023-06-07 Mingyang Sun , Dingkang Yang , Dongliang Kou , Yang Jiang , Weihua Shan , Zhe Yan , Lihua Zhang

Faithful real-time facial animation is essential for avatar-mediated telepresence in Virtual Reality (VR). To emulate authentic communication, avatar animation needs to be efficient and accurate: able to capture both extreme and subtle…

计算机视觉与模式识别 · 计算机科学 2024-07-19 Shaojie Bai , Te-Li Wang , Chenghui Li , Akshay Venkatesh , Tomas Simon , Chen Cao , Gabriel Schwartz , Ryan Wrench , Jason Saragih , Yaser Sheikh , Shih-En Wei

In this paper, we aim to create generalizable and controllable neural signed distance fields (SDFs) that represent clothed humans from monocular depth observations. Recent advances in deep learning, especially neural implicit…

计算机视觉与模式识别 · 计算机科学 2022-01-21 Shaofei Wang , Marko Mihajlovic , Qianli Ma , Andreas Geiger , Siyu Tang

Reconstructing 3D clothed human avatars from single images is a challenging task, especially when encountering complex poses and loose clothing. Current methods exhibit limitations in performance, largely attributable to their dependence on…

计算机视觉与模式识别 · 计算机科学 2023-10-24 Zechuan Zhang , Li Sun , Zongxin Yang , Ling Chen , Yi Yang

This paper presents a method that can quickly adapt dynamic 3D avatars to arbitrary text descriptions of novel styles. Among existing approaches for avatar stylization, direct optimization methods can produce excellent results for arbitrary…

计算机视觉与模式识别 · 计算机科学 2023-05-31 Thu Nguyen-Phuoc , Gabriel Schwartz , Yuting Ye , Stephen Lombardi , Lei Xiao

Synthesizing realistic videos of talking faces under custom lighting conditions and viewing angles benefits various downstream applications like video conferencing. However, most existing relighting methods are either time-consuming or…

计算机视觉与模式识别 · 计算机科学 2024-10-25 Ziqi Cai , Kaiwen Jiang , Shu-Yu Chen , Yu-Kun Lai , Hongbo Fu , Boxin Shi , Lin Gao