中文
相关论文

相关论文: Learning Disentangled Avatars with Hybrid 3D Repre…

200 篇论文

Acquisition and rendering of photo-realistic human heads is a highly challenging research problem of particular importance for virtual telepresence. Currently, the highest quality is achieved by volumetric approaches trained in a person…

计算机视觉与模式识别 · 计算机科学 2021-01-08 Amit Raj , Michael Zollhoefer , Tomas Simon , Jason Saragih , Shunsuke Saito , James Hays , Stephen Lombardi

Our goal is to efficiently learn personalized animatable 3D head avatars from videos that are geometrically accurate, realistic, relightable, and compatible with current rendering systems. While 3D meshes enable efficient processing and are…

计算机视觉与模式识别 · 计算机科学 2023-10-30 Shrisha Bharadwaj , Yufeng Zheng , Otmar Hilliges , Michael J. Black , Victoria Fernandez-Abrevaya

Large-scale pre-trained vision-language models allow for the zero-shot text-based generation of 3D avatars. The previous state-of-the-art method utilized CLIP to supervise neural implicit models that reconstructed a human body mesh.…

计算机视觉与模式识别 · 计算机科学 2023-09-15 Shuo Huang , Zongxin Yang , Liangting Li , Yi Yang , Jia Jia

Two major approaches exist for creating animatable human avatars. The first, a 3D-based approach, optimizes a NeRF- or 3DGS-based avatar from videos of a single person, achieving personalization through a disentangled identity…

计算机视觉与模式识别 · 计算机科学 2025-08-14 Geonhee Sim , Gyeongsik Moon

We present HAHA - a novel approach for animatable human avatar generation from monocular input videos. The proposed method relies on learning the trade-off between the use of Gaussian splatting and a textured mesh for efficient and high…

计算机视觉与模式识别 · 计算机科学 2024-10-10 David Svitov , Pietro Morerio , Lourdes Agapito , Alessio Del Bue

In recent years, more and more attention has been paid to the learning of 3D human representation. However, the complexity of lots of hand-defined human body constraints and the absence of supervision data limit that the existing works…

计算机视觉与模式识别 · 计算机科学 2025-05-27 Lu Wang , Xishuai Peng , S. Kevin Zhou

Efficiently digitizing high-fidelity animatable human avatars from videos is a challenging and active research topic. Recent volume rendering-based neural representations open a new way for human digitization with their friendly usability…

计算机视觉与模式识别 · 计算机科学 2023-03-24 Xiaoke Huang , Yiji Cheng , Yansong Tang , Xiu Li , Jie Zhou , Jiwen Lu

Unsupervised generation of clothed virtual humans with various appearance and animatable poses is important for creating 3D human avatars and other AR/VR applications. Existing methods are either limited to rigid object modeling, or not…

计算机视觉与模式识别 · 计算机科学 2022-08-02 Jianfeng Zhang , Zihang Jiang , Dingdong Yang , Hongyi Xu , Yichun Shi , Guoxian Song , Zhongcong Xu , Xinchao Wang , Jiashi Feng

A human 3D avatar is one of the important elements in the metaverse, and the modeling effect directly affects people's visual experience. However, the human body has a complex topology and diverse details, so it is often expensive,…

计算机视觉与模式识别 · 计算机科学 2023-06-07 Mingyang Sun , Dingkang Yang , Dongliang Kou , Yang Jiang , Weihua Shan , Zhe Yan , Lihua Zhang

We present X-Avatar, a novel avatar model that captures the full expressiveness of digital humans to bring about life-like experiences in telepresence, AR/VR and beyond. Our method models bodies, hands, facial expressions and appearance in…

计算机视觉与模式识别 · 计算机科学 2023-03-10 Kaiyue Shen , Chen Guo , Manuel Kaufmann , Juan Jose Zarate , Julien Valentin , Jie Song , Otmar Hilliges

In this paper, we present a novel strategy to design disentangled 3D face shape representation. Specifically, a given 3D face shape is decomposed into identity part and expression part, which are both encoded and decoded in a nonlinear way.…

计算机视觉与模式识别 · 计算机科学 2019-03-05 Zi-Hang Jiang , Qianyi Wu , Keyu Chen , Juyong Zhang

Despite recent progress in developing animatable full-body avatars, realistic modeling of clothing - one of the core aspects of human self-expression - remains an open challenge. State-of-the-art physical simulation methods can generate…

We introduce a novel approach to creating ultra-realistic head avatars and rendering them in real-time (>30fps at $2048 \times 1334$ resolution). First, we propose a hybrid explicit representation that combines the advantages of two…

图形学 · 计算机科学 2025-02-20 Hongrui Cai , Yuting Xiao , Xuan Wang , Jiafei Li , Yudong Guo , Yanbo Fan , Shenghua Gao , Juyong Zhang

The ability to create realistic, animatable and relightable head avatars from casual video sequences would open up wide ranging applications in communication and entertainment. Current methods either build on explicit 3D morphable meshes…

计算机视觉与模式识别 · 计算机科学 2023-03-01 Yufeng Zheng , Wang Yifan , Gordon Wetzstein , Michael J. Black , Otmar Hilliges

We present the first deep implicit 3D morphable model (i3DMM) of full heads. Unlike earlier morphable face models it not only captures identity-specific geometry, texture, and expressions of the frontal face, but also models the entire…

计算机视觉与模式识别 · 计算机科学 2020-12-01 Tarun Yenamandra , Ayush Tewari , Florian Bernard , Hans-Peter Seidel , Mohamed Elgharib , Daniel Cremers , Christian Theobalt

We present IntrinsicAvatar, a novel approach to recovering the intrinsic properties of clothed human avatars including geometry, albedo, material, and environment lighting from only monocular videos. Recent advancements in human-based…

计算机视觉与模式识别 · 计算机科学 2024-07-12 Shaofei Wang , Božidar Antić , Andreas Geiger , Siyu Tang

To make 3D human avatars widely available, we must be able to generate a variety of 3D virtual humans with varied identities and shapes in arbitrary poses. This task is challenging due to the diversity of clothed body shapes, their complex…

计算机视觉与模式识别 · 计算机科学 2022-04-14 Xu Chen , Tianjian Jiang , Jie Song , Jinlong Yang , Michael J. Black , Andreas Geiger , Otmar Hilliges

Animatable clothing transfer, aiming at dressing and animating garments across characters, is a challenging problem. Most human avatar works entangle the representations of the human body and clothing together, which leads to difficulties…

计算机视觉与模式识别 · 计算机科学 2024-05-14 Siyou Lin , Zhe Li , Zhaoqi Su , Zerong Zheng , Hongwen Zhang , Yebin Liu

We present a novel method for high detail-preserving human avatar creation from monocular video. A parameterized body model is refined and optimized to maximally resemble subjects from a video showing them from all sides. Our avatars…

计算机视觉与模式识别 · 计算机科学 2018-08-07 Thiemo Alldieck , Marcus Magnor , Weipeng Xu , Christian Theobalt , Gerard Pons-Moll

High-quality 3D avatar modeling faces a critical trade-off between fidelity and generalization. On the one hand, multi-view studio data enables high-fidelity modeling of humans with precise control over expressions and poses, but it…