中文
相关论文

相关论文: Relightable and Animatable Neural Avatars from Vid…

200 篇论文

Despite progress in human motion capture, existing multi-view methods often face challenges in estimating the 3D pose and shape of multiple closely interacting people. This difficulty arises from reliance on accurate 2D joint estimations,…

计算机视觉与模式识别 · 计算机科学 2024-08-21 Feichi Lu , Zijian Dong , Jie Song , Otmar Hilliges

We propose a method to learn a high-quality implicit 3D head avatar from a monocular RGB video captured in the wild. The learnt avatar is driven by a parametric face model to achieve user-controlled facial expressions and head poses. Our…

The generation of a virtual digital avatar is a crucial research topic in the field of computer vision. Many existing works utilize Neural Radiance Fields (NeRF) to address this issue and have achieved impressive results. However, previous…

计算机视觉与模式识别 · 计算机科学 2025-02-05 Shengbo Gu , Yu-Kun Qiu , Yu-Ming Tang , Ancong Wu , Wei-Shi Zheng

We present Better Together, a method that simultaneously solves the human pose estimation problem while reconstructing a photorealistic 3D human avatar from multi-view videos. While prior art usually solves these problems separately, we…

计算机视觉与模式识别 · 计算机科学 2025-03-13 Arthur Moreau , Mohammed Brahimi , Richard Shaw , Athanasios Papaioannou , Thomas Tanay , Zhensong Zhang , Eduardo Pérez-Pellitero

Radiance field-based methods have recently been used to reconstruct human avatars, showing that we can significantly downscale the systems needed for creating animated human avatars. Although this progress has been initiated by neural…

计算机视觉与模式识别 · 计算机科学 2025-09-16 Nikolaos Zioulis , Nikolaos Kotarelas , Georgios Albanis , Spyridon Thermos , Anargyros Chatzitofis

We present CaPhy, a novel method for reconstructing animatable human avatars with realistic dynamic properties for clothing. Specifically, we aim for capturing the geometric and physical properties of the clothing from real observations.…

计算机视觉与模式识别 · 计算机科学 2023-08-14 Zhaoqi Su , Liangxiao Hu , Siyou Lin , Hongwen Zhang , Shengping Zhang , Justus Thies , Yebin Liu

We present a method that enables synthesizing novel views and novel poses of arbitrary human performers from sparse multi-view images. A key ingredient of our method is a hybrid appearance blending module that combines the advantages of the…

计算机视觉与模式识别 · 计算机科学 2023-04-12 Youngjoong Kwon , Dahun Kim , Duygu Ceylan , Henry Fuchs

We present a novel framework for generating high-quality, animatable 4D avatar from a single image. While recent advances have shown promising results in 4D avatar creation, existing methods either require extensive multiview data or…

计算机视觉与模式识别 · 计算机科学 2025-04-22 Fei Yin , Mallikarjun B R , Chun-Han Yao , Rafał Mantiuk , Varun Jampani

Delivering immersive, 3D experiences for human communication requires a method to obtain 360 degree photo-realistic avatars of humans. To make these experiences accessible to all, only commodity hardware, like mobile phone cameras, should…

计算机视觉与模式识别 · 计算机科学 2022-10-24 Stanislaw Szymanowicz , Virginia Estellers , Tadas Baltrusaitis , Matthew Johnson

Clothed avatar generation has wide applications in virtual and augmented reality, filmmaking, and more. Previous methods have achieved success in generating diverse digital avatars, however, generating avatars with disentangled components…

计算机视觉与模式识别 · 计算机科学 2025-09-08 Weitian Zhang , Yichao Yan , Sijing Wu , Manwen Liao , Xiaokang Yang

Digital human avatars aim to simulate the dynamic appearance of humans in virtual environments, enabling immersive experiences across gaming, film, virtual reality, and more. However, the conventional process for creating and animating…

计算机视觉与模式识别 · 计算机科学 2025-10-15 Felix Taubner , Ruihang Zhang , Mathieu Tuli , Sherwin Bahmani , David B. Lindell

3D human avatar animation aims at transforming a human avatar from an arbitrary initial pose to a specified target pose using deformation algorithms. Existing approaches typically divide this task into two stages: canonical template…

计算机视觉与模式识别 · 计算机科学 2025-12-02 Jian Shu , Nanjie Yao , Gangjian Zhang , Junlong Ren , Yu Feng , Hao Wang

To make 3D human avatars widely available, we must be able to generate a variety of 3D virtual humans with varied identities and shapes in arbitrary poses. This task is challenging due to the diversity of clothed body shapes, their complex…

计算机视觉与模式识别 · 计算机科学 2022-04-14 Xu Chen , Tianjian Jiang , Jie Song , Jinlong Yang , Michael J. Black , Andreas Geiger , Otmar Hilliges

Neural character models can now reconstruct detailed geometry and texture from video, but they lack explicit shadows and shading, leading to artifacts when generating novel views and poses or during relighting. It is particularly difficult…

计算机视觉与模式识别 · 计算机科学 2024-01-12 Luis Bolanos , Shih-Yang Su , Helge Rhodin

We present NBAvatar - a method for realistic rendering of head avatars handling non-rigid deformations caused by hand-face interaction. We introduce a novel representation for animated avatars by combining the training of oriented planar…

计算机视觉与模式识别 · 计算机科学 2026-03-13 David Svitov , Mahtab Dahaghin

Photorealistic telepresence requires both high-fidelity body modeling and faithful driving to enable dynamically synthesized appearance that is indistinguishable from reality. In this work, we propose an end-to-end framework that addresses…

计算机视觉与模式识别 · 计算机科学 2022-07-21 Edoardo Remelli , Timur Bagautdinov , Shunsuke Saito , Tomas Simon , Chenglei Wu , Shih-En Wei , Kaiwen Guo , Zhe Cao , Fabian Prada , Jason Saragih , Yaser Sheikh

In this work we address the challenging problem of multiview 3D surface reconstruction. We introduce a neural network architecture that simultaneously learns the unknown geometry, camera parameters, and a neural renderer that approximates…

计算机视觉与模式识别 · 计算机科学 2020-10-27 Lior Yariv , Yoni Kasten , Dror Moran , Meirav Galun , Matan Atzmon , Ronen Basri , Yaron Lipman

We present an approach to generate high fidelity 3D face avatar with a high-resolution UV texture map from a single image. To estimate the face geometry, we use a deep neural network to directly predict vertex coordinates of the 3D face…

计算机视觉与模式识别 · 计算机科学 2019-12-10 Ruizhe Wang , Chih-Fan Chen , Hao Peng , Xudong Liu , Oliver Liu , Xin Li

Recovering the 3D shape of transparent objects using a small number of unconstrained natural images is an ill-posed problem. Complex light paths induced by refraction and reflection have prevented both traditional and deep multiview stereo…

计算机视觉与模式识别 · 计算机科学 2020-07-24 Zhengqin Li , Yu-Ying Yeh , Manmohan Chandraker

We present a novel framework for reconstructing animatable human avatars from multiple images, termed CanonicalFusion. Our central concept involves integrating individual reconstruction results into the canonical space. To be specific, we…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Jisu Shin , Junmyeong Lee , Seongmin Lee , Min-Gyu Park , Ju-Mi Kang , Ju Hong Yoon , Hae-Gon Jeon