中文
相关论文

相关论文: Detailed Human Avatars from Monocular Video

200 篇论文

We propose a method for synthesizing edited photo-realistic digital avatars with text instructions. Given a short monocular RGB video and text instructions, our method uses an image-conditioned diffusion model to edit one head image and…

计算机视觉与模式识别 · 计算机科学 2023-06-06 Shaoxu Li

We propose a method for generating video-realistic animations of real humans under user control. In contrast to conventional human character rendering, we do not require the availability of a production-quality photo-realistic 3D model of…

计算机视觉与模式识别 · 计算机科学 2019-05-13 Lingjie Liu , Weipeng Xu , Michael Zollhoefer , Hyeongwoo Kim , Florian Bernard , Marc Habermann , Wenping Wang , Christian Theobalt

Human re-rendering from a single image is a starkly under-constrained problem, and state-of-the-art algorithms often exhibit undesired artefacts, such as over-smoothing, unrealistic distortions of the body parts and garments, or implausible…

计算机视觉与模式识别 · 计算机科学 2021-01-12 Kripasindhu Sarkar , Dushyant Mehta , Weipeng Xu , Vladislav Golyanik , Christian Theobalt

We present a real-time deep learning framework for video-based facial performance capture -- the dense 3D tracking of an actor's face given a monocular video. Our pipeline begins with accurately capturing a subject using a high-end…

计算机视觉与模式识别 · 计算机科学 2017-06-05 Samuli Laine , Tero Karras , Timo Aila , Antti Herva , Shunsuke Saito , Ronald Yu , Hao Li , Jaakko Lehtinen

Photo-realistic human avatars have broad applications, yet high-fidelity avatar generation has traditionally required expensive professional camera rigs and extensive artistic labor. Recent research has enabled constructing them…

计算机视觉与模式识别 · 计算机科学 2026-03-30 Akash Haridas , Imran N. Junejo

Reconstructing animatable and high-quality 3D head avatars from monocular videos, especially with realistic relighting, is a valuable task. However, the limited information from single-view input, combined with the complex head poses and…

计算机视觉与模式识别 · 计算机科学 2025-04-22 Dongbin Zhang , Yunfei Liu , Lijian Lin , Ye Zhu , Kangjie Chen , Minghan Qin , Yu Li , Haoqian Wang

Realistic animatable human avatars from monocular videos are crucial for advancing human-robot interaction and enhancing immersive virtual experiences. While recent research on 3DGS-based human avatars has made progress, it still struggles…

计算机视觉与模式识别 · 计算机科学 2025-10-28 Guangan Jiang , Tianzi Zhang , Dong Li , Zhenjun Zhao , Haoang Li , Mingrui Li , Hongyu Wang

Undoubtedly, high-fidelity 3D hair is crucial for achieving realism, artistic expression, and immersion in computer graphics. While existing 3D hair modeling methods have achieved impressive performance, the challenge of achieving…

计算机视觉与模式识别 · 计算机科学 2024-03-28 Keyu Wu , Lingchen Yang , Zhiyi Kuang , Yao Feng , Xutao Han , Yuefan Shen , Hongbo Fu , Kun Zhou , Youyi Zheng

Pose transfer of human videos aims to generate a high fidelity video of a target person imitating actions of a source person. A few studies have made great progress either through image translation with deep latent features or neural…

计算机视觉与模式识别 · 计算机科学 2023-05-09 Yang-tian Sun , Hao-zhi Huang , Xuan Wang , Yu-kun Lai , Wei Liu , Lin Gao

We propose PAV, Personalized Head Avatar for the synthesis of human faces under arbitrary viewpoints and facial expressions. PAV introduces a method that learns a dynamic deformable neural radiance field (NeRF), in particular from a…

计算机视觉与模式识别 · 计算机科学 2024-08-01 Akin Caliskan , Berkay Kicanaoglu , Hyeongwoo Kim

Recent advancements in 3D avatar generation excel with multi-view supervision for photorealistic models. However, monocular counterparts lag in quality despite broader applicability. We propose ReCaLaB to close this gap. ReCaLaB is a…

计算机视觉与模式识别 · 计算机科学 2024-03-26 Yuchen Rao , Eduardo Perez Pellitero , Benjamin Busam , Yiren Zhou , Jifei Song

For reconstructing high-fidelity human 3D models from monocular videos, it is crucial to maintain consistent large-scale body shapes along with finely matched subtle wrinkles. This paper explores the observation that the per-frame rendering…

计算机视觉与模式识别 · 计算机科学 2024-06-04 Chunjin Song , Zhijie Wu , Bastian Wandt , Leonid Sigal , Helge Rhodin

In this research paper we suggest how to extract a face from an image, modify it, characterize it in terms of high-level properties, and apply it to the creation of a personalized avatar. In this research work we tested, we implemented the…

计算机视觉与模式识别 · 计算机科学 2012-10-24 Vibekananda Dutta , Dr Nishtha Kesswani , Deepti Gahalot

Creating a controllable and relightable digital avatar from multi-view video with fixed illumination is a very challenging problem since humans are highly articulated, creating pose-dependent appearance effects, and skin as well as clothing…

计算机视觉与模式识别 · 计算机科学 2024-07-29 Diogo Luvizon , Vladislav Golyanik , Adam Kortylewski , Marc Habermann , Christian Theobalt

Modeling and rendering photorealistic avatars is of crucial importance in many applications. Existing methods that build a 3D avatar from visual observations, however, struggle to reconstruct clothed humans. We introduce PhysAvatar, a novel…

We study the visual quality judgments of human subjects on digital human avatars (sometimes referred to as "holograms" in the parlance of virtual reality [VR] and augmented reality [AR] systems) that have been subjected to distortions. We…

图像与视频处理 · 电气工程与系统科学 2024-10-04 Yu-Chih Chen , Avinab Saha , Alexandre Chapiro , Christian Häne , Jean-Charles Bazin , Bo Qiu , Stefano Zanetti , Ioannis Katsavounidis , Alan C. Bovik

We present R3-Avatar, incorporating a temporal codebook, to overcome the inability of human avatars to be both animatable and of high-fidelity rendering quality. Existing video-based reconstruction of 3D human avatars either focuses solely…

计算机视觉与模式识别 · 计算机科学 2025-03-18 Yifan Zhan , Wangze Xu , Qingtian Zhu , Muyao Niu , Mingze Ma , Yifei Liu , Zhihang Zhong , Xiao Sun , Yinqiang Zheng

We present a method that reconstructs and animates a 3D head avatar from a single-view portrait image. Existing methods either involve time-consuming optimization for a specific person with multiple images, or they struggle to synthesize…

计算机视觉与模式识别 · 计算机科学 2023-06-16 Xueting Li , Shalini De Mello , Sifei Liu , Koki Nagano , Umar Iqbal , Jan Kautz

Creating high-quality 3D avatars using 3D Gaussian Splatting (3DGS) from a monocular video benefits virtual reality and telecommunication applications. However, existing automatic methods exhibit artifacts under novel poses due to limited…

人机交互 · 计算机科学 2024-12-23 Jotaro Sakamiya , I-Chao Shen , Jinsong Zhang , Mustafa Doga Dogan , Takeo Igarashi

Human performance capture is a highly important computer vision problem with many applications in movie production and virtual/augmented reality. Many previous performance capture approaches either required expensive multi-view setups or…

计算机视觉与模式识别 · 计算机科学 2021-11-23 Marc Habermann , Weipeng Xu , Michael Zollhoefer , Gerard Pons-Moll , Christian Theobalt