English
Related papers

Related papers: UltrAvatar: A Realistic Animatable 3D Avatar Diffu…

200 papers

The manipulation of latent space has recently become an interesting topic in the field of generative models. Recent research shows that latent directions can be used to manipulate images towards certain attributes. However, controlling the…

Computer Vision and Pattern Recognition · Computer Science 2022-02-15 Zehranaz Canfes , M. Furkan Atasoy , Alara Dirik , Pinar Yanardag

Generating 3D human models directly from text helps reduce the cost and time of character modeling. However, achieving multi-attribute controllable and realistic 3D human avatar generation is still challenging due to feature coupling and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Chaoqun Gong , Yuqin Dai , Ronghui Li , Achun Bao , Jun Li , Jian Yang , Yachao Zhang , Xiu Li

Over the past years, significant progress has been made in creating photorealistic and drivable 3D avatars solely from videos of real humans. However, a core remaining challenge is the fine-grained and user-friendly editing of clothing…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Basavaraj Sunagad , Heming Zhu , Mohit Mendiratta , Adam Kortylewski , Christian Theobalt , Marc Habermann

The problem of modeling an animatable 3D human head avatar under light-weight setups is of significant importance but has not been well solved. Existing 3D representations either perform well in the realism of portrait images synthesis or…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Xiaochen Zhao , Lizhen Wang , Jingxiang Sun , Hongwen Zhang , Jinli Suo , Yebin Liu

We present PrismAvatar: a 3D head avatar model which is designed specifically to enable real-time animation and rendering on resource-constrained edge devices, while still enjoying the benefits of neural volumetric rendering at training…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Prashant Raina , Felix Taubner , Mathieu Tuli , Eu Wern Teh , Kevin Ferreira

We present Reduced Gaussian Blendshapes Avatar (RGBAvatar), a method for reconstructing photorealistic, animatable head avatars at speeds sufficient for on-the-fly reconstruction. Unlike prior approaches that utilize linear bases from 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Linzhou Li , Yumeng Li , Yanlin Weng , Youyi Zheng , Kun Zhou

Recent advancements in Gaussian Splatting have enabled increasingly accurate reconstruction of photorealistic head avatars, opening the door to numerous applications in visual effects, videoconferencing, and virtual reality. This, however,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Kelian Baert , Mae Younes , Francois Bourel , Marc Christie , Adnane Boukhayma

Modern 3D-GANs synthesize geometry and texture by training on large-scale datasets with a consistent structure. Training such models on stylized, artistic data, with often unknown, highly variable geometry, and camera information has not…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Rameen Abdal , Hsin-Ying Lee , Peihao Zhu , Menglei Chai , Aliaksandr Siarohin , Peter Wonka , Sergey Tulyakov

Existing 2D methods utilize UNet-based diffusion models to generate multi-view physically-based rendering (PBR) maps but struggle with multi-view inconsistency, while some 3D methods directly generate UV maps, encountering generalization…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Shenhao Zhu , Lingteng Qiu , Xiaodong Gu , Zhengyi Zhao , Chao Xu , Yuxiao He , Zhe Li , Xiaoguang Han , Yao Yao , Xun Cao , Siyu Zhu , Weihao Yuan , Zilong Dong , Hao Zhu

We present X-Avatar, a novel avatar model that captures the full expressiveness of digital humans to bring about life-like experiences in telepresence, AR/VR and beyond. Our method models bodies, hands, facial expressions and appearance in…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Kaiyue Shen , Chen Guo , Manuel Kaufmann , Juan Jose Zarate , Julien Valentin , Jie Song , Otmar Hilliges

We present a novel pipeline for learning high-quality triangular human avatars from multi-view videos. Recent methods for avatar learning are typically based on neural radiance fields (NeRF), which is not compatible with traditional…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Yushuo Chen , Zerong Zheng , Zhe Li , Chao Xu , Yebin Liu

Realistic 3D full-body talking avatars hold great potential in AR, with applications ranging from e-commerce live streaming to holographic communication. Despite advances in 3D Gaussian Splatting (3DGS) for lifelike avatar creation,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Jianchuan Chen , Jingchuan Hu , Gaige Wang , Zhonghua Jiang , Tiansong Zhou , Zhiwen Chen , Chengfei Lv

Rendering photorealistic and dynamically moving human heads is crucial for ensuring a pleasant and immersive experience in AR/VR and video conferencing applications. However, existing methods often struggle to model challenging facial…

Computer Vision and Pattern Recognition · Computer Science 2026-02-20 Cong Wang , Di Kang , Yan-Pei Cao , Linchao Bao , Ying Shan , Song-Hai Zhang

We present NBAvatar - a method for realistic rendering of head avatars handling non-rigid deformations caused by hand-face interaction. We introduce a novel representation for animated avatars by combining the training of oriented planar…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 David Svitov , Mahtab Dahaghin

Over the last years, many face analysis tasks have accomplished astounding performance, with applications including face generation and 3D face reconstruction from a single "in-the-wild" image. Nevertheless, to the best of our knowledge,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Alexandros Lattas , Stylianos Moschoglou , Stylianos Ploumpis , Baris Gecer , Abhijeet Ghosh , Stefanos Zafeiriou

Capturing and editing full head performances enables the creation of virtual characters with various applications such as extended reality and media production. The past few years witnessed a steep rise in the photorealism of human head…

Computer Vision and Pattern Recognition · Computer Science 2023-06-05 Mohit Mendiratta , Xingang Pan , Mohamed Elgharib , Kartik Teotia , Mallikarjun B R , Ayush Tewari , Vladislav Golyanik , Adam Kortylewski , Christian Theobalt

Combining human body models with differentiable rendering has recently enabled animatable avatars of clothed humans from sparse sets of multi-view RGB videos. While state-of-the-art approaches achieve realistic appearance with neural…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Shaofei Wang , Katja Schwarz , Andreas Geiger , Siyu Tang

Recent works on text-to-3d generation show that using only 2D diffusion supervision for 3D generation tends to produce results with inconsistent appearances (e.g., faces on the back view) and inaccurate shapes (e.g., animals with extra…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Cheng Chen , Xiaofeng Yang , Fan Yang , Chengzeng Feng , Zhoujie Fu , Chuan-Sheng Foo , Guosheng Lin , Fayao Liu

Creating animatable 3D avatars from a single image remains challenging due to style limitations (realistic, cartoon, anime) and difficulties in handling accessories or hairstyles. While 3D diffusion models advance single-view reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Tingting Liao , Yujian Zheng , Adilbek Karmanov , Liwen Hu , Leyang Jin , Yuliang Xiu , Hao Li

Modeling animatable human avatars from monocular or multi-view videos has been widely studied, with recent approaches leveraging neural radiance fields (NeRFs) or 3D Gaussian Splatting (3DGS) achieving impressive results in novel-view and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Yahui Li , Zhi Zeng , Liming Pang , Guixuan Zhang , Shuwu Zhang