English
Related papers

Related papers: Multi-view Consistent 3D Gaussian Head Avatars 'wi…

200 papers

Existing approaches for human avatar generation--both NeRF-based and 3D Gaussian Splatting (3DGS) based--struggle with maintaining 3D consistency and exhibit degraded detail reconstruction, particularly when training with sparse inputs. To…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Haoyu Zhao , Hao Wang , Chen Yang , Wei Shen

The creation of high-fidelity, digital versions of human heads is an important stepping stone in the process of further integrating virtual components into our everyday lives. Constructing such avatars is a challenging research problem, due…

Computer Vision and Pattern Recognition · Computer Science 2024-09-16 Simon Giebenhain , Tobias Kirschstein , Martin Rünz , Lourdes Agapito , Matthias Nießner

Multi-view generation with camera pose control and prompt-based customization are both essential elements for achieving controllable generative models. However, existing multi-view generation models do not support customization with…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Minjung Shin , Hyunin Cho , Sooyeon Go , Jin-Hwa Kim , Youngjung Uh

While there has been significant progress in the field of 3D avatar creation from visual observations, modeling physically plausible dynamics of humans with loose garments remains a challenging problem. Although a few existing works address…

Graphics · Computer Science 2025-10-03 Changmin Lee , Jihyun Lee , Tae-Kyun Kim

In this paper, we explore a reconstruction and reenactment separated framework for 3D Gaussians head, which requires only a single portrait image as input to generate controllable avatar. Specifically, we developed a large-scale one-shot…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Zhiling Ye , Cong Zhou , Xiubao Zhang , Haifeng Shen , Weihong Deng , Quan Lu

To date, little attention has been given to multi-view 3D human mesh estimation, despite real-life applicability (e.g., motion capture, sport analysis) and robustness to single-view ambiguities. Existing solutions typically suffer from poor…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Xuan Gong , Liangchen Song , Meng Zheng , Benjamin Planche , Terrence Chen , Junsong Yuan , David Doermann , Ziyan Wu

Recently, multi-view diffusion-based 3D generation methods have gained significant attention. However, these methods often suffer from shape and texture misalignment across generated multi-view images, leading to low-quality 3D generation…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Zhuojiang Cai , Yiheng Zhang , Meitong Guo , Mingdao Wang , Yuwang Wang

Recent advances in diffusion models have significantly improved 3D generation, enabling the use of assets generated from an image for embodied AI simulations. However, the one-to-many nature of the image-to-3D problem limits their use due…

Computer Vision and Pattern Recognition · Computer Science 2025-02-26 Onat Şahin , Mohammad Altillawi , George Eskandar , Carlos Carbone , Ziyuan Liu

Gaussian-based human avatars have achieved an unprecedented level of visual fidelity. However, existing approaches based on high-capacity neural networks typically require a desktop GPU to achieve real-time performance for a single avatar,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Forrest Iandola , Stanislav Pidhorskyi , Igor Santesteban , Divam Gupta , Anuj Pahuja , Nemanja Bartolovic , Frank Yu , Emanuel Garbin , Tomas Simon , Shunsuke Saito

By equipping the most recent 3D Gaussian Splatting representation with head 3D morphable models (3DMM), existing methods manage to create head avatars with high fidelity. However, most existing methods only reconstruct a head without the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Tianhao Wu , Jing Yang , Zhilin Guo , Jingyi Wan , Fangcheng Zhong , Cengiz Oztireli

As the complexity of 3D digital content grows exponentially, understanding human visual attention is critical for optimizing rendering and processing resources. Therefore, reliable 3D mesh saliency ground truth (GT) is essential for…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Guoquan Zheng , Jie Hao , Huiyu Duan , Long Tang , Shuo Yang , Yucheng Zhu , Yongming Han , Liang Yuan , Patrick Le Callet , Guangtao Zhai

Recent advancements in 3D Gaussian Splatting (3DGS) have unlocked significant potential for modeling 3D head avatars, providing greater flexibility than mesh-based methods and more efficient rendering compared to NeRF-based approaches.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Peizhi Yan , Rabab Ward , Qiang Tang , Shan Du

We present HuGDiffusion, a generalizable 3D Gaussian splatting (3DGS) learning pipeline to achieve novel view synthesis (NVS) of human characters from single-view input images. Existing approaches typically require monocular videos or…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Yingzhi Tang , Qijian Zhang , Junhui Hou

We present a novel framework for animating humans in 3D scenes using 3D Gaussian Splatting (3DGS), a neural scene representation that has recently achieved state-of-the-art photorealistic results for novel-view synthesis but remains…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Aymen Mir , Jian Wang , Riza Alp Guler , Chuan Guo , Gerard Pons-Moll , Bing Zhou

Reconstructing a complete 3D head from a single portrait remains challenging because existing methods still face a sharp quality-speed trade-off: high-fidelity pipelines often rely on multi-stage processing and per-subject optimization,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Yujie Gao , Yao Xiao , Xiangnan Zhu , Ya Li , Yiyi Zhang , Liqing Zhang , Jianfu Zhang

3D Gaussian Splatting (3DGS) enables efficient rendering, yet accurate surface reconstruction remains challenging due to unreliable geometric supervision. Existing approaches predominantly rely on depth-based reprojection to infer…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Mai Su , Qihan Yu , Zhongtao Wang , Yilong Li , Chengwei Pan , Yisong Chen , Guoping Wang , Fei Zhu

In this work, we introduce Monocular and Generalizable Gaussian Talking Head Animation (MGGTalk), which requires monocular datasets and generalizes to unseen identities without personalized re-training. Compared with previous 3D Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Shengjie Gong , Haojie Li , Jiapeng Tang , Dongming Hu , Shuangping Huang , Hao Chen , Tianshui Chen , Zhuoman Liu

Generating multi-view images from human instructions is crucial for 3D content creation. The primary challenges involve maintaining consistency across multiple views and effectively synthesizing shapes and textures under diverse conditions.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 JiaKui Hu , Yuxiao Yang , Jialun Liu , Jinbo Wu , Chen Zhao , Yanye Lu

Head avatar reconstruction, crucial for applications in virtual reality, online meetings, gaming, and film industries, has garnered substantial attention within the computer vision community. The fundamental objective of this field is to…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Xuangeng Chu , Yu Li , Ailing Zeng , Tianyu Yang , Lijian Lin , Yunfei Liu , Tatsuya Harada

Multi-view image generation holds significant application value in computer vision, particularly in domains like 3D reconstruction, virtual reality, and augmented reality. Most existing methods, which rely on extending single images, face…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Jiaqi Wu , Yaosen Chen , Shuyuan Zhu