English
Related papers

Related papers: Gaussian Pixel Codec Avatars: A Hybrid Representat…

200 papers

While there has been significant progress in the field of 3D avatar creation from visual observations, modeling physically plausible dynamics of humans with loose garments remains a challenging problem. Although a few existing works address…

Graphics · Computer Science 2025-10-03 Changmin Lee , Jihyun Lee , Tae-Kyun Kim

Portrait animation has witnessed tremendous quality improvements thanks to recent advances in video diffusion models. However, these 2D methods often compromise 3D consistency and speed, limiting their applicability in real-world scenarios,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Kaiwen Jiang , Xueting Li , Seonwook Park , Ravi Ramamoorthi , Shalini De Mello , Koki Nagano

We present VRGaussianAvatar, an integrated system that enables real-time full-body 3D Gaussian Splatting (3DGS) avatars in virtual reality using only head-mounted display (HMD) tracking signals. The system adopts a parallel pipeline with a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Hail Song , Boram Yoon , Seokhwan Yang , Seoyoung Kang , Hyunjeong Kim , Henning Metzmacher , Woontack Woo

Generalizable rendering of an animatable human avatar from sparse inputs relies on data priors and inductive biases extracted from training on large data to avoid scene-specific optimization and to enable fast reconstruction. This raises…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Jing Wen , Alexander G. Schwing , Shenlong Wang

Reconstructing high-fidelity animatable human avatars from monocular videos remains challenging due to insufficient geometric information in single-view observations. While recent 3D Gaussian Splatting methods have shown promise, they…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Jinlong Fan , Bingyu Hu , Xingguang Li , Yuxiang Yang , Jing Zhang

Differentiable rendering enables efficient optimization by allowing gradients to be computed through the rendering process, facilitating 3D reconstruction, inverse rendering and neural scene representation learning. To ensure…

Graphics · Computer Science 2025-03-19 Minye Wu , Haizhao Dai , Kaixin Yao , Tinne Tuytelaars , Jingyi Yu

NeRF-based 3D-aware Generative Adversarial Networks (GANs) like EG3D or GIRAFFE have shown very high rendering quality under large representational variety. However, rendering with Neural Radiance Fields poses challenges for 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Florian Barthel , Arian Beckmann , Wieland Morgenstern , Anna Hilsmann , Peter Eisert

Efficient and realistic crowd rendering is an important element of many real-time graphics applications such as Virtual Reality (VR) and games. To this end, Levels of Detail (LOD) avatar representations such as polygonal meshes, image-based…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Xiaohan Sun , Yinghan Xu , John Dingliana , Carol O'Sullivan

Realistic 3D full-body talking avatars hold great potential in AR, with applications ranging from e-commerce live streaming to holographic communication. Despite advances in 3D Gaussian Splatting (3DGS) for lifelike avatar creation,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Jianchuan Chen , Jingchuan Hu , Gaige Wang , Zhonghua Jiang , Tiansong Zhou , Zhiwen Chen , Chengfei Lv

In this paper, we present a novel 3D head avatar creation approach capable of generalizing from few-shot in-the-wild data with high-fidelity and animatable robustness. Given the underconstrained nature of this problem, incorporating prior…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Xiaozheng Zheng , Chao Wen , Zhaohu Li , Weiyi Zhang , Zhuo Su , Xu Chang , Yang Zhao , Zheng Lv , Xiaoyuan Zhang , Yongjie Zhang , Guidong Wang , Lan Xu

Realistic animatable human avatars from monocular videos are crucial for advancing human-robot interaction and enhancing immersive virtual experiences. While recent research on 3DGS-based human avatars has made progress, it still struggles…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Guangan Jiang , Tianzi Zhang , Dong Li , Zhenjun Zhao , Haoang Li , Mingrui Li , Hongyu Wang

Creating and customizing a 3D clothed avatar from textual descriptions is a critical and challenging task. Traditional methods often treat the human body and clothing as inseparable, limiting users' ability to freely mix and match garments.…

Graphics · Computer Science 2025-03-18 Jia Gong , Shenyu Ji , Lin Geng Foo , Kang Chen , Hossein Rahmani , Jun Liu

High-quality 3D avatar modeling faces a critical trade-off between fidelity and generalization. On the one hand, multi-view studio data enables high-fidelity modeling of humans with precise control over expressions and poses, but it…

Neural image representations have emerged as a promising approach for encoding and rendering visual data. Combined with learning-based workflows, they demonstrate impressive trade-offs between visual fidelity and memory footprint. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Yunxiang Zhang , Bingxuan Li , Alexandr Kuznetsov , Akshay Jindal , Stavros Diolatzis , Kenneth Chen , Anton Sochenov , Anton Kaplanyan , Qi Sun

We propose HeadsUp, a scalable feed-forward method for reconstructing high-quality 3D Gaussian heads from large-scale multi-camera setups. Our method employs an efficient encoder-decoder architecture that compresses input views into a…

We leverage increasingly popular three-dimensional neural representations in order to construct a unified and consistent explanation of a collection of uncalibrated images of the human face. Our approach utilizes Gaussian Splatting, since…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Haodi He , Jihun Yu , Ronald Fedkiw

We propose PixelGaussian, an efficient feed-forward framework for learning generalizable 3D Gaussian reconstruction from arbitrary views. Most existing methods rely on uniform pixel-wise Gaussian representations, which learn a fixed number…

Computer Vision and Pattern Recognition · Computer Science 2024-10-25 Xin Fei , Wenzhao Zheng , Yueqi Duan , Wei Zhan , Masayoshi Tomizuka , Kurt Keutzer , Jiwen Lu

Nuanced expressiveness, particularly through fine-grained hand and facial expressions, is pivotal for enhancing the realism and vitality of digital human representations. In this work, we focus on investigating the expressiveness of human…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Hezhen Hu , Zhiwen Fan , Tianhao Wu , Yihan Xi , Seoyoung Lee , Georgios Pavlakos , Zhangyang Wang

3D Gaussian Splatting (3DGS) has demonstrated impressive novel view synthesis performance. While conventional methods require per-scene optimization, more recently several feed-forward methods have been proposed to generate pixel-aligned…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Shengjun Zhang , Xin Fei , Fangfu Liu , Haixu Song , Yueqi Duan

We observe that Gaussians exhibit distinct roles and characteristics analogous to traditional artistic techniques -- like how artists first sketch outlines before filling in broader areas with color, some Gaussians capture high-frequency…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Yuang Shi , Géraldine Morin , Simone Gasparini , Wei Tsang Ooi