中文
相关论文

相关论文: Gaussian Pixel Codec Avatars: A Hybrid Representat…

200 篇论文

While there has been significant progress in the field of 3D avatar creation from visual observations, modeling physically plausible dynamics of humans with loose garments remains a challenging problem. Although a few existing works address…

图形学 · 计算机科学 2025-10-03 Changmin Lee , Jihyun Lee , Tae-Kyun Kim

Portrait animation has witnessed tremendous quality improvements thanks to recent advances in video diffusion models. However, these 2D methods often compromise 3D consistency and speed, limiting their applicability in real-world scenarios,…

计算机视觉与模式识别 · 计算机科学 2025-12-19 Kaiwen Jiang , Xueting Li , Seonwook Park , Ravi Ramamoorthi , Shalini De Mello , Koki Nagano

We present VRGaussianAvatar, an integrated system that enables real-time full-body 3D Gaussian Splatting (3DGS) avatars in virtual reality using only head-mounted display (HMD) tracking signals. The system adopts a parallel pipeline with a…

计算机视觉与模式识别 · 计算机科学 2026-05-05 Hail Song , Boram Yoon , Seokhwan Yang , Seoyoung Kang , Hyunjeong Kim , Henning Metzmacher , Woontack Woo

Generalizable rendering of an animatable human avatar from sparse inputs relies on data priors and inductive biases extracted from training on large data to avoid scene-specific optimization and to enable fast reconstruction. This raises…

计算机视觉与模式识别 · 计算机科学 2025-02-14 Jing Wen , Alexander G. Schwing , Shenlong Wang

Reconstructing high-fidelity animatable human avatars from monocular videos remains challenging due to insufficient geometric information in single-view observations. While recent 3D Gaussian Splatting methods have shown promise, they…

计算机视觉与模式识别 · 计算机科学 2025-09-19 Jinlong Fan , Bingyu Hu , Xingguang Li , Yuxiang Yang , Jing Zhang

Differentiable rendering enables efficient optimization by allowing gradients to be computed through the rendering process, facilitating 3D reconstruction, inverse rendering and neural scene representation learning. To ensure…

图形学 · 计算机科学 2025-03-19 Minye Wu , Haizhao Dai , Kaixin Yao , Tinne Tuytelaars , Jingyi Yu

NeRF-based 3D-aware Generative Adversarial Networks (GANs) like EG3D or GIRAFFE have shown very high rendering quality under large representational variety. However, rendering with Neural Radiance Fields poses challenges for 3D…

计算机视觉与模式识别 · 计算机科学 2024-12-02 Florian Barthel , Arian Beckmann , Wieland Morgenstern , Anna Hilsmann , Peter Eisert

Efficient and realistic crowd rendering is an important element of many real-time graphics applications such as Virtual Reality (VR) and games. To this end, Levels of Detail (LOD) avatar representations such as polygonal meshes, image-based…

计算机视觉与模式识别 · 计算机科学 2025-03-05 Xiaohan Sun , Yinghan Xu , John Dingliana , Carol O'Sullivan

Realistic 3D full-body talking avatars hold great potential in AR, with applications ranging from e-commerce live streaming to holographic communication. Despite advances in 3D Gaussian Splatting (3DGS) for lifelike avatar creation,…

计算机视觉与模式识别 · 计算机科学 2025-07-24 Jianchuan Chen , Jingchuan Hu , Gaige Wang , Zhonghua Jiang , Tiansong Zhou , Zhiwen Chen , Chengfei Lv

In this paper, we present a novel 3D head avatar creation approach capable of generalizing from few-shot in-the-wild data with high-fidelity and animatable robustness. Given the underconstrained nature of this problem, incorporating prior…

计算机视觉与模式识别 · 计算机科学 2025-01-14 Xiaozheng Zheng , Chao Wen , Zhaohu Li , Weiyi Zhang , Zhuo Su , Xu Chang , Yang Zhao , Zheng Lv , Xiaoyuan Zhang , Yongjie Zhang , Guidong Wang , Lan Xu

Realistic animatable human avatars from monocular videos are crucial for advancing human-robot interaction and enhancing immersive virtual experiences. While recent research on 3DGS-based human avatars has made progress, it still struggles…

计算机视觉与模式识别 · 计算机科学 2025-10-28 Guangan Jiang , Tianzi Zhang , Dong Li , Zhenjun Zhao , Haoang Li , Mingrui Li , Hongyu Wang

Creating and customizing a 3D clothed avatar from textual descriptions is a critical and challenging task. Traditional methods often treat the human body and clothing as inseparable, limiting users' ability to freely mix and match garments.…

图形学 · 计算机科学 2025-03-18 Jia Gong , Shenyu Ji , Lin Geng Foo , Kang Chen , Hossein Rahmani , Jun Liu

High-quality 3D avatar modeling faces a critical trade-off between fidelity and generalization. On the one hand, multi-view studio data enables high-fidelity modeling of humans with precise control over expressions and poses, but it…

Neural image representations have emerged as a promising approach for encoding and rendering visual data. Combined with learning-based workflows, they demonstrate impressive trade-offs between visual fidelity and memory footprint. Existing…

计算机视觉与模式识别 · 计算机科学 2025-05-08 Yunxiang Zhang , Bingxuan Li , Alexandr Kuznetsov , Akshay Jindal , Stavros Diolatzis , Kenneth Chen , Anton Sochenov , Anton Kaplanyan , Qi Sun

We propose HeadsUp, a scalable feed-forward method for reconstructing high-quality 3D Gaussian heads from large-scale multi-camera setups. Our method employs an efficient encoder-decoder architecture that compresses input views into a…

We leverage increasingly popular three-dimensional neural representations in order to construct a unified and consistent explanation of a collection of uncalibrated images of the human face. Our approach utilizes Gaussian Splatting, since…

计算机视觉与模式识别 · 计算机科学 2025-12-19 Haodi He , Jihun Yu , Ronald Fedkiw

We propose PixelGaussian, an efficient feed-forward framework for learning generalizable 3D Gaussian reconstruction from arbitrary views. Most existing methods rely on uniform pixel-wise Gaussian representations, which learn a fixed number…

计算机视觉与模式识别 · 计算机科学 2024-10-25 Xin Fei , Wenzhao Zheng , Yueqi Duan , Wei Zhan , Masayoshi Tomizuka , Kurt Keutzer , Jiwen Lu

Nuanced expressiveness, particularly through fine-grained hand and facial expressions, is pivotal for enhancing the realism and vitality of digital human representations. In this work, we focus on investigating the expressiveness of human…

计算机视觉与模式识别 · 计算机科学 2024-07-04 Hezhen Hu , Zhiwen Fan , Tianhao Wu , Yihan Xi , Seoyoung Lee , Georgios Pavlakos , Zhangyang Wang

3D Gaussian Splatting (3DGS) has demonstrated impressive novel view synthesis performance. While conventional methods require per-scene optimization, more recently several feed-forward methods have been proposed to generate pixel-aligned…

计算机视觉与模式识别 · 计算机科学 2025-03-21 Shengjun Zhang , Xin Fei , Fangfu Liu , Haixu Song , Yueqi Duan

We observe that Gaussians exhibit distinct roles and characteristics analogous to traditional artistic techniques -- like how artists first sketch outlines before filling in broader areas with color, some Gaussians capture high-frequency…

计算机视觉与模式识别 · 计算机科学 2026-01-13 Yuang Shi , Géraldine Morin , Simone Gasparini , Wei Tsang Ooi