中文
相关论文

相关论文: Gaussian Pixel Codec Avatars: A Hybrid Representat…

200 篇论文

Codec Avatars are a recent class of learned, photorealistic face models that accurately represent the geometry and texture of a person in 3D (i.e., for virtual reality), and are almost indistinguishable from video. In this paper we describe…

计算机视觉与模式识别 · 计算机科学 2020-08-13 Alexander Richard , Colin Lea , Shugao Ma , Juergen Gall , Fernando de la Torre , Yaser Sheikh

3D head animation has seen major quality and runtime improvements over the last few years, particularly empowered by the advances in differentiable rendering and neural radiance fields. Real-time rendering is a highly desirable goal for…

计算机视觉与模式识别 · 计算机科学 2024-08-14 Helisa Dhamo , Yinyu Nie , Arthur Moreau , Jifei Song , Richard Shaw , Yiren Zhou , Eduardo Pérez-Pellitero

Faithful real-time facial animation is essential for avatar-mediated telepresence in Virtual Reality (VR). To emulate authentic communication, avatar animation needs to be efficient and accurate: able to capture both extreme and subtle…

计算机视觉与模式识别 · 计算机科学 2024-07-19 Shaojie Bai , Te-Li Wang , Chenghui Li , Akshay Venkatesh , Tomas Simon , Chen Cao , Gabriel Schwartz , Ryan Wrench , Jason Saragih , Yaser Sheikh , Shih-En Wei

We propose Relightable Full-Body Gaussian Codec Avatars, a new approach for modeling relightable full-body avatars with fine-grained details including face and hands. The unique challenge for relighting full-body avatars lies in the large…

This paper aims to introduce 3D Gaussian for efficient, expressive, and editable digital avatar generation. This task faces two major challenges: (1) The unstructured nature of 3D Gaussian makes it incompatible with current generation…

计算机视觉与模式识别 · 计算机科学 2024-05-31 Weitian Zhang , Yichao Yan , Yunhui Liu , Xingdong Sheng , Xiaokang Yang

In this paper, we propose UniGS, a unified map representation and differentiable framework for high-fidelity multimodal 3D reconstruction based on 3D Gaussian Splatting. Our framework integrates a CUDA-accelerated rasterization pipeline…

计算机视觉与模式识别 · 计算机科学 2025-11-14 Yusen Xie , Zhenmin Huang , Jianhao Jiao , Dimitrios Kanoulas , Jun Ma

Recent advances in 3D Gaussian splatting have significantly improved real-time novel view synthesis, yet insufficient geometric constraints during scene optimization often result in blurred reconstructions of fine-grained details,…

计算机视觉与模式识别 · 计算机科学 2025-08-15 Zheng Zhou , Jia-Chen Zhang , Yu-Jie Xiong , Chun-Ming Xia

Recently, implicit neural representation has been widely used to generate animatable human avatars. However, the materials and geometry of those representations are coupled in the neural network and hard to edit, which hinders their…

计算机视觉与模式识别 · 计算机科学 2024-05-21 Qifeng Chen , Rengan Xie , Kai Huang , Qi Wang , Wenting Zheng , Rong Li , Yuchi Huo

Current personalized neural head avatars face a trade-off: lightweight models lack detail and realism, while high-quality, animatable avatars require significant computational resources, making them unsuitable for commodity devices. To…

计算机视觉与模式识别 · 计算机科学 2025-04-01 Wojciech Zielonka , Timo Bolkart , Thabo Beeler , Justus Thies

We introduce PICA, a novel representation for high-fidelity animatable clothed human avatars with physics-accurate dynamics, even for loose clothing. Previous neural rendering-based representations of animatable clothed humans typically…

计算机视觉与模式识别 · 计算机科学 2024-07-09 Bo Peng , Yunfan Tao , Haoyu Zhan , Yudong Guo , Juyong Zhang

We study the problem of 3D-aware full-body human generation, aiming at creating animatable human avatars with high-quality textures and geometries. Generally, two challenges remain in this field: i) existing methods struggle to generate…

计算机视觉与模式识别 · 计算机科学 2023-10-05 Xuanmeng Zhang , Jianfeng Zhang , Rohan Chacko , Hongyi Xu , Guoxian Song , Yi Yang , Jiashi Feng

Implicit neural representations (INRs) recently achieved great success in image representation and compression, offering high visual quality and fast rendering speeds with 10-1000 FPS, assuming sufficient GPU resources are available.…

图像与视频处理 · 电气工程与系统科学 2024-07-10 Xinjie Zhang , Xingtong Ge , Tongda Xu , Dailan He , Yan Wang , Hongwei Qin , Guo Lu , Jing Geng , Jun Zhang

To bring digital avatars into people's lives, it is highly demanded to efficiently generate complete, realistic, and animatable head avatars. This task is challenging, and it is difficult for existing methods to satisfy all the requirements…

计算机视觉与模式识别 · 计算机科学 2023-04-11 Sijing Wu , Yichao Yan , Yunhao Li , Yuhao Cheng , Wenhan Zhu , Ke Gao , Xiaobo Li , Guangtao Zhai

We introduce Dream, Lift, Animate (DLA), a novel framework that reconstructs animatable 3D human avatars from a single image. This is achieved by leveraging multi-view generation, 3D Gaussian lifting, and pose-aware UV-space mapping of 3D…

图形学 · 计算机科学 2025-11-18 Marcel C. Bühler , Ye Yuan , Xueting Li , Yangyi Huang , Koki Nagano , Umar Iqbal

Our goal is to create a realistic 3D facial avatar with hair and accessories using only a text description. While this challenge has attracted significant recent interest, existing methods either lack realism, produce unrealistic shapes, or…

计算机视觉与模式识别 · 计算机科学 2023-09-14 Hao Zhang , Yao Feng , Peter Kulits , Yandong Wen , Justus Thies , Michael J. Black

We introduce RMAvatar, a novel human avatar representation with Gaussian splatting embedded on mesh to learn clothed avatar from a monocular video. We utilize the explicit mesh geometry to represent motion and shape of a virtual human and…

计算机视觉与模式识别 · 计算机科学 2025-01-14 Sen Peng , Weixing Xie , Zilong Wang , Xiaohu Guo , Zhonggui Chen , Baorong Yang , Xiao Dong

In this paper, we introduce GaussianMotion, a novel human rendering model that generates fully animatable scenes aligned with textual descriptions using Gaussian Splatting. Although existing methods achieve reasonable text-to-3D generation…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Gyumin Shim , Sangmin Lee , Jaegul Choo

Searching for a unified scene representation remains a research challenge in computer graphics. Traditional mesh-based representations are unsuitable for dense, fuzzy elements, and introduce additional complexity for filtering and…

图形学 · 计算机科学 2024-09-24 Yang Zhou , Songyin Wu , Ling-Qi Yan

Multi-view volumetric rendering techniques have recently shown great potential in modeling and synthesizing high-quality head avatars. A common approach to capture full head dynamic performances is to track the underlying geometry using a…

计算机视觉与模式识别 · 计算机科学 2023-03-28 Kartik Teotia , Mallikarjun B R , Xingang Pan , Hyeongwoo Kim , Pablo Garrido , Mohamed Elgharib , Christian Theobalt

Generating animatable human avatars from a single image is essential for various digital human modeling applications. Existing 3D reconstruction methods often struggle to capture fine details in animatable models, while generative…

计算机视觉与模式识别 · 计算机科学 2024-12-04 Lingteng Qiu , Shenhao Zhu , Qi Zuo , Xiaodong Gu , Yuan Dong , Junfei Zhang , Chao Xu , Zhe Li , Weihao Yuan , Liefeng Bo , Guanying Chen , Zilong Dong