中文
相关论文

相关论文: TalkingGaussian: Structure-Persistent 3D Talking H…

200 篇论文

Audio-driven 3D talking head synthesis has advanced rapidly with Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS). By leveraging rich pre-trained priors, few-shot methods enable instant personalization from just a few seconds…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Haolan Xu , Keli Cheng , Lei Wang , Ning Bi , Xiaoming Liu

In this paper, we propose a 3D geometry-aware deformable Gaussian Splatting method for dynamic view synthesis. Existing neural radiance fields (NeRF) based solutions learn the deformation in an implicit manner, which cannot incorporate 3D…

计算机视觉与模式识别 · 计算机科学 2024-04-16 Zhicheng Lu , Xiang Guo , Le Hui , Tianrui Chen , Min Yang , Xiao Tang , Feng Zhu , Yuchao Dai

We introduce GenSync, a novel framework for multi-identity lip-synced video synthesis using 3D Gaussian Splatting. Unlike most existing 3D methods that require training a new model for each identity , GenSync learns a unified network that…

计算机视觉与模式识别 · 计算机科学 2025-05-06 Anushka Agarwal , Muhammad Yusuf Hassan , Talha Chafekar

Reconstruction and rendering-based talking head synthesis methods achieve high-quality results with strong identity preservation but are limited by their dependence on identity-specific models. Each new identity requires training from…

计算机视觉与模式识别 · 计算机科学 2025-06-30 Hong Nie , Fuyuan Cao , Lu Chen , Fengxin Chen , Yuefeng Zou , Jun Yu

Text-to-3D, known for its efficient generation methods and expansive creative potential, has garnered significant attention in the AIGC domain. However, the pixel-wise rendering of NeRF and its ray marching light sampling constrain the…

计算机视觉与模式识别 · 计算机科学 2024-11-27 Xinhai Li , Huaibin Wang , Kuo-Kun Tseng

3D scene representations have gained immense popularity in recent years. Methods that use Neural Radiance fields are versatile for traditional tasks such as novel view synthesis. In recent times, some work has emerged that aims to extend…

计算机视觉与模式识别 · 计算机科学 2024-04-09 Shijie Zhou , Haoran Chang , Sicheng Jiang , Zhiwen Fan , Zehao Zhu , Dejia Xu , Pradyumna Chari , Suya You , Zhangyang Wang , Achuta Kadambi

3D Gaussian splatting (3DGS) is an innovative rendering technique that surpasses the neural radiance field (NeRF) in both rendering speed and visual quality by leveraging an explicit 3D scene representation. Existing 3DGS approaches require…

计算机视觉与模式识别 · 计算机科学 2025-06-13 Lintao Xiang , Hongpei Zheng , Yating Huang , Qijun Yang , Hujun Yin

We introduce HyperGaussians, a novel extension of 3D Gaussian Splatting for high-quality animatable face avatars. Creating such detailed face avatars from videos is a challenging problem and has numerous applications in augmented and…

计算机视觉与模式识别 · 计算机科学 2026-03-27 Gent Serifi , Marcel C. Buehler

Neural implicit representations, including Neural Distance Fields and Neural Radiance Fields, have demonstrated significant capabilities for reconstructing surfaces with complicated geometry and topology, and generating novel views of a…

图形学 · 计算机科学 2024-02-08 Lin Gao , Jie Yang , Bo-Tao Zhang , Jia-Mu Sun , Yu-Jie Yuan , Hongbo Fu , Yu-Kun Lai

Talking head generation aims to generate faces that maintain the identity information of the source image and imitate the motion of the driving image. Most pioneering methods rely primarily on 2D representations and thus will inevitably…

计算机视觉与模式识别 · 计算机科学 2023-04-12 Weichuang Li , Longhao Zhang , Dong Wang , Bin Zhao , Zhigang Wang , Mulin Chen , Bang Zhang , Zhongjian Wang , Liefeng Bo , Xuelong Li

Dynamic reconstruction of deformable tissues in endoscopic video is a key technology for robot-assisted surgery. Recent reconstruction methods based on neural radiance fields (NeRFs) have achieved remarkable results in the reconstruction of…

计算机视觉与模式识别 · 计算机科学 2024-07-09 Weixing Xie , Junfeng Yao , Xianpeng Cao , Qiqin Lin , Zerui Tang , Xiao Dong , Xiaohu Guo

Achieving high synchronization in the synthesis of realistic, speech-driven talking head videos presents a significant challenge. A lifelike talking head requires synchronized coordination of subject identity, lip movements, facial…

计算机视觉与模式识别 · 计算机科学 2025-06-18 Ziqiao Peng , Wentao Hu , Junyuan Ma , Xiangyu Zhu , Xiaomei Zhang , Hao Zhao , Hui Tian , Jun He , Hongyan Liu , Zhaoxin Fan

Existing methods like Neural Radiation Fields (NeRF) and 3D Gaussian Splatting (3DGS) have made significant strides in facial attribute control such as facial animation and components editing, yet they struggle with fine-grained…

计算机视觉与模式识别 · 计算机科学 2024-08-21 Pinxin Liu , Luchuan Song , Daoan Zhang , Hang Hua , Yunlong Tang , Huaijin Tu , Jiebo Luo , Chenliang Xu

State-of-the-art novel view synthesis methods achieve impressive results for multi-view captures of static 3D scenes. However, the reconstructed scenes still lack "liveliness," a key component for creating engaging 3D experiences. Recently,…

计算机视觉与模式识别 · 计算机科学 2025-03-10 Thomas Wimmer , Michael Oechsle , Michael Niemeyer , Federico Tombari

The emergence of 3D Gaussian Splatting (3DGS) has greatly accelerated the rendering speed of novel view synthesis. Unlike neural implicit representations like Neural Radiance Fields (NeRF) that represent a 3D scene with position and…

计算机视觉与模式识别 · 计算机科学 2024-04-16 Tong Wu , Yu-Jie Yuan , Ling-Xiao Zhang , Jie Yang , Yan-Pei Cao , Ling-Qi Yan , Lin Gao

In this paper, we introduce GaussianMotion, a novel human rendering model that generates fully animatable scenes aligned with textual descriptions using Gaussian Splatting. Although existing methods achieve reasonable text-to-3D generation…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Gyumin Shim , Sangmin Lee , Jaegul Choo

Scene representations using 3D Gaussian primitives have produced excellent results in modeling the appearance of static and dynamic 3D scenes. Many graphics applications, however, demand the ability to manipulate both the appearance and the…

计算机视觉与模式识别 · 计算机科学 2024-04-02 Ri-Zhao Qiu , Ge Yang , Weijia Zeng , Xiaolong Wang

Recent advances in radiance field reconstruction, such as 3D Gaussian Splatting (3DGS), have achieved high-quality novel view synthesis and fast rendering by representing scenes with compositions of Gaussian primitives. However, 3D…

3D Gaussian Splatting (3DGS) has revolutionized 3D scene representation with superior efficiency and quality. While recent adaptations for computed tomography (CT) show promise, they struggle with severe artifacts under highly sparse-view…

计算机视觉与模式识别 · 计算机科学 2026-02-13 Yuxiang Zhong , Jun Wei , Chaoqi Chen , Senyou An , Hui Huang

We leverage increasingly popular three-dimensional neural representations in order to construct a unified and consistent explanation of a collection of uncalibrated images of the human face. Our approach utilizes Gaussian Splatting, since…

计算机视觉与模式识别 · 计算机科学 2025-12-19 Haodi He , Jihun Yu , Ronald Fedkiw