中文
相关论文

相关论文: DEGSTalk: Decomposed Per-Embedding Gaussian Fields…

200 篇论文

Talking head synthesis is a promising approach for the video production industry. Recently, a lot of effort has been devoted in this research area to improve the generation quality or enhance the model generalization. However, there are few…

计算机视觉与模式识别 · 计算机科学 2023-04-21 Shuai Shen , Wenliang Zhao , Zibin Meng , Wanhua Li , Zheng Zhu , Jie Zhou , Jiwen Lu

Existing full-body Gaussian avatar methods primarily optimize global reconstruction quality and often fail to preserve fine-grained facial geometry and expression details. This challenge arises from limited facial representational capacity…

计算机视觉与模式识别 · 计算机科学 2026-04-14 Willem Menu , Erkut Akdag , Pedro Quesado , Yasaman Kashefbahrami , Egor Bondarev

We introduce a new hair modeling method that uses a dual representation of classical hair strands and 3D Gaussians to produce accurate and realistic strand-based reconstructions from multi-view data. In contrast to recent approaches that…

计算机视觉与模式识别 · 计算机科学 2024-09-24 Egor Zakharov , Vanessa Sklyarova , Michael Black , Giljoo Nam , Justus Thies , Otmar Hilliges

We present a novel approach for synthesizing 3D facial motions from audio sequences using key motion embeddings. Despite recent advancements in data-driven techniques, accurately mapping between audio signals and 3D facial meshes remains…

计算机视觉与模式识别 · 计算机科学 2024-09-04 Zhihao Xu , Shengjie Gong , Jiapeng Tang , Lingyu Liang , Yining Huang , Haojie Li , Shuangping Huang

As 3D Gaussian Splatting (3DGS) provides fast and high-quality novel view synthesis, it is a natural extension to deform a canonical 3DGS to multiple frames for representing a dynamic scene. However, previous works fail to accurately…

计算机视觉与模式识别 · 计算机科学 2024-07-29 Jeongmin Bae , Seoha Kim , Youngsik Yun , Hahyun Lee , Gun Bang , Youngjung Uh

Reconstructing clean, distractor-free 3D scenes from real-world captures remains a significant challenge, particularly in highly dynamic and cluttered settings such as egocentric videos. To tackle this problem, we introduce DeGauss, a…

计算机视觉与模式识别 · 计算机科学 2025-07-25 Rui Wang , Quentin Lohmeyer , Mirko Meboldt , Siyu Tang

We introduce FaceTalk, a novel generative approach designed for synthesizing high-fidelity 3D motion sequences of talking human heads from input audio signal. To capture the expressive, detailed nature of human heads, including hair, ears,…

计算机视觉与模式识别 · 计算机科学 2024-03-19 Shivangi Aneja , Justus Thies , Angela Dai , Matthias Nießner

Talking face generation aims to synthesize a sequence of face images that correspond to a clip of speech. This is a challenging task because face appearance variation and semantics of speech are coupled together in the subtle movements of…

计算机视觉与模式识别 · 计算机科学 2019-04-24 Hang Zhou , Yu Liu , Ziwei Liu , Ping Luo , Xiaogang Wang

We introduce HyperGaussians, a novel extension of 3D Gaussian Splatting for high-quality animatable face avatars. Creating such detailed face avatars from videos is a challenging problem and has numerous applications in augmented and…

计算机视觉与模式识别 · 计算机科学 2026-03-27 Gent Serifi , Marcel C. Buehler

We propose HeadsUp, a scalable feed-forward method for reconstructing high-quality 3D Gaussian heads from large-scale multi-camera setups. Our method employs an efficient encoder-decoder architecture that compresses input views into a…

We present a novel framework for generating photorealistic 3D human head and subsequently manipulating and reposing them with remarkable flexibility. The proposed approach leverages an implicit function representation of 3D human heads,…

计算机视觉与模式识别 · 计算机科学 2023-12-22 Yushi Lan , Feitong Tan , Di Qiu , Qiangeng Xu , Kyle Genova , Zeng Huang , Sean Fanello , Rohit Pandey , Thomas Funkhouser , Chen Change Loy , Yinda Zhang

Audio-driven 3D talking head synthesis has advanced rapidly with Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS). By leveraging rich pre-trained priors, few-shot methods enable instant personalization from just a few seconds…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Haolan Xu , Keli Cheng , Lei Wang , Ning Bi , Xiaoming Liu

Audio-driven talking-head generation has advanced rapidly with diffusion-based generative models, yet producing temporally coherent videos with fine-grained motion control remains challenging. We propose DEMO, a flow-matching generative…

计算机视觉与模式识别 · 计算机科学 2025-10-14 Peiyin Chen , Zhuowei Yang , Hui Feng , Sheng Jiang , Rui Yan

We propose HoliGS, a novel deformable Gaussian splatting framework that addresses embodied view synthesis from long monocular RGB videos. Unlike prior 4D Gaussian splatting and dynamic NeRF pipelines, which struggle with training overhead…

计算机视觉与模式识别 · 计算机科学 2025-06-25 Xiaoyuan Wang , Yizhou Zhao , Botao Ye , Xiaojun Shan , Weijie Lyu , Lu Qi , Kelvin C. K. Chan , Yinxiao Li , Ming-Hsuan Yang

Talking head synthesis has emerged as a prominent research topic in computer graphics and multimedia, yet most existing methods often struggle to strike a balance between generation quality and computational efficiency, particularly under…

图形学 · 计算机科学 2025-06-30 Shuai Shen , Wanhua Li , Yunpeng Zhang , Yap-Peng Tan , Jiwen Lu

Speech-driven 3D face animation aims to generate realistic facial expressions that match the speech content and emotion. However, existing methods often neglect emotional facial expressions or fail to disentangle them from speech content.…

计算机视觉与模式识别 · 计算机科学 2023-08-28 Ziqiao Peng , Haoyu Wu , Zhenbo Song , Hao Xu , Xiangyu Zhu , Jun He , Hongyan Liu , Zhaoxin Fan

Realistic 3D full-body talking avatars hold great potential in AR, with applications ranging from e-commerce live streaming to holographic communication. Despite advances in 3D Gaussian Splatting (3DGS) for lifelike avatar creation,…

计算机视觉与模式识别 · 计算机科学 2025-07-24 Jianchuan Chen , Jingchuan Hu , Gaige Wang , Zhonghua Jiang , Tiansong Zhou , Zhiwen Chen , Chengfei Lv

In this paper, we introduce GaussianMotion, a novel human rendering model that generates fully animatable scenes aligned with textual descriptions using Gaussian Splatting. Although existing methods achieve reasonable text-to-3D generation…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Gyumin Shim , Sangmin Lee , Jaegul Choo

Gaussian splatting has emerged as a powerful 3D representation that harnesses the advantages of both explicit (mesh) and implicit (NeRF) 3D representations. In this paper, we seek to leverage Gaussian splatting to generate realistic…

计算机视觉与模式识别 · 计算机科学 2024-04-01 Ye Yuan , Xueting Li , Yangyi Huang , Shalini De Mello , Koki Nagano , Jan Kautz , Umar Iqbal

Modeling open-vocabulary language fields in 3D is essential for intuitive human-AI interaction and querying within physical environments. State-of-the-art approaches, such as LangSplat, leverage 3D Gaussian Splatting to efficiently…

计算机视觉与模式识别 · 计算机科学 2025-10-28 Pranav Saxena