English
Related papers

Related papers: TalkingGaussian: Structure-Persistent 3D Talking H…

200 papers

As 3D Gaussian Splatting (3DGS) provides fast and high-quality novel view synthesis, it is a natural extension to deform a canonical 3DGS to multiple frames for representing a dynamic scene. However, previous works fail to accurately…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Jeongmin Bae , Seoha Kim , Youngsik Yun , Hahyun Lee , Gun Bang , Youngjung Uh

The field of novel-view synthesis has recently witnessed the emergence of 3D Gaussian Splatting, which represents scenes in a point-based manner and renders through rasterization. This methodology, in contrast to Radiance Fields that rely…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Fengyi Zhang , Yadan Luo , Tianjun Zhang , Lin Zhang , Zi Huang

Reconstructing dynamic 3D scenes from monocular video remains fundamentally challenging due to the need to jointly infer motion, structure, and appearance from limited observations. Existing dynamic scene reconstruction methods based on…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Jiahui Li , Shengeng Tang , Jingxuan He , Gang Huang , Zhangye Wang , Yantao Pan , Lechao Cheng

Recent advancements in radiance field rendering show promising results in 3D scene representation, where Gaussian splatting-based techniques emerge as state-of-the-art due to their quality and efficiency. Gaussian splatting is widely used…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Arnab Dey , Cheng-You Lu , Andrew I. Comport , Srinath Sridhar , Chin-Teng Lin , Jean Martinet

Recent developments in 3D reconstruction and neural rendering have significantly propelled the capabilities of photo-realistic 3D scene rendering across various academic and industrial fields. The 3D Gaussian Splatting technique, alongside…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Zexu Huang , Min Xu , Stuart Perry

Real-time rendering of human head avatars is a cornerstone of many computer graphics applications, such as augmented reality, video games, and films, to name a few. Recent approaches address this challenge with computationally efficient…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Kartik Teotia , Hyeongwoo Kim , Pablo Garrido , Marc Habermann , Mohamed Elgharib , Christian Theobalt

While recent advances in deep neural networks have made it possible to render high-quality images, generating photo-realistic and personalized talking head remains challenging. With given audio, the key to tackling this task is…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Shunyu Yao , RuiZhe Zhong , Yichao Yan , Guangtao Zhai , Xiaokang Yang

Recently, Gaussian Splatting, a method that represents a 3D scene as a collection of Gaussian distributions, has gained significant attention in addressing the task of novel view synthesis. In this paper, we highlight a fundamental…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Haoxuan Qu , Zhuoling Li , Hossein Rahmani , Yujun Cai , Jun Liu

Recent studies in Radiance Fields have paved the robust way for novel view synthesis with their photorealistic rendering quality. Nevertheless, they usually employ neural networks and volumetric rendering, which are costly to train and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Byeonghyeon Lee , Howoong Lee , Xiangyu Sun , Usman Ali , Eunbyung Park

Recently, with the development of Neural Radiance Fields and Gaussian Splatting, 3D reconstruction techniques have achieved remarkably high fidelity. However, the latent representations learnt by these methods are highly entangled and lack…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Shuyi Jiang , Qihao Zhao , Hossein Rahmani , De Wen Soh , Jun Liu , Na Zhao

3D Gaussian Splatting (3DGS) has revolutionized fast novel view synthesis, yet its opacity-based formulation makes surface extraction fundamentally difficult. Unlike implicit methods built on Signed Distance Fields or occupancy, 3DGS lacks…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Diego Gomez , Antoine Guédon , Nissim Maruani , Bingchen Gong , Maks Ovsjanikov

Synthesizing consistent and photorealistic 3D scenes is an open problem in computer vision. Video diffusion models generate impressive videos but cannot directly synthesize 3D representations, i.e., lack 3D consistency in the generated…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Katja Schwarz , Norman Mueller , Peter Kontschieder

3D Gaussian Splatting (3DGS) has gained significant attention for its real-time, photo-realistic rendering in novel-view synthesis and 3D modeling. However, existing methods struggle with accurately modeling scenes affected by transient…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Chuanyu Fu , Yuqi Zhang , Kunbin Yao , Guanying Chen , Yuan Xiong , Chuan Huang , Shuguang Cui , Xiaochun Cao

4D generation has made remarkable progress in synthesizing dynamic 3D objects from input text, images, or videos. However, existing methods often represent motion as an implicit deformation field, which limits direct control and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Lifan Wu , Ruijie Zhu , Yubo Ai , Tianzhu Zhang

Talking head synthesis is to synthesize a lip-synchronized talking head video using audio. Recently, the capability of NeRF to enhance the realism and texture details of synthesized talking heads has attracted the attention of researchers.…

Graphics · Computer Science 2025-02-21 Xiaoxing Liu , Zhilei Liu , Chongke Bi

Reconstructing 3D scenes and synthesizing novel views has seen rapid progress in recent years. Neural Radiance Fields demonstrated that continuous volumetric radiance fields can achieve high-quality image synthesis, but their long training…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Jan Held , Renaud Vandeghen , Sanghyun Son , Daniel Rebain , Matheus Gadelha , Yi Zhou , Ming C. Lin , Marc Van Droogenbroeck , Andrea Tagliasacchi

Novel view synthesis with neural models has advanced rapidly in recent years, yet adapting these models to scene changes remains an open problem. Existing methods are either labor-intensive, requiring extensive model retraining, or fail to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Lin Zeng , Boming Zhao , Jiarui Hu , Xujie Shen , Ziqiang Dang , Hujun Bao , Zhaopeng Cui

3D Gaussian Splatting has demonstrated remarkable real-time rendering capabilities and superior visual quality in novel view synthesis for static scenes. Building upon these advantages, researchers have progressively extended 3D Gaussians…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Han Jiao , Jiakai Sun , Lei Zhao , Zhanjie Zhang , Wei Xing , Huaizhong Lin

Talking head synthesis is a practical technique with wide applications. Current Neural Radiance Field (NeRF) based approaches have shown their superiority on driving one-shot talking heads with videos or signals regressed from audio.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Dongze Li , Kang Zhao , Wei Wang , Yifeng Ma , Bo Peng , Yingya Zhang , Jing Dong

Reconstructing clean, distractor-free 3D scenes from real-world captures remains a significant challenge, particularly in highly dynamic and cluttered settings such as egocentric videos. To tackle this problem, we introduce DeGauss, a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Rui Wang , Quentin Lohmeyer , Mirko Meboldt , Siyu Tang