English
Related papers

Related papers: Geometry Driven Progressive Warping for One-Shot F…

200 papers

One-shot video-driven talking face generation aims at producing a synthetic talking video by transferring the facial motion from a video to an arbitrary portrait image. Head pose and facial expression are always entangled in facial motion…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Youxin Pang , Yong Zhang , Weize Quan , Yanbo Fan , Xiaodong Cun , Ying Shan , Dong-ming Yan

Rendering photorealistic and dynamically moving human heads is crucial for ensuring a pleasant and immersive experience in AR/VR and video conferencing applications. However, existing methods often struggle to model challenging facial…

Computer Vision and Pattern Recognition · Computer Science 2026-02-20 Cong Wang , Di Kang , Yan-Pei Cao , Linchao Bao , Ying Shan , Song-Hai Zhang

This paper is on face/head reenactment where the goal is to transfer the facial pose (3D head orientation and expression) of a target face to a source face. Previous methods focus on learning embedding networks for identity and pose…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Stella Bounareli , Vasileios Argyriou , Georgios Tzimiropoulos

Audio-driven talking head generation necessitates seamless integration of audio and visual data amidst the challenges posed by diverse input portraits and intricate correlations between audio and facial motions. In response, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Ziqi Zhou , Weize Quan , Hailin Shi , Wei Li , Lili Wang , Dong-Ming Yan

In this paper, we present our framework for neural face/head reenactment whose goal is to transfer the 3D head orientation and expression of a target face to a source face. Previous methods focus on learning embedding networks for identity…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Stella Bounareli , Christos Tzelepis , Vasileios Argyriou , Ioannis Patras , Georgios Tzimiropoulos

Displacement mapping is an important tool for modeling detailed geometric features. We explore the problem of authoring complex surfaces while ray tracing interactively. Current techniques for ray tracing displaced surfaces rely on…

Graphics · Computer Science 2025-02-05 Rama Carl Hoetzlein

We present a data-driven method for learning to generate animations of 3D garments using a 2D image diffusion model. In contrast to existing methods, typically based on fully connected networks, graph neural networks, or generative…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Raquel Vidaurre , Elena Garces , Dan Casas

We present a novel approach that enables photo-realistic re-animation of portrait videos using only an input video. In contrast to existing approaches that are restricted to manipulations of facial expressions only, we are the first to…

Computer Vision and Pattern Recognition · Computer Science 2018-05-31 Hyeongwoo Kim , Pablo Garrido , Ayush Tewari , Weipeng Xu , Justus Thies , Matthias Nießner , Patrick Pérez , Christian Richardt , Michael Zollhöfer , Christian Theobalt

We propose a method to create plausible geometric and texture style variations of 3D objects in the quest to democratize 3D content creation. Given a pair of textured source and target objects, our method predicts a part-aware affine…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Kangxue Yin , Jun Gao , Maria Shugrina , Sameh Khamis , Sanja Fidler

We present a method for fine-grained face manipulation. Given a face image with an arbitrary expression, our method can synthesize another arbitrary expression by the same person. This is achieved by first fitting a 3D face model and then…

Computer Vision and Pattern Recognition · Computer Science 2019-02-26 Zhenglin Geng , Chen Cao , Sergey Tulyakov

We present a deformable generator model to disentangle the appearance and geometric information for both image and video data in a purely unsupervised manner. The appearance generator network models the information related to appearance,…

Machine Learning · Computer Science 2023-10-09 Xianglei Xing , Ruiqi Gao , Tian Han , Song-Chun Zhu , Ying Nian Wu

Recent generative models can create visually plausible 3D representations of objects. However, the generation process often allows for implicit control signals, such as contextual descriptions, and rarely supports bold geometric distortions…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Changwoon Choi , Hyunsoo Lee , Clément Jambon , Yael Vinker , Young Min Kim

Audio-driven 3D facial animation has achieved significant progress in both research and applications. While recent baselines struggle to generate natural and continuous facial movements due to their frame-by-frame vertex generation…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Xuanmeng Sha , Liyun Zhang , Tomohiro Mashita , Naoya Chiba , Yuki Uranishi

There is a growing demand for the accessible creation of high-quality 3D avatars that are animatable and customizable. Although 3D morphable models provide intuitive control for editing and animation, and robustness for single-view face…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Connor Z. Lin , Koki Nagano , Jan Kautz , Eric R. Chan , Umar Iqbal , Leonidas Guibas , Gordon Wetzstein , Sameh Khamis

Deep learning-based medical image segmentation and surface mesh generation typically involve a sequential pipeline from image to segmentation to meshes, often requiring large training datasets while making limited use of prior geometric…

Audio-driven portrait animation aims to synthesize portrait videos that are conditioned by given audio. Animating high-fidelity and multimodal video portraits has a variety of applications. Previous methods have attempted to capture…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Yunfei Liu , Lijian Lin , Fei Yu , Changyin Zhou , Yu Li

3D generative modeling is accelerating as the technology allowing the capture of geometric data is developing. However, the acquired data is often inconsistent, resulting in unregistered meshes or point clouds. Many generative learning…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Thomas Besnier , Sylvain Arguillère , Emery Pierson , Mohamed Daoudi

In contrast to the traditional avatar creation pipeline which is a costly process, contemporary generative approaches directly learn the data distribution from photographs. While plenty of works extend unconditional generative models and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Junshu Tang , Bo Zhang , Binxin Yang , Ting Zhang , Dong Chen , Lizhuang Ma , Fang Wen

Face morphing is a problem in computer graphics with numerous artistic and forensic applications. It is challenging due to variations in pose, lighting, gender, and ethnicity. This task consists of a warping for feature alignment and a…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Guilherme Schardong , Tiago Novello , Hallison Paz , Iurii Medvedev , Vinícius da Silva , Luiz Velho , Nuno Gonçalves

Generating new images with desired properties (e.g. new view/poses) from source images has been enthusiastically pursued recently, due to its wide range of potential applications. One way to ensure high-quality generation is to use multiple…

Computer Vision and Pattern Recognition · Computer Science 2022-02-03 Jiawei Lu , He Wang , Tianjia Shao , Yin Yang , Kun Zhou