English
Related papers

Related papers: Deep Face Video Inpainting via UV Mapping

200 papers

Face manipulation detection has been receiving a lot of attention for the reliability and security of the face images/videos. Recent studies focus on using auxiliary information or prior knowledge to capture robust manipulation traces,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Haoyue Wang , Sheng Li , Ji He , Zhenxing Qian , Xinpeng Zhang , Shaolin Fan

Image inpainting is a technique of completing missing pixels such as occluded region restoration, distracting objects removal, and facial completion. Among these inpainting tasks, facial completion algorithm performs face inpainting…

Computer Vision and Pattern Recognition · Computer Science 2023-01-20 Dongsik Yoon , Jeonggi Kwak , Yuanming Li , David Han , Youngsaeng Jin , Hanseok Ko

Pose-invariant face recognition refers to the problem of identifying or verifying a person by analyzing face images captured from different poses. This problem is challenging due to the large variation of pose, illumination and facial…

Computer Vision and Pattern Recognition · Computer Science 2020-11-11 In Seop Na , Chung Tran , Dung Nguyen , Sang Dinh

Prior knowledge of face shape and structure plays an important role in face inpainting. However, traditional face inpainting methods mainly focus on the generated image resolution of the missing portion without consideration of the special…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Xian Zhang , Xin Wang , Bin Kong , Canghong Shi , Youbing Yin , Qi Song , Siwei Lyu , Jiancheng Lv , Canghong Shi , Xiaojie Li

Although image inpainting, or the art of repairing the old and deteriorated images, has been around for many years, it has gained even more popularity because of the recent development in image processing techniques. With the improvement of…

Computer Vision and Pattern Recognition · Computer Science 2019-12-11 Omar Elharrouss , Noor Almaadeed , Somaya Al-Maadeed , Younes Akbari

Portraits or selfie images taken from a close distance typically suffer from perspective distortion. In this paper, we propose an end-to-end deep learning-based rectification pipeline to mitigate the effects of perspective distortion. We…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Ahmed Alhawwary , Janne Mustaniemi , Phong Nguyen-Ha , Janne Heikkilä

Recently, removing objects from videos and filling in the erased regions using deep video inpainting (VI) algorithms has attracted considerable attention. Usually, a video sequence and object segmentation masks for all frames are required…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Sangjin Lee , Suhwan Cho , Sangyoun Lee

Image inpainting methods have shown significant improvements by using deep neural networks recently. However, many of these techniques often create distorted structures or blurry textures inconsistent with surrounding areas. The problem is…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Maitreya Suin , Kuldeep Purohit , A. N. Rajagopalan

Sharing short personalized videos to various social media networks has become quite popular in recent years. This raises the need for digital retouching of portraits in videos. However, applying portrait image editing directly on portrait…

Computer Vision and Pattern Recognition · Computer Science 2022-05-06 Xiangjun Tang , Wenxin Sun , Yong-Liang Yang , Xiaogang Jin

Novel View Synthesis (NVS) and 3D generation have recently achieved prominent improvements. However, these works mainly focus on confined categories or synthetic 3D assets, which are discouraged from generalizing to challenging in-the-wild…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Chenjie Cao , Chaohui Yu , Fan Wang , Xiangyang Xue , Yanwei Fu

Many existing video inpainting algorithms utilize optical flows to construct the corresponding maps and then propagate pixels from adjacent frames to missing areas by mapping. Despite the effectiveness of the propagation mechanism, they…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Xian Wu , Chang Liu

Image inpainting techniques have shown significant improvements by using deep neural networks recently. However, most of them may either fail to reconstruct reasonable structures or restore fine-grained textures. In order to solve this…

Computer Vision and Pattern Recognition · Computer Science 2019-08-13 Yurui Ren , Xiaoming Yu , Ruonan Zhang , Thomas H. Li , Shan Liu , Ge Li

Recovering detailed facial geometry from a set of calibrated multi-view images is valuable for its wide range of applications. Traditional multi-view stereo (MVS) methods adopt an optimization-based scheme to regularize the matching cost.…

Computer Vision and Pattern Recognition · Computer Science 2022-05-06 Yunze Xiao , Hao Zhu , Haotian Yang , Zhengyu Diao , Xiangju Lu , Xun Cao

Inpainting for real-world human and pedestrian removal in high-resolution video clips presents significant challenges, particularly in achieving high-quality outcomes, ensuring temporal consistency, and managing complex object interactions…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Huiming Sun , Yikang Li , Kangning Yang , Ruineng Li , Daitao Xing , Yangbo Xie , Lan Fu , Kaiyu Zhang , Ming Chen , Jiaming Ding , Jiang Geng , Jie Cai , Zibo Meng , Chiuman Ho

We present a real-time deep learning framework for video-based facial performance capture -- the dense 3D tracking of an actor's face given a monocular video. Our pipeline begins with accurately capturing a subject using a high-end…

Computer Vision and Pattern Recognition · Computer Science 2017-06-05 Samuli Laine , Tero Karras , Timo Aila , Antti Herva , Shunsuke Saito , Ronald Yu , Hao Li , Jaakko Lehtinen

Facial image inpainting, with high-fidelity preservation for image realism, is a very challenging task. This is due to the subtle texture in key facial features (component) that are not easily transferable. Many image inpainting techniques…

Computer Vision and Pattern Recognition · Computer Science 2021-05-10 Jireh Jam , Connah Kendrick , Vincent Drouard , Kevin Walker , Moi Hoon Yap

In this paper, we present a deep-learning-based framework for audio-visual speech inpainting, i.e., the task of restoring the missing parts of an acoustic speech signal from reliable audio context and uncorrupted visual information. Recent…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-04 Giovanni Morrone , Daniel Michelsanti , Zheng-Hua Tan , Jesper Jensen

Facial video re-targeting is a challenging problem aiming to modify the facial attributes of a target subject in a seamless manner by a driving monocular sequence. We leverage the 3D geometry of faces and Generative Adversarial Networks…

Computer Vision and Pattern Recognition · Computer Science 2021-09-29 Michail Christos Doukas , Mohammad Rami Koujan , Viktoriia Sharmanska , Anastasios Roussos

Video inpainting has been challenged by complex scenarios like large movements and low-light conditions. Current methods, including emerging diffusion models, face limitations in quality and efficiency. This paper introduces the Flow-Guided…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Bohai Gu , Yongsheng Yu , Heng Fan , Libo Zhang

Recovering the missing regions of an image is a task that is called image inpainting. Depending on the shape of missing areas, different methods are presented in the literature. One of the challenges of this problem is extracting features…

Computer Vision and Pattern Recognition · Computer Science 2020-01-13 Ghazale Ghorbanzade , Zahra Nabizadeh , Nader Karimi , Shadrokh Samavi