English
Related papers

Related papers: Deep Face Video Inpainting via UV Mapping

200 papers

Traditional 3D morphable face models (3DMMs) provide fine-grained control over expression but cannot easily capture geometric and appearance details. Neural volumetric representations approach photorealism but are hard to animate and do not…

Computer Vision and Pattern Recognition · Computer Science 2022-11-07 Yufeng Zheng , Victoria Fernández Abrevaya , Marcel C. Bühler , Xu Chen , Michael J. Black , Otmar Hilliges

3D photography renders a static image into a video with appealing 3D visual effects. Existing approaches typically first conduct monocular depth estimation, then render the input frame to subsequent frames with various viewpoints, and…

Computer Vision and Pattern Recognition · Computer Science 2023-02-22 Xiaodong Wang , Chenfei Wu , Shengming Yin , Minheng Ni , Jianfeng Wang , Linjie Li , Zhengyuan Yang , Fan Yang , Lijuan Wang , Zicheng Liu , Yuejian Fang , Nan Duan

This paper presents a novel image inpainting framework for face mask removal. Although current methods have demonstrated their impressive ability in recovering damaged face images, they suffer from two main problems: the dependence on…

Computer Vision and Pattern Recognition · Computer Science 2022-03-04 Xiangnan Yin , Liming Chen

In this paper, we present a new inpainting framework for recovering missing regions of video frames. Compared with image inpainting, performing this task on video presents new challenges such as how to preserving temporal consistency and…

Computer Vision and Pattern Recognition · Computer Science 2019-05-09 Yifan Ding , Chuan Wang , Haibin Huang , Jiaming Liu , Jue Wang , Liqiang Wang

Image inpainting approaches have achieved significant progress with the help of deep neural networks. However, existing approaches mainly focus on leveraging the priori distribution learned by neural networks to produce a single inpainting…

Computer Vision and Pattern Recognition · Computer Science 2022-01-27 Wangbo Yu , Jinhao Du , Ruixin Liu , Yixuan Li , Yuesheng zhu

Deep learning-based video inpainting has yielded promising results and gained increasing attention from researchers. Generally, these methods usually assume that the corrupted region masks of each frame are known and easily obtained.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Zhiliang Wu , Hanyu Xuan , Changchang Sun , Kang Zhang , Yan Yan

Video inpainting aims to fill spatio-temporal "corrupted" regions with plausible content. To achieve this goal, it is necessary to find correspondences from neighbouring frames to faithfully hallucinate the unknown content. Current methods…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Xueyan Zou , Linjie Yang , Ding Liu , Yong Jae Lee

With the advancement of deep learning-driven video editing technology, security risks have emerged. Malicious video tampering can lead to public misunderstanding, property losses, and legal disputes. Currently, detection methods are mostly…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Pengfei Pei

Current state-of-the-art methods for video inpainting typically rely on optical flow or attention-based approaches to inpaint masked regions by propagating visual information across frames. While such approaches have led to significant…

Omnidirectional videos that capture the entire surroundings are employed in a variety of fields such as VR applications and remote sensing. However, their wide field of view often causes unwanted objects to appear in the videos. This…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Ryosuke Seshimo , Mariko Isogawa

As a very common type of video, face videos often appear in movies, talk shows, live broadcasts, and other scenes. Real-world online videos are often plagued by degradations such as blurring and quantization noise, due to the high…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Yutong Wang , Jiajie Teng , Jiajiong Cao , Yuming Li , Chenguang Ma , Hongteng Xu , Dixin Luo

Recently audio-driven talking face video generation has attracted considerable attention. However, very few researches address the issue of emotional editing of these talking face videos with continuously controllable expressions, which is…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Zhiyao Sun , Yu-Hui Wen , Tian Lv , Yanan Sun , Ziyang Zhang , Yaoyuan Wang , Yong-Jin Liu

We propose the first deep learning solution to video frame inpainting, a challenging instance of the general video inpainting problem with applications in video editing, manipulation, and forensics. Our task is less ambiguous than frame…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 Ximeng Sun , Ryan Szeto , Jason J. Corso

For few-shot learning, it is still a critical challenge to realize photo-realistic face visually dubbing on high-resolution videos. Previous works fail to generate high-fidelity dubbing results. To address the above problem, this paper…

Computer Vision and Pattern Recognition · Computer Science 2023-03-08 Zhimeng Zhang , Zhipeng Hu , Wenjin Deng , Changjie Fan , Tangjie Lv , Yu Ding

To see what is not in the image is one of the broader missions of computer vision. Technology to inpaint images has made significant progress with the coming of deep learning. This paper proposes a method to tackle occlusion specific to…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Surabhi Gupta , Ashwath Shetty , Avinash Sharma

Editing and manipulating facial features in videos is an interesting and important field of research with a plethora of applications, ranging from movie post-production and visual effects to realistic avatars for video games and virtual…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Girish Kumar Solanki , Anastasios Roussos

Video outpainting aims to adequately complete missing areas at the edges of video frames. Compared to image outpainting, it presents an additional challenge as the model should maintain the temporal consistency of the filled area. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-01-22 Fanda Fan , Chaoxu Guo , Litong Gong , Biao Wang , Tiezheng Ge , Yuning Jiang , Chunjie Luo , Jianfeng Zhan

Facial Image inpainting aim is to restore the missing or corrupted regions in face images while preserving identity, structural consistency and photorealistic image quality, a task specifically created for photo restoration. Though there…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Abhigyan Bhattacharya , Hiranmoy Roy , Debotosh Bhattacharjee

Recently proposed robust 3D face alignment methods establish either dense or sparse correspondence between a 3D face model and a 2D facial image. The use of these methods presents new challenges as well as opportunities for facial texture…

Computer Vision and Pattern Recognition · Computer Science 2017-12-14 Jiankang Deng , Shiyang Cheng , Niannan Xue , Yuxiang Zhou , Stefanos Zafeiriou

Digital video inpainting techniques have been substantially improved with deep learning in recent years. Although inpainting is originally designed to repair damaged areas, it can also be used as malicious manipulation to remove important…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Zijie Lou , Gang Cao , Man Lin