English
Related papers

Related papers: An Internal Learning Approach to Video Inpainting

200 papers

Image inpainting, the process of restoring missing or corrupted regions of an image by reconstructing pixel information, has recently seen considerable advancements through deep learning-based approaches. In this paper, we introduce a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Kourosh Kiani , Razieh Rastgoo , Alireza Chaji , Sergio Escalera

Generating long videos remains a fundamental challenge, and achieving high controllability in video inpainting and outpainting is particularly demanding. To address both of these challenges simultaneously and achieve controllable video…

Computer Vision and Pattern Recognition · Computer Science 2025-11-06 Shuangquan Lyu , Steven Mao , Yue Ma

3D Gaussians have recently emerged as an efficient representation for novel view synthesis. This work studies its editability with a particular focus on the inpainting task, which aims to supplement an incomplete set of 3D Gaussians with…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Zhiheng Liu , Hao Ouyang , Qiuyu Wang , Ka Leong Cheng , Jie Xiao , Kai Zhu , Nan Xue , Yu Liu , Yujun Shen , Yang Cao

We propose a novel method for learning convolutional neural image representations without manual supervision. We use motion cues in the form of optical flow, to supervise representations of static images. The obvious approach of training a…

Computer Vision and Pattern Recognition · Computer Science 2018-07-17 Aravindh Mahendran , James Thewlis , Andrea Vedaldi

Blind video decaptioning is a problem of automatically removing text overlays and inpainting the occluded parts in videos without any input masks. While recent deep learning based inpainting methods deal with a single image and mostly…

Computer Vision and Pattern Recognition · Computer Science 2019-05-09 Dahun Kim , Sanghyun Woo , Joon-Young Lee , In So Kweon

With the advancement of deepfake generation techniques, the importance of deepfake detection in protecting multimedia content integrity has become increasingly obvious. Recently, temporal inconsistency clues have been explored to improve…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Fan Nie , Jiangqun Ni , Jian Zhang , Bin Zhang , Weizhe Zhang

Deep image inpainting aims to restore damaged or missing regions in an image with realistic contents. While having a wide range of applications such as object removal and image recovery, deep inpainting techniques also have the risk of…

Computer Vision and Pattern Recognition · Computer Science 2021-06-04 Ang Li , Qiuhong Ke , Xingjun Ma , Haiqin Weng , Zhiyuan Zong , Feng Xue , Rui Zhang

We explore novel-view synthesis for dynamic scenes from monocular videos. Prior approaches rely on costly test-time optimization of 4D representations or do not preserve scene geometry when trained in a feed-forward manner. Our approach is…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Kaihua Chen , Tarasha Khurana , Deva Ramanan

Optical flow, which captures motion information across frames, is exploited in recent video inpainting methods through propagating pixels along its trajectories. However, the hand-crafted flow-based processes in these methods are applied…

Image and Video Processing · Electrical Eng. & Systems 2022-04-08 Zhen Li , Cheng-Ze Lu , Jianhua Qin , Chun-Le Guo , Ming-Ming Cheng

Recent image inpainting methods have shown promising results due to the power of deep learning, which can explore external information available from the large training dataset. However, many state-of-the-art inpainting networks are still…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Eunhye Lee , Jeongmu Kim , Jisu Kim , Tae Hyun Kim

Recent image inpainting methods show promising results due to the power of deep learning, which can explore external information available from a large training dataset. However, many state-of-the-art inpainting networks are still limited…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Eunhye Lee , Jeongmu Kim , Jisu Kim , Tae Hyun Kim

Video outpainting presents a unique challenge of extending the borders while maintaining consistency with the given content. In this paper, we suggest the use of video inpainting models that excel in object flow learning and reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Sangwoo Youn , Minji Lee , Nokap Tony Park , Yeonggyoo Jeon , Taeyoung Na

Image inpainting is one of the most challenging tasks in computer vision. Recently, generative-based image inpainting methods have been shown to produce visually plausible images. However, they still have difficulties to generate the…

Computer Vision and Pattern Recognition · Computer Science 2020-02-24 Mohamed Abbas Hedjazi , Yakup Genc

2D portrait animation has experienced significant advancements in recent years. Much research has utilized the prior knowledge embedded in large generative diffusion models to enhance high-quality image manipulation. However, most methods…

Computer Vision and Pattern Recognition · Computer Science 2025-01-16 Xinya Ji , Gaspard Zoss , Prashanth Chandran , Lingchen Yang , Xun Cao , Barbara Solenthaler , Derek Bradley

In this work, we address a challenge in video inpainting: reconstructing occluded regions in dynamic, real-world scenarios. Motivated by the need for continuous human motion monitoring in healthcare settings, where facial features are…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Zheyan Zhang , Diego Klabjan , Renee CB Manworren

We present a method to estimate depth of a dynamic scene, containing arbitrary moving objects, from an ordinary video captured with a moving camera. We seek a geometrically and temporally consistent solution to this underconstrained…

Computer Vision and Pattern Recognition · Computer Science 2021-08-04 Zhoutong Zhang , Forrester Cole , Richard Tucker , William T. Freeman , Tali Dekel

Inpainting for real-world human and pedestrian removal in high-resolution video clips presents significant challenges, particularly in achieving high-quality outcomes, ensuring temporal consistency, and managing complex object interactions…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Huiming Sun , Yikang Li , Kangning Yang , Ruineng Li , Daitao Xing , Yangbo Xie , Lan Fu , Kaiyu Zhang , Ming Chen , Jiaming Ding , Jiang Geng , Jie Cai , Zibo Meng , Chiuman Ho

Single image inverse problem is a notoriously challenging ill-posed problem that aims to restore the original image from one of its corrupted versions. Recently, this field has been immensely influenced by the emergence of deep-learning…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Qianwei Zhou , Chen Zhou , Haigen Hu , Yuhang Chen , Shengyong Chen , Xiaoxin Li

Scene-aware motion synthesis has been widely researched recently due to its numerous applications. Prevailing methods rely heavily on paired motion-scene data, while it is difficult to generalize to diverse scenes when trained only on a few…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Jingyu Gong , Chong Zhang , Fengqi Liu , Ke Fan , Qianyu Zhou , Xin Tan , Zhizhong Zhang , Yuan Xie

Recently deep neutral networks have achieved promising performance for filling large missing regions in image inpainting tasks. They usually adopted the standard convolutional architecture over the corrupted image, leading to meaningless…

Computer Vision and Pattern Recognition · Computer Science 2019-09-30 Yuqing Ma , Xianglong Liu , Shihao Bai , Lei Wang , Aishan Liu , Dacheng Tao , Edwin Hancock