English
Related papers

Related papers: Video Inpainting by Jointly Learning Temporal Stru…

200 papers

How to efficiently utilize temporal information to recover videos in a consistent way is the main issue for video inpainting problems. Conventional 2D CNNs have achieved good performance on image inpainting but often lead to temporally…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Ya-Liang Chang , Zhe Yu Liu , Kuan-Ying Lee , Winston Hsu

We consider the problem of filling in missing spatio-temporal regions of a video. We provide a novel flow-based solution by introducing a generative model of images in relation to the scene (without missing regions) and mappings from the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Dong Lao , Peihao Zhu , Peter Wonka , Ganesh Sundaramoorthi

This paper proposes a new method for simultaneous 3D reconstruction and semantic segmentation of indoor scenes. Unlike existing methods that require recording a video using a color camera and/or a depth camera, our method only needs a small…

Computer Vision and Pattern Recognition · Computer Science 2019-06-20 Jingyu Yang , Ji Xu , Kun Li , Yu-Kun Lai , Huanjing Yue , Jianzhi Lu , Hao Wu , Yebin Liu

The art of recovering an image from damage in an undetectable form is known as inpainting. The manual work of inpainting is most often a very time consuming process. Due to digitalization of this technique, it is automatic and faster. In…

Computer Vision and Pattern Recognition · Computer Science 2013-07-15 S. Padmavathi , N. Archana , K. P. Soman

Patch-based methods and deep networks have been employed to tackle image inpainting problem, with their own strengths and weaknesses. Patch-based methods are capable of restoring a missing region with high-quality texture through searching…

Computer Vision and Pattern Recognition · Computer Science 2021-11-05 Rui Xu , Minghao Guo , Jiaqi Wang , Xiaoxiao Li , Bolei Zhou , Chen Change Loy

Video inpainting aims to fill the given spatiotemporal holes with realistic appearance but is still a challenging task even with prosperous deep learning approaches. Recent works introduce the promising Transformer architecture into deep…

Computer Vision and Pattern Recognition · Computer Science 2021-04-15 Rui Liu , Hanming Deng , Yangyi Huang , Xiaoyu Shi , Lewei Lu , Wenxiu Sun , Xiaogang Wang , Jifeng Dai , Hongsheng Li

Video super-resolution aims at generating a high-resolution video from its low-resolution counterpart. With the rapid rise of deep learning, many recently proposed video super-resolution methods use convolutional neural networks in…

Computer Vision and Pattern Recognition · Computer Science 2020-01-07 Xiaohong Liu , Lingshi Kong , Yang Zhou , Jiying Zhao , Jun Chen

Free-form video inpainting is a very challenging task that could be widely used for video editing such as text removal. Existing patch-based methods could not handle non-repetitive structures such as faces, while directly applying…

Computer Vision and Pattern Recognition · Computer Science 2019-07-24 Ya-Liang Chang , Zhe Yu Liu , Kuan-Ying Lee , Winston Hsu

Recent deep learning based approaches have shown promising results for the challenging task of inpainting large missing regions in an image. These methods can generate visually plausible image structures and textures, but often create…

Computer Vision and Pattern Recognition · Computer Science 2018-03-23 Jiahui Yu , Zhe Lin , Jimei Yang , Xiaohui Shen , Xin Lu , Thomas S. Huang

Image inpainting has earned substantial progress, owing to the encoder-and-decoder pipeline, which is benefited from the Convolutional Neural Networks (CNNs) with convolutional downsampling to inpaint the masked regions semantically from…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Haipeng Liu , Yang Wang , Biao Qian , Yong Rui , Meng Wang

In this paper, we present a novel image inpainting technique using frequency domain information. Prior works on image inpainting predict the missing pixels by training neural networks using only the spatial domain information. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-07-14 Hiya Roy , Subhajit Chaudhury , Toshihiko Yamasaki , Tatsuaki Hashimoto

In this work we present a deep learning framework for video compressive sensing. The proposed formulation enables recovery of video frames in a few seconds at significantly improved reconstruction quality compared to previous approaches.…

Computer Vision and Pattern Recognition · Computer Science 2017-12-19 Michael Iliadis , Leonidas Spinoulas , Aggelos K. Katsaggelos

Decomposing a video into a layer-based representation is crucial for easy video editing for the creative industries, as it enables independent editing of specific layers. Existing video-layer decomposition models rely on implicit neural…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Maria Pilligua , Danna Xue , Javier Vazquez-Corral

Video object removal is a challenging task in video processing that often requires massive human efforts. Given the mask of the foreground object in each frame, the goal is to complete (inpaint) the object region and generate a video…

Computer Vision and Pattern Recognition · Computer Science 2019-04-16 Ya-Liang Chang , Zhe Yu Liu , Winston Hsu

Image Inpainting is one of the very popular tasks in the field of image processing with broad applications in computer vision. In various practical applications, images are often deteriorated by noise due to the presence of corrupted, lost,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Harsh Patel , Amey Kulkarni , Shivam Sahni , Udit Vyas

One of the solutions of depth imaging of moving scene is to project a static pattern on the object and use just a single image for reconstruction. However, if the motion of the object is too fast with respect to the exposure time of the…

Computer Vision and Pattern Recognition · Computer Science 2017-10-03 Yuki Shiba , Satoshi Ono , Ryo Furukawa , Shinsaku Hiura , Hiroshi Kawasaki

Video inpainting fills in corrupted video content with plausible replacements. While recent advances in endoscopic video inpainting have shown potential for enhancing the quality of endoscopic videos, they mainly repair 2D visual…

Image and Video Processing · Electrical Eng. & Systems 2024-07-04 Francis Xiatian Zhang , Shuang Chen , Xianghua Xie , Hubert P. H. Shum

Although deep learning has enabled a huge leap forward in image inpainting, current methods are often unable to synthesize realistic high-frequency details. In this paper, we propose applying super-resolution to coarsely reconstructed…

Computer Vision and Pattern Recognition · Computer Science 2022-06-30 Soo Ye Kim , Kfir Aberman , Nori Kanazawa , Rahul Garg , Neal Wadhwa , Huiwen Chang , Nikhil Karnad , Munchurl Kim , Orly Liba

This paper addresses the problem of face video inpainting. Existing video inpainting methods target primarily at natural scenes with repetitive patterns. They do not make use of any prior knowledge of the face to help retrieve…

Computer Vision and Pattern Recognition · Computer Science 2023-02-14 Wenqi Yang , Zhenfang Chen , Chaofeng Chen , Guanying Chen , Kwan-Yee K. Wong

We study the task of image inpainting, which is to fill in the missing region of an incomplete image with plausible contents. To this end, we propose a learning-based approach to generate visually coherent completion given a high-resolution…

Computer Vision and Pattern Recognition · Computer Science 2018-07-27 Yuhang Song , Chao Yang , Zhe Lin , Xiaofeng Liu , Qin Huang , Hao Li , C. -C. Jay Kuo