English
Related papers

Related papers: Deep Video Inpainting

200 papers

This paper studies video inpainting detection, which localizes an inpainted region in a video both spatially and temporally. In particular, we introduce VIDNet, Video Inpainting Detection Network, which contains a two-stream encoder-decoder…

Computer Vision and Pattern Recognition · Computer Science 2021-01-28 Peng Zhou , Ning Yu , Zuxuan Wu , Larry S. Davis , Abhinav Shrivastava , Ser-Nam Lim

Traditional neural network-driven inpainting methods struggle to deliver high-quality results within the constraints of mobile device processing power and memory. Our research introduces an innovative approach to optimize memory usage by…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Hoyoung Kim , Azimbek Khudoyberdiev , Seonghwan Jeong , Jihoon Ryoo

Recent image-to-video (I2V) based video inpainting methods have made significant strides by leveraging single-image priors and modeling temporal consistency across masked frames. Nevertheless, these methods suffer from severe content…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Ming Xie , Junqiu Yu , Qiaole Dong , Xiangyang Xue , Yanwei Fu

Video inpainting involves modifying local regions within a video, ensuring spatial and temporal consistency. Most existing methods focus primarily on scene completion (i.e., filling missing regions) and lack the capability to insert new…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Shiyuan Yang , Zheng Gu , Liang Hou , Xin Tao , Pengfei Wan , Xiaodong Chen , Jing Liao

Image inpainting is an effective method to enhance distorted digital images. Different inpainting methods use the information of neighboring pixels to predict the value of missing pixels. Recently deep neural networks have been used to…

Computer Vision and Pattern Recognition · Computer Science 2021-12-20 Mohammad H. Givkashi , Mahshid Hadipour , Arezoo PariZanganeh , Zahra Nabizadeh , Nader Karimi , Shadrokh Samavi

Patch-based methods and deep networks have been employed to tackle image inpainting problem, with their own strengths and weaknesses. Patch-based methods are capable of restoring a missing region with high-quality texture through searching…

Computer Vision and Pattern Recognition · Computer Science 2021-11-05 Rui Xu , Minghao Guo , Jiaqi Wang , Xiaoxiao Li , Bolei Zhou , Chen Change Loy

Compression methods based on inpainting are an evolving alternative to classical transform-based codecs for still images. Attempts to apply these ideas to video compression are rare, since reaching real-time performance is very challenging.…

Image and Video Processing · Electrical Eng. & Systems 2021-05-05 Sarah Andris , Pascal Peter , Rahul Mohideen Kaja Mohideen , Joachim Weickert , Sebastian Hoffmann

Video inpainting aims to fill the given spatiotemporal holes with realistic appearance but is still a challenging task even with prosperous deep learning approaches. Recent works introduce the promising Transformer architecture into deep…

Computer Vision and Pattern Recognition · Computer Science 2021-04-15 Rui Liu , Hanming Deng , Yangyi Huang , Xiaoyu Shi , Lewei Lu , Wenxiu Sun , Xiaogang Wang , Jifeng Dai , Hongsheng Li

We study the task of image inpainting, which is to fill in the missing region of an incomplete image with plausible contents. To this end, we propose a learning-based approach to generate visually coherent completion given a high-resolution…

Computer Vision and Pattern Recognition · Computer Science 2018-07-27 Yuhang Song , Chao Yang , Zhe Lin , Xiaofeng Liu , Qin Huang , Hao Li , C. -C. Jay Kuo

Recent learning-based inpainting algorithms have achieved compelling results for completing missing regions after removing undesired objects in videos. To maintain the temporal consistency among the frames, 3D spatial and temporal…

Computer Vision and Pattern Recognition · Computer Science 2021-11-08 Vishnu Sanjay Ramiya Srinivasan , Rui Ma , Qiang Tang , Zili Yi , Zhan Xu

Although deep learning has enabled a huge leap forward in image inpainting, current methods are often unable to synthesize realistic high-frequency details. In this paper, we propose applying super-resolution to coarsely reconstructed…

Computer Vision and Pattern Recognition · Computer Science 2022-06-30 Soo Ye Kim , Kfir Aberman , Nori Kanazawa , Rahul Garg , Neal Wadhwa , Huiwen Chang , Nikhil Karnad , Munchurl Kim , Orly Liba

We develop an automated video colorization framework that minimizes the flickering of colors across frames. If we apply image colorization techniques to successive frames of a video, they treat each frame as a separate colorization task.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Thejan Wijesinghe , Chamath Abeysinghe , Chanuka Wijayakoon , Lahiru Jayathilake , Uthayasanker Thayasivam

Deep generative models have shown success in automatically synthesizing missing image regions using surrounding context. However, users cannot directly decide what content to synthesize with such approaches. We propose an end-to-end network…

Computer Vision and Pattern Recognition · Computer Science 2018-03-23 Yinan Zhao , Brian Price , Scott Cohen , Danna Gurari

Recent advances in deep learning have shown exciting promise in filling large holes in natural images with semantically plausible and context aware details, impacting fundamental image manipulation tasks such as object removal. While these…

Computer Vision and Pattern Recognition · Computer Science 2017-04-14 Chao Yang , Xin Lu , Zhe Lin , Eli Shechtman , Oliver Wang , Hao Li

Applying image processing algorithms independently to each frame of a video often leads to undesired inconsistent results over time. Developing temporally consistent video-based extensions, however, requires domain knowledge for individual…

Computer Vision and Pattern Recognition · Computer Science 2018-08-02 Wei-Sheng Lai , Jia-Bin Huang , Oliver Wang , Eli Shechtman , Ersin Yumer , Ming-Hsuan Yang

Video object removal is a challenging task in video processing that often requires massive human efforts. Given the mask of the foreground object in each frame, the goal is to complete (inpaint) the object region and generate a video…

Computer Vision and Pattern Recognition · Computer Science 2019-04-16 Ya-Liang Chang , Zhe Yu Liu , Winston Hsu

To get clear street-view and photo-realistic simulation in autonomous driving, we present an automatic video inpainting algorithm that can remove traffic agents from videos and synthesize missing regions with the guidance of depth/point…

Computer Vision and Pattern Recognition · Computer Science 2020-09-23 Miao Liao , Feixiang Lu , Dingfu Zhou , Sibo Zhang , Wei Li , Ruigang Yang

Image inpainting is currently a hot topic within the field of computer vision. It offers a viable solution for various applications, including photographic restoration, video editing, and medical imaging. Deep learning advancements, notably…

Computer Vision and Pattern Recognition · Computer Science 2025-02-07 Omar Elharrouss , Rafat Damseh , Abdelkader Nasreddine Belkacem , Elarbi Badidi , Abderrahmane Lakas

Recent deep learning based approaches have shown promising results for the challenging task of inpainting large missing regions in an image. These methods can generate visually plausible image structures and textures, but often create…

Computer Vision and Pattern Recognition · Computer Science 2018-03-23 Jiahui Yu , Zhe Lin , Jimei Yang , Xiaohui Shen , Xin Lu , Thomas S. Huang

Video outpainting aims to adequately complete missing areas at the edges of video frames. Compared to image outpainting, it presents an additional challenge as the model should maintain the temporal consistency of the filled area. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-01-22 Fanda Fan , Chaoxu Guo , Litong Gong , Biao Wang , Tiezheng Ge , Yuning Jiang , Chunjie Luo , Jianfeng Zhan