English
Related papers

Related papers: An Internal Learning Approach to Video Inpainting

200 papers

Deep image prior (DIP) was recently introduced as an effective unsupervised approach for image restoration tasks. DIP represents the image to be recovered as the output of a deep convolutional neural network, and learns the network's…

Image and Video Processing · Electrical Eng. & Systems 2023-02-10 Riccardo Barbano , Johannes Leuschner , Maximilian Schmidt , Alexander Denker , Andreas Hauptmann , Peter Maaß , Bangti Jin

Deep video inpainting is typically used as malicious manipulation to remove important objects for creating fake videos. It is significant to identify the inpainted regions blindly. This letter proposes a simple yet effective forensic scheme…

Computer Vision and Pattern Recognition · Computer Science 2024-06-26 Zijie Lou , Gang Cao , Man Lin

A significant number of researchers have applied deep learning methods to image fusion. However, most works require a large amount of training data or depend on pre-trained models or frameworks to capture features from source images. This…

Computer Vision and Pattern Recognition · Computer Science 2022-02-23 Xudong Ma , Paul Hill , Nantheera Anantrasirichai , Alin Achim

In the deep learning era, long video generation of high-quality still remains challenging due to the spatio-temporal complexity and continuity of videos. Existing prior works have attempted to model video distribution by representing videos…

Computer Vision and Pattern Recognition · Computer Science 2022-02-23 Sihyun Yu , Jihoon Tack , Sangwoo Mo , Hyunsu Kim , Junho Kim , Jung-Woo Ha , Jinwoo Shin

In this paper, we consider the task of unsupervised object discovery in videos. Previous works have shown promising results via processing optical flows to segment objects. However, taking flow as input brings about two drawbacks. First,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Shuangrui Ding , Weidi Xie , Yabo Chen , Rui Qian , Xiaopeng Zhang , Hongkai Xiong , Qi Tian

Existing implicit neural representation (INR) methods do not fully exploit spatiotemporal redundancies in videos. Index-based INRs ignore the content-specific spatial features and hybrid INRs ignore the contextual dependency on adjacent…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Qi Zhao , M. Salman Asif , Zhan Ma

Image Inpainting is one of the very popular tasks in the field of image processing with broad applications in computer vision. In various practical applications, images are often deteriorated by noise due to the presence of corrupted, lost,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Harsh Patel , Amey Kulkarni , Shivam Sahni , Udit Vyas

In the era of generative AI, integrating video generation models into robotics opens new possibilities for the general-purpose robot agent. This paper introduces imitation learning with latent video planning (VILP). We propose a latent…

Robotics · Computer Science 2025-02-05 Zhengtong Xu , Qiang Qiu , Yu She

Static appearance of video may impede the ability of a deep neural network to learn motion-relevant features in video action recognition. In this paper, we introduce a new concept, Dynamic Appearance (DA), summarizing the appearance…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Guoxi Huang , Adrian G. Bors

Image deconvolution is the process of recovering convolutional degraded images, which is always a hard inverse problem because of its mathematically ill-posed property. On the success of the recently proposed deep image prior (DIP), we…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Zhunxuan Wang , Zipei Wang , Qiqi Li , Hakan Bilen

We study the task of image inpainting, which is to fill in the missing region of an incomplete image with plausible contents. To this end, we propose a learning-based approach to generate visually coherent completion given a high-resolution…

Computer Vision and Pattern Recognition · Computer Science 2018-07-27 Yuhang Song , Chao Yang , Zhe Lin , Xiaofeng Liu , Qin Huang , Hao Li , C. -C. Jay Kuo

Creating editable videos that depict complex interactions between multiple objects in various artistic styles has long been a challenging task in filmmaking. Progress is often hampered by the scarcity of data sets that contain paired text…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Anisha Jain

Omnidirectional videos that capture the entire surroundings are employed in a variety of fields such as VR applications and remote sensing. However, their wide field of view often causes unwanted objects to appear in the videos. This…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Ryosuke Seshimo , Mariko Isogawa

We propose the first deep learning solution to video frame inpainting, a challenging instance of the general video inpainting problem with applications in video editing, manipulation, and forensics. Our task is less ambiguous than frame…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 Ximeng Sun , Ryan Szeto , Jason J. Corso

Video inpainting fills in corrupted video content with plausible replacements. While recent advances in endoscopic video inpainting have shown potential for enhancing the quality of endoscopic videos, they mainly repair 2D visual…

Image and Video Processing · Electrical Eng. & Systems 2024-07-04 Francis Xiatian Zhang , Shuang Chen , Xianghua Xie , Hubert P. H. Shum

The advent of deep learning in the past decade has significantly helped advance image inpainting. Although achieving promising performance, deep learning-based inpainting algorithms still struggle from the distortion caused by the fusion of…

Computer Vision and Pattern Recognition · Computer Science 2023-01-05 Kangdi Shi , Muhammad Alrabeiah , Jun Chen

We show how to insert an object from one image to another and get realistic results in the hard case, where the shading of the inserted object clashes with the shading of the scene. Rendering objects using an illumination model of the scene…

Computer Vision and Pattern Recognition · Computer Science 2022-09-14 Anand Bhattad , David A. Forsyth

Image inpainting methods have shown significant improvements by using deep neural networks recently. However, many of these techniques often create distorted structures or blurry textures inconsistent with surrounding areas. The problem is…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Maitreya Suin , Kuldeep Purohit , A. N. Rajagopalan

In this paper, we present a deep-learning-based framework for audio-visual speech inpainting, i.e., the task of restoring the missing parts of an acoustic speech signal from reliable audio context and uncorrupted visual information. Recent…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-04 Giovanni Morrone , Daniel Michelsanti , Zheng-Hua Tan , Jesper Jensen

Inpainting has been continuously studied in the field of computer vision. As artificial intelligence technology developed, deep learning technology was introduced in inpainting research, helping to improve performance. Currently, the input…

Image and Video Processing · Electrical Eng. & Systems 2021-01-27 Seo Woo Han , Doug Young Suh