English
Related papers

Related papers: Generative Image Inpainting with Contextual Attent…

200 papers

Current Neural Radiance Fields (NeRF) can generate photorealistic novel views. For editing 3D scenes represented by NeRF, with the advent of generative models, this paper proposes Inpaint4DNeRF to capitalize on state-of-the-art stable…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Han Jiang , Haosen Sun , Ruoxuan Li , Chi-Keung Tang , Yu-Wing Tai

Despite the ever-increasing interest in applying deep learning (DL) models to medical imaging, the typical scarcity and imbalance of medical datasets can severely impact the performance of DL models. The generation of synthetic data that…

Image and Video Processing · Electrical Eng. & Systems 2023-04-03 Pouria Rouzrokh , Bardia Khosravi , Shahriar Faghani , Mana Moassefi , Sanaz Vahdati , Bradley J. Erickson

Diffusion-based inpainting can reconstruct missing image areas with high quality from sparse data, provided that their location and their values are well optimised. This is particularly useful for applications such as image compression,…

Image and Video Processing · Electrical Eng. & Systems 2023-03-24 Pascal Peter , Karl Schrader , Tobias Alt , Joachim Weickert

We propose a novel video inpainting algorithm that simultaneously hallucinates missing appearance and motion (optical flow) information, building upon the recent 'Deep Image Prior' (DIP) that exploits convolutional network architectures to…

Computer Vision and Pattern Recognition · Computer Science 2019-09-18 Haotian Zhang , Long Mai , Ning Xu , Zhaowen Wang , John Collomosse , Hailin Jin

Recently, learning-based algorithms for image inpainting achieve remarkable progress dealing with squared or irregular holes. However, they fail to generate plausible textures inside damaged area because there lacks surrounding information.…

Image and Video Processing · Electrical Eng. & Systems 2019-09-19 Zongyu Guo , Zhibo Chen , Tao Yu , Jiale Chen , Sen Liu

Denoising Diffusion Probabilistic Models (DDPMs) have recently achieved remarkable results in conditional and unconditional image generation. The pre-trained models can be adapted without further training to different downstream tasks, by…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Asya Grechka , Guillaume Couairon , Matthieu Cord

Learning a good image prior is a long-term goal for image restoration and manipulation. While existing methods like deep image prior (DIP) capture low-level image statistics, there are still gaps toward an image prior that captures rich…

Image and Video Processing · Electrical Eng. & Systems 2020-07-21 Xingang Pan , Xiaohang Zhan , Bo Dai , Dahua Lin , Chen Change Loy , Ping Luo

Inpainting has been continuously studied in the field of computer vision. As artificial intelligence technology developed, deep learning technology was introduced in inpainting research, helping to improve performance. Currently, the input…

Image and Video Processing · Electrical Eng. & Systems 2021-01-27 Seo Woo Han , Doug Young Suh

Facial Image inpainting aim is to restore the missing or corrupted regions in face images while preserving identity, structural consistency and photorealistic image quality, a task specifically created for photo restoration. Though there…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Abhigyan Bhattacharya , Hiranmoy Roy , Debotosh Bhattacharjee

We introduce a new framework for manipulating and interacting with deep generative models that we call network bending. We present a comprehensive set of deterministic transformations that can be inserted as distinct layers into the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-15 Terence Broad , Frederic Fol Leymarie , Mick Grierson

We tackle the problem of texture inpainting where the input images are textures with missing values along with masks that indicate the zones that should be generated. Many works have been done in image inpainting with the aim to achieve…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Ahmed Ben Saad , Youssef Tamaazousti , Josselin Kherroubi , Alexis He

Recent advancements in large generative models, particularly diffusion-based methods, have significantly enhanced the capabilities of image editing. However, achieving precise control over image composition tasks remains a challenge.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Jinrui Yang , Qing Liu , Yijun Li , Soo Ye Kim , Daniil Pakhomov , Mengwei Ren , Jianming Zhang , Zhe Lin , Cihang Xie , Yuyin Zhou

Deep image inpainting aims to restore damaged or missing regions in an image with realistic contents. While having a wide range of applications such as object removal and image recovery, deep inpainting techniques also have the risk of…

Computer Vision and Pattern Recognition · Computer Science 2021-06-04 Ang Li , Qiuhong Ke , Xingjun Ma , Haiqin Weng , Zhiyuan Zong , Feng Xue , Rui Zhang

A regular convolution layer applying a filter in the same way over known and unknown areas causes visual artifacts in the inpainted image. Several studies address this issue with feature re-normalization on the output of the convolution.…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Håkon Hukkelås , Frank Lindseth , Rudolf Mester

We present a new latent model of natural images that can be learned on large-scale datasets. The learning process provides a latent embedding for every image in the training dataset, as well as a deep convolutional network that maps the…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 ShahRukh Athar , Evgeny Burnaev , Victor Lempitsky

While recent generative models for 2D images achieve impressive visual results, they clearly lack the ability to perform 3D reasoning. This heavily restricts the degree of control over generated objects as well as the possible applications…

Computer Vision and Pattern Recognition · Computer Science 2020-10-26 Dario Pavllo , Graham Spinks , Thomas Hofmann , Marie-Francine Moens , Aurelien Lucchi

Although deep learning has enabled a huge leap forward in image inpainting, current methods are often unable to synthesize realistic high-frequency details. In this paper, we propose applying super-resolution to coarsely reconstructed…

Computer Vision and Pattern Recognition · Computer Science 2022-06-30 Soo Ye Kim , Kfir Aberman , Nori Kanazawa , Rahul Garg , Neal Wadhwa , Huiwen Chang , Nikhil Karnad , Munchurl Kim , Orly Liba

Image inpainting task requires filling the corrupted image with contents coherent with the context. This research field has achieved promising progress by using neural image inpainting methods. Nevertheless, there is still a critical…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Lisai Zhang , Qingcai Chen , Baotian Hu , Shuoran Jiang

Music Inpainting is the task of filling in missing or lost information in a piece of music. We investigate this task from an interactive music creation perspective. To this end, a novel deep learning-based approach for musical score…

Machine Learning · Computer Science 2020-04-14 Ashis Pati , Alexander Lerch , Gaëtan Hadjeres

We present a novel deep learning based algorithm for video inpainting. Video inpainting is a process of completing corrupted or missing regions in videos. Video inpainting has additional challenges compared to image inpainting due to the…

Computer Vision and Pattern Recognition · Computer Science 2019-09-02 Sungho Lee , Seoung Wug Oh , DaeYeun Won , Seon Joo Kim