English
Related papers

Related papers: Learning to Inpaint by Progressively Growing the M…

200 papers

This paper proposes a mask optimization method for improving the quality of object removal using image inpainting. While many inpainting methods are trained with a set of random masks, a target for inpainting may be an object, such as a…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Kodai Shimosato , Norimichi Ukita

Prior knowledge of face shape and structure plays an important role in face inpainting. However, traditional face inpainting methods mainly focus on the generated image resolution of the missing portion without consideration of the special…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Xian Zhang , Xin Wang , Bin Kong , Canghong Shi , Youbing Yin , Qi Song , Siwei Lyu , Jiancheng Lv , Canghong Shi , Xiaojie Li

Image inpainting techniques have shown promising improvement with the assistance of generative adversarial networks (GANs) recently. However, most of them often suffered from completed results with unreasonable structure or blurriness. To…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Zheng Hui , Jie Li , Xiumei Wang , Xinbo Gao

This is the technique report for the winning solution of the CVPR2024 GenAI Media Generation Challenge Workshop's Instruction-guided Image Editing track. Instruction-guided image editing has been largely studied in recent years. The most…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Xuan Ju , Junhao Zhuang , Zhaoyang Zhang , Yuxuan Bian , Qiang Xu , Ying Shan

Recent advances in conditional image generation tasks, such as image-to-image translation and image inpainting, are largely accounted to the success of conditional GAN models, which are often optimized by the joint use of the GAN loss with…

Machine Learning · Computer Science 2019-02-26 Soochan Lee , Junsoo Ha , Gunhee Kim

We present a generative image inpainting system to complete images with free-form mask and guidance. The system is based on gated convolutions learned from millions of images without additional labelling efforts. The proposed gated…

Computer Vision and Pattern Recognition · Computer Science 2019-10-23 Jiahui Yu , Zhe Lin , Jimei Yang , Xiaohui Shen , Xin Lu , Thomas Huang

We study the task of image inpainting, which is to fill in the missing region of an incomplete image with plausible contents. To this end, we propose a learning-based approach to generate visually coherent completion given a high-resolution…

Computer Vision and Pattern Recognition · Computer Science 2018-07-27 Yuhang Song , Chao Yang , Zhe Lin , Xiaofeng Liu , Qin Huang , Hao Li , C. -C. Jay Kuo

Contemporary benchmark methods for image inpainting are based on deep generative models and specifically leverage adversarial loss for yielding realistic reconstructions. However, these models cannot be directly applied on image/video…

Computer Vision and Pattern Recognition · Computer Science 2017-11-20 Avisek Lahiri , Arnav Jain , Prabir Kumar Biswas , Pabitra Mitra

Image inpainting is a restoration method that reconstructs missing image parts. However, a carefully selected mask of known pixels that yield a high quality inpainting can also act as a sparse image representation. This challenging spatial…

Image and Video Processing · Electrical Eng. & Systems 2022-12-05 Pascal Peter

The objective of image outpainting is to extend image current border and generate new regions based on known ones. Previous methods adopt generative adversarial networks (GANs) to synthesize realistic images. However, the lack of explicit…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Ye Ma , Jin Ma , Min Zhou , Quan Chen , Tiezheng Ge , Yuning Jiang , Tong Lin

Deep learning (DL) has demonstrated its powerful capabilities in the field of image inpainting. The DL-based image inpainting approaches can produce visually plausible results, but often generate various unpleasant artifacts, especially in…

Computer Vision and Pattern Recognition · Computer Science 2020-09-03 Haiwei Wu , Jiantao Zhou , Yuanman Li

This paper examines the limitations of advanced text-to-image models in accurately rendering unconventional concepts which are scarcely represented or absent in their training datasets. We identify how these limitations not only confine the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Jiyoon Myung , Jihyeon Park

We describe a new training methodology for generative adversarial networks. The key idea is to grow both the generator and discriminator progressively: starting from a low resolution, we add new layers that model increasingly fine details…

Neural and Evolutionary Computing · Computer Science 2018-02-28 Tero Karras , Timo Aila , Samuli Laine , Jaakko Lehtinen

Generation of photo-realistic images, semantic editing and representation learning are a few of many potential applications of high resolution generative models. Recent progress in GANs have established them as an excellent choice for such…

Computer Vision and Pattern Recognition · Computer Science 2021-12-13 Partha Ghosh , Dominik Zietlow , Michael J. Black , Larry S. Davis , Xiaochen Hu

This study introduces a novel method for inpainting normal maps using a generative adversarial network (GAN). Normal maps, often derived from a lightstage, are crucial in performance capture but can have obscured areas due to movement…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Hancheng Zuo , Bernard Tiddeman

This paper presents a new adversarial training framework for image inpainting with segmentation confusion adversarial training (SCAT) and contrastive learning. SCAT plays an adversarial game between an inpainting generator and a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Zhiwen Zuo , Lei Zhao , Ailin Li , Zhizhong Wang , Zhanjie Zhang , Jiafu Chen , Wei Xing , Dongming Lu

In this paper, we propose a generative multi-column network for image inpainting. This network synthesizes different image components in a parallel manner within one stage. To better characterize global structures, we design a…

Computer Vision and Pattern Recognition · Computer Science 2018-10-23 Yi Wang , Xin Tao , Xiaojuan Qi , Xiaoyong Shen , Jiaya Jia

Diffusion-based inpainting is a powerful tool for the reconstruction of images from sparse data. Its quality strongly depends on the choice of known data. Optimising their spatial location -- the inpainting mask -- is challenging. A…

Image and Video Processing · Electrical Eng. & Systems 2022-05-17 Tobias Alt , Pascal Peter , Joachim Weickert

Image inpainting has made significant advances in recent years. However, it is still challenging to recover corrupted images with both vivid textures and reasonable structures. Some specific methods only tackle regular textures while losing…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Qiaole Dong , Chenjie Cao , Yanwei Fu

Generating high fidelity identity-preserving faces with different facial attributes has a wide range of applications. Although a number of generative models have been developed to tackle this problem, there is still much room for further…

Computer Vision and Pattern Recognition · Computer Science 2021-11-08 Dan Ma , Bin Liu , Zhao Kang , Jiayu Zhou , Jianke Zhu , Zenglin Xu