English
Related papers

Related papers: Free-Form Image Inpainting with Gated Convolution

200 papers

In recent years, groundbreaking advancements in Generative Artificial Intelligence (GenAI) have triggered a transformative paradigm shift, significantly influencing various domains. In this work, we specifically explore an integrated…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Felipe Rodrigues Perche-Mahlow , André Felipe-Zanella , William Alberto Cruz-Castañeda , Marcellus Amadeus

Recent inversion methods have shown that real images can be inverted into StyleGAN's latent space and numerous edits can be achieved on those images thanks to the semantically rich feature representations of well-trained GAN models.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Ahmet Burak Yildirim , Hamza Pehlivan , Bahri Batuhan Bilecen , Aysegul Dundar

We present a new multi-modal face image generation method that converts a text prompt and a visual input, such as a semantic mask or scribble map, into a photo-realistic face image. To do this, we combine the strengths of Generative…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Jihyun Kim , Changjae Oh , Hoseok Do , Soohyun Kim , Kwanghoon Sohn

In recent years, with the rapid development of artificial intelligence, image generation based on deep learning has dramatically advanced. Image generation based on Generative Adversarial Networks (GANs) is a promising study. However, since…

Machine Learning · Computer Science 2022-03-16 Yongqi Tian , Xueyuan Gong , Jialin Tang , Binghua Su , Xiaoxiang Liu , Xinyuan Zhang

While GANs can produce photo-realistic images in ideal conditions for certain domains, the generation of full-body human images remains difficult due to the diversity of identities, hairstyles, clothing, and the variance in pose. Instead of…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Anna Frühstück , Krishna Kumar Singh , Eli Shechtman , Niloy J. Mitra , Peter Wonka , Jingwan Lu

Facial video inpainting plays a crucial role in a wide range of applications, including but not limited to the removal of obstructions in video conferencing and telemedicine, enhancement of facial expression analysis, privacy protection,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Fatemeh Ghorbani Lohesara , Karen Egiazarian , Sebastian Knorr

3D GAN inversion projects a single image into the latent space of a pre-trained 3D GAN to achieve single-shot novel view synthesis, which requires visible regions with high fidelity and occluded regions with realism and multi-view…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Kaitao Huang , Yan Yan , Jing-Hao Xue , Hanzi Wang

Image generation has been heavily investigated in computer vision, where one core research challenge is to generate images from arbitrarily complex distributions with little supervision. Generative Adversarial Networks (GANs) as an implicit…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Hui Ying , He Wang , Tianjia Shao , Yin Yang , Kun Zhou

Object removal and image inpainting in facial images is a task in which objects that occlude a facial image are specifically targeted, removed, and replaced by a properly reconstructed facial image. Two different approaches utilizing U-net…

Computer Vision and Pattern Recognition · Computer Science 2022-09-30 Jookyung Song , Yeonjin Chang , Seonguk Park , Nojun Kwak

Haze and smog are among the most common environmental factors impacting image quality and, therefore, image analysis. This paper proposes an end-to-end generative method for image dehazing. It is based on designing a fully convolutional…

Computer Vision and Pattern Recognition · Computer Science 2019-12-02 Zheng Liu , Botao Xiao , Muhammad Alrabeiah , Keyan Wang , Jun Chen

Image outpainting seeks for a semantically consistent extension of the input image beyond its available content. Compared to inpainting -- filling in missing pixels in a way coherent with the neighboring pixels -- outpainting can be…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Yen-Chi Cheng , Chieh Hubert Lin , Hsin-Ying Lee , Jian Ren , Sergey Tulyakov , Ming-Hsuan Yang

3D-controllable portrait synthesis has significantly advanced, thanks to breakthroughs in generative adversarial networks (GANs). However, it is still challenging to manipulate existing face images with precise 3D control. While…

Computer Vision and Pattern Recognition · Computer Science 2022-08-25 Yuchen Liu , Zhixin Shu , Yijun Li , Zhe Lin , Richard Zhang , S. Y. Kung

With the remarkable recent progress on learning deep generative models, it becomes increasingly interesting to develop models for controllable image synthesis from reconfigurable inputs. This paper focuses on a recent emerged task,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Wei Sun , Tianfu Wu

This paper introduces a novel method for image colorization that utilizes a color transformer and generative adversarial networks (GANs) to address the challenge of generating visually appealing colorized images. Conventional approaches…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Hamza Shafiq , Bumshik Lee

Recent advances in deep generative models have shown promising potential in image inpanting, which refers to the task of predicting missing pixel values of an incomplete image using the known context. However, existing methods can be slow…

Computer Vision and Pattern Recognition · Computer Science 2018-03-29 Chao Yang , Yuhang Song , Xiaofeng Liu , Qingming Tang , C. -C. Jay Kuo

Interactive fashion image manipulation, which enables users to edit images with sketches and color strokes, is an interesting research problem with great application value. Existing works often treat it as a general inpainting task and do…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Haoye Dong , Xiaodan Liang , Yixuan Zhang , Xujie Zhang , Zhenyu Xie , Bowen Wu , Ziqi Zhang , Xiaohui Shen , Jian Yin

In this paper, we propose a generative multi-column network for image inpainting. This network synthesizes different image components in a parallel manner within one stage. To better characterize global structures, we design a…

Computer Vision and Pattern Recognition · Computer Science 2018-10-23 Yi Wang , Xin Tao , Xiaojuan Qi , Xiaoyong Shen , Jiaya Jia

Recent advances in deep learning have shown exciting promise in filling large holes and lead to another orientation for image inpainting. However, existing learning-based methods often create artifacts and fallacious textures because of…

Computer Vision and Pattern Recognition · Computer Science 2018-12-05 Qingguo Xiao , Guangyao Li , Qiaochuan Chen

Recent image inpainting methods have made great progress but often struggle to generate plausible image structures when dealing with large holes in complex images. This is partially due to the lack of effective network structures that can…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Haitian Zheng , Zhe Lin , Jingwan Lu , Scott Cohen , Eli Shechtman , Connelly Barnes , Jianming Zhang , Ning Xu , Sohrab Amirghodsi , Jiebo Luo

Segmenting an image into its parts is a frequent preprocess for high-level vision tasks such as image editing. However, annotating masks for supervised training is expensive. Weakly-supervised and unsupervised methods exist, but they depend…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Xingzhe He , Bastian Wandt , Helge Rhodin